You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If all the gradient inputs of some grad_op are marked as no_gradient, which means all of them can be considered as zeros. For grad_ops are in essence the propagation of gradients, all the outputs are definitely zeros when all gradient inputs are zeros. Therefore the grad_op can also be skipped.
The text was updated successfully, but these errors were encountered:
If all the gradient inputs of some
grad_op
are marked as no_gradient, which means all of them can be considered as zeros. Forgrad_op
s are in essence the propagation of gradients, all the outputs are definitely zeros when all gradient inputs are zeros. Therefore thegrad_op
can also be skipped.The text was updated successfully, but these errors were encountered: