Skip to content

Commit

Permalink
fix reducer check for main_grad (PaddlePaddle#57960)
Browse files Browse the repository at this point in the history
  • Loading branch information
haohongxiang authored and Frida-a committed Oct 14, 2023
1 parent 385d8c9 commit 64303f3
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions paddle/fluid/distributed/collective/reducer.cc
Original file line number Diff line number Diff line change
Expand Up @@ -757,9 +757,7 @@ void EagerReducer::AddDistHook(size_t var_index) {
auto *autograd_meta = tensors_[var_index].get_autograd_meta();
auto &grad_tensor = static_cast<egr::AutogradMeta *>(autograd_meta)->Grad();

if (!HasGrad(var_index)) {
group_tensor.ShareDataWith(phi::DenseTensor());
} else {
if (HasGrad(var_index)) {
auto grad_dense_tensor =
*(std::dynamic_pointer_cast<phi::DenseTensor>(grad_tensor.impl()));
group_tensor.ShareDataWith(grad_dense_tensor);
Expand Down

0 comments on commit 64303f3

Please sign in to comment.