Skip to content

Commit 5bc28e7

Browse files
committed
Revert "Small fix"
This reverts commit 11612773b3d68aa5b8d72bad1de4b1714ea1193a. Signed-off-by: Max Kovalenko <mkovalenko@habana.ai>
1 parent bbc5469 commit 5bc28e7

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

deepspeed/runtime/zero/partition_parameters.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1894,7 +1894,7 @@ def _allgather_params_coalesced(self, param_list, hierarchy=0, quantize=False):
18941894
def _allgather_params(self, param_list, hierarchy=0):
18951895
if len(param_list) == 0:
18961896
return
1897-
1897+
18981898
partition_size = sum([param.ds_tensor.ds_numel for param in param_list])
18991899

19001900
tensor_size = partition_size * self.num_partitions

0 commit comments

Comments
 (0)