don't use no_sync when deepspeed doesn't support it for certain zero stages#35157

Merged

ArthurZucker merged 4 commits intohuggingface:mainfrom winglian:deepspeed-no-sync-zero

Dec 13, 2024

+1

Commits on Dec 9, 2024

Commits on Dec 11, 2024

fix no_sync context for deepspeed across all zero types
winglian
committed

Commits on Dec 13, 2024

chore: lint
winglian
committed