Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Fix eval accumulation when
accelerate
> 0.20.3 (huggingface#26060)
As mentioned in: huggingface#25641 Eval accumulation will never happen with `accelerate > 0.20.3`, so this change ensures that `sync_gradients` is ignored if accelerate is > 0.20.3
- Loading branch information