-
Notifications
You must be signed in to change notification settings - Fork 3.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Deprecate nvidia/apex #16039
Deprecate nvidia/apex #16039
Conversation
024d6dc
to
15ed1ce
Compare
2f286e1
to
ea40f56
Compare
⚡ Required checks status: All passing 🟢Groups summary🟢 pytorch_lightning: Tests workflowThese checks are required after the changes to 🟢 pytorch_lightning: Azure GPU
These checks are required after the changes to 🟢 pytorch_lightning: Azure HPU
These checks are required after the changes to 🟢 pytorch_lightning: Azure IPU
These checks are required after the changes to 🟢 pytorch_lightning: Docs
These checks are required after the changes to 🟢 lightning_lite: CPU workflow
These checks are required after the changes to 🟢 lightning_lite: Azure GPU
These checks are required after the changes to 🟢 mypy
These checks are required after the changes to 🟢 installThese checks are required after the changes to Thank you for your contribution! 💜
|
60683d6
to
e24f958
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🦦
What does this PR do?
Fixes #14416
PyTorch Lightning package changes:
NativeMixedPrecisionPlugin
in favor ofMixedPrecisionPlugin
LightningModule.optimizer_step(..., using_native_amp=bool)
argumentTrainer(amp_backend)
Trainer.amp_backend
Trainer(amp_level)
. This was already deprecated but the previous deprecation has been replaced with the one in this PR for consistency.ApexMixedPrecisionPlugin
. The deprecation message triggered by Apex internally is replaced by ours.AMPType
enum and updates the codebase to avoid it. The_DeprecatedEnumMeta
class is re-introduced to do this.DeepSpeedPrecisionPlugin(amp_type, amp_level)
arguments.Lite package changes:
NativeMixedPrecision
class toMixedPrecision
DeepSpeedPrecision(amp_type, amp_level)
arguments and their supportAMPType
enum and its uses.Follow-up items (out of scope for this PR):
Does your PR introduce any breaking changes? If yes, please list them.
None intended
Before submitting
PR review
cc @Borda @tchaton @carmocca @justusschock @awaelchli