Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Attn amp #337

Merged
merged 3 commits into from
Jun 15, 2023
Merged

Attn amp #337

merged 3 commits into from
Jun 15, 2023

Conversation

vchiley
Copy link
Contributor

@vchiley vchiley commented Jun 15, 2023

  1. add explicit cast where running without autocast causes issues

  2. undo one of the autocasts previously added to the tests to verify that everything works well

@vchiley vchiley merged commit 8c3c0c6 into mosaicml:main Jun 15, 2023
@vchiley vchiley deleted the attn_amp branch November 9, 2023 22:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants