Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove torch.jit.fuser("fuser2") in test #7069

Merged
merged 2 commits into from
Jan 10, 2023

Conversation

davidberard98
Copy link
Contributor

@davidberard98 davidberard98 commented Jan 9, 2023

Internally we're considering removing support for fuser2, so we would need to remove this special case from the test.

More context:

  • This special case was added due to a bug in NNC (issue with pow() & different argument dtypes in NNC pytorch#75476). This switched the fuser for this test case from NNC, to NVFuser, which at the time was still an experimental option.
  • Since then, NVFuser has replaced NNC as the default fuser. So, NVFuser will be used instead of NNC even without explicitly turning it on with torch.jit.fuser('fuser2') (note: fuser2 == NVFuser). The exception to this is for internal usage, where NNC is still used instead of NVFuser.
  • Finally, it appears that the initial NNC bug (issue with pow() & different argument dtypes in NNC pytorch#75476) has been fixed. I verified this both locally and in CI, by changing fuser2 (NVFuser) to fuser1 (NNC) and running this test (as seen here)

So, it looks like we can safely remove this special case for fuser2 in this test, which will unblock any internal fuser migration that we may need to do.

cc @pmeier

Internally we're considering removing support for fuser2, so we need to remove this special case from the test.
@davidberard98 davidberard98 changed the title [WIP] Remove torch.jit.fuser("fuser2") in test Remove torch.jit.fuser("fuser2") in test Jan 9, 2023
Copy link
Member

@NicolasHug NicolasHug left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR and for the detailed context @davidberard98 !

@NicolasHug NicolasHug merged commit 2b16299 into pytorch:main Jan 10, 2023
facebook-github-bot pushed a commit that referenced this pull request Jan 10, 2023
Summary:
* [WIP] Remove torch.jit.fuser("fuser2") in test

Internally we're considering removing support for fuser2, so we need to remove this special case from the test.

* completely remove special-casing

Reviewed By: YosuaMichael

Differential Revision: D42431384

fbshipit-source-id: 33c88cc2b54bc76e7541892fc0f9f607d67eb3c7
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants