Skip to content

Enable autocast for all ops #2797

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
6 tasks done
fmassa opened this issue Oct 13, 2020 · 1 comment
Closed
6 tasks done

Enable autocast for all ops #2797

fmassa opened this issue Oct 13, 2020 · 1 comment

Comments

@fmassa
Copy link
Member

fmassa commented Oct 13, 2020

🚀 Feature

Currently only NMS and RoIAlign support autocast (introduced in PyTorch 1.6.0). We should extend support for autocast to all C++ ops in torchvision.

Motivation

Mixed precision training is PyTorch is obtained via support for autocast (automatically casting between fp16 -> fp32 depending on the operation).

The work should follow what was done for the RoIAlign function in #2384 (as that PR also converted NMS to use the dispatcher).

Adding support for autocast means that the op should be registered via the dispatcher, so this is blocked by #2796

Pitch

Out-of-the-box mixed precision support for all operators implemented in torchvision:

  • nms
  • roi_align
  • deform_conv2d
  • roi_pool
  • ps_roi_align
  • ps_roi_pool
@fmassa
Copy link
Member Author

fmassa commented Oct 30, 2020

Fixed via referenced issues, with last PR in #2938

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants