Commits on Jul 2, 2024

1. Renaming quantize to quantize_ …

   Summary:
   Addressing feedback for `quantize` API from pytorch#391 (comment)
   
   this is an API that changes model inplace, so we want to change the name to reflect that. inplace model quantization is important especially for LLM since it will be hard to load the model to memory. we typically load the model to meta device and then load the quantized weight.
   
   Test Plan:
   python test/quantization/test_quant_api.py
   python test/integration/test_integration.py
   
   Reviewers:
   
   Subscribers:
   
   Tasks:
   
   Tags:

   

   jerryzh168 committed Jul 2, 2024
   Configuration menu

   • View commit details
   • Copy full SHA for 79e740c
   • Browse repository at this point

   Copy the full SHA

   79e740c View commit details

   Browse the repository at this point in the history