New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update Quantization Presets #105

Merged

Satrat merged 1 commit into main from sa/update_presets

Jul 3, 2024

Satrat commented Jul 2, 2024

Default W8A8 to channelwise weights, dynamic per token activations
Add new W8A16 preset
Show all quantization args explicitly rather than assuming defaults for readability


          make preset more explicit

4ce123e

Satrat requested review from bfineran, rahul-tuli, robertgshaw2-neuralmagic and mgoin

July 2, 2024 16:39

bfineran approved these changes

View reviewed changes

Satrat mentioned this pull request

Update Quantization Scheme Standards for better readability #106

Merged

dbogunowicz approved these changes

View reviewed changes

Satrat merged commit aecb127 into main

1 check passed

Satrat deleted the sa/update_presets branch

July 3, 2024 21:10

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

dbogunowicz dbogunowicz approved these changes

bfineran bfineran approved these changes

rahul-tuli Awaiting requested review from rahul-tuli

robertgshaw2-neuralmagic Awaiting requested review from robertgshaw2-neuralmagic

mgoin Awaiting requested review from mgoin

Labels

None yet