Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PyTorch AWQ Weight-only 3x API Implementation #1561

Merged
merged 54 commits into from
Feb 5, 2024
Merged

Conversation

Kaihui-intel
Copy link
Contributor

Type of Change

feature

Description

detail description

Expected Behavior & Potential Risk

the expected behavior that triggered by this PR

How has this PR been tested?

how to reproduce the test (including hardware information)

Dependency Change?

any library dependency introduced or removed

Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
pre-commit-ci bot and others added 12 commits January 23, 2024 02:21
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
@Kaihui-intel Kaihui-intel added the PyTorch Related to PyTorch F/W label Feb 1, 2024
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
@Kaihui-intel Kaihui-intel removed the draft label Feb 2, 2024
@Kaihui-intel Kaihui-intel marked this pull request as ready for review February 2, 2024 07:00
pre-commit-ci bot and others added 9 commits February 2, 2024 07:05
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Copy link
Contributor

@yiliu30 yiliu30 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some comments; others are LGTM.

neural_compressor/torch/quantization/config.py Outdated Show resolved Hide resolved
neural_compressor/torch/algorithms/weight_only/utility.py Outdated Show resolved Hide resolved
neural_compressor/torch/algorithms/weight_only/awq.py Outdated Show resolved Hide resolved
neural_compressor/torch/algorithms/weight_only/utility.py Outdated Show resolved Hide resolved
Kaihui-intel and others added 24 commits February 5, 2024 09:00
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
@Kaihui-intel Kaihui-intel merged commit a9bf79c into master Feb 5, 2024
22 checks passed
@Kaihui-intel Kaihui-intel deleted the kaihui/awq branch February 5, 2024 07:38
yiliu30 pushed a commit that referenced this pull request Feb 6, 2024
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
INC3.X PyTorch Related to PyTorch F/W
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants