Skip to content

Conversation

yiliu30
Copy link
Contributor

@yiliu30 yiliu30 commented Apr 23, 2024

Type of Change

Enhancement

Description

# Set all `Linear` to fc1_config
fc1_config = RTNConfig(bits=6, dtype="int8")
quant_config.set_local(torch.nn.Linear, fc1_config)

# Set all `add` to fc1_config
quant_config.set_local(torch.add, fc1_config)

How has this PR been tested?

Pre-CI

Dependency Change?

None

yiliu30 added 3 commits April 23, 2024 10:08
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Copy link

github-actions bot commented Apr 23, 2024

⚡ Required checks status: All passing 🟢

Groups summary

🟢 Code Scan Tests workflow
Check ID Status Error details
Code-Scan success
Code-Scan (Bandit Code Scan Bandit) success
Code-Scan (DocStyle Code Scan DocStyle) success
Code-Scan (Pylint Code Scan Pylint) success

These checks are required after the changes to neural_compressor/common/base_config.py, neural_compressor/torch/utils/utility.py.

🟢 Model Tests 3x workflow
Check ID Status Error details
Model-Test-3x success
Model-Test-3x (Generate Report GenerateReport) success
Model-Test-3x (Run PyTorch Model opt_125m_woq_gptq_int4) success
Model-Test-3x (Run PyTorch Model opt_125m_woq_gptq_int4_dq_bnb) success
Model-Test-3x (Run PyTorch Model opt_125m_woq_gptq_int4_dq_ggml) success

These checks are required after the changes to neural_compressor/common/base_config.py, neural_compressor/torch/utils/utility.py.

🟢 Unit Tests 3x-TensorFlow workflow
Check ID Status Error details
UT-3x-TensorFlow success
UT-3x-TensorFlow (Coverage Compare CollectDatafiles) success
UT-3x-TensorFlow (Unit Test 3x TensorFlow Unit Test 3x TensorFlow) success
UT-3x-TensorFlow (Unit Test 3x TensorFlow baseline Unit Test 3x TensorFlow baseline) success

These checks are required after the changes to neural_compressor/common/base_config.py.

🟢 Unit Tests 3x-PyTorch workflow
Check ID Status Error details
UT-3x-Torch success
UT-3x-Torch (Coverage Compare CollectDatafiles) success
UT-3x-Torch (Unit Test 3x Torch Unit Test 3x Torch) success
UT-3x-Torch (Unit Test 3x Torch baseline Unit Test 3x Torch baseline) success

These checks are required after the changes to neural_compressor/common/base_config.py, neural_compressor/torch/utils/utility.py, test/3x/torch/test_config.py, test/3x/common/test_common.py.

🟢 Unit Tests 3x-ONNXRT workflow
Check ID Status Error details
UT-3x-ONNXRT success
UT-3x-ONNXRT (Coverage Compare CollectDatafiles) success
UT-3x-ONNXRT (Unit Test 3x ONNXRT Unit Test 3x ONNXRT) success
UT-3x-ONNXRT (Unit Test 3x ONNXRT baseline Unit Test 3x ONNXRT baseline) success

These checks are required after the changes to neural_compressor/common/base_config.py.


Thank you for your contribution! 💜

Note
This comment is automatically generated and will be updates every 180 seconds within the next 6 hours. If you have any other questions, contact chensuyue or XuehaoSun for help.

@yiliu30 yiliu30 requested review from violetch24 and xin3he April 23, 2024 07:12
@yiliu30 yiliu30 added the INC3.X label Apr 23, 2024
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Copy link
Contributor

@xin3he xin3he left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perfect, thanks.

@chensuyue
Copy link
Contributor

/azp run Model-Test-3x

Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@yiliu30 yiliu30 merged commit a58638c into master Apr 25, 2024
@yiliu30 yiliu30 deleted the fix_set_local branch April 25, 2024 07:57
zehao-intel pushed a commit that referenced this pull request Apr 26, 2024
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants