Skip to content
This repository has been archived by the owner on Sep 18, 2024. It is now read-only.

Is there any way to run the ptq-quantization without training? #5777

Open
powk2 opened this issue May 7, 2024 · 0 comments
Open

Is there any way to run the ptq-quantization without training? #5777

powk2 opened this issue May 7, 2024 · 0 comments

Comments

@powk2
Copy link

powk2 commented May 7, 2024

Describe the bug:
As far as I know, most ptq-quantization methods needn't train again but it seems that the current ptq-quantization of nni must run with the training process. It would cost too many time to train again. Is there any way to run the ptq-quantization of nni without training?

Environment:

  • NNI version:
  • Training service (local|remote|pai|aml|etc):
  • Python version:
  • PyTorch version:
  • Cpu or cuda version:

Reproduce the problem

  • Code|Example:

  • How to reproduce:

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant