New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Int8量化模型 #1

Open

hubin858130 opened this issue Dec 18, 2022 · 1 comment

hubin858130 commented Dec 18, 2022 •

edited

Loading

发现一个针对SD的onnx的int8量化脚本和量化好的库，这个能转出ncnn的int8模型不？

Owner

fengwang commented Dec 18, 2022

似乎可行。
但是这个模型是 dynamic quantization 的，也就是只有权重被 quantize 到了 int8，模型中间层的输入输出还是 fp32。
我稍后尝试下，看运算速度能提升多少，还有输出是不是会有瑕疵。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment