You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@xiejunyi-joey
Have you reproduced the accuracy results with the scripts vit_quanteval.py?
My test results show the quantized model accuracy is not good on imagenet.
2023-07-18 15:01:42,720 - main - INFO - Original model performances
2023-07-18 15:01:42,720 - main - INFO - ===========================
2023-07-18 15:01:42,720 - main - INFO - Original Model | 32-bit Environment | perplexity : 0.8132
2023-07-18 15:01:42,720 - main - INFO - Original Model | 8-bit Environment | perplexity: 0.0016
2023-07-18 15:01:42,720 - main - INFO - Optimized model performances
2023-07-18 15:01:42,721 - main - INFO - ===========================
2023-07-18 15:01:42,721 - main - INFO - Optimized Model | 32-bit Environment | perplexity: 0.8082
2023-07-18 15:01:42,721 - main - INFO - Optimized Model | 8-bit Environment | perplexity: 0.0020
I used aimet-model-zoo vit demo(vit_quanteval.py),and export the quanted model with json to onnx;And I use snpe-onnx-to-dlc(v2.10),but errors
The text was updated successfully, but these errors were encountered: