New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

推理时间是怎么算出来这么快的呢？ #14

Open

mhn2836 opened this issue Nov 12, 2022 · 1 comment

mhn2836 commented Nov 12, 2022

是有模型优化还是其他的推理加速方式呢？

york-yan commented Jan 12, 2024

同样的问题，请问作者可以提供一下测试代码么？我跑出来的结果比较慢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment