New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问能否支持llama.cpp量化版本以轻量化部署？ #4

Open

1-2-3 opened this issue Aug 7, 2023 · 1 comment

1-2-3 commented Aug 7, 2023

No description provided.

Collaborator

zhangxiaofan101 commented Dec 13, 2023

在新开源的版本中我们提供了兼容LMdeploy的解决方案，以及基于GPTQ的解决方案。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment