Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to convert LLMA with hugging face format to ggml model? #892

Closed
xiejibing opened this issue Apr 11, 2023 · 2 comments
Closed

How to convert LLMA with hugging face format to ggml model? #892

xiejibing opened this issue Apr 11, 2023 · 2 comments

Comments

@xiejibing
Copy link

the script convert-pth-to-ggml.py provides the ability to convert llama model (faire scale format) to ggml model,but how to convert a llama model with hugging face format to the ggml model?

@prusnak
Copy link
Collaborator

prusnak commented Apr 11, 2023

What do you mean by hugging face format? Do you mean safetensors?

There is a universal convert script brewing here - you might want to try it: #545

@prusnak
Copy link
Collaborator

prusnak commented Apr 14, 2023

try the new convert.py script that is now in master

@prusnak prusnak closed this as not planned Won't fix, can't repro, duplicate, stale Apr 14, 2023
Deadsg pushed a commit to Deadsg/llama.cpp that referenced this issue Dec 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants