You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Just a suggestion to replace the model in this tutorial from gpt4all-j to phi-2. A smaller model might help new users to follow the tutorial. Can serve as a good first issue for beginner contributors.
Is your feature request related to a problem? Please describe.
Just a suggestion to replace the model in this tutorial from
gpt4all-j
tophi-2
. A smaller model might help new users to follow the tutorial. Can serve as a good first issue for beginner contributors.Describe the solution you'd like
Replace the model link with https://huggingface.co/TheBloke/phi-2-GGUF/resolve/main/phi-2.Q2_K.gguf and also change the model name in the request to
phi-2.Q2_K
.Additional context
I tried running phi-2 on my M2 MBA using the above replacements. Everything works like a charm :)
The text was updated successfully, but these errors were encountered: