Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace model in Build tutorial for mac to phi-2 #1720

Closed
ManishAradwad opened this issue Feb 18, 2024 · 2 comments · Fixed by #2171
Closed

Replace model in Build tutorial for mac to phi-2 #1720

ManishAradwad opened this issue Feb 18, 2024 · 2 comments · Fixed by #2171
Labels
enhancement New feature or request up for grabs Tickets that no-one is currently working on

Comments

@ManishAradwad
Copy link

Is your feature request related to a problem? Please describe.

Just a suggestion to replace the model in this tutorial from gpt4all-j to phi-2. A smaller model might help new users to follow the tutorial. Can serve as a good first issue for beginner contributors.

Describe the solution you'd like
Replace the model link with https://huggingface.co/TheBloke/phi-2-GGUF/resolve/main/phi-2.Q2_K.gguf and also change the model name in the request to phi-2.Q2_K.

Additional context
I tried running phi-2 on my M2 MBA using the above replacements. Everything works like a charm :)

@ManishAradwad ManishAradwad added the enhancement New feature or request label Feb 18, 2024
@mudler mudler added the up for grabs Tickets that no-one is currently working on label Feb 23, 2024
@mudler
Copy link
Owner

mudler commented Feb 23, 2024

Good point! Do you feel to take a stab at it?

@LeonSijiaLu
Copy link
Contributor

Hello there! Just diving into the LocalAI community. I'm excited about picking up this issue as my starting point, if you guys are okay with it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request up for grabs Tickets that no-one is currently working on
Projects
None yet
3 participants