Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Replace GPT-3.5 with Node Llama3 #3

Closed
lalalune opened this issue Jul 9, 2024 · 0 comments
Closed

Replace GPT-3.5 with Node Llama3 #3

lalalune opened this issue Jul 9, 2024 · 0 comments
Assignees
@vladkashka56

Comments

@lalalune
Copy link
Member

lalalune commented Jul 9, 2024 •
edited
Loading

We want to make Ruby run entirely locally and as quickly as possible. We will use a local running Llama 3 model.

https://github.com/withcatai/node-llama-cpp

If this is very slow, even with GPU acceleration, than we will use Fireworks.ai or Together.ai
lalalune pushed a commit that referenced this issue Oct 27, 2024
@MarcoMandar
Merge pull request #3 from ai16z/main
1794330 
merge from main
lalalune pushed a commit that referenced this issue Dec 14, 2024
@jacob-tucker
Merge pull request #3 from storyprotocol/plugin-improvements
5595de8 
add attachTerms and improve registerIP to use IP metadata spec
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@vladkashka56 vladkashka56

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@lalalune @vladkashka56