Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add SambaNova Support #218

Closed
jhpiedrahitao opened this issue Dec 11, 2024 · 4 comments
Closed

Add SambaNova Support #218

jhpiedrahitao opened this issue Dec 11, 2024 · 4 comments

Comments

@jhpiedrahitao
Copy link

SambaNova's SambaNovaCloud offers fast inference for multiple open-source models at full precision
artificial analysis providers leaderboards

@jhpiedrahitao
Copy link
Author

adding support in #215

@therealjkvalentine
Copy link

Would love to see this working in pydantic, Sambanova is the only provider with a performant free tier offering Llama 405B! Very important to those of us building open-source first AI applications and/or concerned about ability to deploy on-prem e.g. https://github.com/OpenBB-finance

@samuelcolvin
Copy link
Member

I've written up #239 with proposed rules for when to add new models, feedback welcome.

@samuelcolvin
Copy link
Member

I've decided to adopt the rules set out in #239, so we won't be able to accept a SambaNova model at this time.

Sorry to disappoint.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants