Sambanova models support

[jhpiedrahitao]

PR implementing SambaNovaModel and allowing access to SambaNovaCloudModels.
includes, model, base tests and docs

[hyperlint-ai]

2 files reviewed, 1 total issue(s) found.

[samuelcolvin]

Hi @jhpiedrahitao, I've never heard of Sambanova. Please can you start by creating an issue and see if we get significant interest from the community, before we consider adding this to pydantic-ai itself.

Alternatively if you want to use or even distribute this without waiting, you can always create a new package, e.g. pyantic-ai-sambanova which has pydantic-ai as a dependency, and exposes SambaNovaModel.

[sambarnes]

Hi @jhpiedrahitao, I've never heard of Sambanova. Please can you start by creating an issue and see if we get significant interest from the community, before we consider adding this to pydantic-ai itself.

we've got a number of sambanova provided models at openrouter, and there is support for that already in pydantic-ai

i actually just saw this recent issue, after hearing users ask if it works with our services:
#139

would you be open to a quick docs pr adding another example at the end of here?

from openai import AsyncOpenAI

from pydantic_ai import Agent
from pydantic_ai.models.openai import OpenAIModel

client = AsyncOpenAI(
  base_url='https://openrouter.ai/api/v1',
  api_key='your-api-key',
)
model = OpenAIModel('anthropic/claude-3.5-sonnet', openai_client=client)
agent = Agent(model)
...

we're considering making pydantic-ai the default in our quickstart docs as well, considering a lot of people really love the devx so far

[jhpiedrahitao]

Hi @jhpiedrahitao, I've never heard of Sambanova. Please can you start by creating an issue and see if we get significant interest from the community, before we consider adding this to pydantic-ai itself.

Alternatively if you want to use or even distribute this without waiting, you can always create a new package, e.g. pyantic-ai-sambanova which has pydantic-ai as a dependency, and exposes SambaNovaModel.

Hi @samuelcolvin I created the issue here #218

You can find more information here https://sambanova.ai/
also in the issue linked to artificial analysis providers leader board, where you can see SambaNova being on top for several models

[samuelcolvin]

@sambarnes definitely happy to add that example to the docs. I also think we could add base_url as a kwarg to OpenAIModel so you can simplify it to just

model = OpenAIModel(
    'anthropic/claude-3.5-sonnet',
  base_url='https://openrouter.ai/api/v1',
  api_key='your-api-key',
)

PR welcome to add that.

[soufianechami]

You may also need to add Sambanova LLM API to the list at the top of this document:

This installs the pydantic_ai package, core dependencies, and libraries required to use the following LLM APIs:

• OpenAI API
• Google VertexAI API for Gemini models
• Anthropic API
• Groq API
• SambaNova API

[samuelcolvin]

Closing as per #218 (comment)