Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Listing chat models for each provider #4208

Open
SilverMarcs opened this issue Dec 26, 2024 · 1 comment
Open

Listing chat models for each provider #4208

SilverMarcs opened this issue Dec 26, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@SilverMarcs
Copy link

Feature Description

List inference models available for any provider

Use Cases

The user may want to see all potential models available for usage by each provider. OpenAI has a /models endpoint for this. Would be nice to have a unified interface of retrieving available endpoints grouped by provider. Currently I only see a long union type of strings hardcoded in the source code but even that is not exported/exposed by the SDK

Additional context

Some providers may not have such a model retrieving endpoint. In such cases, it might suffice to just return the hardcoded union of stings

@SilverMarcs SilverMarcs added the enhancement New feature or request label Dec 26, 2024
@jcuenod
Copy link

jcuenod commented Dec 29, 2024

I came looking for this. It's supported by the openai spec with the url https://api.openai.com/v1/models, which covers a lot of implementations. It's also supported by Anthropic but with a different api.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants