Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Model cannot be Azure model if not in mapping list #6706

Open
AlexVialaBellander opened this issue Nov 12, 2024 · 1 comment
Open
Labels
awaiting: user response bug Something isn't working

Comments

@AlexVialaBellander
Copy link

What happened?

In Azure, deployments are often named other things than the model names, for instance "gpt-4o" could be named "wrapper-api-gpt-4o". This causes the mapping to not recognise the model since it is not in the mapping json.

I would suggest an additional parameter that differentiates the deployment name used for querying the api vs the model selector.

Relevant log output

No response

Twitter / LinkedIn details

No response

@AlexVialaBellander AlexVialaBellander added the bug Something isn't working label Nov 12, 2024
@krrishdholakia
Copy link
Contributor

the mapping to not recognise the model since it is not in the mapping

The mapping is based on the model name returned by the azure deployment. What is the issue you're seeing? sample code for repro here would be helpful

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
awaiting: user response bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants