Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Serve: Provide OpenAI SDK compatible API #275

Open
HavenDV opened this issue Apr 30, 2024 · 5 comments
Open

Serve: Provide OpenAI SDK compatible API #275

HavenDV opened this issue Apr 30, 2024 · 5 comments
Labels
enhancement New feature or request providers

Comments

@HavenDV
Copy link
Contributor

HavenDV commented Apr 30, 2024

What would you like to be added:

Why is this needed:

Anything else we need to know?
@HavenDV HavenDV added enhancement New feature or request providers labels Apr 30, 2024
@HavenDV
Copy link
Contributor Author

HavenDV commented May 18, 2024

It should allow https://github.com/open-webui/open-webui usage

@erisonliang
Copy link

Could you please add non-ssl url (for example, LM Studio's open ai using url for local server is http://localhost:1234 by default) supported in OpenAIProvider?

@HavenDV
Copy link
Contributor Author

HavenDV commented May 21, 2024

image.
image
you can use this constructor and https = false in OpenAIClientSettings to bypass it

@HavenDV
Copy link
Contributor Author

HavenDV commented May 21, 2024

I will soon change the OpenAI sdk (it will be completely generated from their official OpenAPI and will contain all the features at the time of their release) so there is no point in changing anything yet

@erisonliang
Copy link

Thank you so much. I'll try it soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request providers
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@HavenDV @erisonliang