Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add client-side http connectors to other LLMs #2

Open
Livshitz opened this issue Mar 28, 2023 · 1 comment
Open

Add client-side http connectors to other LLMs #2

Livshitz opened this issue Mar 28, 2023 · 1 comment
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed

Comments

@Livshitz
Copy link
Contributor

Check out the OpenAI client-side connector here as a reference.
Should be relatively easy to add a simple HTTP wrapper for other LLM providers, including HF.
Though, worth checking per each if it supports streaming.

@Livshitz Livshitz added enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed labels Mar 28, 2023
@Livshitz
Copy link
Contributor Author

Livshitz commented Sep 7, 2023

Example where and how the current OpenAI API's currently implemented:
https://github.com/feedox/alt-gpt/blob/master/src/scripts/ts/modules/openAI.ts#L38

This is where it is being called in the code flow:
https://github.com/feedox/alt-gpt/blob/master/src/scripts/ts/modules/altGPT.ts#L175

With multiple LLM APIs, there should be a switch case to select the appropriate API based on the selected provider dropdown.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant