Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow custom providers via third-party extensions #45

Closed
jtpio opened this issue Feb 17, 2025 · 1 comment · Fixed by #50
Closed

Allow custom providers via third-party extensions #45

jtpio opened this issue Feb 17, 2025 · 1 comment · Fixed by #50
Assignees
Labels
enhancement New feature or request

Comments

@jtpio
Copy link
Member

jtpio commented Feb 17, 2025

Problem

Just like Jupyter AI allows for custom providers: https://jupyter-ai.readthedocs.io/en/latest/developers/index.html#custom-model-providers

It would be great to let folks add other providers, using the JupyterLab extension mechanism.

Proposed Solution

Likely to be done after #35.

Provide a way to register a new provider with capabilities (chat / completion).

Additional context

Maybe after #35 it should also show all the registered providers (core + from extensions).

@jtpio jtpio added the enhancement New feature or request label Feb 17, 2025
@brichet
Copy link
Collaborator

brichet commented Feb 28, 2025

We could probably have a registry that should replace of the utils module, to set/get the providers.

If I'm not mistaken, each provider should provides:

  • the chat model class
  • the completer class
  • the settings schema
  • optionally the error handler, which can be different depending on the provider
    export function getSettings(name: string): any {
  • optionally the instructions to be displayed in the settings

In any case, it would be a nice improvement form the current state, that would clarify/centralize all the provider's accessors.

@brichet brichet self-assigned this Feb 28, 2025
This was referenced Feb 28, 2025
@jtpio jtpio closed this as completed in #50 Mar 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants