Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Leverage a Code-tuned SLM in-browser #24

Open
AABoyles opened this issue Dec 20, 2024 · 1 comment
Open

Leverage a Code-tuned SLM in-browser #24

AABoyles opened this issue Dec 20, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@AABoyles
Copy link

Problem

Requiring the Mistral API key to enable this extension violates the core value offering of Jupyterlite--namely, that it runs in the browser.

Proposed Solution

Leverage a simple, in-browser SLM to handle AI code completion. Ideally this should be the default option, providing users with seamless, batteries-included access to the extension's functionality, and extend the option to users to leverage Mistral (or other providers) for faster or higher-quality responses.

@AABoyles AABoyles added the enhancement New feature or request label Dec 20, 2024
@jtpio
Copy link
Member

jtpio commented Jan 4, 2025

Thanks @AABoyles for the suggestion 👍

Indeed this extension has a lot of potential. It's still in its early days which is why it was focused on supporting some of the popular providers for now.

For reference there is also https://github.com/krassowski/jupyterlab-transformers-completer, which was created after the addition of the inline completer API to JupyterLab. A while back the models were working ok in the browser, but were not really useful for code completion (too small). But maybe the state has improved since.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants