Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Answer Engine] switching between models (or select different models to answer the question) #3097

Open
Tracked by #2657
wsxiaoys opened this issue Sep 6, 2024 · 2 comments · Fixed by #3164
Open
Tracked by #2657

[Answer Engine] switching between models (or select different models to answer the question) #3097

wsxiaoys opened this issue Sep 6, 2024 · 2 comments · Fixed by #3164
Assignees
@antimonyGu
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@wsxiaoys
Copy link
Member

wsxiaoys commented Sep 6, 2024 •
edited
Loading

  1. For HttpModelConfig, adding supported_models field of api endpoint, thus allowing users select different models to complete tasks.
  2. Add /v1/models interface to list supported models for chat / completion endpoint (if exists) (example)

tabby/crates/tabby-common/src/config.rs

Line 247 in d5bde52

pub model_name: Option<String>,

@wsxiaoys wsxiaoys added enhancement New feature or request documentation Improvements or additions to documentation good first issue Good for newcomers and removed documentation Improvements or additions to documentation labels Sep 6, 2024
@wsxiaoys wsxiaoys changed the title switching between models (or select different models to answer the question) [Answer Engine] switching between models (or select different models to answer the question) Sep 6, 2024
@antimonyGu
Copy link
Contributor

Start working on this issue.

@wanyukang
Copy link

Wow, looking forward to this feature

@wsxiaoys wsxiaoys mentioned this issue Sep 11, 2024
Open
6 tasks
@antimonyGu antimonyGu mentioned this issue Sep 19, 2024
Merged
@wsxiaoys wsxiaoys assigned liangfung and antimonyGu and unassigned antimonyGu and liangfung Oct 2, 2024
@wsxiaoys wsxiaoys mentioned this issue Oct 15, 2024
Open
This was referenced Oct 22, 2024
Merged
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@antimonyGu antimonyGu

Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat(core, webserver): add /v1beta/models api antimonyGu/tabby
4 participants
@wsxiaoys @wanyukang @antimonyGu @liangfung