Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BFCL] Add DeepSeek-V2, DeepSeek-V2-Lite, DeepSeek-Coder-V2-Instruct, DeepSeek-Coder-V2-Lite-Instruct #697

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

[BFCL] Add DeepSeek-V2, DeepSeek-V2-Lite, DeepSeek-Coder-V2-Instruct, DeepSeek-Coder-V2-Lite-Instruct #697

wants to merge 4 commits into from

Conversation

moonlight1431
Copy link

Added handler for DeepSeek-V2 model family based on local hosting, can change to based on API w/decode_ast and decode_execute

@moonlight1431
added deepseekv2 handler for DeepSeek-V2-Chat-0628,DeepSeek-V2-Chat, …
50c1222 
…DeepSeek-V2, DeepSeek-V2-Lite, DeepSeek-v2-Lite-Chat
@HuanzhiMao
Copy link
Collaborator

HuanzhiMao commented Oct 14, 2024 •
edited
Loading

Thanks for the PR @moonlight1431!
Could you update the deepseekHandler with DeepSeek-Coder-V2 as well? https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct

@HuanzhiMao HuanzhiMao added the BFCL-New Model Add New Model to BFCL label Oct 14, 2024
@moonlight1431
Copy link
Author

added the DeepSeek-Coder-V2 to the deepseek handler!!

@ShishirPatil
Copy link
Owner

Thank you @moonlight1431
@HuanzhiMao I think once we fix the merge conflict in our latest handler map, this is good to go?

@HuanzhiMao HuanzhiMao changed the title added deepseekv2 handler for DeepSeek-V2-Chat-0628,DeepSeek-V2-Chat, … [BFCL] Add DeepSeek-V2, DeepSeek-V2-Lite, DeepSeek-Coder-V2-Instruct, DeepSeek-Coder-V2-Lite-Instruct Nov 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@HuanzhiMao HuanzhiMao HuanzhiMao left review comments

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
BFCL-New Model Add New Model to BFCL
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@moonlight1431 @HuanzhiMao @ShishirPatil