Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ENH: qwen switch to llama cpp #778

Merged
merged 14 commits into from
Dec 21, 2023
Merged

ENH: qwen switch to llama cpp #778

merged 14 commits into from
Dec 21, 2023

Conversation

codingl2k1
Copy link
Contributor

@codingl2k1 codingl2k1 commented Dec 18, 2023 •
edited
Loading

  • qwen ggufv2 support tool calls.

Fixes: #789

@XprobeBot XprobeBot added the enhancement New feature or request label Dec 18, 2023
@XprobeBot XprobeBot added this to the v0.7.3 milestone Dec 18, 2023
@codingl2k1 codingl2k1 marked this pull request as ready for review December 19, 2023 09:58
@aresnow1 aresnow1 merged commit bbe64c8 into xorbitsai:main Dec 21, 2023
10 of 12 checks passed
Bojun-Feng pushed a commit to Bojun-Feng/inference that referenced this pull request Dec 27, 2023
@codingl2k1 @Bojun-Feng
ENH: qwen switch to llama cpp (xorbitsai#778)
9ae71f6
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@aresnow1 aresnow1 aresnow1 approved these changes

Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
v0.7.3
Development

Successfully merging this pull request may close these issues.

BUG: chat command line failed for qwen model
3 participants
@codingl2k1 @aresnow1 @XprobeBot