Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FEAT: Support Vicuna-v1.5 and Vicuna-v1.5-16k #343

Merged
merged 4 commits into from
Aug 17, 2023

Conversation

RayJi01
Copy link
Contributor

@RayJi01 RayJi01 commented Aug 11, 2023

Support 7B and 13B models for each model format
Resolves #296

@XprobeBot XprobeBot added this to the v0.2.0 milestone Aug 11, 2023
@RayJi01
Copy link
Contributor Author

RayJi01 commented Aug 11, 2023

Testing for the chat functionality yield good results:

For Vicuna-V1.5-16K 7B 4-bit:
image

For Vicuna-V1.5 7B 4-bit:
image

This ensure that the model yield good result.

@RayJi01 RayJi01 force-pushed the FEAT/Add_Vicuna_V1.5 branch from 1b915b3 to 8f778bb Compare August 11, 2023 09:05
@UranusSeven UranusSeven force-pushed the FEAT/Add_Vicuna_V1.5 branch from 8f778bb to f4e7a8f Compare August 14, 2023 06:49
@UranusSeven UranusSeven force-pushed the FEAT/Add_Vicuna_V1.5 branch from f4e7a8f to fc89ec6 Compare August 17, 2023 02:46
doc/source/models/builtin/vicuna-v1.5-16k.rst Show resolved Hide resolved
doc/source/models/builtin/vicuna-v1.5-16k.rst Show resolved Hide resolved
doc/source/models/builtin/vicuna-v1.5-16k.rst Outdated Show resolved Hide resolved
doc/source/models/builtin/vicuna-v1.5-16k.rst Outdated Show resolved Hide resolved
doc/source/models/builtin/vicuna-v1.5.rst Outdated Show resolved Hide resolved
doc/source/models/builtin/vicuna-v1.5.rst Outdated Show resolved Hide resolved
Copy link
Contributor

@pangyoki pangyoki left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@UranusSeven UranusSeven merged commit bfe33e5 into xorbitsai:main Aug 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

ENH: support vicuna v1.5
4 participants