Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Gemma2 models from google #5953

Closed
bks5881 opened this issue Jun 28, 2024 · 3 comments
Closed

Gemma2 models from google #5953

bks5881 opened this issue Jun 28, 2024 · 3 comments
Labels
new model Requests to new models

Comments

@bks5881
Copy link

bks5881 commented Jun 28, 2024

The model to consider.

https://huggingface.co/google/gemma-2-27b-it

The closest model vllm already supports.

gemma

What's your difficulty of supporting the model you want?

No response
@bks5881 bks5881 added the new model Requests to new models label Jun 28, 2024
@DarkLight1337
Copy link
Member

It has been added by #5908, so expect to see it in the next release!

@lonngxiang
Copy link

Model architectures ['Gemma2ForCausalLM'] are not supported for now

@DarkLight1337
Copy link
Member

The changes are only in main branch for now, but a release is planned in the next few days.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
new model Requests to new models
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@bks5881 @lonngxiang @DarkLight1337