Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support InternVL-8B model on Arc A770 #11923

Open
Fred-cell opened this issue Aug 26, 2024 · 1 comment
Open

support InternVL-8B model on Arc A770 #11923

Fred-cell opened this issue Aug 26, 2024 · 1 comment
Assignees

Comments

@Fred-cell
Copy link

https://modelscope.cn/models/OpenGVLab/InternVL2-8B#%E7%AE%80%E4%BB%8B
image
support this model base 2x Arc A770

@Uxito-Ada
Copy link
Contributor

Hi @Fred-cell ,

We tried to enable InternVL2-8B on vllm 2-card serving, while an open issue about vllm is found that blocks this model. We will keep paying attention to it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants
@glorysdj @Uxito-Ada @Fred-cell and others