[New Model]: NVLM 1.0

[shermansiu]

The model to consider.

Collection: https://huggingface.co/collections/nvidia/nvlm-10-66e9f407c764a0ee6e37b7f4
NVLM-D 1.0 72B: https://huggingface.co/nvidia/NVLM-D-72B

The closest model vllm already supports.

https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/internvl.py

The Huggingface inference code was reportedly adapted from the InternVL codebase.

What's your difficulty of supporting the model you want?

NVLM 1.0 has a new architecture that may take some time to support in vLLM.

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[nskumz]

yup, please make the model supports to vLLM.