[Usage]: vLLM Run Ernie45 Problem Collection

[CSWYF3634076]

Please provide feedback on your question under this issue

Current recommended branch CSWYF3634076/vllm:ernie

The currently supported text models.
The multimodal model is still being adapted, and you can use FastDeploy to experience multimodal model

vllm pr: vllm-project#20220

vllm 0.9.2 have support ernie 4.5 text models

[CSWYF3634076]

If you encounter garbled text after merged the latest vllm-project/vllm code, please temporarily set the environment variable
TORCHDYNAMO_DISABLE=1

=======================================================================
Updated on July 3, 2025: The current vllm main branch issue has been fixed

[fstandhartinger]

just a clarification.
does that mean in the
https://github.com/CSWYF3634076/vllm/tree/ernie
branch in combination with
TORCHDYNAMO_DISABLE=1
it is supposed to be working?
also multimodal, with the 4.5-VL-424B-A47B model?

[CSWYF3634076]

just a clarification. does that mean in the https://github.com/CSWYF3634076/vllm/tree/ernie branch in combination with TORCHDYNAMO_DISABLE=1 it is supposed to be working? also multimodal, with the 4.5-VL-424B-A47B model?

CSWYF3634076/vllm:ernie ✅
CSWYF3634076/vllm:ernie + merge latest vllm-project/vllm code + TORCHDYNAMO_DISABLE=1 ✅
multimodal is ERNIE-4.5-VL-424B-A47B-PT and ERNIE-4.5-VL-28B-A3B-PT

[CSWYF3634076]

just a clarification. does that mean in the https://github.com/CSWYF3634076/vllm/tree/ernie branch in combination with TORCHDYNAMO_DISABLE=1 it is supposed to be working? also multimodal, with the 4.5-VL-424B-A47B model?

The current vllm main branch issue has been fixed

[CSWYF3634076]

vllm 0.10.2 have support ernie vl model