[Question]: From which version at least, the vllm supports to infrence and serve Qwen2.5-14B-Instruct model?

[zengqingfu1442]

Has this been raised before?

• I have checked the GitHub README.
• I have checked the Qwen documentation and cannot find an answer there.
• I have searched the issues and there is not a similar one.
• I confirm that this is not a bug report, a feature request, or a badcase.

Description

Which version of vllm support to inference and serve Qwen2.5-14B-Instruct model？

[jklj077]

the latest version is recommended. tested with v0.6.1. qwen2 arch (Qwen1.5, Qwen2, Qwen2.5) is supported by vllm since v0.3.0.

[thiner]

If you want to use the tools calling feature of Qwen2.5, you need to use version 0.6.0 or above.