-
Notifications
You must be signed in to change notification settings - Fork 6.9k
Closed
Labels
bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn'tcommunity-backlogllmtriageNeeds triage (eg: priority, bug/not-bug, and owning component)Needs triage (eg: priority, bug/not-bug, and owning component)vllm
Description
What happened + What you expected to happen
- install ray==2.46.0
install lastest vllm (from CI) - go through ray serve deployment steps
- it fails with
resolve_chat_template_content_format() got an unexpected keyword argument 'trust_remote_code'due to [Frontend] Chat template fallbacks for multimodal models vllm-project/vllm#17805 removing the args
Marking the severity as "low" because new vllm release not there yet, but 0.9.0 will be out today
Versions / Dependencies
ray==2.46.0
vllm@https://wheels.vllm.ai/d19110204c03e9b77ed957fc70c1262ff370f5e2/vllm-1.0.0.dev-cp38-abi3-manylinux1_x86_64.whl
Reproduction script
serve run config_TIMESTAMP.yaml
Issue Severity
Low: It annoys or frustrates me.
Metadata
Metadata
Assignees
Labels
bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn'tcommunity-backlogllmtriageNeeds triage (eg: priority, bug/not-bug, and owning component)Needs triage (eg: priority, bug/not-bug, and owning component)vllm