-
Notifications
You must be signed in to change notification settings - Fork 542
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Your current environment
The output of `python collect_env.py`
Your output of above commands here
🐛 Describe the bug
- aclgraph disabling ep
File "/usr/local/python3.11.10/lib/python3.11/site-packages/vllm/v1/executor/multiproc_executor.py", line 202, in get_response
raise RuntimeError(
RuntimeError: Worker failed with error 'Constraints violated (L['input_ids'].size()[0])! For more information, run with TORCH_LOGS="+dynamic".
- Not all values of RelaxedUnspecConstraint(L['input_ids'].size()[0]) are valid because L['input_ids'].size()[0] was inferred to be a constant (2048). - aclgraph + enable ep --> gatherV3 error
[v0.9.0rc2] FAQ / Feedback | 问题/反馈 # #1115 (comment)
Yikun
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working