Skip to content

[Bug]: qwen3 moe failed with aclgraph #1324

@MengqingCao

Description

@MengqingCao

Your current environment

The output of `python collect_env.py`
Your output of above commands here

🐛 Describe the bug

  1. aclgraph disabling ep
  File "/usr/local/python3.11.10/lib/python3.11/site-packages/vllm/v1/executor/multiproc_executor.py", line 202, in get_response                                  

    raise RuntimeError(                                                                                                                                           

RuntimeError: Worker failed with error 'Constraints violated (L['input_ids'].size()[0])! For more information, run with TORCH_LOGS="+dynamic".                    

  - Not all values of RelaxedUnspecConstraint(L['input_ids'].size()[0]) are valid because L['input_ids'].size()[0] was inferred to be a constant (2048).   

#1115 (comment)

  1. aclgraph + enable ep --> gatherV3 error
    [v0.9.0rc2] FAQ / Feedback | 问题/反馈 # #1115 (comment)

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions