Skip to content

Commit 011edb5

Browse files
huachenheliywang96
authored andcommitted
[Temp fix] Disable torch.compile for Qwen2.5 VL's VisionBlock temporarily. (vllm-project#27760)
Signed-off-by: Chenheli Hua <huachenheli@outlook.com> Signed-off-by: Roger Wang <hey@rogerw.io> Co-authored-by: Roger Wang <hey@rogerw.io>
1 parent a8fadbe commit 011edb5

File tree

1 file changed

+11
-9
lines changed

1 file changed

+11
-9
lines changed

vllm/model_executor/models/qwen2_5_vl.py

Lines changed: 11 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -460,15 +460,17 @@ def forward(
460460
return output
461461

462462

463-
@support_torch_compile(
464-
dynamic_arg_dims={
465-
"x": 0,
466-
"cu_seqlens": 0,
467-
"rotary_pos_emb": 0,
468-
"seqlens": 0,
469-
},
470-
mark_unbacked_dims={"seqlens": 0},
471-
)
463+
# (FIXME): Enable this after dynamic slicing is fixed
464+
# See https://github.com/vllm-project/vllm/pull/27760
465+
# @support_torch_compile(
466+
# dynamic_arg_dims={
467+
# "x": 0,
468+
# "cu_seqlens": 0,
469+
# "rotary_pos_emb": 0,
470+
# "seqlens": 0,
471+
# },
472+
# mark_unbacked_dims={"seqlens": 0},
473+
# )
472474
class Qwen2_5_VisionBlock(nn.Module):
473475
def __init__(
474476
self,

0 commit comments

Comments
 (0)