能支持其他Pytorch版本吗？

[PolarisHsu]

目前仅支持2.4，2.4以下版本会报错，但我们的集群环境目前还不支持这么新的版本。

[kq-chen]

try pip install git+https://github.com/huggingface/transformers.git@27903de

The constraint torch>2.4 is not introduced by qwen2-vl, but stems from a recent bug in transformers. Although the fix has been proposed, it has not yet been merged.

As a temporary workaround, you can install transformers from a commit before PR #31502.

[GeLee-Q]

是不是nn.RMS 不支持的问题
可以在 /transformers/pytorch_utils.py 中把
# ALL_LAYERNORM_LAYERS = [nn.LayerNorm, nn.RMSNorm]
这一行注释掉

[kq-chen]

the fix has been merged. now, you can try qwen2-vl with torch<2.4.