IndexError: tuple index out of range while running python image_demo.py

[3togo]

How to fix it?

(jvenv2) eli@sf-5820:/work/gitee/similarities/examples$ python image_demo.py
Similarity: ClipSimilarity, matching_model: CLIPModel
text_outputs= BaseModelOutputWithPoolingAndCrossAttentions(last_hidden_state=tensor([[[-1.1101, -1.0938, 0.4898, ..., -0.0164, -0.6199, -0.0707],
[-0.6594, -0.4225, 0.2657, ..., 0.2450, -0.9777, 0.0150],
[-0.4969, -0.4251, 0.1939, ..., 0.1082, -1.2218, 0.1043],
...,
[-0.5155, -0.2084, 0.2472, ..., -0.1606, -1.1309, -0.5505],
[-0.6670, -0.3467, 0.3174, ..., -0.0138, -1.1362, -0.3339],
[-1.1101, -1.0938, 0.4898, ..., -0.0164, -0.6199, -0.0707]],

    [[-0.0918,  0.0306, -0.3715,  ...,  0.7056, -0.6969, -0.6218],
     [-0.2009,  0.4845, -0.7210,  ...,  0.7905, -1.1266, -0.3237],
     [ 0.0015,  0.5168, -0.7785,  ...,  0.5152, -1.0434, -0.4373],
     ...,
     [-0.0331,  0.6689, -0.8446,  ...,  0.7927, -1.1110, -0.2845],
     [-0.0289,  0.6874, -0.8168,  ...,  0.7872, -1.0861, -0.2702],
     [-0.0220,  0.6936, -0.8694,  ...,  0.8004, -1.0756, -0.2936]]],
   device='cuda:0'), pooler_output=None, hidden_states=None, past_key_values=None, attentions=None, cross_attentions=None)

Traceback (most recent call last):
File "/work/gitee/similarities/examples/image_demo.py", line 67, in
clip_demo()
File "/work/gitee/similarities/examples/image_demo.py", line 51, in clip_demo
sim_scores = m.similarity(imgs, texts)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/work/gitee/similarities/similarities/imagesim.py", line 129, in similarity
text_emb2 = self._get_vector(b)
^^^^^^^^^^^^^^^^^^^
File "/work/gitee/similarities/similarities/imagesim.py", line 82, in _get_vector
return self.clip_model.encode(text_or_img, batch_size=batch_size, show_progress_bar=show_progress_bar)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/work/gitee/similarities/similarities/clip_model.py", line 173, in encode
out_features = self.forward(features)
^^^^^^^^^^^^^^^^^^^^^^
File "/work/gitee/similarities/similarities/clip_model.py", line 62, in forward
text_embeds = self.model.text_projection(text_outputs[1])
~~~~~~~~~~~~^^^
File "/home/eli/jvenv2/lib/python3.11/site-packages/transformers/utils/generic.py", line 320, in getitem
return self.to_tuple()[k]
~~~~~~~~~~~~~~~^^^
IndexError: tuple index out of range

[shibing624]

我本地没复现问题，你看下输入数据有问题不，可以把完整的示例数据发下，我复现下问题。1）加上用的哪个模型；2）加上执行的脚本是哪个，和代码版本。

[shibing624]

fixed, chinese clip model get pooled output is not to english clip model.