[Dependency bug]: Transformers 4.31.0 not supported (Unexpected key(s) in state_dict: "language_encoder.embeddings.position_ids".)

[ZnS-oscar]

To reproduce the bug(Bug description):
Use the pretrained weight of bert in thispage, and run pip install transformers , which will download the newest version of transformers(version 4.34.1). when trying to test the model, the Error occurs: RuntimeError: Error(s) in loading state_dict for ReferIt3DNet_transformer: Unexpected key(s) in state_dict: "language_encoder.embeddings.position_ids".
Bug explanation:
Because the pretrained weight of bert does not support the newest version of transformers(version 4.34.1) (this issue is written on 2023-Oct-24)
Solution:
pip install transformers==4.30.2 to go back to an early version.