transformers version support

[YeonjeeJung]

Hi, I really appreciate your amazing research. So I would like to use this framework to verify my work.

However, now I want to use latest llama model in this framework but the latest transformers version (4.45.0) is not compatible with it.
Do you have any support for this problem?

[chenneJelly]

I search the issue and i found that transformers==4.31.0 works

[YeonjeeJung]

@chenneJelly Thank you for sharing your experiment!

For more specifically, I am now want to replace the LLM model with LLaMA3.2.
But latest transformers support this model.
I tried transformers 4.33.0, and It worked for the models in BLIP-2 and InstructBLIP, but not LLaMA3.2

Does anyone have a solution?