The checkpoint you are trying to load has model type modernbert but Transformers does not recognize this architecture

[ngo010]

Hi,

I run the example code:

`from transformers import AutoTokenizer, AutoModelForMaskedLM

model_id = "answerdotai/ModernBERT-base"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForMaskedLM.from_pretrained(model_id)`

It shows an error:

ValueError: The checkpoint you are trying to load has model type modernbertbut Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

I have installed the up-to-date version:
Transformers=4.47.1
Flash-attn=2.7.2.post1

Could you please advise how to fix it? Thanks.

[davedgd]

You need a newer version of transformers:

pip install git+https://github.com/huggingface/transformers.git

[ngo010]

Thanks. The latest version 4.48.0.dev0 works.