Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Breaking change in upcoming PyTorch version for weight norm and loading pretrained models #24692

Closed
MarktHart opened this issue Jul 6, 2023 · 1 comment

Comments

@MarktHart
Copy link

Probably to be fixed around here:

expected_keys = list(model_state_dict.keys())

See this issue on PyTorch:
pytorch/pytorch#102999 (comment)

@ydshieh
Copy link
Collaborator

ydshieh commented Jul 7, 2023

Hi, what's your transformers version?

If you use a dev version with the commit of this PR ##24030 included, it should be fine. Let me know if not, thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants