Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issues with the gptfast setup scripts #393

Closed
vayuda opened this issue Jun 18, 2024 · 1 comment
Closed

Issues with the gptfast setup scripts #393

vayuda opened this issue Jun 18, 2024 · 1 comment

Comments

@vayuda
Copy link
Collaborator

vayuda commented Jun 18, 2024

convert_hf_checkpoint.py attempts to import ModelConfig from models.py, but this file is not in the right place for this import statement to work

This is a result of just copying from the gptfast repo most likely
In that repo, model.py is located in the parent directory but for us its in torchao/_models/llama

The fix is simple enough but I'm using this issue as a placeholder while I continue testing this

@HDCharles
Copy link
Contributor

Yeah, you're right, I guess i had gpt-fast in my path so it didn't error when i tested this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants