We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
When I try to use regular expression in the "ignore" field of GPTQModifier it fails to recognize the appropriate models.
Example: ignore: ["lm_head", “re:.*gate”] Mixtral-7x8B-Instruct-v0.1
Some layers that were to be ignored were not found in the model: {'re:.*gate'}
The text was updated successfully, but these errors were encountered:
Fix Issue #112 (#126)
7f5443c
Revert "Fix Issue #112 (#126)"
469268a
This reverts commit 7f5443c.
No branches or pull requests
When I try to use regular expression in the "ignore" field of GPTQModifier it fails to recognize the appropriate models.
Example:
ignore: ["lm_head", “re:.*gate”]
Mixtral-7x8B-Instruct-v0.1
Some layers that were to be ignored were not found in the model: {'re:.*gate'}
The text was updated successfully, but these errors were encountered: