Skip to content

Commit

Permalink
fix-deprecated-exllama-arg (#27243)
Browse files Browse the repository at this point in the history
fix-exllama
  • Loading branch information
SunMarc committed Nov 2, 2023
1 parent 8801861 commit 441c3e0
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions src/transformers/utils/quantization_config.py
Original file line number Diff line number Diff line change
Expand Up @@ -455,6 +455,7 @@ def post_init(self):
"The value of `use_exllama` will be overwritten by `disable_exllama` passed in `GPTQConfig` or stored in your config file."
)
self.use_exllama = not self.disable_exllama
self.disable_exllama = None
elif self.disable_exllama is not None and self.use_exllama is not None:
# Only happens if user explicitly passes in both arguments
raise ValueError("Cannot specify both `disable_exllama` and `use_exllama`. Please use just `use_exllama`")
Expand Down

0 comments on commit 441c3e0

Please sign in to comment.