We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent b67407a commit 900f9acCopy full SHA for 900f9ac
torchao/prototype/awq/README.md
@@ -15,7 +15,9 @@ Evaluation perplexity numbers were calculated using the script in awq/example.py
15
16
17
The following tests were performed using LM eval and groupsize = 128
18
-| Model | Quantization | Perplexity | Truthful QA MC2 | WinoGrande | ARC challenge |
+
19
+| Model | Quantization | Perplexity | Truthful QA MC2 | WinoGrande | ARC challenge |
20
+|--------------------|--------------|------------|-----------------|------------|---------------|
21
| Llama-3-8B-Instruct| bfloat16 | 10.936 | 0.540 | 0.783 | 0.567 |
22
| | awq-hqq-int4 | 11.383 | 0.522 | 0.772 | 0.543 |
23
| | awq-uint4 | 11.409 | 0.519 | 0.756 | 0.577 |
0 commit comments