Skip to content

Commit 900f9ac

Browse files
authored
Update README.md (#1036)
1 parent b67407a commit 900f9ac

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

Diff for: torchao/prototype/awq/README.md

+3-1
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,9 @@ Evaluation perplexity numbers were calculated using the script in awq/example.py
1515

1616

1717
The following tests were performed using LM eval and groupsize = 128
18-
| Model | Quantization | Perplexity | Truthful QA MC2 | WinoGrande | ARC challenge |
18+
19+
| Model | Quantization | Perplexity | Truthful QA MC2 | WinoGrande | ARC challenge |
20+
|--------------------|--------------|------------|-----------------|------------|---------------|
1921
| Llama-3-8B-Instruct| bfloat16 | 10.936 | 0.540 | 0.783 | 0.567 |
2022
| | awq-hqq-int4 | 11.383 | 0.522 | 0.772 | 0.543 |
2123
| | awq-uint4 | 11.409 | 0.519 | 0.756 | 0.577 |

0 commit comments

Comments
 (0)