Skip to content

Commit b7995e4

Browse files
mingfeimaChillee
authored andcommitted
update error log
1 parent 889e78b commit b7995e4

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

generate.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -227,7 +227,7 @@ def _load_model(checkpoint_path, device, precision, use_tp):
227227
print("Using int4 weight-only quantization!")
228228
path_comps = checkpoint_path.name.split(".")
229229
assert path_comps[-3].startswith("g")
230-
assert path_comps[-2] in device
230+
assert path_comps[-2] in device, "weight packed format mismatch, please rerun quantize.py!"
231231
groupsize = int(path_comps[-3][1:])
232232
from quantize import WeightOnlyInt4QuantHandler
233233
simple_quantizer = WeightOnlyInt4QuantHandler(model, groupsize)

0 commit comments

Comments
 (0)