convert-gptq-to-ggml:KeyError: 'model.layers.0.self_attn.q_proj.zeros'

[iMountTai]

Cool job, but I am getting the following error after running convert-gptq-to-ggml.py.

[iMountTai]

I made the following changes

but

[prusnak]

try the new convert.py script that is now in master

[iMountTai]

@prusnak Thanks! But hint

Error: Input uses the newer GPTQ-for-LLaMa format (using g_idx), which is not yet natively supported by GGML.  For now you can still convert this model by passing `--outtype f16` to dequantize, but that will result in a much larger output file for no quality benefit

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.