Skip to content

Commit 495dacf

Browse files
authored
Add IQ2 tensor types
These were added in ggml-org/llama.cpp#4773 It's annoying that I8 used to be 16 and it's now 18. I16 and I32 also changed.
1 parent af7d88d commit 495dacf

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

gguflib.h

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,10 @@ enum gguf_tensor_type {
3434
GGUF_TYPE_Q5_K = 13,
3535
GGUF_TYPE_Q6_K = 14,
3636
GGUF_TYPE_Q8_K = 15,
37+
// IQ2 quants
38+
GGML_TYPE_IQ2_XXS = 16,
39+
GGML_TYPE_IQ2_XS = 17,
40+
// Integer quants
3741
GGUF_TYPE_I8,
3842
GGUF_TYPE_I16,
3943
GGUF_TYPE_I32,

0 commit comments

Comments
 (0)