The "quantize.exe" script was not found in the current location

[yoann56100]

Im trying to use it with 65B, but when i want to quantize it, i have the error "The "quantize.exe" script was not found in the current location"

Im running it on windows 11 with 48bg of ram and I7 12700k

[Nyko483]

I got the same issue :
--> python3 quantize.py 7B
The "quantize.exe" script was not found in the current location.
If you want to use it from another location, set the --quantize-script-path argument from the command line.

Running on windows 11 16Gb of ram, AMD 5k 5, RTX 3050

[prusnak]

You need to compile the quantize.exe first

[Robertultime]

And how to compile the quantize.exe ?

[IcawFype]

And where is quantize.exe ?

[T4rg3n]

And where is quantize.exe ?

You have to build it with CMake or Visual Studio

[axelhusson]

for information try like this, it's ok for me :
.......\llama.cpp\build\bin\Release> python.exe ......\quantize.py 7B

[IcawFype]

And where is quantize.exe ?

You have to build it with CMake or Visual Studio

Ok thanks :)

[PatriceMarin]

Hi,
I have the same issue on Mac OS / Silicon chip. Any clue?
Thanks :)

Edit:
I finally find a way
python3 ~/Github/llama.cpp/quantize.py 7B -q ~/Github/llama.cpp/quantize.py