File tree 1 file changed +6
-0
lines changed
1 file changed +6
-0
lines changed Original file line number Diff line number Diff line change @@ -26,6 +26,12 @@ pip install llama-cpp-python
26
26
The above command will attempt to install the package and build build ` llama.cpp ` from source.
27
27
This is the recommended installation method as it ensures that ` llama.cpp ` is built with the available optimizations for your system.
28
28
29
+ Note: If you are using Apple Silicon (M1) Mac, make sure you have installed a version of Python that supports arm64 architecture. For example:
30
+ ```
31
+ wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-MacOSX-arm64.sh
32
+ bash Miniforge3-MacOSX-arm64.sh
33
+ ```
34
+ Otherwise, while installing it will build the llama.ccp x86 version which will be 10x slower on Apple Silicon (M1) Mac.
29
35
30
36
### Installation with OpenBLAS / cuBLAS / CLBlast
31
37
You can’t perform that action at this time.
0 commit comments