Skip to content

Commit d8bd001

Browse files
authored
Add info about CUDA_VISIBLE_DEVICES (#1682)
1 parent b5c8546 commit d8bd001

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

README.md

+3-1
Original file line numberDiff line numberDiff line change
@@ -310,6 +310,8 @@ Building the program with BLAS support may lead to some performance improvements
310310
```
311311
Note: Because llama.cpp uses multiple CUDA streams for matrix multiplication results [are not guaranteed to be reproducible](https://docs.nvidia.com/cuda/cublas/index.html#results-reproducibility). If you need reproducibility, set `GGML_CUDA_MAX_STREAMS` in the file `ggml-cuda.cu` to 1.
312312
313+
The environment variable [`CUDA_VISIBLE_DEVICES`](https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#env-vars) can be used to specify which GPU(s) will be used.
314+
313315
- **CLBlast**
314316
315317
OpenCL acceleration is provided by the matrix multiplication kernels from the [CLBlast](https://github.com/CNugteren/CLBlast) project and custom kernels for ggml that can generate tokens on the GPU.
@@ -348,7 +350,7 @@ Building the program with BLAS support may lead to some performance improvements
348350
cmake --install . --prefix /some/path
349351
```
350352

351-
Where `/some/path` is where the built library will be installed (default is `/usr/loca`l`).
353+
Where `/some/path` is where the built library will be installed (default is `/usr/local`).
352354
</details>
353355

354356
Building:

0 commit comments

Comments
 (0)