Skip to content

Commit 13c0d71

Browse files
[README]Add NIXL installation guide in README (#308)
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com> Co-authored-by: Artur Fierka <artur.fierka@intel.com>
1 parent f929720 commit 13c0d71

File tree

1 file changed

+24
-0
lines changed

1 file changed

+24
-0
lines changed

README.md

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -47,8 +47,29 @@ Learn more:
4747
```bash
4848
cd vllm-gaudi
4949
pip install -e .
50+
cd ..
51+
```
52+
53+
4. (Optional) Install nixl:
54+
55+
```bash
56+
cd vllm-gaudi
57+
python install_nixl.sh
58+
cd ..
5059
```
5160

61+
## Install with Docker file
62+
63+
```bash
64+
docker build -t ubuntu.pytorch.vllm.nixl.latest \
65+
-f .cd/Dockerfile.ubuntu.pytorch.vllm.nixl.latest github.com/vllm-project/vllm-gaudi
66+
docker run -it --rm --runtime=habana \
67+
--name=ubuntu.pytorch.vllm.nixl.latest \
68+
--network=host \
69+
-e HABANA_VISIBLE_DEVICES=all \
70+
vllm-gaudi-for-llmd /bin/bash
71+
```
72+
5273
### Full installation from source (vLLM and vLLM-Gaudi):
5374

5475
```bash
@@ -68,4 +89,7 @@ cd ..
6889
# Build vLLM-Gaudi from source
6990
cd vllm-gaudi
7091
pip install -e .
92+
93+
# Build nixl
94+
python install_nixl.sh
7195
```

0 commit comments

Comments
 (0)