File tree Expand file tree Collapse file tree 1 file changed +24
-0
lines changed Expand file tree Collapse file tree 1 file changed +24
-0
lines changed Original file line number Diff line number Diff line change @@ -47,8 +47,29 @@ Learn more:
4747 ` ` ` bash
4848 cd vllm-gaudi
4949 pip install -e .
50+ cd ..
51+ ` ` `
52+
53+ 4. (Optional) Install nixl:
54+
55+ ` ` ` bash
56+ cd vllm-gaudi
57+ python install_nixl.sh
58+ cd ..
5059 ` ` `
5160
61+ # # Install with Docker file
62+
63+ ` ` ` bash
64+ docker build -t ubuntu.pytorch.vllm.nixl.latest \
65+ -f .cd/Dockerfile.ubuntu.pytorch.vllm.nixl.latest github.com/vllm-project/vllm-gaudi
66+ docker run -it --rm --runtime=habana \
67+ --name=ubuntu.pytorch.vllm.nixl.latest \
68+ --network=host \
69+ -e HABANA_VISIBLE_DEVICES=all \
70+ vllm-gaudi-for-llmd /bin/bash
71+ ` ` `
72+
5273# ## Full installation from source (vLLM and vLLM-Gaudi):
5374
5475` ` ` bash
6889# Build vLLM-Gaudi from source
6990cd vllm-gaudi
7091pip install -e .
92+
93+ # Build nixl
94+ python install_nixl.sh
7195` ` `
You can’t perform that action at this time.
0 commit comments