Skip to content

Commit

Permalink
Dockerfile.ubi: remove vllm-nccl workaround
Browse files Browse the repository at this point in the history
Fixed upstream in vllm-project#5091
  • Loading branch information
dtrifiro authored and prashantgupta24 committed Jul 1, 2024
1 parent 0b75c6d commit 6857ea0
Showing 1 changed file with 0 additions and 13 deletions.
13 changes: 0 additions & 13 deletions Dockerfile.ubi
Original file line number Diff line number Diff line change
Expand Up @@ -183,22 +183,9 @@ RUN --mount=type=bind,from=build,src=/workspace/dist,target=/workspace/dist \
--mount=type=cache,target=/root/.cache/pip \
pip install dist/*.whl --verbose

# vllm requires a specific nccl version built from source distribution
# See https://github.com/NVIDIA/nccl/issues/1234
RUN pip install \
-v \
--force-reinstall \
--no-binary="all" \
--no-cache-dir \
"vllm-nccl-cu12==2.18.1.0.4.0" && \
mv /root/.config/vllm/nccl/cu12/libnccl.so.2.18.1 /opt/vllm/lib/ && \
chmod 0755 /opt/vllm/lib/libnccl.so.2.18.1


ENV HF_HUB_OFFLINE=1 \
PORT=8000 \
HOME=/home/vllm \
VLLM_NCCL_SO_PATH=/opt/vllm/lib/libnccl.so.2.18.1 \
VLLM_USAGE_SOURCE=production-docker-image \
VLLM_WORKER_MULTIPROC_METHOD=fork

Expand Down

0 comments on commit 6857ea0

Please sign in to comment.