Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update to Unified ROCm 6.2 base image #155

Merged
merged 6 commits into from
Aug 27, 2024
Merged

Update to Unified ROCm 6.2 base image #155

Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
b901369
optimizations for process output step
sanyalington Jul 25, 2024
90f15da
Llama3.1 (#129)
gshtras Aug 12, 2024
ffa6d0a
Update hipblaslt and FA revs to match what was used for MLPerf
JArnoldAMD Aug 26, 2024
5b5c04d
Merge PR #104 from https://github.com/ROCm/vllm
JArnoldAMD Aug 26, 2024
145dade
Switch to "unified docker" with a ROCm 6.2 base image
JArnoldAMD Aug 27, 2024
e4793c2
Merge branch 'ROCm:fp8_throughput' into fp8_throughput
JArnoldAMD Aug 27, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions Dockerfile.rocm
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
# default base image
ARG BASE_IMAGE="rocm/pytorch:rocm6.1.2_ubuntu20.04_py3.9_pytorch_staging"
ARG BASE_IMAGE="rocm/pytorch-private:20240819_exec_dashboard_unified_rc3_added_triton_fa_vllm"

ARG COMMON_WORKDIR=/app

# The following ARGs should be "0" or "1". If "1", the respective component will be built and installed on top of the base image
ARG BUILD_HIPBLASLT="1"
ARG BUILD_RCCL="1"
ARG BUILD_FA="1"
ARG BUILD_HIPBLASLT="0"
ARG BUILD_RCCL="0"
ARG BUILD_FA="0"
ARG BUILD_CUPY="0"
ARG BUILD_TRITON="1"
# This ARG should also be "0" or "1". If "1", the vLLM development directory is obtained via git clone.
Expand All @@ -26,7 +26,7 @@ ARG PYTORCH_ROCM_ARCH="gfx90a;gfx942"
ENV PYTORCH_ROCM_ARCH=${PYTORCH_ROCM_ARCH}

# Install some basic utilities
RUN apt-get update && apt-get install python3 python3-pip -
RUN apt-get update && apt-get install -y python3 python3-pip -
RUN apt-get update && apt-get install -y \
sqlite3 libsqlite3-dev libfmt-dev libmsgpack-dev libsuitesparse-dev

Expand Down