Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update condaforge/miniforge3 #660

Closed
wants to merge 10 commits into from
Closed

Update condaforge/miniforge3 #660

Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
be6ceee
Update condaforge/miniforge3
raydouglass Apr 19, 2024
29cb06e
Merge branch 'branch-24.08' into raft-cpu-miniforge
raydouglass Jun 14, 2024
a1c6936
Merge branch 'branch-24.08' into raft-cpu-miniforge
raydouglass Jun 25, 2024
1d6afb8
Merge branch 'branch-24.08' into raft-cpu-miniforge
jakirkham Jul 30, 2024
268a820
for CPU bench dockerfile, create and copy env to avoid truststore issue
msarahan Jul 31, 2024
448b101
don't change prefix path when copying
msarahan Jul 31, 2024
158052b
elide debian intermediary; do micromamba clean
msarahan Jul 31, 2024
778a8d8
move condarc copy above micromamba install
msarahan Aug 1, 2024
c5a115a
change to root user to create data folder
msarahan Aug 1, 2024
dd6623c
fix chown -r -> -R
msarahan Aug 1, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
28 changes: 12 additions & 16 deletions raft-ann-bench/cpu/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,13 +3,21 @@
ARG PYTHON_VER=3.11
ARG RAPIDS_VER=24.08

FROM condaforge/mambaforge:23.3.1-0 as raft-ann-bench-cpu
FROM mambaorg/micromamba:1.5.8 AS raft-ann-bench-cpu
ARG RAPIDS_VER
ARG PYTHON_VER

COPY condarc /opt/conda/.condarc

RUN micromamba install -y -n base \
"python=${PYTHON_VER}" \
"raft-ann-bench-cpu=${RAPIDS_VER}.*" \
"conda" && \
micromamba clean --all --yes


SHELL ["/bin/bash", "-euo", "pipefail", "-c"]
USER root

# Create a data folder accessible by any user so mounted volumes under it can be accessible
# when the user passes their uid to docker run with -u $(id -u)
Expand All @@ -21,22 +29,10 @@ echo ". /opt/conda/etc/profile.d/conda.sh; conda activate base" >> /etc/bash.bas
EOF

# we need perl temporarily for the remaining benchmark perl scripts
RUN apt-get install perl -y

# Install python before updating environment, otherwise Python 3.9 image
# runs into a solver conflict with truststore 0.8.0. This avoids the environment installing
# packages incompatible with python version needed before python itself is pinned to the correct version.
RUN <<EOF
mamba install -y -n base "python=${PYTHON_VER}"
mamba update --all -y -n base
mamba install -y -n base \
"raft-ann-bench-cpu=${RAPIDS_VER}.*" \
"python=${PYTHON_VER}"
conda clean -afy
chmod -R 777 /opt/conda
EOF
RUN apt-get update -y && apt-get install perl-base -y

RUN useradd -rm -d /home/rapids -s /bin/bash -u 1001 rapids
RUN chown -R rapids /opt/conda
USER rapids
WORKDIR /data/benchmarks

Expand All @@ -47,7 +43,7 @@ CMD ["--dataset fashion-mnist-784-euclidean", "", "--algorithms hnswlib"]
ENTRYPOINT ["/bin/bash", "/data/scripts/run_benchmark.sh"]


FROM bench-base as raft-ann-bench-cpu-datasets
FROM bench-base AS raft-ann-bench-cpu-datasets

SHELL ["/bin/bash", "-euo", "pipefail", "-c"]

Expand Down
Loading