Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rel 22.03 #124

Merged
merged 28 commits into from
Mar 4, 2022
Merged

Rel 22.03 #124

merged 28 commits into from
Mar 4, 2022

Conversation

albert17
Copy link
Contributor

No description provided.

@albert17 albert17 requested review from benfred and jperez999 March 4, 2022 01:23
Copy link
Member

@EvenOldridge EvenOldridge left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Assuming we need to lock versions this looks good to me. I'm not familiar enough with this to know.

@@ -1,5 +1,5 @@
# syntax=docker/dockerfile:1.2
ARG TRITON_VERSION=22.01
ARG TRITON_VERSION=22.02
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we want to make this a range? >= ?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a variable, it it not a comparison, it is an assignation

@@ -44,7 +46,7 @@ RUN ln -s /usr/bin/python3 /usr/bin/python
# Install multiple packages
RUN pip install cupy-cuda115 nvidia-pyindex pybind11 pytest protobuf transformers==4.12 tensorflow-metadata
RUN pip install betterproto cachetools graphviz nvtx scipy sklearn
RUN pip install numba --no-deps
RUN pip install pandas numba==0.55.1 numpy==1.21.5
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to fix versions here?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For now we need to change them before installin Merlin Software. We need to update Merlin Software prerequisites

mv jackson-databind-2.13.1.jar /usr/local/hadoop/share/hadoop/common/lib/ && \
rm /usr/local/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar && rm /usr/local/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar
mv ./hadoop-3.3.1 /usr/local/hadoop && cd /usr/local/lib/ && ln -s libhdfs.so.0.0.0 libhdfs.so ; \
fi

ENV JAVA_HOME=/usr/java/jdk-16.0.2
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we even need java if we're not installing hdfs?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

HugeCTR wanted to keep it as optional. They will be using it for dev

@albert17 albert17 merged commit 23ac23a into NVIDIA-Merlin:main Mar 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants