-
Notifications
You must be signed in to change notification settings - Fork 118
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Rel 22.03 #124
Rel 22.03 #124
Conversation
remove the "update jackson databind and remove log4j" part
remove "update jackson databind and rm log4j"
Delete Hadoop installer for v3.5
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Assuming we need to lock versions this looks good to me. I'm not familiar enough with this to know.
@@ -1,5 +1,5 @@ | |||
# syntax=docker/dockerfile:1.2 | |||
ARG TRITON_VERSION=22.01 | |||
ARG TRITON_VERSION=22.02 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we want to make this a range? >= ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is a variable, it it not a comparison, it is an assignation
@@ -44,7 +46,7 @@ RUN ln -s /usr/bin/python3 /usr/bin/python | |||
# Install multiple packages | |||
RUN pip install cupy-cuda115 nvidia-pyindex pybind11 pytest protobuf transformers==4.12 tensorflow-metadata | |||
RUN pip install betterproto cachetools graphviz nvtx scipy sklearn | |||
RUN pip install numba --no-deps | |||
RUN pip install pandas numba==0.55.1 numpy==1.21.5 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we need to fix versions here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For now we need to change them before installin Merlin Software. We need to update Merlin Software prerequisites
mv jackson-databind-2.13.1.jar /usr/local/hadoop/share/hadoop/common/lib/ && \ | ||
rm /usr/local/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar && rm /usr/local/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar | ||
mv ./hadoop-3.3.1 /usr/local/hadoop && cd /usr/local/lib/ && ln -s libhdfs.so.0.0.0 libhdfs.so ; \ | ||
fi | ||
|
||
ENV JAVA_HOME=/usr/java/jdk-16.0.2 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we even need java if we're not installing hdfs?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
HugeCTR wanted to keep it as optional. They will be using it for dev
No description provided.