Skip to content

Fix TLS error when upgrading nvidia packages. #1068

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Aug 31, 2021
Merged

Fix TLS error when upgrading nvidia packages. #1068

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
9d12541
Fix TLS error when upgrading nvidia packages.
rosbo Aug 27, 2021
eef0d59
pin kornia and gensim
rosbo Aug 31, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 7 additions & 10 deletions Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,13 +11,8 @@ ADD clean-layer.sh /tmp/clean-layer.sh
ADD patches/nbconvert-extensions.tpl /opt/kaggle/nbconvert-extensions.tpl
ADD patches/template_conf.json /opt/kaggle/conf.json

# This is necessary for apt to access HTTPS sources
RUN apt-get update && \
apt-get install apt-transport-https && \
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This package is already part of the gcr.io/deeplearning-platform-release/base-cpu image.

/tmp/clean-layer.sh

# Use a fixed apt-get repo to stop intermittent failures due to flaky httpredir connections,
# as described by Lionel Chan at http://stackoverflow.com/a/37426929/5881346
# Use a fixed apt-get repo to stop intermittent failures due to flaky httpredir connections,
# as described by Lionel Chan at http://stackoverflow.com/a/37426929/5881346
RUN sed -i "s/httpredir.debian.org/debian.uchicago.edu/" /etc/apt/sources.list && \
apt-get update && \
# Needed by vowpalwabbit & lightGBM (GPU build).
Expand All @@ -30,7 +25,7 @@ RUN sed -i "s/httpredir.debian.org/debian.uchicago.edu/" /etc/apt/sources.list &
/tmp/clean-layer.sh

# Make sure the dynamic linker finds the right libstdc++
ENV LD_LIBRARY_PATH=/opt/conda/lib
ENV LD_LIBRARY_PATH=/usr/lib/x86_64-linux-gnu:/opt/conda/lib
# b/128333086: Set PROJ_LIB to points to the proj4 cartographic library.
ENV PROJ_LIB=/opt/conda/share/proj

Expand Down Expand Up @@ -67,7 +62,8 @@ RUN pip install tensorflow==${TENSORFLOW_VERSION} && \

RUN apt-get install -y libfreetype6-dev && \
apt-get install -y libglib2.0-0 libxext6 libsm6 libxrender1 libfontconfig1 --fix-missing && \
pip install gensim && \
# b/198300835 kornia 4.1.0 is not compatible with our version of numpy.
pip install gensim==4.0.1 && \
pip install textblob && \
pip install wordcloud && \
pip install xgboost && \
Expand Down Expand Up @@ -304,7 +300,8 @@ RUN pip install bleach && \
pip install notebook && \
pip install papermill && \
pip install olefile && \
pip install kornia && \
# b/198300835 kornia 0.5.10 is not compatible with our version of numpy.
pip install kornia==0.5.8 && \
pip install pandas_summary && \
pip install pandocfilters && \
pip install pexpect && \
Expand Down
2 changes: 0 additions & 2 deletions gpu.Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,8 +9,6 @@ ADD clean-layer.sh /tmp/clean-layer.sh
COPY --from=nvidia /etc/apt/sources.list.d/cuda.list /etc/apt/sources.list.d/
COPY --from=nvidia /etc/apt/sources.list.d/nvidia-ml.list /etc/apt/sources.list.d/
COPY --from=nvidia /etc/apt/trusted.gpg /etc/apt/trusted.gpg.d/cuda.gpg
# See b/142337634#comment28
RUN sed -i 's/deb https:\/\/developer.download.nvidia.com/deb http:\/\/developer.download.nvidia.com/' /etc/apt/sources.list.d/*.list
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was a workaround to download the packages over http.

However, NVIDIA servers forces https now.

Removing the work-around now that we can fetch package over https with apt.


ENV CUDA_MAJOR_VERSION=11
ENV CUDA_MINOR_VERSION=0
Expand Down