-
Notifications
You must be signed in to change notification settings - Fork 166
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Cache CI downloads #599
Comments
cc/ @mhdawson |
@jbergstroem In the case of openssl-fips-2.0.9.tar.gz, it could be hosted on local disk or on the local network. That tarball was released 2 years ago and hasn't been the current one for 1.5 years. |
@bnoordhuis ok; similar to how we treat ICU I guess. |
The prior discusion/agreement was that we could host them on the main ci machine, we just never made progress on doing that. |
Backref to nodejs/node#13219 which was about the fips tarball download failing. |
While there's no better solution, this is what the ChakraCore Linux jobs use now: Bash functionfunction cache_download {
if [ -z "$1" ] || [ -z "$2" ] || [ -z "$3" ]; then
echo "Missing argument"
return 1
fi
URL=$1
EXPECTED_SHA=$2
DEST=$3
mkdir -p "$HOME/cache_files"
CACHE_FILE="$HOME/cache_files/$EXPECTED_SHA"
CACHE_SHA="X"
if [ -f "$CACHE_FILE" ]; then
CACHE_SHA=`shasum -a 256 "$CACHE_FILE" | cut '-d ' -f1`
fi
if [ "X${CACHE_SHA}" != "X${EXPECTED_SHA}" ]; then
rm "$CACHE_FILE" || true
curl -L "$URL" -o "$CACHE_FILE"
DOWNLOADED_SHA=`shasum -a 256 "$CACHE_FILE" | cut '-d ' -f1`
if [ "X${DOWNLOADED_SHA}" != "X${EXPECTED_SHA}" ]; then
echo Downloaded SHA256 mismatch.
rm -v "$CACHE_FILE"
return 1
fi
fi
cp -fv "$CACHE_FILE" "$DEST"
} |
Closing due to long period of inactivity. Feel free to re-open if this is a thing. I'm just trying to close stuff that has been ignored for sufficiently long that it seems likely it's not something we're going to get to. |
There has been some discussion of setting up a cache on one of the CI machines to store things we download all the time, I couldn't find an existing issue covering it.
There are a couple of things that I know about:
We need a place to put packages so we don't have to manually download them every time we setup a machine (definitely useful for AIX, not sure about other platforms).
deps: upgrade zlib to 1.2.11 node#10980 (comment) (by @bnoordhuis)
The text was updated successfully, but these errors were encountered: