Skip to content

Commit

Permalink
Launch secondary trial ncov builds using the up-and-coming new nextst…
Browse files Browse the repository at this point in the history
…rain/base image

…instead of switching the primary ncov build to the new image, which
might be overly disruptive to the build shepherds.

The trial build will do all the things the primary build does, but
upload resulting files to a separate destination as not to interfere.
Build intermediates are uploaded under:

    s3://nextstrain-ncov-private/branch/new-build-base-image/…

While build outputs (JSONs) will be visible under:

    https://nextstrain.org/staging/trial/ncov/…
  • Loading branch information
tsibley committed Jan 22, 2021
1 parent de8f8a8 commit 3d8ab2f
Show file tree
Hide file tree
Showing 2 changed files with 16 additions and 1 deletion.
1 change: 0 additions & 1 deletion bin/launch-build
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,6 @@
set -euo pipefail

nextstrain build --aws-batch --cpus 96 --memory 180GiB --detach \
--image nextstrain/base:branch-python-base \
"$@" \
--profile nextstrain_profiles/nextstrain \
--set-threads tree=16
16 changes: 16 additions & 0 deletions bin/rebuild-staging
Original file line number Diff line number Diff line change
Expand Up @@ -66,6 +66,22 @@ main() {

echo "Notifying Slack about rebuild."
"$bin"/notify-slack "A new staging build was submitted. Follow along in your local ncov repo with: "'```'"nextstrain build --aws-batch --attach $aws_batch_job_id ."'```'


echo "Launching a trial build for nextstrain/base:branch-python-base"

# Must use a config file because Snakemake's --config options seemingly
# don't override the profile's config files as they should. Not sure why.
tee trial.yaml <<<"
---
S3_BUCKET: nextstrain-ncov-private/branch/new-build-base-image
s3_staging_url: s3://nextstrain-staging/trial_
"

"$bin"/launch-build \
--image nextstrain/base:branch-python-base \
ncov deploy_to_staging upload \
--configfile trial.yaml
}

# Returns 1 if both files match (have identical hashes). Else returns 0.
Expand Down

0 comments on commit 3d8ab2f

Please sign in to comment.