-
Notifications
You must be signed in to change notification settings - Fork 596
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
WDLize GvsPrepareCallset (briefly known as CreateCohortTable) #7200
Conversation
.dockstore.yml
Outdated
branches: | ||
- master | ||
- ah_var_store | ||
- mmt_ngs_cohort_extract_wdl |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
remove before merging
@@ -68,7 +72,8 @@ task CreateCohortTableTask { | |||
--destination_table ~{destination_cohort_table_name_final} \ | |||
--fq_cohort_sample_names ~{fq_cohort_sample_table_final} \ | |||
--query_project ~{query_project_final} \ | |||
--fq_sample_mapping_table ~{fq_sample_mapping_table_final} | |||
--fq_sample_mapping_table ~{fq_sample_mapping_table_final} \ | |||
$SA_ARGS |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nice
String? fq_cohort_sample_table | ||
String? fq_sample_mapping_table | ||
|
||
File? service_account_json |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is this still defined as a File even if it's just a path to a json in GCP?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
as Kris pointed out, since it's a file, it'll localize, so we can just pass it straight into python. tested!
|
||
if [ ~{has_service_account_file} = 'true' ]; then | ||
SA_FILENAME="sa_key.json" | ||
gsutil cp "~{service_account_json}" $SA_FILENAME |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If this is declared as aFile
above, won't it already be copied down to the VM now and the path be a local path?
@@ -0,0 +1,14 @@ | |||
if [ $# -lt 1 ]; then | |||
echo "USAGE: ./build_docker.sh [DOCKER_TAG_STRING]" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
❤️
specops issue #273: https://github.com/broadinstitute/dsp-spec-ops/issues/273
ngs_cohort_extract.py
->create_cohort_extract_data_table.py
User does not have bigquery.jobs.create permission in project specops-variantstore-sa-tests.