azul2 on  issues/dsotirho-ucsc/6702-hibernate-alarms  daniel.local 🐍 v3.11.10 (.venv) took 6s at 11/13 10:56:48 ❌141 ❯make auto_deploy ; sleep 60 ; make integration_test ; git status ; git rev-parse HEAD ; date /Library/Developer/CommandLineTools/usr/bin/make -C lambdas /Library/Developer/CommandLineTools/usr/bin/make -C layer layer python /Users/daniel/repo/azul2/scripts/check_branch.py python .chalice/config.json.template.py .chalice/config.json Creating .chalice/config.json python /Users/daniel/repo/azul2/scripts/stage_layer.py 2024-11-13 10:56:55,491 INFO MainThread botocore.credentials: Found credentials in shared credentials file: ~/.aws/credentials 2024-11-13 10:56:55,528 INFO MainThread azul.deployment: Allocated new Boto3 client for 'iam' with ID 4406925968 2024-11-13 10:56:55,954 INFO MainThread azul.deployment: Allocated new Boto3 client for 'sts' with ID 4407562832 2024-11-13 10:56:55,991 INFO MainThread azul.lambda_layer: Checking for dependencies layer package at s3://edu-ucsc-gi-platform-hca-dev-shared.us-east-1/azul/daniel/lambda_layers/546c5a28a1c100e4b96892a9889811114e4767ab.zip. 2024-11-13 10:56:56,016 INFO MainThread azul.deployment: Allocated new Boto3 client for 's3' with ID 4442959504 2024-11-13 10:56:56,128 INFO MainThread azul.boto3: s3.HeadObject: Making HEAD request to https://s3.amazonaws.com/edu-ucsc-gi-platform-hca-dev-shared.us-east-1/azul/daniel/lambda_layers/546c5a28a1c100e4b96892a9889811114e4767ab.zip 2024-11-13 10:56:56,128 INFO MainThread azul.boto3: s3.HeadObject: … without request body 2024-11-13 10:56:56,487 INFO MainThread azul.boto3: s3.HeadObject: Got 200 response 2024-11-13 10:56:56,487 INFO MainThread azul.boto3: s3.HeadObject: … with response body b'' 2024-11-13 10:56:56,487 INFO MainThread azul.lambda_layer: Layer package already up-to-date. /Library/Developer/CommandLineTools/usr/bin/make -C indexer package python /Users/daniel/repo/azul2/scripts/check_branch.py python .chalice/config.json.template.py .chalice/config.json [INFO] 2024-11-13T10:56:58.313Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-11-13T10:56:58.355Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4382016976 Creating .chalice/config.json python vendor/resources/environ.json.template.py vendor/resources/environ.json Creating vendor/resources/environ.json PYTHONHASHSEED=0 python -m compileall \ -f -q --invalidation-mode checked-hash \ vendor vendor/humancellatlas vendor/azul python -m azul.changelog vendor chalice package --stage daniel --pkg-format terraform .chalice/terraform /Users/daniel/repo/azul2/.venv/lib/python3.11/site-packages/_distutils_hack/__init__.py:32: UserWarning: Setuptools is replacing distutils. Support for replacing an already imported distutils is deprecated. In the future, this condition will fail. Register concerns at https://github.com/pypa/setuptools/issues/new?template=distutils-deprecation.yml warnings.warn( [INFO] 2024-11-13T10:57:00.060Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-11-13T10:57:00.089Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4362025936 Creating deployment package. Reusing existing deployment package. [INFO] 2024-11-13T10:57:00.531Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in environment variables. /Library/Developer/CommandLineTools/usr/bin/make -C service package python /Users/daniel/repo/azul2/scripts/check_branch.py python .chalice/config.json.template.py .chalice/config.json [INFO] 2024-11-13T10:57:02.446Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-11-13T10:57:02.474Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4438496528 Creating .chalice/config.json python vendor/resources/environ.json.template.py vendor/resources/environ.json Creating vendor/resources/environ.json PYTHONHASHSEED=0 python -m compileall \ -f -q --invalidation-mode checked-hash \ vendor vendor/humancellatlas vendor/azul python -m azul.changelog vendor chalice package --stage daniel --pkg-format terraform .chalice/terraform /Users/daniel/repo/azul2/.venv/lib/python3.11/site-packages/_distutils_hack/__init__.py:32: UserWarning: Setuptools is replacing distutils. Support for replacing an already imported distutils is deprecated. In the future, this condition will fail. Register concerns at https://github.com/pypa/setuptools/issues/new?template=distutils-deprecation.yml warnings.warn( Creating deployment package. Reusing existing deployment package. [INFO] 2024-11-13T10:57:03.995Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in environment variables. /Library/Developer/CommandLineTools/usr/bin/make -C terraform auto_apply python /Users/daniel/repo/azul2/scripts/check_branch.py set -o pipefail && git ls-files --ignored --others --directory --exclude-standard | (grep -v '/[^/]' || test $? -eq 1) | xargs -r rm -rv __pycache__//cloudwatch_dashboard.template.json.cpython-311.pyc __pycache__/ api_gateway.tf.json authentication.tf.json backend.tf.json cloudwatch.tf.json common.tf.json dynamo.tf.json lambda_layer.tf.json plan.bin plan.json providers.tf.json s3.tf.json sqs.tf.json step_function.tf.json python providers.tf.json.template.py providers.tf.json Creating providers.tf.json python backend.tf.json.template.py backend.tf.json Creating backend.tf.json terraform init -reconfigure -lockfile=readonly Initializing the backend... Successfully configured the backend "s3"! Terraform will automatically use this backend unless the backend configuration changes. Initializing provider plugins... - Reusing previous version of hashicorp/external from the dependency lock file - Reusing previous version of hashicorp/null from the dependency lock file - Reusing previous version of hashicorp/google from the dependency lock file - Reusing previous version of hashicorp/aws from the dependency lock file - Reusing previous version of opensearch-project/opensearch from the dependency lock file - Using previously-installed hashicorp/google v4.58.0 - Using previously-installed hashicorp/aws v5.49.0 - Using previously-installed opensearch-project/opensearch v2.2.1 - Using previously-installed hashicorp/external v2.2.0 - Using previously-installed hashicorp/null v3.2.0 Terraform has been successfully initialized! You may now begin working with Terraform. Try running "terraform plan" to see any changes that are required for your infrastructure. All Terraform commands should now work. If you ever set or change modules or backend configuration for Terraform, rerun this command to reinitialize your working directory. If you forget, other commands will detect it and remind you to do so if necessary. python /Users/daniel/repo/azul2/scripts/terraform_schema.py check \ || (echo "Schema is stale. Run 'make update_schema' and commit." ; false) 2024-11-13 10:57:10,406 INFO MainThread azul.terraform: Running ['terraform', 'version', '-json'] 2024-11-13 10:57:10,457 INFO MainThread azul.terraform: Terraform output: { "terraform_version": "1.9.8", "platform": "darwin_arm64", "provider_selections": { "registry.terraform.io/hashicorp/aws": "5.49.0", "registry.terraform.io/hashicorp/external": "2.2.0", "registry.terraform.io/hashicorp/google": "4.58.0", "registry.terraform.io/hashicorp/null": "3.2.0", "registry.terraform.io/opensearch-project/opensearch": "2.2.1" }, "terraform_outdated": false } python api_gateway.tf.json.template.py api_gateway.tf.json [INFO] 2024-11-13T10:57:11.722Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'es' with ID 4632594192 Creating api_gateway.tf.json python authentication.tf.json.template.py authentication.tf.json Creating authentication.tf.json python cloudwatch.tf.json.template.py cloudwatch.tf.json Creating cloudwatch.tf.json python common.tf.json.template.py common.tf.json Creating common.tf.json python dynamo.tf.json.template.py dynamo.tf.json Creating dynamo.tf.json python elasticsearch.tf.json.template.py elasticsearch.tf.json python lambda_layer.tf.json.template.py lambda_layer.tf.json Creating lambda_layer.tf.json python s3.tf.json.template.py s3.tf.json Creating s3.tf.json python sqs.tf.json.template.py sqs.tf.json Creating sqs.tf.json python step_function.tf.json.template.py step_function.tf.json [INFO] 2024-11-13T10:57:18.373Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-11-13T10:57:18.424Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4467077648 [INFO] 2024-11-13T10:57:18.824Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'sts' with ID 4467652752 Creating step_function.tf.json terraform validate Success! The configuration is valid. python /Users/daniel/repo/azul2/scripts/rename_resources.py 2024-11-13 10:57:23,088 INFO MainThread azul.terraform: Running ['terraform', 'state', 'list'] terraform plan -no-color -out=plan.bin null_resource.hmac_secret: Refreshing state... [id=5577006791947779410] data.external.elasticsearch_nodes: Reading... data.google_client_config.current: Reading... google_project_iam_custom_role.azul: Refreshing state... [id=projects/platform-hca-dev/roles/azul_daniel_11] aws_acm_certificate.indexer_0: Refreshing state... [id=arn:aws:acm:us-east-1:122796619775:certificate/9df7078f-62c2-487d-b9ab-4c72e2fce35f] aws_acm_certificate.service_0: Refreshing state... [id=arn:aws:acm:us-east-1:122796619775:certificate/6f14e47b-d3af-4098-9074-3a51fe1f2370] aws_acm_certificate.service_1: Refreshing state... [id=arn:aws:acm:us-east-1:122796619775:certificate/ce201833-ad5e-4757-b5ba-007a4508bde8] data.aws_region.current: Reading... data.aws_subnet.gitlab_public_1: Reading... aws_lambda_layer_version.dependencies: Refreshing state... [id=arn:aws:lambda:us-east-1:122796619775:layer:azul-dependencies-daniel:296] aws_sqs_queue.notifications_fail: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/122796619775/azul-notifications_fail-daniel] data.aws_region.current: Read complete after 0s [id=us-east-1] data.aws_subnet.gitlab_private_1: Reading... data.google_client_config.current: Read complete after 0s [id=projects/platform-hca-dev/regions//zones/] data.aws_vpc.gitlab: Reading... data.aws_caller_identity.indexer: Reading... aws_dynamodb_table.object_versions: Refreshing state... [id=azul-object_versions-daniel] data.aws_caller_identity.indexer: Read complete after 0s [id=122796619775] data.aws_partition.indexer: Reading... data.aws_partition.indexer: Read complete after 0s [id=aws] aws_cloudwatch_event_rule.service_servicecachehealth: Refreshing state... [id=azul-servicecachehealth-daniel] data.aws_region.indexer: Reading... data.aws_subnet.gitlab_private_0: Reading... data.aws_region.indexer: Read complete after 0s [id=us-east-1] data.aws_partition.service: Reading... data.aws_partition.service: Read complete after 0s [id=aws] data.aws_s3_bucket.logs: Reading... aws_iam_role.states: Refreshing state... [id=azul-statemachine-daniel] data.aws_subnet.gitlab_public_1: Read complete after 1s [id=subnet-02866d3ce894ba178] aws_iam_role.indexer: Refreshing state... [id=azul-indexer-daniel] data.aws_subnet.gitlab_private_1: Read complete after 1s [id=subnet-07cab4c0971afee67] data.aws_wafv2_ip_set.allowed_v4_ips: Reading... aws_iam_role.service: Refreshing state... [id=azul-service-daniel] data.aws_subnet.gitlab_private_0: Read complete after 0s [id=subnet-03776c9deb0ed1c77] data.aws_region.service: Reading... data.aws_region.service: Read complete after 0s [id=us-east-1] data.aws_caller_identity.service: Reading... data.aws_caller_identity.service: Read complete after 0s [id=122796619775] aws_cloudwatch_event_rule.indexer_indexercachehealth: Refreshing state... [id=azul-indexercachehealth-daniel] data.external.elasticsearch_nodes: Read complete after 1s [id=-] aws_dynamodb_table.sources_cache_by_auth: Refreshing state... [id=azul-sources_cache_by_auth-daniel] data.aws_s3_bucket.logs: Read complete after 0s [id=edu-ucsc-gi-platform-hca-dev-logs.us-east-1] data.aws_route53_zone.dev_singlecell_gi_ucsc_edu: Reading... aws_cloudwatch_log_group.service: Refreshing state... [id=/aws/apigateway/azul-service-daniel] data.aws_vpc.gitlab: Read complete after 1s [id=vpc-06931ee1298704867] aws_kms_key.manifest: Refreshing state... [id=bd5443c4-469b-490c-a47f-0fe56e8be3b6] aws_cloudwatch_log_group.waf_api_gateway: Refreshing state... [id=aws-waf-logs-azul-api_gateway-daniel] data.aws_wafv2_ip_set.allowed_v4_ips: Read complete after 1s [id=0f8a542f-1472-451e-a910-c35334f87df9] data.aws_caller_identity.current: Reading... aws_cloudwatch_log_group.indexer: Refreshing state... [id=/aws/apigateway/azul-indexer-daniel] data.aws_caller_identity.current: Read complete after 0s [id=122796619775] aws_sqs_queue.tallies_fail: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/122796619775/azul-tallies_fail-daniel.fifo] data.aws_wafv2_ip_set.blocked_v4_ips: Reading... aws_s3_bucket.storage: Refreshing state... [id=edu-ucsc-gi-platform-hca-dev-storage-daniel.us-east-1] data.aws_subnet.gitlab_public_0: Reading... aws_sqs_queue.notifications_retry: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/122796619775/azul-notifications_retry-daniel] aws_security_group.indexer: Refreshing state... [id=sg-0cc391f421dd12e70] data.aws_subnet.gitlab_public_0: Read complete after 0s [id=subnet-0c4b13fb5432426c3] aws_security_group.service: Refreshing state... [id=sg-0375b33dbf313a173] aws_sfn_state_machine.manifest: Refreshing state... [id=arn:aws:states:us-east-1:122796619775:stateMachine:azul-manifest-daniel] data.aws_wafv2_ip_set.blocked_v4_ips: Read complete after 0s [id=60749613-bc5f-4a3f-9a11-3009cf99319a] aws_iam_role_policy.states: Refreshing state... [id=azul-statemachine-daniel:azul-statemachine-daniel] google_service_account.azul_public: Refreshing state... [id=projects/platform-hca-dev/serviceAccounts/azul-ucsc-11-public-daniel@platform-hca-dev.iam.gserviceaccount.com] google_service_account.azul: Refreshing state... [id=projects/platform-hca-dev/serviceAccounts/azul-ucsc-11-daniel@platform-hca-dev.iam.gserviceaccount.com] google_service_account.azul_unregistered: Refreshing state... [id=projects/platform-hca-dev/serviceAccounts/azul-ucsc-11-unreg-daniel@platform-hca-dev.iam.gserviceaccount.com] aws_sqs_queue.tallies_retry: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/122796619775/azul-tallies_retry-daniel.fifo] data.aws_route53_zone.dev_singlecell_gi_ucsc_edu: Read complete after 1s [id=ZRJRXAKW4OYOA] aws_cloudwatch_dashboard.dashboard: Refreshing state... [id=azul-dashboard-daniel] aws_lambda_function.indexer_aggregate: Refreshing state... [id=azul-indexer-daniel-aggregate] aws_lambda_function.indexer: Refreshing state... [id=azul-indexer-daniel] aws_lambda_function.indexer_contribute: Refreshing state... [id=azul-indexer-daniel-contribute] aws_lambda_function.indexer_aggregate_retry: Refreshing state... [id=azul-indexer-daniel-aggregate_retry] aws_sqs_queue.notifications: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/122796619775/azul-notifications-daniel] aws_lambda_function.indexer_contribute_retry: Refreshing state... [id=azul-indexer-daniel-contribute_retry] aws_lambda_function.indexer_indexercachehealth: Refreshing state... [id=azul-indexer-daniel-indexercachehealth] aws_wafv2_web_acl.api_gateway: Refreshing state... [id=fbf58fe0-fe9d-4277-9e54-067fe11f2195] aws_kms_alias.manifest: Refreshing state... [id=alias/azul-manifest-daniel] aws_route53_record.indexer_domain_validation_0: Refreshing state... [id=ZRJRXAKW4OYOA__8d8629347339c6b9ab5f73af4452501e.indexer.daniel.dev.singlecell.gi.ucsc.edu._CNAME] aws_route53_record.service_domain_validation_0: Refreshing state... [id=ZRJRXAKW4OYOA__7ec7bd992f8c52f7dc868205af307cd8.service.daniel.dev.singlecell.gi.ucsc.edu._CNAME] aws_route53_record.service_domain_validation_1: Refreshing state... [id=ZRJRXAKW4OYOA__93a0125de244a1421bfbb7dc5099f5a0.drs.daniel.dev.singlecell.gi.ucsc.edu._CNAME] google_project_iam_member.azul: Refreshing state... [id=platform-hca-dev/projects/platform-hca-dev/roles/azul_daniel_11/serviceAccount:azul-ucsc-11-daniel@platform-hca-dev.iam.gserviceaccount.com] aws_lambda_function.service_manifest: Refreshing state... [id=azul-service-daniel-manifest] aws_lambda_function.service: Refreshing state... [id=azul-service-daniel] aws_lambda_function.service_servicecachehealth: Refreshing state... [id=azul-service-daniel-servicecachehealth] aws_sqs_queue.tallies: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/122796619775/azul-tallies-daniel.fifo] aws_lambda_event_source_mapping.indexer_aggregate: Refreshing state... [id=40f44561-9d61-4633-8276-2e9a8e8f8d8d] aws_lambda_event_source_mapping.indexer_contribute: Refreshing state... [id=2e88dd96-7871-411c-b607-b0eddf26cd04] aws_lambda_event_source_mapping.indexer_aggregate_retry: Refreshing state... [id=9bec7800-3b5c-4159-808f-92895e628a4f] aws_lambda_event_source_mapping.indexer_contribute_retry: Refreshing state... [id=7e20e766-c08c-48e5-85e7-8a340923c993] aws_lambda_function_event_invoke_config.indexer_indexercachehealth: Refreshing state... [id=azul-indexer-daniel-indexercachehealth] aws_lambda_permission.indexer_indexercachehealth: Refreshing state... [id=terraform-20240912192836802300000001] aws_cloudwatch_event_target.indexer_indexercachehealth: Refreshing state... [id=azul-indexercachehealth-daniel-azul-indexercachehealth-daniel] aws_acm_certificate_validation.indexer_0: Refreshing state... [id=2024-06-27 17:47:28.016 +0000 UTC] aws_acm_certificate_validation.service_0: Refreshing state... [id=2024-06-27 17:47:36.308 +0000 UTC] aws_api_gateway_rest_api.indexer: Refreshing state... [id=u2f0nkn089] aws_acm_certificate_validation.service_1: Refreshing state... [id=2024-06-27 17:47:35.911 +0000 UTC] aws_s3_bucket_inventory.storage: Refreshing state... [id=edu-ucsc-gi-platform-hca-dev-storage-daniel.us-east-1:azul-inventory-daniel] aws_iam_role_policy.service: Refreshing state... [id=azul-service-daniel:service] aws_s3_bucket_logging.storage: Refreshing state... [id=edu-ucsc-gi-platform-hca-dev-storage-daniel.us-east-1] aws_s3_bucket_public_access_block.storage: Refreshing state... [id=edu-ucsc-gi-platform-hca-dev-storage-daniel.us-east-1] aws_s3_bucket_lifecycle_configuration.storage: Refreshing state... [id=edu-ucsc-gi-platform-hca-dev-storage-daniel.us-east-1] aws_iam_role_policy.indexer: Refreshing state... [id=azul-indexer-daniel:indexer] aws_lambda_permission.service_servicecachehealth: Refreshing state... [id=terraform-20240912192947513900000002] aws_lambda_function_event_invoke_config.service_servicecachehealth: Refreshing state... [id=azul-service-daniel-servicecachehealth] aws_cloudwatch_event_target.service_servicecachehealth: Refreshing state... [id=azul-servicecachehealth-daniel-azul-servicecachehealth-daniel] aws_api_gateway_rest_api.service: Refreshing state... [id=xa7lc03ug7] aws_api_gateway_domain_name.indexer_0: Refreshing state... [id=indexer.daniel.dev.singlecell.gi.ucsc.edu] aws_api_gateway_domain_name.service_0: Refreshing state... [id=service.daniel.dev.singlecell.gi.ucsc.edu] aws_api_gateway_domain_name.service_1: Refreshing state... [id=drs.daniel.dev.singlecell.gi.ucsc.edu] aws_route53_record.service_1: Refreshing state... [id=ZRJRXAKW4OYOA_drs.daniel.dev.singlecell.gi.ucsc.edu_A] aws_route53_record.service_0: Refreshing state... [id=ZRJRXAKW4OYOA_service.daniel.dev.singlecell.gi.ucsc.edu_A] aws_route53_record.indexer_0: Refreshing state... [id=ZRJRXAKW4OYOA_indexer.daniel.dev.singlecell.gi.ucsc.edu_A] aws_api_gateway_deployment.indexer: Refreshing state... [id=209by0] aws_lambda_permission.indexer: Refreshing state... [id=terraform-20240912193001060900000003] aws_api_gateway_stage.indexer: Refreshing state... [id=ags-u2f0nkn089-daniel] aws_lambda_permission.service: Refreshing state... [id=terraform-20240912193013867500000004] aws_api_gateway_deployment.service: Refreshing state... [id=kp2ydt] aws_api_gateway_base_path_mapping.indexer_0: Refreshing state... [id=indexer.daniel.dev.singlecell.gi.ucsc.edu/] aws_api_gateway_method_settings.indexer_0: Refreshing state... [id=u2f0nkn089-daniel-*/*] aws_api_gateway_stage.service: Refreshing state... [id=ags-xa7lc03ug7-daniel] aws_api_gateway_base_path_mapping.service_1: Refreshing state... [id=drs.daniel.dev.singlecell.gi.ucsc.edu/] aws_api_gateway_base_path_mapping.service_0: Refreshing state... [id=service.daniel.dev.singlecell.gi.ucsc.edu/] aws_api_gateway_method_settings.service_0: Refreshing state... [id=xa7lc03ug7-daniel-*/*] aws_api_gateway_method_settings.service_1: Refreshing state... [id=xa7lc03ug7-daniel-*/*] aws_wafv2_web_acl_association.service: Refreshing state... [id=arn:aws:wafv2:us-east-1:122796619775:regional/webacl/azul-api_gateway-daniel/fbf58fe0-fe9d-4277-9e54-067fe11f2195,arn:aws:apigateway:us-east-1::/restapis/xa7lc03ug7/stages/daniel] aws_wafv2_web_acl_association.indexer: Refreshing state... [id=arn:aws:wafv2:us-east-1:122796619775:regional/webacl/azul-api_gateway-daniel/fbf58fe0-fe9d-4277-9e54-067fe11f2195,arn:aws:apigateway:us-east-1::/restapis/u2f0nkn089/stages/daniel] aws_wafv2_web_acl_logging_configuration.waf_api_gateway: Refreshing state... [id=arn:aws:wafv2:us-east-1:122796619775:regional/webacl/azul-api_gateway-daniel/fbf58fe0-fe9d-4277-9e54-067fe11f2195] Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following symbols: ~ update in-place Terraform will perform the following actions: # aws_lambda_function.indexer will be updated in-place ~ resource "aws_lambda_function" "indexer" { id = "azul-indexer-daniel" tags = { "Name" = "azul-indexer-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-indexer" "billing" = "hca" "component" = "azul-indexer" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (28 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "17dadfabbcd151db21a50883da101ab7ab9dd0c0" -> "bd02f599085b03e1f7584d80e99d9973a412abbf" # (40 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_aggregate will be updated in-place ~ resource "aws_lambda_function" "indexer_aggregate" { id = "azul-indexer-daniel-aggregate" tags = { "Name" = "azul-indexer_aggregate-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-indexer" "billing" = "hca" "component" = "azul-indexer_aggregate" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (28 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "17dadfabbcd151db21a50883da101ab7ab9dd0c0" -> "bd02f599085b03e1f7584d80e99d9973a412abbf" # (40 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_aggregate_retry will be updated in-place ~ resource "aws_lambda_function" "indexer_aggregate_retry" { id = "azul-indexer-daniel-aggregate_retry" tags = { "Name" = "azul-indexer_aggregate_retry-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-indexer" "billing" = "hca" "component" = "azul-indexer_aggregate_retry" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (28 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "17dadfabbcd151db21a50883da101ab7ab9dd0c0" -> "bd02f599085b03e1f7584d80e99d9973a412abbf" # (40 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_contribute will be updated in-place ~ resource "aws_lambda_function" "indexer_contribute" { id = "azul-indexer-daniel-contribute" tags = { "Name" = "azul-indexer_contribute-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-indexer" "billing" = "hca" "component" = "azul-indexer_contribute" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (28 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "17dadfabbcd151db21a50883da101ab7ab9dd0c0" -> "bd02f599085b03e1f7584d80e99d9973a412abbf" # (40 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_contribute_retry will be updated in-place ~ resource "aws_lambda_function" "indexer_contribute_retry" { id = "azul-indexer-daniel-contribute_retry" tags = { "Name" = "azul-indexer_contribute_retry-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-indexer" "billing" = "hca" "component" = "azul-indexer_contribute_retry" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (28 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "17dadfabbcd151db21a50883da101ab7ab9dd0c0" -> "bd02f599085b03e1f7584d80e99d9973a412abbf" # (40 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_indexercachehealth will be updated in-place ~ resource "aws_lambda_function" "indexer_indexercachehealth" { id = "azul-indexer-daniel-indexercachehealth" tags = { "Name" = "azul-indexer_indexercachehealth-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-indexer" "billing" = "hca" "component" = "azul-indexer_indexercachehealth" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (28 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "17dadfabbcd151db21a50883da101ab7ab9dd0c0" -> "bd02f599085b03e1f7584d80e99d9973a412abbf" # (40 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.service will be updated in-place ~ resource "aws_lambda_function" "service" { id = "azul-service-daniel" tags = { "Name" = "azul-service-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-service" "billing" = "hca" "component" = "azul-service" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (28 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "17dadfabbcd151db21a50883da101ab7ab9dd0c0" -> "bd02f599085b03e1f7584d80e99d9973a412abbf" # (40 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.service_manifest will be updated in-place ~ resource "aws_lambda_function" "service_manifest" { id = "azul-service-daniel-manifest" tags = { "Name" = "azul-service_manifest-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-service" "billing" = "hca" "component" = "azul-service_manifest" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (28 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "17dadfabbcd151db21a50883da101ab7ab9dd0c0" -> "bd02f599085b03e1f7584d80e99d9973a412abbf" # (40 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.service_servicecachehealth will be updated in-place ~ resource "aws_lambda_function" "service_servicecachehealth" { id = "azul-service-daniel-servicecachehealth" tags = { "Name" = "azul-service_servicecachehealth-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-service" "billing" = "hca" "component" = "azul-service_servicecachehealth" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (28 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "17dadfabbcd151db21a50883da101ab7ab9dd0c0" -> "bd02f599085b03e1f7584d80e99d9973a412abbf" # (40 unchanged elements hidden) } } # (4 unchanged blocks hidden) } Plan: 0 to add, 9 to change, 0 to destroy. ───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── Saved the plan to: plan.bin To perform exactly these actions, run the following command to apply: terraform apply "plan.bin" terraform show -json plan.bin > plan.json terraform apply -auto-approve plan.bin aws_lambda_function.service: Modifying... [id=azul-service-daniel] aws_lambda_function.indexer_contribute: Modifying... [id=azul-indexer-daniel-contribute] aws_lambda_function.service_manifest: Modifying... [id=azul-service-daniel-manifest] aws_lambda_function.service_servicecachehealth: Modifying... [id=azul-service-daniel-servicecachehealth] aws_lambda_function.indexer_contribute_retry: Modifying... [id=azul-indexer-daniel-contribute_retry] aws_lambda_function.indexer_aggregate: Modifying... [id=azul-indexer-daniel-aggregate] aws_lambda_function.indexer_indexercachehealth: Modifying... [id=azul-indexer-daniel-indexercachehealth] aws_lambda_function.indexer_aggregate_retry: Modifying... [id=azul-indexer-daniel-aggregate_retry] aws_lambda_function.indexer: Modifying... [id=azul-indexer-daniel] aws_lambda_function.service_manifest: Modifications complete after 6s [id=azul-service-daniel-manifest] aws_lambda_function.indexer: Modifications complete after 7s [id=azul-indexer-daniel] aws_lambda_function.service: Modifications complete after 7s [id=azul-service-daniel] aws_lambda_function.indexer_indexercachehealth: Modifications complete after 7s [id=azul-indexer-daniel-indexercachehealth] aws_lambda_function.indexer_aggregate_retry: Modifications complete after 7s [id=azul-indexer-daniel-aggregate_retry] aws_lambda_function.indexer_contribute: Modifications complete after 7s [id=azul-indexer-daniel-contribute] aws_lambda_function.indexer_contribute_retry: Modifications complete after 7s [id=azul-indexer-daniel-contribute_retry] aws_lambda_function.indexer_aggregate: Modifications complete after 7s [id=azul-indexer-daniel-aggregate] aws_lambda_function.service_servicecachehealth: Modifications complete after 7s [id=azul-service-daniel-servicecachehealth] Apply complete! Resources: 0 added, 9 changed, 0 destroyed. python /Users/daniel/repo/azul2/scripts/post_deploy_tdr.py 2024-11-13 10:57:54,765 INFO MainThread botocore.credentials: Found credentials in shared credentials file: ~/.aws/credentials 2024-11-13 10:57:54,791 INFO MainThread azul.deployment: Allocated new Boto3 client for 'secretsmanager' with ID 4484722128 2024-11-13 10:57:55,356 INFO MainThread azul.terra: Making POST request to 'https://sam.dsde-dev.broadinstitute.org/register/user/v1' 2024-11-13 10:57:55,357 DEBUG MainThread azul.terra: … with request body '' 2024-11-13 10:57:55,911 INFO MainThread azul.terra: Got 409 response after 0.555s from POST to https://sam.dsde-dev.broadinstitute.org/register/user/v1 2024-11-13 10:57:55,912 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:57:55 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Referrer-Policy': 'strict-origin-when-cross-origin', 'Access-Control-Allow-Origin': '*', 'Access-Control-Allow-Headers': 'authorization,content-type,accept,origin,x-app-id', 'Access-Control-Allow-Methods': 'GET,POST,PUT,PATCH,DELETE,OPTIONS,HEAD', 'Access-Control-Max-Age': '1728000', 'Content-Type': 'application/json', 'Content-Length': '161', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:57:55,912 DEBUG MainThread azul.terra: … with response body b'{"causes":[],"message":"user azul-ucsc-11-daniel@platform-hca-dev.iam.gserviceaccount.com is already registered","source":"sa...' 2024-11-13 10:57:55,912 INFO MainThread azul.terra: Google service account 'azul-ucsc-11-daniel@platform-hca-dev.iam.gserviceaccount.com' previously registered with SAM. 2024-11-13 10:57:55,912 INFO MainThread azul.terra: Making GET request to 'https://sam.dsde-dev.broadinstitute.org/register/user/v1' 2024-11-13 10:57:55,912 DEBUG MainThread azul.terra: … without request body 2024-11-13 10:57:56,619 INFO MainThread azul.terra: Got 200 response after 0.707s from GET to https://sam.dsde-dev.broadinstitute.org/register/user/v1 2024-11-13 10:57:56,619 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:57:55 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Referrer-Policy': 'strict-origin-when-cross-origin', 'Access-Control-Allow-Origin': '*', 'Access-Control-Allow-Headers': 'authorization,content-type,accept,origin,x-app-id', 'Access-Control-Allow-Methods': 'GET,POST,PUT,PATCH,DELETE,OPTIONS,HEAD', 'Access-Control-Max-Age': '1728000', 'Content-Type': 'application/json', 'Content-Length': '227', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:57:56,620 DEBUG MainThread azul.terra: … with response body b'{"enabled":{"tosAccepted":true,"google":true,"ldap":true,"allUsersGroup":true,"adminEnabled":true},"userInfo":{"userEmail":"a...' 2024-11-13 10:57:56,936 INFO MainThread azul.terra: Making POST request to 'https://sam.dsde-dev.broadinstitute.org/register/user/v1' 2024-11-13 10:57:56,936 DEBUG MainThread azul.terra: … with request body '' 2024-11-13 10:57:57,126 INFO MainThread azul.terra: Got 409 response after 0.190s from POST to https://sam.dsde-dev.broadinstitute.org/register/user/v1 2024-11-13 10:57:57,126 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:57:57 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Referrer-Policy': 'strict-origin-when-cross-origin', 'Access-Control-Allow-Origin': '*', 'Access-Control-Allow-Headers': 'authorization,content-type,accept,origin,x-app-id', 'Access-Control-Allow-Methods': 'GET,POST,PUT,PATCH,DELETE,OPTIONS,HEAD', 'Access-Control-Max-Age': '1728000', 'Content-Type': 'application/json', 'Content-Length': '168', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:57:57,126 DEBUG MainThread azul.terra: … with response body b'{"causes":[],"message":"user azul-ucsc-11-public-daniel@platform-hca-dev.iam.gserviceaccount.com is already registered","sour...' 2024-11-13 10:57:57,126 INFO MainThread azul.terra: Google service account 'azul-ucsc-11-public-daniel@platform-hca-dev.iam.gserviceaccount.com' previously registered with SAM. 2024-11-13 10:57:57,127 INFO MainThread azul.terra: Making GET request to 'https://sam.dsde-dev.broadinstitute.org/register/user/v1' 2024-11-13 10:57:57,127 DEBUG MainThread azul.terra: … without request body 2024-11-13 10:57:57,817 INFO MainThread azul.terra: Got 200 response after 0.690s from GET to https://sam.dsde-dev.broadinstitute.org/register/user/v1 2024-11-13 10:57:57,817 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:57:57 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Referrer-Policy': 'strict-origin-when-cross-origin', 'Access-Control-Allow-Origin': '*', 'Access-Control-Allow-Headers': 'authorization,content-type,accept,origin,x-app-id', 'Access-Control-Allow-Methods': 'GET,POST,PUT,PATCH,DELETE,OPTIONS,HEAD', 'Access-Control-Max-Age': '1728000', 'Content-Type': 'application/json', 'Content-Length': '234', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:57:57,817 DEBUG MainThread azul.terra: … with response body b'{"enabled":{"tosAccepted":true,"google":true,"ldap":true,"allUsersGroup":true,"adminEnabled":true},"userInfo":{"userEmail":"a...' 2024-11-13 10:57:57,985 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_8185730f411340d39cc3929271784c2b__20210830_20210903&limit=2' 2024-11-13 10:57:57,985 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-11-13 10:57:57,985 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c5f4661568de4cf4bbc2a0ae10f08243__20210827_20230215&limit=2' 2024-11-13 10:57:57,985 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a004b1501c364af69bbd070c06dbc17d__20210830_20210903&limit=2' 2024-11-13 10:57:57,985 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-11-13 10:57:57,986 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_379ed69ebe0548bcaf5ea7fc589709bf__20210827_20210902&limit=2' 2024-11-13 10:57:57,986 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_455b46e6d8ea4611861ede720a562ada__20210901_20210903&limit=2' 2024-11-13 10:57:57,986 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-11-13 10:57:57,986 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_99101928d9b14aafb759e97958ac7403__20210830_20210903&limit=2' 2024-11-13 10:57:57,986 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c6ad8f9bd26a4811b2ba93d487978446__20210827_20210903&limit=2' 2024-11-13 10:57:57,987 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0c3b7785f74d40918616a68757e4c2a8__20210827_20210903&limit=2' 2024-11-13 10:57:57,987 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-11-13 10:57:57,988 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-11-13 10:57:57,988 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-11-13 10:57:57,988 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-11-13 10:57:57,988 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-11-13 10:57:58,693 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.705s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_455b46e6d8ea4611861ede720a562ada__20210901_20210903&limit=2 2024-11-13 10:57:58,694 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:57:58 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'em2VGxMJ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:57:58,694 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e0664f4e-cf09-488a-841d-4baf2cbf1507","name":"hca_dev_455b46e6d8ea4611861ede72...' 2024-11-13 10:57:58,694 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-5ef7f2e2:hca_dev_455b46e6d8ea4611861ede720a562ada__20210901_20210903:. 2024-11-13 10:57:58,694 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-5ef7f2e2.hca_dev_455b46e6d8ea4611861ede720a562ada__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:57:58,782 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.795s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a004b1501c364af69bbd070c06dbc17d__20210830_20210903&limit=2 2024-11-13 10:57:58,783 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:57:58 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pnYDqBMe', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:57:58,783 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"2c4ec571-f489-4277-b215-da8dedd86803","name":"hca_dev_a004b1501c364af69bbd070c...' 2024-11-13 10:57:58,783 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-d4b988d6:hca_dev_a004b1501c364af69bbd070c06dbc17d__20210830_20210903:. 2024-11-13 10:57:58,784 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d4b988d6.hca_dev_a004b1501c364af69bbd070c06dbc17d__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:57:58,800 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.812s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c6ad8f9bd26a4811b2ba93d487978446__20210827_20210903&limit=2 2024-11-13 10:57:58,801 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:57:58 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6qAl31W0', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:57:58,801 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"0ab78bd0-2e02-4536-b3c9-bdd7a57d7988","name":"hca_dev_c6ad8f9bd26a4811b2ba93d4...' 2024-11-13 10:57:58,802 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-990234a8:hca_dev_c6ad8f9bd26a4811b2ba93d487978446__20210827_20210903:. 2024-11-13 10:57:58,802 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-990234a8.hca_dev_c6ad8f9bd26a4811b2ba93d487978446__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:57:58,815 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.827s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0c3b7785f74d40918616a68757e4c2a8__20210827_20210903&limit=2 2024-11-13 10:57:58,815 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:57:58 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6qr01y2Q', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:57:58,816 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"f012a311-5d55-42ad-8b77-f8a1816f3aa4","name":"hca_dev_0c3b7785f74d40918616a687...' 2024-11-13 10:57:58,816 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-eab7fa76:hca_dev_0c3b7785f74d40918616a68757e4c2a8__20210827_20210903:. 2024-11-13 10:57:58,816 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-eab7fa76.hca_dev_0c3b7785f74d40918616a68757e4c2a8__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:57:58,827 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.839s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_379ed69ebe0548bcaf5ea7fc589709bf__20210827_20210902&limit=2 2024-11-13 10:57:58,827 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:57:58 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a5OD7lwD', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:57:58,827 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"477240da-1ce8-422a-aef4-cc2cf65dd539","name":"hca_dev_379ed69ebe0548bcaf5ea7fc...' 2024-11-13 10:57:58,828 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-1720b3c5:hca_dev_379ed69ebe0548bcaf5ea7fc589709bf__20210827_20210902:. 2024-11-13 10:57:58,828 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.840s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_99101928d9b14aafb759e97958ac7403__20210830_20210903&limit=2 2024-11-13 10:57:58,829 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1720b3c5.hca_dev_379ed69ebe0548bcaf5ea7fc589709bf__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:57:58,829 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:57:58 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a0580RvV', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:57:58,830 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"cddb722a-4229-47bb-ba86-736b7898406f","name":"hca_dev_99101928d9b14aafb759e979...' 2024-11-13 10:57:58,830 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-02c59b72:hca_dev_99101928d9b14aafb759e97958ac7403__20210830_20210903:. 2024-11-13 10:57:58,831 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-02c59b72.hca_dev_99101928d9b14aafb759e97958ac7403__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:57:58,836 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.850s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c5f4661568de4cf4bbc2a0ae10f08243__20210827_20230215&limit=2 2024-11-13 10:57:58,836 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:57:58 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVG7omyB', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:57:58,837 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"356c3be6-78c2-47e0-b71a-5d0ffd6603de","name":"hca_dev_c5f4661568de4cf4bbc2a0ae...' 2024-11-13 10:57:58,837 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-27c50fbc:hca_dev_c5f4661568de4cf4bbc2a0ae10f08243__20210827_20230215:. 2024-11-13 10:57:58,838 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-27c50fbc.hca_dev_c5f4661568de4cf4bbc2a0ae10f08243__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:57:58,847 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.862s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_8185730f411340d39cc3929271784c2b__20210830_20210903&limit=2 2024-11-13 10:57:58,847 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:57:58 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a9RkYqyZ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:57:58,847 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e470d283-fd86-45b3-bec2-0c1663c16a67","name":"hca_dev_8185730f411340d39cc39292...' 2024-11-13 10:57:58,848 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-bf3a4c8a:hca_dev_8185730f411340d39cc3929271784c2b__20210830_20210903:. 2024-11-13 10:57:58,848 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-bf3a4c8a.hca_dev_8185730f411340d39cc3929271784c2b__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:57:59,943 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "728b7c9d-7b10-4a24-9592-903ae2ea47be", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d4b988d6.hca_dev_a004b1501c364af69bbd070c06dbc17d__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:00,011 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "3e8f6b12-ce6e-4ab7-8918-0e7a37c8ef19", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-5ef7f2e2.hca_dev_455b46e6d8ea4611861ede720a562ada__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:00,027 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "08ab68ee-f8bd-48c3-801e-099f851a3012", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-eab7fa76.hca_dev_0c3b7785f74d40918616a68757e4c2a8__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:00,028 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "e688a009-f0c8-4431-93aa-473b2151117d", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-990234a8.hca_dev_c6ad8f9bd26a4811b2ba93d487978446__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:00,078 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "e61b08ae-4794-4504-957b-000fd2f25ff9", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-27c50fbc.hca_dev_c5f4661568de4cf4bbc2a0ae10f08243__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:00,107 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "ff2dcfed-740f-4d79-a218-7217f1f90138", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1720b3c5.hca_dev_379ed69ebe0548bcaf5ea7fc589709bf__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:00,126 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "d762c6b0-0be6-4c61-ae9f-7b97746ae0ff", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-bf3a4c8a.hca_dev_8185730f411340d39cc3929271784c2b__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:00,142 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d4b988d6.hca_dev_a004b1501c364af69bbd070c06dbc17d__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:00,249 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-eab7fa76.hca_dev_0c3b7785f74d40918616a68757e4c2a8__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '0')\n " 2024-11-13 10:58:00,254 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-5ef7f2e2.hca_dev_455b46e6d8ea4611861ede720a562ada__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '9')\n " 2024-11-13 10:58:00,255 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-990234a8.hca_dev_c6ad8f9bd26a4811b2ba93d487978446__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, 'e')\n " 2024-11-13 10:58:00,280 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-27c50fbc.hca_dev_c5f4661568de4cf4bbc2a0ae10f08243__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:00,281 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "37629b2d-08ee-4cfe-9934-e4514ddbfc2f", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-02c59b72.hca_dev_99101928d9b14aafb759e97958ac7403__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:00,294 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1720b3c5.hca_dev_379ed69ebe0548bcaf5ea7fc589709bf__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:00,359 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-bf3a4c8a.hca_dev_8185730f411340d39cc3929271784c2b__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:00,559 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-02c59b72.hca_dev_99101928d9b14aafb759e97958ac7403__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '5a')\n " 2024-11-13 10:58:01,113 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "a1d0e786-ec2a-41d0-87b2-953deabb8c48", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-990234a8.hca_dev_c6ad8f9bd26a4811b2ba93d487978446__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, 'e')\n "} 2024-11-13 10:58:01,132 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "41713ebb-1334-4126-b12c-ad4d44ec76ed", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-eab7fa76.hca_dev_0c3b7785f74d40918616a68757e4c2a8__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '0')\n "} 2024-11-13 10:58:01,147 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "f75b8a60-6700-47a4-b601-6ae7be6f4f59", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-5ef7f2e2.hca_dev_455b46e6d8ea4611861ede720a562ada__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '9')\n "} 2024-11-13 10:58:01,187 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "69e38288-5dab-4441-b74c-f3a916943b01", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1720b3c5.hca_dev_379ed69ebe0548bcaf5ea7fc589709bf__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:01,203 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "5a4d2008-74c5-4bb6-a525-8289d63ac6eb", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d4b988d6.hca_dev_a004b1501c364af69bbd070c06dbc17d__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:01,225 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "33651dd8-15b5-46d7-aaca-532c7a927235", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-27c50fbc.hca_dev_c5f4661568de4cf4bbc2a0ae10f08243__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:01,297 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_414accedeba0440fb721befbc5642bef__20210827_20210903&limit=2' 2024-11-13 10:58:01,297 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-11-13 10:58:01,307 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_03c6fce7789e4e78a27a664d562bb738__20210902_20210907&limit=2' 2024-11-13 10:58:01,307 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-11-13 10:58:01,340 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2af52a1365cb4973b51339be38f2df3f__20210830_20210903&limit=2' 2024-11-13 10:58:01,340 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-11-13 10:58:01,403 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "461cd313-3a9d-4e66-9668-7863b313a627", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-02c59b72.hca_dev_99101928d9b14aafb759e97958ac7403__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '5a')\n "} 2024-11-13 10:58:01,410 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_7880637a35a14047b422b5eac2a2a358__20210901_20210903&limit=2' 2024-11-13 10:58:01,410 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-11-13 10:58:01,411 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "a6b1cca4-3f28-4896-b738-63865cf0afdf", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-bf3a4c8a.hca_dev_8185730f411340d39cc3929271784c2b__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:01,438 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_90bd693340c048d48d76778c103bf545__20210827_20211110&limit=2' 2024-11-13 10:58:01,438 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-11-13 10:58:01,439 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_faeedcb0e0464be7b1ad80a3eeabb066__20210831_20210903&limit=2' 2024-11-13 10:58:01,439 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-11-13 10:58:01,488 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.190s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_414accedeba0440fb721befbc5642bef__20210827_20210903&limit=2 2024-11-13 10:58:01,488 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:01 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6B0lQBJ3', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:01,488 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e612386b-287d-4424-beb8-4ab62f925642","name":"hca_dev_414accedeba0440fb721befb...' 2024-11-13 10:58:01,488 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-31b3553a:hca_dev_414accedeba0440fb721befbc5642bef__20210827_20210903:. 2024-11-13 10:58:01,488 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-31b3553a.hca_dev_414accedeba0440fb721befbc5642bef__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:01,490 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.182s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_03c6fce7789e4e78a27a664d562bb738__20210902_20210907&limit=2 2024-11-13 10:58:01,490 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:01 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6JMg9ZDo', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:01,490 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"79abca77-cb9b-4905-8853-190367e397dc","name":"hca_dev_03c6fce7789e4e78a27a664d...' 2024-11-13 10:58:01,490 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-e2ab8487:hca_dev_03c6fce7789e4e78a27a664d562bb738__20210902_20210907:. 2024-11-13 10:58:01,490 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e2ab8487.hca_dev_03c6fce7789e4e78a27a664d562bb738__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:01,566 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_67a3de0945b949c3a068ff4665daa50e__20210827_20210903&limit=2' 2024-11-13 10:58:01,566 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-11-13 10:58:01,575 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a39728aa70a04201b0a281b7badf3e71__20210830_20210903&limit=2' 2024-11-13 10:58:01,575 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-11-13 10:58:01,612 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.271s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2af52a1365cb4973b51339be38f2df3f__20210830_20210903&limit=2 2024-11-13 10:58:01,612 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:01 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVKD7yxD', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:01,612 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"1b3866aa-d2a3-42cf-888d-7fb57a77c5aa","name":"hca_dev_2af52a1365cb4973b51339be...' 2024-11-13 10:58:01,612 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-3041c2cf:hca_dev_2af52a1365cb4973b51339be38f2df3f__20210830_20210903:. 2024-11-13 10:58:01,612 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3041c2cf.hca_dev_2af52a1365cb4973b51339be38f2df3f__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:01,627 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.216s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_7880637a35a14047b422b5eac2a2a358__20210901_20210903&limit=2 2024-11-13 10:58:01,627 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:01 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a5AA1QXb', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:01,627 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"58a0eacf-0caa-449b-9fc8-4fe629e99176","name":"hca_dev_7880637a35a14047b422b5ea...' 2024-11-13 10:58:01,627 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-12b7a9e1:hca_dev_7880637a35a14047b422b5eac2a2a358__20210901_20210903:. 2024-11-13 10:58:01,627 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-12b7a9e1.hca_dev_7880637a35a14047b422b5eac2a2a358__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:01,653 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.214s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_90bd693340c048d48d76778c103bf545__20210827_20211110&limit=2 2024-11-13 10:58:01,653 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:01 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6J54wYMm', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:01,653 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.214s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_faeedcb0e0464be7b1ad80a3eeabb066__20210831_20210903&limit=2 2024-11-13 10:58:01,653 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"8bf100c0-7ac3-4860-80ca-28093f4adb61","name":"hca_dev_90bd693340c048d48d76778c...' 2024-11-13 10:58:01,653 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:01 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aNlOEb5w', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:01,653 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-29509483:hca_dev_90bd693340c048d48d76778c103bf545__20210827_20211110:. 2024-11-13 10:58:01,653 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"9bf03ef5-4f42-4afb-b451-21923c6ff468","name":"hca_dev_faeedcb0e0464be7b1ad80a3...' 2024-11-13 10:58:01,653 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-29509483.hca_dev_90bd693340c048d48d76778c103bf545__20210827_20211110.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:01,653 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-96d8e08c:hca_dev_faeedcb0e0464be7b1ad80a3eeabb066__20210831_20210903:. 2024-11-13 10:58:01,653 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-96d8e08c.hca_dev_faeedcb0e0464be7b1ad80a3eeabb066__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:01,751 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.185s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_67a3de0945b949c3a068ff4665daa50e__20210827_20210903&limit=2 2024-11-13 10:58:01,751 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:01 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6vWz2r1l', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:01,751 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"13c6bf33-41a3-4330-a3f7-1e69f675b01e","name":"hca_dev_67a3de0945b949c3a068ff46...' 2024-11-13 10:58:01,751 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-ecb9c129:hca_dev_67a3de0945b949c3a068ff4665daa50e__20210827_20210903:. 2024-11-13 10:58:01,751 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ecb9c129.hca_dev_67a3de0945b949c3a068ff4665daa50e__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:01,770 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.194s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a39728aa70a04201b0a281b7badf3e71__20210830_20210903&limit=2 2024-11-13 10:58:01,770 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:01 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e48G4nb3', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:01,770 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"b580fa04-b2ef-472e-bd39-4a51368e813c","name":"hca_dev_a39728aa70a04201b0a281b7...' 2024-11-13 10:58:01,770 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-d3d5bbfa:hca_dev_a39728aa70a04201b0a281b7badf3e71__20210830_20210903:. 2024-11-13 10:58:01,770 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d3d5bbfa.hca_dev_a39728aa70a04201b0a281b7badf3e71__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:02,383 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "30bca03e-ea7c-4c6b-b0c7-6b4e0a4a5d00", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e2ab8487.hca_dev_03c6fce7789e4e78a27a664d562bb738__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:02,416 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "0a08153c-9216-44c5-b966-1f85b724c497", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-31b3553a.hca_dev_414accedeba0440fb721befbc5642bef__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:02,476 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "60c83a41-e076-46ad-a9d6-d0d4c39918e0", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-29509483.hca_dev_90bd693340c048d48d76778c103bf545__20210827_20211110.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:02,478 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "0a492903-2f6b-41a2-84a6-7177c3ca856e", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-96d8e08c.hca_dev_faeedcb0e0464be7b1ad80a3eeabb066__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:02,555 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e2ab8487.hca_dev_03c6fce7789e4e78a27a664d562bb738__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '9f')\n " 2024-11-13 10:58:02,560 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "5714d6a0-3f7a-477d-bbea-1a52c3a370e7", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-12b7a9e1.hca_dev_7880637a35a14047b422b5eac2a2a358__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:02,567 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "5a580cfd-1b90-43bd-8eb7-a046264a7a4d", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3041c2cf.hca_dev_2af52a1365cb4973b51339be38f2df3f__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:02,583 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "436ab0e6-f999-4819-b994-3a0cb4ae537a", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d3d5bbfa.hca_dev_a39728aa70a04201b0a281b7badf3e71__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:02,586 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-31b3553a.hca_dev_414accedeba0440fb721befbc5642bef__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:02,627 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-29509483.hca_dev_90bd693340c048d48d76778c103bf545__20210827_20211110.links`\n WHERE STARTS_WITH(datarepo_row_id, '4c')\n " 2024-11-13 10:58:02,679 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "9efdc6ad-bcaf-4384-b26b-52e63dd6b67f", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ecb9c129.hca_dev_67a3de0945b949c3a068ff4665daa50e__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:02,705 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-96d8e08c.hca_dev_faeedcb0e0464be7b1ad80a3eeabb066__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:02,718 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-12b7a9e1.hca_dev_7880637a35a14047b422b5eac2a2a358__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, 'd')\n " 2024-11-13 10:58:02,740 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d3d5bbfa.hca_dev_a39728aa70a04201b0a281b7badf3e71__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:02,751 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3041c2cf.hca_dev_2af52a1365cb4973b51339be38f2df3f__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:02,847 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ecb9c129.hca_dev_67a3de0945b949c3a068ff4665daa50e__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, 'b')\n " 2024-11-13 10:58:03,390 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "c0e71dc4-6a5c-433a-ba15-9d141eda52f8", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e2ab8487.hca_dev_03c6fce7789e4e78a27a664d562bb738__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '9f')\n "} 2024-11-13 10:58:03,465 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "0e974363-369c-4f11-b09b-0f828d8b3329", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-29509483.hca_dev_90bd693340c048d48d76778c103bf545__20210827_20211110.links`\n WHERE STARTS_WITH(datarepo_row_id, '4c')\n "} 2024-11-13 10:58:03,503 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "f9beadb4-cc81-40a5-8a19-fee1d92bc50e", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-31b3553a.hca_dev_414accedeba0440fb721befbc5642bef__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:03,507 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "6574d167-bed7-4928-b552-d724e55beef7", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3041c2cf.hca_dev_2af52a1365cb4973b51339be38f2df3f__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:03,525 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "1e72d72b-abe5-4d60-b795-801894da7416", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-96d8e08c.hca_dev_faeedcb0e0464be7b1ad80a3eeabb066__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:03,535 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_41fb1734a121461695c73b732c9433c7__20210830_20210903&limit=2' 2024-11-13 10:58:03,535 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-11-13 10:58:03,544 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "34633ad9-5b1f-449c-8adb-62d3ba431a2d", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-12b7a9e1.hca_dev_7880637a35a14047b422b5eac2a2a358__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, 'd')\n "} 2024-11-13 10:58:03,635 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_52b29aa4c8d642b4807ab35be94469ca__20210830_20210903&limit=2' 2024-11-13 10:58:03,635 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-11-13 10:58:03,643 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "520cd054-c05a-44ed-820d-f0fe834506e1", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d3d5bbfa.hca_dev_a39728aa70a04201b0a281b7badf3e71__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:03,655 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_38449aea70b540db84b31e08f32efe34__20210830_20210903&limit=2' 2024-11-13 10:58:03,655 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-11-13 10:58:03,669 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0d4b87ea6e9e456982e41343e0e3259f__20210827_20210903&limit=2' 2024-11-13 10:58:03,669 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-11-13 10:58:03,696 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_992aad5e7fab46d9a47ddf715e8cfd24__20210830_20210903&limit=2' 2024-11-13 10:58:03,696 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-11-13 10:58:03,704 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e526d91dcf3a44cb80c5fd7676b55a1d__20210902_20230215&limit=2' 2024-11-13 10:58:03,704 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-11-13 10:58:03,726 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.191s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_41fb1734a121461695c73b732c9433c7__20210830_20210903&limit=2 2024-11-13 10:58:03,726 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:03 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pQvdRE8M', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:03,726 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"dc7a86a7-e75c-4012-934b-86e7f7ff21eb","name":"hca_dev_41fb1734a121461695c73b73...' 2024-11-13 10:58:03,726 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-b4789901:hca_dev_41fb1734a121461695c73b732c9433c7__20210830_20210903:. 2024-11-13 10:58:03,726 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b4789901.hca_dev_41fb1734a121461695c73b732c9433c7__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:03,819 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.184s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_52b29aa4c8d642b4807ab35be94469ca__20210830_20210903&limit=2 2024-11-13 10:58:03,819 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:03 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pQvX7L7o', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:03,819 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"1e63b2ce-88ec-4c56-b016-56e9bd7f35e5","name":"hca_dev_52b29aa4c8d642b4807ab35b...' 2024-11-13 10:58:03,820 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-ffcf8b00:hca_dev_52b29aa4c8d642b4807ab35be94469ca__20210830_20210903:. 2024-11-13 10:58:03,820 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ffcf8b00.hca_dev_52b29aa4c8d642b4807ab35be94469ca__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:03,855 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.200s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_38449aea70b540db84b31e08f32efe34__20210830_20210903&limit=2 2024-11-13 10:58:03,855 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:03 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'plggG3Lm', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:03,855 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"cabce9f2-b98b-49f3-9dd4-d7e14c19acd2","name":"hca_dev_38449aea70b540db84b31e08...' 2024-11-13 10:58:03,855 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-ac6efd3f:hca_dev_38449aea70b540db84b31e08f32efe34__20210830_20210903:. 2024-11-13 10:58:03,855 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ac6efd3f.hca_dev_38449aea70b540db84b31e08f32efe34__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:03,861 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.192s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0d4b87ea6e9e456982e41343e0e3259f__20210827_20210903&limit=2 2024-11-13 10:58:03,861 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:03 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pl1gN2V1', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:03,861 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"4c15703d-2502-4863-8d82-fc1b6ccf65f0","name":"hca_dev_0d4b87ea6e9e456982e41343...' 2024-11-13 10:58:03,861 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-fef02a92:hca_dev_0d4b87ea6e9e456982e41343e0e3259f__20210827_20210903:. 2024-11-13 10:58:03,861 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-fef02a92.hca_dev_0d4b87ea6e9e456982e41343e0e3259f__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:03,887 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.184s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e526d91dcf3a44cb80c5fd7676b55a1d__20210902_20230215&limit=2 2024-11-13 10:58:03,887 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:03 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aE7nYQ20', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:03,887 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"5f55707c-6cb2-4b8a-a1b0-9099617fae2e","name":"hca_dev_e526d91dcf3a44cb80c5fd76...' 2024-11-13 10:58:03,887 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-e1712bfa:hca_dev_e526d91dcf3a44cb80c5fd7676b55a1d__20210902_20230215:. 2024-11-13 10:58:03,888 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e1712bfa.hca_dev_e526d91dcf3a44cb80c5fd7676b55a1d__20210902_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:03,900 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.204s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_992aad5e7fab46d9a47ddf715e8cfd24__20210830_20210903&limit=2 2024-11-13 10:58:03,900 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:03 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6Wdz4L7k', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:03,900 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"924ed952-4c7b-455f-871b-c740b72d405f","name":"hca_dev_992aad5e7fab46d9a47ddf71...' 2024-11-13 10:58:03,900 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-a6312a94:hca_dev_992aad5e7fab46d9a47ddf715e8cfd24__20210830_20210903:. 2024-11-13 10:58:03,900 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-a6312a94.hca_dev_992aad5e7fab46d9a47ddf715e8cfd24__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:04,159 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_dc1a41f69e0942a6959e3be23db6da56__20210827_20220228_dcp14&limit=2' 2024-11-13 10:58:04,159 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-11-13 10:58:04,168 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "1b76f61f-fdbc-42e0-b575-dc5b31a68756", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ecb9c129.hca_dev_67a3de0945b949c3a068ff4665daa50e__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, 'b')\n "} 2024-11-13 10:58:04,340 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2a64db431b554639aabb8dba0145689d__20210830_20210903&limit=2' 2024-11-13 10:58:04,341 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-11-13 10:58:04,342 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.183s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_dc1a41f69e0942a6959e3be23db6da56__20210827_20220228_dcp14&limit=2 2024-11-13 10:58:04,342 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:04 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6gRVwMn8', 'Content-Type': 'application/json', 'Content-Length': '956', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:04,342 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e785046f-93af-4c79-94b1-d8d0b4c04689","name":"hca_dev_dc1a41f69e0942a6959e3be2...' 2024-11-13 10:58:04,343 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-3b058b81:hca_dev_dc1a41f69e0942a6959e3be23db6da56__20210827_20220228_dcp14:. 2024-11-13 10:58:04,343 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (198 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3b058b81.hca_dev_dc1a41f69e0942a6959e3be23db6da56__20210827_20220228_dcp14.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:04,531 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.190s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2a64db431b554639aabb8dba0145689d__20210830_20210903&limit=2 2024-11-13 10:58:04,531 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:04 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e1qJjYo8', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:04,531 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"31d19143-1faa-471a-8575-4a8052fdcf19","name":"hca_dev_2a64db431b554639aabb8dba...' 2024-11-13 10:58:04,531 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-38f08cd8:hca_dev_2a64db431b554639aabb8dba0145689d__20210830_20210903:. 2024-11-13 10:58:04,532 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-38f08cd8.hca_dev_2a64db431b554639aabb8dba0145689d__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:04,683 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "b7f0dc47-2b34-4aeb-aca7-d8fdd9ffd07c", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ac6efd3f.hca_dev_38449aea70b540db84b31e08f32efe34__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:04,688 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "4ed01f5d-bb9f-404f-bbf0-e9d920e18cfe", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b4789901.hca_dev_41fb1734a121461695c73b732c9433c7__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:04,732 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "d89531df-7062-4498-80cf-08892b869b82", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ffcf8b00.hca_dev_52b29aa4c8d642b4807ab35be94469ca__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:04,785 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "d11bf9b1-37bc-40fa-a818-fed009051d47", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-a6312a94.hca_dev_992aad5e7fab46d9a47ddf715e8cfd24__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:04,789 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "318e3340-b3e7-4c6c-b2e5-d95542f0f166", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e1712bfa.hca_dev_e526d91dcf3a44cb80c5fd7676b55a1d__20210902_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:04,833 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ac6efd3f.hca_dev_38449aea70b540db84b31e08f32efe34__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:04,844 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b4789901.hca_dev_41fb1734a121461695c73b732c9433c7__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:04,883 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "7de4f4be-ff0b-49b1-964e-77dce3ed032a", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-fef02a92.hca_dev_0d4b87ea6e9e456982e41343e0e3259f__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:04,889 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ffcf8b00.hca_dev_52b29aa4c8d642b4807ab35be94469ca__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '2')\n " 2024-11-13 10:58:04,931 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e1712bfa.hca_dev_e526d91dcf3a44cb80c5fd7676b55a1d__20210902_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, 'd')\n " 2024-11-13 10:58:04,936 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-a6312a94.hca_dev_992aad5e7fab46d9a47ddf715e8cfd24__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:05,052 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-fef02a92.hca_dev_0d4b87ea6e9e456982e41343e0e3259f__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:05,284 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "98f4f4f4-a5af-4cde-abaf-f03ae974f1fd", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3b058b81.hca_dev_dc1a41f69e0942a6959e3be23db6da56__20210827_20220228_dcp14.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:05,408 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "265b20c2-8734-47e3-a206-8acf2490a554", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-38f08cd8.hca_dev_2a64db431b554639aabb8dba0145689d__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:05,486 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (198 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3b058b81.hca_dev_dc1a41f69e0942a6959e3be23db6da56__20210827_20220228_dcp14.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:05,545 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-38f08cd8.hca_dev_2a64db431b554639aabb8dba0145689d__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:05,593 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "f716269f-da4b-4a6a-b520-cdcdf1db74b7", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ac6efd3f.hca_dev_38449aea70b540db84b31e08f32efe34__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:05,665 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "fd5581a2-0f15-424f-8af7-c0a197585ed3", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b4789901.hca_dev_41fb1734a121461695c73b732c9433c7__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:05,725 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "3457e4c8-61d3-41ed-87e4-e46f6f406e67", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ffcf8b00.hca_dev_52b29aa4c8d642b4807ab35be94469ca__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '2')\n "} 2024-11-13 10:58:05,762 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "852b06b0-f033-4bf8-9d93-1ff0c30fb8e5", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-a6312a94.hca_dev_992aad5e7fab46d9a47ddf715e8cfd24__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:05,765 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_51f02950ee254f4b8d0759aa99bb3498__20210827_20230215&limit=2' 2024-11-13 10:58:05,766 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-11-13 10:58:05,846 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "9d0ff42b-1e57-4119-81dd-4f4feff5ae66", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e1712bfa.hca_dev_e526d91dcf3a44cb80c5fd7676b55a1d__20210902_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, 'd')\n "} 2024-11-13 10:58:05,850 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_4037007b0eff4e6db7bd8dd8eec80143__20210831_20210903&limit=2' 2024-11-13 10:58:05,851 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-11-13 10:58:05,852 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "8f7083b4-2724-4535-9f0a-81756b2d51ff", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-fef02a92.hca_dev_0d4b87ea6e9e456982e41343e0e3259f__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:05,874 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ccef38d7aa9240109621c4c7b1182647__20210831_20210903&limit=2' 2024-11-13 10:58:05,874 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-11-13 10:58:05,933 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_60ea42e1af4942f58164d641fdb696bc__20210827_20210903&limit=2' 2024-11-13 10:58:05,933 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-11-13 10:58:05,958 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.192s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_51f02950ee254f4b8d0759aa99bb3498__20210827_20230215&limit=2 2024-11-13 10:58:05,958 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:05 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ek1YPyVd', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:05,959 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"9e33ae37-eb19-47b5-a5fd-e2e8a41d3574","name":"hca_dev_51f02950ee254f4b8d0759aa...' 2024-11-13 10:58:05,959 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-b46086a9:hca_dev_51f02950ee254f4b8d0759aa99bb3498__20210827_20230215:. 2024-11-13 10:58:05,959 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b46086a9.hca_dev_51f02950ee254f4b8d0759aa99bb3498__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:06,017 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_42d4f8d454224b78adaee7c3c2ef511c__20210830_20210903&limit=2' 2024-11-13 10:58:06,018 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-11-13 10:58:06,032 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a9c022b4c7714468b769cabcf9738de3__20210827_20210903&limit=2' 2024-11-13 10:58:06,032 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-11-13 10:58:06,033 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.181s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_4037007b0eff4e6db7bd8dd8eec80143__20210831_20210903&limit=2 2024-11-13 10:58:06,033 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:06 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eOAdqKmz', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:06,034 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"f5a52dbb-acad-47fd-8832-436134301ea2","name":"hca_dev_4037007b0eff4e6db7bd8dd8...' 2024-11-13 10:58:06,034 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-ec07c8d8:hca_dev_4037007b0eff4e6db7bd8dd8eec80143__20210831_20210903:. 2024-11-13 10:58:06,034 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ec07c8d8.hca_dev_4037007b0eff4e6db7bd8dd8eec80143__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:06,059 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.184s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ccef38d7aa9240109621c4c7b1182647__20210831_20210903&limit=2 2024-11-13 10:58:06,059 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:06 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pnOOgY16', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:06,059 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"70c0ed2f-0db6-4245-b1c5-d140cc6c712c","name":"hca_dev_ccef38d7aa9240109621c4c7...' 2024-11-13 10:58:06,060 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-aa8357fb:hca_dev_ccef38d7aa9240109621c4c7b1182647__20210831_20210903:. 2024-11-13 10:58:06,060 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-aa8357fb.hca_dev_ccef38d7aa9240109621c4c7b1182647__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:06,132 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.199s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_60ea42e1af4942f58164d641fdb696bc__20210827_20210903&limit=2 2024-11-13 10:58:06,132 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:06 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aK1BmZv2', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:06,133 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"155a019c-ca47-432d-939b-6e51d5bec730","name":"hca_dev_60ea42e1af4942f58164d641...' 2024-11-13 10:58:06,133 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-da221b1a:hca_dev_60ea42e1af4942f58164d641fdb696bc__20210827_20210903:. 2024-11-13 10:58:06,134 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-da221b1a.hca_dev_60ea42e1af4942f58164d641fdb696bc__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:06,211 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.193s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_42d4f8d454224b78adaee7c3c2ef511c__20210830_20210903&limit=2 2024-11-13 10:58:06,211 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:06 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eXENv157', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:06,211 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"41d88011-1981-4f50-b6fe-78f7b7d27bab","name":"hca_dev_42d4f8d454224b78adaee7c3...' 2024-11-13 10:58:06,213 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-4e5ffd52:hca_dev_42d4f8d454224b78adaee7c3c2ef511c__20210830_20210903:. 2024-11-13 10:58:06,214 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4e5ffd52.hca_dev_42d4f8d454224b78adaee7c3c2ef511c__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:06,244 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.211s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a9c022b4c7714468b769cabcf9738de3__20210827_20210903&limit=2 2024-11-13 10:58:06,244 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:06 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVdJBgwm', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:06,244 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"daa3a6f0-c1e0-4e38-b6aa-235fa509daf5","name":"hca_dev_a9c022b4c7714468b769cabc...' 2024-11-13 10:58:06,245 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-58610528:hca_dev_a9c022b4c7714468b769cabcf9738de3__20210827_20210903:. 2024-11-13 10:58:06,245 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-58610528.hca_dev_a9c022b4c7714468b769cabcf9738de3__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:06,320 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "669d68fd-4de6-479e-9bcd-7343d4f31d8c", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3b058b81.hca_dev_dc1a41f69e0942a6959e3be23db6da56__20210827_20220228_dcp14.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:06,372 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "e74e37cb-9a04-4971-a93e-2b993948be41", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-38f08cd8.hca_dev_2a64db431b554639aabb8dba0145689d__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:06,489 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_403c3e7668144a2da5805dd5de38c7ff__20210827_20210903&limit=2' 2024-11-13 10:58:06,490 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-11-13 10:58:06,545 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_1ce3b3dc02f244a896dad6d107b27a76__20210827_20210903&limit=2' 2024-11-13 10:58:06,545 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-11-13 10:58:06,671 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.181s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_403c3e7668144a2da5805dd5de38c7ff__20210827_20210903&limit=2 2024-11-13 10:58:06,671 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:06 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a5AzggyD', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:06,672 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"139ecf31-b6bb-419a-97c8-1245029631bb","name":"hca_dev_403c3e7668144a2da5805dd5...' 2024-11-13 10:58:06,672 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-c0ec174a:hca_dev_403c3e7668144a2da5805dd5de38c7ff__20210827_20210903:. 2024-11-13 10:58:06,672 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c0ec174a.hca_dev_403c3e7668144a2da5805dd5de38c7ff__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:06,721 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.176s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_1ce3b3dc02f244a896dad6d107b27a76__20210827_20210903&limit=2 2024-11-13 10:58:06,721 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:06 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6gryJMrJ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:06,721 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"5c3ab1e3-24a9-4ae7-9c56-638422b1ae8b","name":"hca_dev_1ce3b3dc02f244a896dad6d1...' 2024-11-13 10:58:06,722 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-f5321179:hca_dev_1ce3b3dc02f244a896dad6d107b27a76__20210827_20210903:. 2024-11-13 10:58:06,722 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f5321179.hca_dev_1ce3b3dc02f244a896dad6d107b27a76__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:06,792 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "68f191fd-26cd-4701-8881-71fd41ae2863", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b46086a9.hca_dev_51f02950ee254f4b8d0759aa99bb3498__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:06,867 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "795cea6c-eb7a-47d0-8164-6210254fd524", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ec07c8d8.hca_dev_4037007b0eff4e6db7bd8dd8eec80143__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:06,944 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b46086a9.hca_dev_51f02950ee254f4b8d0759aa99bb3498__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:06,996 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "6fecf072-c4e9-4852-866f-94daebf76bf5", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-da221b1a.hca_dev_60ea42e1af4942f58164d641fdb696bc__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:07,014 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ec07c8d8.hca_dev_4037007b0eff4e6db7bd8dd8eec80143__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:07,020 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "096f1a8f-eb73-491e-85b2-bef7db34b3da", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-aa8357fb.hca_dev_ccef38d7aa9240109621c4c7b1182647__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:07,148 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "71581605-f505-4c28-909a-4cf368954eb8", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4e5ffd52.hca_dev_42d4f8d454224b78adaee7c3c2ef511c__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:07,167 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-aa8357fb.hca_dev_ccef38d7aa9240109621c4c7b1182647__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '12')\n " 2024-11-13 10:58:07,171 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "b59a5e53-cb67-4290-8370-7fb68cda1689", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-58610528.hca_dev_a9c022b4c7714468b769cabcf9738de3__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:07,185 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-da221b1a.hca_dev_60ea42e1af4942f58164d641fdb696bc__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '87')\n " 2024-11-13 10:58:07,314 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-58610528.hca_dev_a9c022b4c7714468b769cabcf9738de3__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:07,328 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4e5ffd52.hca_dev_42d4f8d454224b78adaee7c3c2ef511c__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:07,512 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "7ddcfce6-0e5b-4d36-80fc-65b024ec75ee", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c0ec174a.hca_dev_403c3e7668144a2da5805dd5de38c7ff__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:07,608 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "c2fe2eff-eb9d-43ea-b983-ea2c86c039fd", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b46086a9.hca_dev_51f02950ee254f4b8d0759aa99bb3498__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:07,678 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "e391b278-f606-4c2f-9756-78e181e5f7d5", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f5321179.hca_dev_1ce3b3dc02f244a896dad6d107b27a76__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:07,708 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c0ec174a.hca_dev_403c3e7668144a2da5805dd5de38c7ff__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:07,755 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d3446f0c30f34a12b7c36af877c7bb2d__20210901_20210903&limit=2' 2024-11-13 10:58:07,755 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-11-13 10:58:07,799 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "c910e8b1-57bb-4d2f-97f6-aabcd88e4678", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-aa8357fb.hca_dev_ccef38d7aa9240109621c4c7b1182647__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '12')\n "} 2024-11-13 10:58:07,836 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f5321179.hca_dev_1ce3b3dc02f244a896dad6d107b27a76__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '4')\n " 2024-11-13 10:58:07,900 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "620f9bd8-4657-4fdd-97b7-0daa13fa2c44", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-da221b1a.hca_dev_60ea42e1af4942f58164d641fdb696bc__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '87')\n "} 2024-11-13 10:58:07,917 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "42b61ba4-1536-4f1b-a2d9-1e944c0b6447", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ec07c8d8.hca_dev_4037007b0eff4e6db7bd8dd8eec80143__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:07,940 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.185s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d3446f0c30f34a12b7c36af877c7bb2d__20210901_20210903&limit=2 2024-11-13 10:58:07,940 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:07 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e2DP2YEx', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:07,940 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"3011a1cf-1388-4819-8091-fee55e878ea1","name":"hca_dev_d3446f0c30f34a12b7c36af8...' 2024-11-13 10:58:07,941 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-b3632667:hca_dev_d3446f0c30f34a12b7c36af877c7bb2d__20210901_20210903:. 2024-11-13 10:58:07,941 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b3632667.hca_dev_d3446f0c30f34a12b7c36af877c7bb2d__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:07,960 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_23587fb31a4a4f58ad74cc9a4cb4c254__20210827_20210909&limit=2' 2024-11-13 10:58:07,961 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-11-13 10:58:08,046 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_b4a7d12f6c2f40a39e359756997857e3__20210831_20210903&limit=2' 2024-11-13 10:58:08,046 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-11-13 10:58:08,061 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_b51f49b40d2e4cbdbbd504cd171fc2fa__20210830_20210903&limit=2' 2024-11-13 10:58:08,061 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-11-13 10:58:08,144 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.183s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_23587fb31a4a4f58ad74cc9a4cb4c254__20210827_20210909&limit=2 2024-11-13 10:58:08,144 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:08 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pobjKYge', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:08,145 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"7138a5ec-41de-458d-9ac3-2fa2b0575787","name":"hca_dev_23587fb31a4a4f58ad74cc9a...' 2024-11-13 10:58:08,145 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-23782220:hca_dev_23587fb31a4a4f58ad74cc9a4cb4c254__20210827_20210909:. 2024-11-13 10:58:08,146 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-23782220.hca_dev_23587fb31a4a4f58ad74cc9a4cb4c254__20210827_20210909.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:08,209 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "bb56c6bc-10f0-430b-9945-938788e25bd8", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-58610528.hca_dev_a9c022b4c7714468b769cabcf9738de3__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:08,211 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "5d489cdb-dd3a-4780-a458-feb13684cda4", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4e5ffd52.hca_dev_42d4f8d454224b78adaee7c3c2ef511c__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:08,252 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.191s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_b51f49b40d2e4cbdbbd504cd171fc2fa__20210830_20210903&limit=2 2024-11-13 10:58:08,252 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:08 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6qEJ7o1X', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:08,252 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"806a9a68-1804-4234-85e1-aac7cdbffd73","name":"hca_dev_b51f49b40d2e4cbdbbd504cd...' 2024-11-13 10:58:08,253 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-0b465564:hca_dev_b51f49b40d2e4cbdbbd504cd171fc2fa__20210830_20210903:. 2024-11-13 10:58:08,253 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0b465564.hca_dev_b51f49b40d2e4cbdbbd504cd171fc2fa__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:08,256 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.210s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_b4a7d12f6c2f40a39e359756997857e3__20210831_20210903&limit=2 2024-11-13 10:58:08,256 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:08 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pQwAPM8R', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:08,257 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"a36cb7cb-0122-40af-8942-1d5ec9372e77","name":"hca_dev_b4a7d12f6c2f40a39e359756...' 2024-11-13 10:58:08,257 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-b2004d1c:hca_dev_b4a7d12f6c2f40a39e359756997857e3__20210831_20210903:. 2024-11-13 10:58:08,257 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b2004d1c.hca_dev_b4a7d12f6c2f40a39e359756997857e3__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:08,395 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_52d10a60c8d14d068a5eaf0d5c0d5034__20210827_20210902&limit=2' 2024-11-13 10:58:08,396 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-11-13 10:58:08,396 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f48e7c39cc6740559d79bc437892840c__20210830_20211007&limit=2' 2024-11-13 10:58:08,397 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-11-13 10:58:08,442 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "34cf273b-7c87-446a-994b-df6f8d2a8c22", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c0ec174a.hca_dev_403c3e7668144a2da5805dd5de38c7ff__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:08,575 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.178s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f48e7c39cc6740559d79bc437892840c__20210830_20211007&limit=2 2024-11-13 10:58:08,575 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:08 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a95P4Lwg', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:08,575 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"dc4c099e-1d33-4810-aca5-036a026f3aae","name":"hca_dev_f48e7c39cc6740559d79bc43...' 2024-11-13 10:58:08,575 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-b51e6694:hca_dev_f48e7c39cc6740559d79bc437892840c__20210830_20211007:. 2024-11-13 10:58:08,576 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b51e6694.hca_dev_f48e7c39cc6740559d79bc437892840c__20210830_20211007.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:08,582 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.186s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_52d10a60c8d14d068a5eaf0d5c0d5034__20210827_20210902&limit=2 2024-11-13 10:58:08,582 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:08 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6M4Bg9DG', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:08,582 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"60f11345-3c51-43c7-9c40-4d41eae11a17","name":"hca_dev_52d10a60c8d14d068a5eaf0d...' 2024-11-13 10:58:08,582 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-f76414c8:hca_dev_52d10a60c8d14d068a5eaf0d5c0d5034__20210827_20210902:. 2024-11-13 10:58:08,582 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f76414c8.hca_dev_52d10a60c8d14d068a5eaf0d5c0d5034__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:08,605 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_cddab57b68684be4806f395ed9dd635a__20210831_20210907&limit=2' 2024-11-13 10:58:08,605 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-11-13 10:58:08,611 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "87fb0522-5b50-4ac8-8b3d-7a3971f9451b", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f5321179.hca_dev_1ce3b3dc02f244a896dad6d107b27a76__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '4')\n "} 2024-11-13 10:58:08,768 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "a9b4e9ec-011e-4d09-a30a-5584db542361", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b3632667.hca_dev_d3446f0c30f34a12b7c36af877c7bb2d__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:08,786 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_1cd1f41ff81a486ba05b66ec60f81dcf__20210901_20210903&limit=2' 2024-11-13 10:58:08,786 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-11-13 10:58:08,806 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.201s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_cddab57b68684be4806f395ed9dd635a__20210831_20210907&limit=2 2024-11-13 10:58:08,806 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:08 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6zmq4Q2p', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:08,806 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"5d88275d-d7a5-492b-8e2a-4e93305a0b46","name":"hca_dev_cddab57b68684be4806f395e...' 2024-11-13 10:58:08,807 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-24e672db:hca_dev_cddab57b68684be4806f395ed9dd635a__20210831_20210907:. 2024-11-13 10:58:08,807 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-24e672db.hca_dev_cddab57b68684be4806f395ed9dd635a__20210831_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:08,939 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b3632667.hca_dev_d3446f0c30f34a12b7c36af877c7bb2d__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:08,960 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.174s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_1cd1f41ff81a486ba05b66ec60f81dcf__20210901_20210903&limit=2 2024-11-13 10:58:08,961 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:08 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eX0vyDgW', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:08,961 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"3d661f98-8742-434a-98de-168dde5b5120","name":"hca_dev_1cd1f41ff81a486ba05b66ec...' 2024-11-13 10:58:08,961 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-86c60513:hca_dev_1cd1f41ff81a486ba05b66ec60f81dcf__20210901_20210903:. 2024-11-13 10:58:08,961 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-86c60513.hca_dev_1cd1f41ff81a486ba05b66ec60f81dcf__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:09,020 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "105ed082-8b4e-43a2-a255-7e821f655b84", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-23782220.hca_dev_23587fb31a4a4f58ad74cc9a4cb4c254__20210827_20210909.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:09,096 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "864d7347-30c2-4a31-b905-050a170fb848", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0b465564.hca_dev_b51f49b40d2e4cbdbbd504cd171fc2fa__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:09,152 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "5a63f3da-a0e9-409d-9e00-f1dc2ae61f67", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b2004d1c.hca_dev_b4a7d12f6c2f40a39e359756997857e3__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:09,163 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-23782220.hca_dev_23587fb31a4a4f58ad74cc9a4cb4c254__20210827_20210909.links`\n WHERE STARTS_WITH(datarepo_row_id, '3c')\n " 2024-11-13 10:58:09,252 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0b465564.hca_dev_b51f49b40d2e4cbdbbd504cd171fc2fa__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '0')\n " 2024-11-13 10:58:09,304 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b2004d1c.hca_dev_b4a7d12f6c2f40a39e359756997857e3__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:09,323 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "fd3a7fbd-a85e-42ba-883d-ce9649eaab3c", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b51e6694.hca_dev_f48e7c39cc6740559d79bc437892840c__20210830_20211007.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:09,396 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "b3216142-8720-4b9f-ac5a-c6234a03bbfa", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f76414c8.hca_dev_52d10a60c8d14d068a5eaf0d5c0d5034__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:09,484 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b51e6694.hca_dev_f48e7c39cc6740559d79bc437892840c__20210830_20211007.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:09,558 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f76414c8.hca_dev_52d10a60c8d14d068a5eaf0d5c0d5034__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, 'f')\n " 2024-11-13 10:58:09,564 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "f5cf75cd-8a0b-4acd-857a-e695ec616615", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-24e672db.hca_dev_cddab57b68684be4806f395ed9dd635a__20210831_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:09,724 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-24e672db.hca_dev_cddab57b68684be4806f395ed9dd635a__20210831_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '0f')\n " 2024-11-13 10:58:09,800 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "ce523f14-6f39-4535-ae8d-3efc12f64c19", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b3632667.hca_dev_d3446f0c30f34a12b7c36af877c7bb2d__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:09,905 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "b94f2747-1d9b-42ba-ad24-e562d35e1bd6", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-86c60513.hca_dev_1cd1f41ff81a486ba05b66ec60f81dcf__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:09,955 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d2111fac3fc44f429b6d32cd6a828267__20210830_20230215&limit=2' 2024-11-13 10:58:09,955 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-11-13 10:58:09,988 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "7a6ea744-7692-4b8e-b8bb-75441aea40f8", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-23782220.hca_dev_23587fb31a4a4f58ad74cc9a4cb4c254__20210827_20210909.links`\n WHERE STARTS_WITH(datarepo_row_id, '3c')\n "} 2024-11-13 10:58:10,052 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-86c60513.hca_dev_1cd1f41ff81a486ba05b66ec60f81dcf__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:10,120 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "9b9e2509-7e82-4cbd-a556-9730fbf3c348", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0b465564.hca_dev_b51f49b40d2e4cbdbbd504cd171fc2fa__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '0')\n "} 2024-11-13 10:58:10,128 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_3e329187a9c448ec90e3cc45f7c2311c__20210901_20210903&limit=2' 2024-11-13 10:58:10,128 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-11-13 10:58:10,141 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.185s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d2111fac3fc44f429b6d32cd6a828267__20210830_20230215&limit=2 2024-11-13 10:58:10,141 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:10 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e1q9D7Qr', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:10,141 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"7496e23c-ff51-45fc-9d0f-37659b290038","name":"hca_dev_d2111fac3fc44f429b6d32cd...' 2024-11-13 10:58:10,141 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-2a4ab485:hca_dev_d2111fac3fc44f429b6d32cd6a828267__20210830_20230215:. 2024-11-13 10:58:10,142 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2a4ab485.hca_dev_d2111fac3fc44f429b6d32cd6a828267__20210830_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:10,187 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "ed4c6c7b-8f13-4ee0-90f5-a79804525b08", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b2004d1c.hca_dev_b4a7d12f6c2f40a39e359756997857e3__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:10,278 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "2cacc649-44de-4e40-9c21-1493774f8f83", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b51e6694.hca_dev_f48e7c39cc6740559d79bc437892840c__20210830_20211007.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:10,289 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ccd1f1ba74ce469b9fc9f6faea623358__20210827_20210902&limit=2' 2024-11-13 10:58:10,289 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-11-13 10:58:10,308 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.180s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_3e329187a9c448ec90e3cc45f7c2311c__20210901_20210903&limit=2 2024-11-13 10:58:10,308 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:10 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e7LYZDJp', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:10,309 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"d5222430-0f7a-4bd1-8706-c58b4397a9b8","name":"hca_dev_3e329187a9c448ec90e3cc45...' 2024-11-13 10:58:10,309 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-bdc9f342:hca_dev_3e329187a9c448ec90e3cc45f7c2311c__20210901_20210903:. 2024-11-13 10:58:10,309 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-bdc9f342.hca_dev_3e329187a9c448ec90e3cc45f7c2311c__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:10,338 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "4fc34b22-2136-46da-99f0-0d5da12996a9", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f76414c8.hca_dev_52d10a60c8d14d068a5eaf0d5c0d5034__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, 'f')\n "} 2024-11-13 10:58:10,349 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f8aa201c4ff145a4890e840d63459ca2__20210901_20210903&limit=2' 2024-11-13 10:58:10,349 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-11-13 10:58:10,440 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_dbd836cfbfc241f0983441cc6c0b235a__20210827_20210902&limit=2' 2024-11-13 10:58:10,441 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-11-13 10:58:10,469 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.180s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ccd1f1ba74ce469b9fc9f6faea623358__20210827_20210902&limit=2 2024-11-13 10:58:10,469 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:10 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVlgjmjr', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:10,469 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"5d9ff6e0-3ec0-44f5-bb5c-32691a09517b","name":"hca_dev_ccd1f1ba74ce469b9fc9f6fa...' 2024-11-13 10:58:10,470 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-2f4bfe5d:hca_dev_ccd1f1ba74ce469b9fc9f6faea623358__20210827_20210902:. 2024-11-13 10:58:10,470 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2f4bfe5d.hca_dev_ccd1f1ba74ce469b9fc9f6faea623358__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:10,475 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "dbbac9de-7104-405d-a004-538f71d23203", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-24e672db.hca_dev_cddab57b68684be4806f395ed9dd635a__20210831_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '0f')\n "} 2024-11-13 10:58:10,490 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2086eb0510b9432bb7f0169ccc49d270__20210827_20210903&limit=2' 2024-11-13 10:58:10,490 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-11-13 10:58:10,551 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.202s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f8aa201c4ff145a4890e840d63459ca2__20210901_20210903&limit=2 2024-11-13 10:58:10,551 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:10 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pLVgWYWk', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:10,551 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"251c52e6-3bda-48df-a4f2-50aa759d7d80","name":"hca_dev_f8aa201c4ff145a4890e840d...' 2024-11-13 10:58:10,551 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-e8e0a59a:hca_dev_f8aa201c4ff145a4890e840d63459ca2__20210901_20210903:. 2024-11-13 10:58:10,552 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e8e0a59a.hca_dev_f8aa201c4ff145a4890e840d63459ca2__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:10,647 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.206s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_dbd836cfbfc241f0983441cc6c0b235a__20210827_20210902&limit=2 2024-11-13 10:58:10,647 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:10 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pPmDzwnx', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:10,648 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"fcc6b9e5-3e37-464f-8d5b-2b7b3d40f128","name":"hca_dev_dbd836cfbfc241f0983441cc...' 2024-11-13 10:58:10,648 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-848e2d4f:hca_dev_dbd836cfbfc241f0983441cc6c0b235a__20210827_20210902:. 2024-11-13 10:58:10,649 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-848e2d4f.hca_dev_dbd836cfbfc241f0983441cc6c0b235a__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:10,659 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_78b2406dbff246fc8b6120690e602227__20210827_20210902&limit=2' 2024-11-13 10:58:10,660 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-11-13 10:58:10,673 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.183s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2086eb0510b9432bb7f0169ccc49d270__20210827_20210903&limit=2 2024-11-13 10:58:10,673 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:10 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pYW0oYOr', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:10,673 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"fcca83ce-9015-42ae-a846-504cefa7902a","name":"hca_dev_2086eb0510b9432bb7f0169c...' 2024-11-13 10:58:10,674 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-c808badb:hca_dev_2086eb0510b9432bb7f0169ccc49d270__20210827_20210903:. 2024-11-13 10:58:10,674 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c808badb.hca_dev_2086eb0510b9432bb7f0169ccc49d270__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:10,828 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "9dc9651c-8289-4541-8f46-8fc1b2d04aa4", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-86c60513.hca_dev_1cd1f41ff81a486ba05b66ec60f81dcf__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:10,859 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.199s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_78b2406dbff246fc8b6120690e602227__20210827_20210902&limit=2 2024-11-13 10:58:10,859 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:10 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aw3q48v2', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:10,859 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"90d35849-38f1-4259-86dd-b91023a6b9d8","name":"hca_dev_78b2406dbff246fc8b612069...' 2024-11-13 10:58:10,859 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-7913b094:hca_dev_78b2406dbff246fc8b6120690e602227__20210827_20210902:. 2024-11-13 10:58:10,860 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-7913b094.hca_dev_78b2406dbff246fc8b6120690e602227__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:11,024 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ae71be1dddd84feb9bed24c3ddb6e1ad__20210916_20210916&limit=2' 2024-11-13 10:58:11,024 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-11-13 10:58:11,035 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "eb3c76db-a8f8-470b-96d3-9968b771ccfa", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2a4ab485.hca_dev_d2111fac3fc44f429b6d32cd6a828267__20210830_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:11,165 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "9102ab22-f398-4aad-9b10-a73db94bae59", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-bdc9f342.hca_dev_3e329187a9c448ec90e3cc45f7c2311c__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:11,174 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2a4ab485.hca_dev_d2111fac3fc44f429b6d32cd6a828267__20210830_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, 'e')\n " 2024-11-13 10:58:11,205 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.181s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ae71be1dddd84feb9bed24c3ddb6e1ad__20210916_20210916&limit=2 2024-11-13 10:58:11,206 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:11 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6vm7lKq2', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:11,206 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"69525f31-1a87-4a22-9ea3-e10ade1b7343","name":"hca_dev_ae71be1dddd84feb9bed24c3...' 2024-11-13 10:58:11,207 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-1dce87e5:hca_dev_ae71be1dddd84feb9bed24c3ddb6e1ad__20210916_20210916:. 2024-11-13 10:58:11,207 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1dce87e5.hca_dev_ae71be1dddd84feb9bed24c3ddb6e1ad__20210916_20210916.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:11,296 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "d1c419f9-0d20-40a1-b2fc-a48d4f8bc899", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2f4bfe5d.hca_dev_ccd1f1ba74ce469b9fc9f6faea623358__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:11,349 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-bdc9f342.hca_dev_3e329187a9c448ec90e3cc45f7c2311c__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '8')\n " 2024-11-13 10:58:11,360 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "d37d843f-afe8-4df3-ac90-82dc2ce1a25f", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e8e0a59a.hca_dev_f8aa201c4ff145a4890e840d63459ca2__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:11,456 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2f4bfe5d.hca_dev_ccd1f1ba74ce469b9fc9f6faea623358__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, 'd')\n " 2024-11-13 10:58:11,544 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e8e0a59a.hca_dev_f8aa201c4ff145a4890e840d63459ca2__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, 'f')\n " 2024-11-13 10:58:11,660 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "b6472b5c-33b6-4f3f-a270-1b9d0059b095", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-848e2d4f.hca_dev_dbd836cfbfc241f0983441cc6c0b235a__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:11,752 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "be874599-716d-4863-9b28-c6b80bfe9420", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-7913b094.hca_dev_78b2406dbff246fc8b6120690e602227__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:11,799 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-848e2d4f.hca_dev_dbd836cfbfc241f0983441cc6c0b235a__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:11,830 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "05d45244-a0e1-4ad4-a65d-f26bf7c6734a", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c808badb.hca_dev_2086eb0510b9432bb7f0169ccc49d270__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:11,893 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-7913b094.hca_dev_78b2406dbff246fc8b6120690e602227__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '7')\n " 2024-11-13 10:58:11,921 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "13691442-8a98-432b-8879-75a312984e2a", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2a4ab485.hca_dev_d2111fac3fc44f429b6d32cd6a828267__20210830_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, 'e')\n "} 2024-11-13 10:58:11,983 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c808badb.hca_dev_2086eb0510b9432bb7f0169ccc49d270__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:12,068 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_05be4f374506429bb112506444507d62__20210827_20210902&limit=2' 2024-11-13 10:58:12,069 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-11-13 10:58:12,084 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "2857385e-2e65-46b5-9ca1-b99558ab1b52", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1dce87e5.hca_dev_ae71be1dddd84feb9bed24c3ddb6e1ad__20210916_20210916.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:12,136 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "f669c71a-9fd5-45c3-a6d3-86917a2efb66", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-bdc9f342.hca_dev_3e329187a9c448ec90e3cc45f7c2311c__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '8')\n "} 2024-11-13 10:58:12,234 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1dce87e5.hca_dev_ae71be1dddd84feb9bed24c3ddb6e1ad__20210916_20210916.links`\n WHERE STARTS_WITH(datarepo_row_id, 'ab')\n " 2024-11-13 10:58:12,257 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.188s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_05be4f374506429bb112506444507d62__20210827_20210902&limit=2 2024-11-13 10:58:12,257 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:12 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pP04N32Z', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:12,257 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"ee9a4b92-82c1-4324-85ec-252cd8cea024","name":"hca_dev_05be4f374506429bb1125064...' 2024-11-13 10:58:12,257 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-9f4012c9:hca_dev_05be4f374506429bb112506444507d62__20210827_20210902:. 2024-11-13 10:58:12,257 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-9f4012c9.hca_dev_05be4f374506429bb112506444507d62__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:12,277 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_842605c7375a47c59e2ca71c2c00fcad__20210830_20210903&limit=2' 2024-11-13 10:58:12,277 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-11-13 10:58:12,286 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "4483bc7b-a3bf-4221-bd57-c1e4e6494455", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2f4bfe5d.hca_dev_ccd1f1ba74ce469b9fc9f6faea623358__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, 'd')\n "} 2024-11-13 10:58:12,399 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "7a5b2a23-deed-408a-b32e-bad3484b93f4", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e8e0a59a.hca_dev_f8aa201c4ff145a4890e840d63459ca2__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, 'f')\n "} 2024-11-13 10:58:12,433 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_b963bd4b4bc14404842569d74bc636b8__20210827_20210928&limit=2' 2024-11-13 10:58:12,433 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-11-13 10:58:12,470 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.193s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_842605c7375a47c59e2ca71c2c00fcad__20210830_20210903&limit=2 2024-11-13 10:58:12,470 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:12 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eRG8bYbN', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:12,471 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"4a245d7b-c43c-4bcb-a738-90ae11378928","name":"hca_dev_842605c7375a47c59e2ca71c...' 2024-11-13 10:58:12,471 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-bd995e95:hca_dev_842605c7375a47c59e2ca71c2c00fcad__20210830_20210903:. 2024-11-13 10:58:12,471 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-bd995e95.hca_dev_842605c7375a47c59e2ca71c2c00fcad__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:12,544 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_24c654a5caa5440a8f02582921f2db4a__20210830_20210903&limit=2' 2024-11-13 10:58:12,544 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-11-13 10:58:12,599 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "e28a2abe-31cf-4c1e-a1ce-77ef68755685", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-848e2d4f.hca_dev_dbd836cfbfc241f0983441cc6c0b235a__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:12,613 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.180s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_b963bd4b4bc14404842569d74bc636b8__20210827_20210928&limit=2 2024-11-13 10:58:12,614 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:12 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVGGDmbB', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:12,614 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"c935fa3e-06f7-4e85-9ff1-c58eaa789978","name":"hca_dev_b963bd4b4bc14404842569d7...' 2024-11-13 10:58:12,614 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-cd97e83a:hca_dev_b963bd4b4bc14404842569d74bc636b8__20210827_20210928:. 2024-11-13 10:58:12,614 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-cd97e83a.hca_dev_b963bd4b4bc14404842569d74bc636b8__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:12,642 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "ddd551b7-ea59-498d-99e7-55f52f341ca7", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-7913b094.hca_dev_78b2406dbff246fc8b6120690e602227__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '7')\n "} 2024-11-13 10:58:12,716 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "80ad00cb-808c-4fe1-b9f3-fbeb8307b41a", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c808badb.hca_dev_2086eb0510b9432bb7f0169ccc49d270__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:12,744 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.200s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_24c654a5caa5440a8f02582921f2db4a__20210830_20210903&limit=2 2024-11-13 10:58:12,744 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:12 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6gW0O1AV', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:12,745 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"c594fc9a-f1c5-4770-acaa-013c2852e660","name":"hca_dev_24c654a5caa5440a8f025829...' 2024-11-13 10:58:12,745 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-1c2c69d9:hca_dev_24c654a5caa5440a8f02582921f2db4a__20210830_20210903:. 2024-11-13 10:58:12,745 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1c2c69d9.hca_dev_24c654a5caa5440a8f02582921f2db4a__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:12,752 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d3ac7c1b53024804b611dad9f89c049d__20210827_20230215&limit=2' 2024-11-13 10:58:12,752 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-11-13 10:58:12,800 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_005d611a14d54fbf846e571a1f874f70__20210827_20210903&limit=2' 2024-11-13 10:58:12,801 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-11-13 10:58:12,889 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_5ee710d7e2d54fe2818d15f5e31dae32__20210901_20210903&limit=2' 2024-11-13 10:58:12,889 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-11-13 10:58:12,929 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.177s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d3ac7c1b53024804b611dad9f89c049d__20210827_20230215&limit=2 2024-11-13 10:58:12,930 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:12 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eZOJqoLJ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:12,930 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e2af563e-68e2-495a-a51a-041e1e32f037","name":"hca_dev_d3ac7c1b53024804b611dad9...' 2024-11-13 10:58:12,930 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-1005632d:hca_dev_d3ac7c1b53024804b611dad9f89c049d__20210827_20230215:. 2024-11-13 10:58:12,930 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1005632d.hca_dev_d3ac7c1b53024804b611dad9f89c049d__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:12,968 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "720b1b4a-de5e-4e73-a044-3f3e8d2ddd9f", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1dce87e5.hca_dev_ae71be1dddd84feb9bed24c3ddb6e1ad__20210916_20210916.links`\n WHERE STARTS_WITH(datarepo_row_id, 'ab')\n "} 2024-11-13 10:58:12,980 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.179s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_005d611a14d54fbf846e571a1f874f70__20210827_20210903&limit=2 2024-11-13 10:58:12,980 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:13 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e3J9n7gY', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:12,980 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"90c2d68f-a000-4c8d-a493-8be93a71b44d","name":"hca_dev_005d611a14d54fbf846e571a...' 2024-11-13 10:58:12,980 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-a9252919:hca_dev_005d611a14d54fbf846e571a1f874f70__20210827_20210903:. 2024-11-13 10:58:12,981 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-a9252919.hca_dev_005d611a14d54fbf846e571a1f874f70__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:13,081 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.191s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_5ee710d7e2d54fe2818d15f5e31dae32__20210901_20210903&limit=2 2024-11-13 10:58:13,081 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:13 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6MKDqk8W', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:13,081 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"006f69b6-7f42-4eba-81df-86805c22dd3d","name":"hca_dev_5ee710d7e2d54fe2818d15f5...' 2024-11-13 10:58:13,081 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-279f1986:hca_dev_5ee710d7e2d54fe2818d15f5e31dae32__20210901_20210903:. 2024-11-13 10:58:13,082 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-279f1986.hca_dev_5ee710d7e2d54fe2818d15f5e31dae32__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:13,116 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_248fcf0316c64a41b6ccaad4d894ca42__20210907_20210907&limit=2' 2024-11-13 10:58:13,116 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-11-13 10:58:13,172 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "82723c2c-c9e2-444e-bb8f-e614fd681c00", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-9f4012c9.hca_dev_05be4f374506429bb112506444507d62__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:13,300 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.183s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_248fcf0316c64a41b6ccaad4d894ca42__20210907_20210907&limit=2 2024-11-13 10:58:13,300 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:13 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6v3WQyna', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:13,300 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"b1083e8b-4de9-467a-97de-18179c4e6bd1","name":"hca_dev_248fcf0316c64a41b6ccaad4...' 2024-11-13 10:58:13,300 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-4c3e6011:hca_dev_248fcf0316c64a41b6ccaad4d894ca42__20210907_20210907:. 2024-11-13 10:58:13,301 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4c3e6011.hca_dev_248fcf0316c64a41b6ccaad4d894ca42__20210907_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:13,316 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-9f4012c9.hca_dev_05be4f374506429bb112506444507d62__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '70')\n " 2024-11-13 10:58:13,345 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "22b4838b-309c-44c4-8a8e-07c17ff91bb1", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-cd97e83a.hca_dev_b963bd4b4bc14404842569d74bc636b8__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:13,447 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "85874844-0443-4499-9d42-a4301f7c6201", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-bd995e95.hca_dev_842605c7375a47c59e2ca71c2c00fcad__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:13,501 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-cd97e83a.hca_dev_b963bd4b4bc14404842569d74bc636b8__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:13,594 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-bd995e95.hca_dev_842605c7375a47c59e2ca71c2c00fcad__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:13,610 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "114ba551-5da8-44cb-9631-0e64022bae37", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1c2c69d9.hca_dev_24c654a5caa5440a8f02582921f2db4a__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:13,754 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1c2c69d9.hca_dev_24c654a5caa5440a8f02582921f2db4a__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:13,768 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "ef8735e0-0d95-4b0b-8371-3729c490fa29", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-a9252919.hca_dev_005d611a14d54fbf846e571a1f874f70__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:13,824 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "1ccb1231-a0f5-4f0f-bee1-cd44f9c600f1", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1005632d.hca_dev_d3ac7c1b53024804b611dad9f89c049d__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:13,844 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "07e32e81-2ef3-4b06-9738-4f423914ab4d", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-279f1986.hca_dev_5ee710d7e2d54fe2818d15f5e31dae32__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:13,916 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-a9252919.hca_dev_005d611a14d54fbf846e571a1f874f70__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:13,987 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1005632d.hca_dev_d3ac7c1b53024804b611dad9f89c049d__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:13,992 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-279f1986.hca_dev_5ee710d7e2d54fe2818d15f5e31dae32__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:14,172 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "2da5f861-c7ba-4999-8155-64137cf4f531", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-9f4012c9.hca_dev_05be4f374506429bb112506444507d62__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '70')\n "} 2024-11-13 10:58:14,205 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "3d12767d-6b4c-462b-8064-128642496250", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4c3e6011.hca_dev_248fcf0316c64a41b6ccaad4d894ca42__20210907_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:14,296 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "aaa0001c-4a17-4f75-bdf7-a37334b27445", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-cd97e83a.hca_dev_b963bd4b4bc14404842569d74bc636b8__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:14,319 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_6072616c87944b208f52fb15992ea5a4__20210827_20210902&limit=2' 2024-11-13 10:58:14,320 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-11-13 10:58:14,352 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4c3e6011.hca_dev_248fcf0316c64a41b6ccaad4d894ca42__20210907_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, 'd8')\n " 2024-11-13 10:58:14,448 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_eaefa1b6dae14414953b17b0427d061e__20210827_20210903&limit=2' 2024-11-13 10:58:14,449 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-11-13 10:58:14,469 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "09eff02e-e30c-4f4d-bbd5-35652cc99171", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-bd995e95.hca_dev_842605c7375a47c59e2ca71c2c00fcad__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:14,480 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.160s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_6072616c87944b208f52fb15992ea5a4__20210827_20210902&limit=2 2024-11-13 10:58:14,480 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:14 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pnvE1qLg', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:14,480 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"19510524-bbb9-4883-9228-fcbee947d27e","name":"hca_dev_6072616c87944b208f52fb15...' 2024-11-13 10:58:14,481 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-0abea017:hca_dev_6072616c87944b208f52fb15992ea5a4__20210827_20210902:. 2024-11-13 10:58:14,481 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0abea017.hca_dev_6072616c87944b208f52fb15992ea5a4__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:14,517 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "5f928518-daa6-443a-a5a5-6a59336e6690", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1c2c69d9.hca_dev_24c654a5caa5440a8f02582921f2db4a__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:14,635 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.187s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_eaefa1b6dae14414953b17b0427d061e__20210827_20210903&limit=2 2024-11-13 10:58:14,636 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:14 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVYo4YMr', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:14,636 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"05ed25dc-408d-4045-998d-6166fc2c3293","name":"hca_dev_eaefa1b6dae14414953b17b0...' 2024-11-13 10:58:14,636 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-dbc3e131:hca_dev_eaefa1b6dae14414953b17b0427d061e__20210827_20210903:. 2024-11-13 10:58:14,636 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-dbc3e131.hca_dev_eaefa1b6dae14414953b17b0427d061e__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:14,658 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_87d52a86bdc7440cb84d170f7dc346d9__20210830_20210903&limit=2' 2024-11-13 10:58:14,658 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-11-13 10:58:14,732 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_955dfc2ca8c64d04aa4d907610545d11__20210831_20210903&limit=2' 2024-11-13 10:58:14,733 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-11-13 10:58:14,735 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "7fb341b4-3a9c-41ac-823f-1cf90ae5b216", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-a9252919.hca_dev_005d611a14d54fbf846e571a1f874f70__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:14,752 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "505514e6-03d6-48c4-b1d7-b2ae894a4fd5", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-279f1986.hca_dev_5ee710d7e2d54fe2818d15f5e31dae32__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:14,835 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.177s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_87d52a86bdc7440cb84d170f7dc346d9__20210830_20210903&limit=2 2024-11-13 10:58:14,835 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:14 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aKGkoPgQ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:14,835 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"0522bcb4-e8f9-4c0b-936b-b2d729cbcac7","name":"hca_dev_87d52a86bdc7440cb84d170f...' 2024-11-13 10:58:14,836 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-8eb2ffd1:hca_dev_87d52a86bdc7440cb84d170f7dc346d9__20210830_20210903:. 2024-11-13 10:58:14,836 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-8eb2ffd1.hca_dev_87d52a86bdc7440cb84d170f7dc346d9__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:14,855 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "e7783a75-1297-4805-933d-d7eb91ca2d6e", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-1005632d.hca_dev_d3ac7c1b53024804b611dad9f89c049d__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:14,877 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_7adede6a0ab745e69b67ffe7466bec1f__20210830_20210903&limit=2' 2024-11-13 10:58:14,878 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-11-13 10:58:14,909 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.175s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_955dfc2ca8c64d04aa4d907610545d11__20210831_20210903&limit=2 2024-11-13 10:58:14,909 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:14 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ekRWEyQO', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:14,909 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"d8ee3cfa-32c9-49c2-b1ae-af0a7bb1c98d","name":"hca_dev_955dfc2ca8c64d04aa4d9076...' 2024-11-13 10:58:14,910 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-788c3b52:hca_dev_955dfc2ca8c64d04aa4d907610545d11__20210831_20210903:. 2024-11-13 10:58:14,910 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-788c3b52.hca_dev_955dfc2ca8c64d04aa4d907610545d11__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:14,928 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_027c51c60719469fa7f5640fe57cbece__20210827_20210902&limit=2' 2024-11-13 10:58:14,928 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-11-13 10:58:15,011 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_83f5188e3bf749569544cea4f8997756__20210929_20211007&limit=2' 2024-11-13 10:58:15,013 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-11-13 10:58:15,070 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.192s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_7adede6a0ab745e69b67ffe7466bec1f__20210830_20210903&limit=2 2024-11-13 10:58:15,070 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:15 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e4EJ8rv4', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:15,070 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"a73ed2f2-12c7-4c71-a09d-3189b0fedc26","name":"hca_dev_7adede6a0ab745e69b67ffe7...' 2024-11-13 10:58:15,070 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-4747d8fe:hca_dev_7adede6a0ab745e69b67ffe7466bec1f__20210830_20210903:. 2024-11-13 10:58:15,071 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4747d8fe.hca_dev_7adede6a0ab745e69b67ffe7466bec1f__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:15,111 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.182s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_027c51c60719469fa7f5640fe57cbece__20210827_20210902&limit=2 2024-11-13 10:58:15,111 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:15 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eXnrA3RQ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:15,111 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"7b6a1bb0-7da1-4975-bd61-04865a1dc296","name":"hca_dev_027c51c60719469fa7f5640f...' 2024-11-13 10:58:15,111 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-c148d39c:hca_dev_027c51c60719469fa7f5640fe57cbece__20210827_20210902:. 2024-11-13 10:58:15,112 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c148d39c.hca_dev_027c51c60719469fa7f5640fe57cbece__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:15,172 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "ebafe28b-7f80-4875-a544-e8e659405e87", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4c3e6011.hca_dev_248fcf0316c64a41b6ccaad4d894ca42__20210907_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, 'd8')\n "} 2024-11-13 10:58:15,187 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.173s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_83f5188e3bf749569544cea4f8997756__20210929_20211007&limit=2 2024-11-13 10:58:15,187 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:15 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'emddRbBa', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:15,187 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"92166035-2bfc-412b-91a5-fdff874967b2","name":"hca_dev_83f5188e3bf749569544cea4...' 2024-11-13 10:58:15,187 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-560ee3d1:hca_dev_83f5188e3bf749569544cea4f8997756__20210929_20211007:. 2024-11-13 10:58:15,188 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-560ee3d1.hca_dev_83f5188e3bf749569544cea4f8997756__20210929_20211007.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:15,320 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f81efc039f564354aabb6ce819c3d414__20210827_20210903&limit=2' 2024-11-13 10:58:15,320 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-11-13 10:58:15,352 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "b6c7dc08-a1fe-40ad-b999-a06a0423efe1", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0abea017.hca_dev_6072616c87944b208f52fb15992ea5a4__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:15,483 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "bcd00b4d-87fe-4dab-a9c5-4f9c75d6d490", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-dbc3e131.hca_dev_eaefa1b6dae14414953b17b0427d061e__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:15,493 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.173s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f81efc039f564354aabb6ce819c3d414__20210827_20210903&limit=2 2024-11-13 10:58:15,494 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:15 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ekRWWwbO', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:15,494 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"2c5901f6-67bf-40cc-aea1-621a60c19baa","name":"hca_dev_f81efc039f564354aabb6ce8...' 2024-11-13 10:58:15,494 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-10f0610a:hca_dev_f81efc039f564354aabb6ce819c3d414__20210827_20210903:. 2024-11-13 10:58:15,494 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-10f0610a.hca_dev_f81efc039f564354aabb6ce819c3d414__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:15,504 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0abea017.hca_dev_6072616c87944b208f52fb15992ea5a4__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, 'a')\n " 2024-11-13 10:58:15,645 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-dbc3e131.hca_dev_eaefa1b6dae14414953b17b0427d061e__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '0')\n " 2024-11-13 10:58:15,668 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "8a3db68f-115f-446c-a9eb-49750b79f2e5", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-8eb2ffd1.hca_dev_87d52a86bdc7440cb84d170f7dc346d9__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:15,772 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "b9f626fb-7c5a-44cb-8fc8-0042df65f4f0", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-788c3b52.hca_dev_955dfc2ca8c64d04aa4d907610545d11__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:15,828 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-8eb2ffd1.hca_dev_87d52a86bdc7440cb84d170f7dc346d9__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:15,889 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "7da98bf1-1d45-4924-934b-04d7af38386e", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4747d8fe.hca_dev_7adede6a0ab745e69b67ffe7466bec1f__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:15,944 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "e3d29101-3539-4e0d-8aaf-5a9d0751b764", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c148d39c.hca_dev_027c51c60719469fa7f5640fe57cbece__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:15,956 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "fda9e8bc-7882-47ee-af22-29bf343a506c", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-560ee3d1.hca_dev_83f5188e3bf749569544cea4f8997756__20210929_20211007.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:15,966 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-788c3b52.hca_dev_955dfc2ca8c64d04aa4d907610545d11__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:16,060 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4747d8fe.hca_dev_7adede6a0ab745e69b67ffe7466bec1f__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '04')\n " 2024-11-13 10:58:16,103 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c148d39c.hca_dev_027c51c60719469fa7f5640fe57cbece__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:16,112 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-560ee3d1.hca_dev_83f5188e3bf749569544cea4f8997756__20210929_20211007.links`\n WHERE STARTS_WITH(datarepo_row_id, 'b4')\n " 2024-11-13 10:58:16,373 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "cb8f145c-4e0f-408d-8596-a2707d211349", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0abea017.hca_dev_6072616c87944b208f52fb15992ea5a4__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, 'a')\n "} 2024-11-13 10:58:16,412 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "24287ad7-2b9a-4c4b-820e-95db85781e1c", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-10f0610a.hca_dev_f81efc039f564354aabb6ce819c3d414__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:16,428 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "7bdf8ef1-dcc1-4c5b-8f85-4758d710d339", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-dbc3e131.hca_dev_eaefa1b6dae14414953b17b0427d061e__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '0')\n "} 2024-11-13 10:58:16,516 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2043c65a1cf84828a6569e247d4e64f1__20210831_20210907&limit=2' 2024-11-13 10:58:16,517 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-11-13 10:58:16,524 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "aa6d354e-3554-4e5e-ac86-79e84b0f684e", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-8eb2ffd1.hca_dev_87d52a86bdc7440cb84d170f7dc346d9__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:16,563 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-10f0610a.hca_dev_f81efc039f564354aabb6ce819c3d414__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:16,589 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0792db3480474e62802c9177c9cd8e28__20210827_20210903&limit=2' 2024-11-13 10:58:16,589 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-11-13 10:58:16,697 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_08b794a0519c4516b184c583746254c5__20210901_20210903&limit=2' 2024-11-13 10:58:16,698 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-11-13 10:58:16,702 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.184s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2043c65a1cf84828a6569e247d4e64f1__20210831_20210907&limit=2 2024-11-13 10:58:16,703 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:16 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ekL1OM7x', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:16,703 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e889c6f4-8783-46d6-89bc-8ab9685edf35","name":"hca_dev_2043c65a1cf84828a6569e24...' 2024-11-13 10:58:16,704 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-76de829d:hca_dev_2043c65a1cf84828a6569e247d4e64f1__20210831_20210907:. 2024-11-13 10:58:16,704 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-76de829d.hca_dev_2043c65a1cf84828a6569e247d4e64f1__20210831_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:16,724 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "e6280f0c-6285-4bc4-80ce-2bafa110c82e", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-788c3b52.hca_dev_955dfc2ca8c64d04aa4d907610545d11__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:16,766 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.177s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0792db3480474e62802c9177c9cd8e28__20210827_20210903&limit=2 2024-11-13 10:58:16,766 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:16 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6z0q9qPk', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:16,766 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"d74bbb92-2f76-4637-b386-4a60eec93e28","name":"hca_dev_0792db3480474e62802c9177...' 2024-11-13 10:58:16,766 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-baa2812f:hca_dev_0792db3480474e62802c9177c9cd8e28__20210827_20210903:. 2024-11-13 10:58:16,767 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-baa2812f.hca_dev_0792db3480474e62802c9177c9cd8e28__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:16,858 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "f85c21d3-e693-4071-b32e-5f52f0f62fbe", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c148d39c.hca_dev_027c51c60719469fa7f5640fe57cbece__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:16,868 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "8b05f202-7b83-4279-819f-d413907db587", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4747d8fe.hca_dev_7adede6a0ab745e69b67ffe7466bec1f__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '04')\n "} 2024-11-13 10:58:16,878 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a29952d9925e40f48a1c274f118f1f51__20210827_20210902&limit=2' 2024-11-13 10:58:16,879 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-11-13 10:58:16,880 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.181s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_08b794a0519c4516b184c583746254c5__20210901_20210903&limit=2 2024-11-13 10:58:16,880 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:16 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eRJQPVW4', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:16,880 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"f7eefeb5-4198-4d9a-b3db-f2db6a567a15","name":"hca_dev_08b794a0519c4516b184c583...' 2024-11-13 10:58:16,881 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-38e08b5c:hca_dev_08b794a0519c4516b184c583746254c5__20210901_20210903:. 2024-11-13 10:58:16,881 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-38e08b5c.hca_dev_08b794a0519c4516b184c583746254c5__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:16,948 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "3d917801-a335-47e2-9e6d-749cebd34ffb", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-560ee3d1.hca_dev_83f5188e3bf749569544cea4f8997756__20210929_20211007.links`\n WHERE STARTS_WITH(datarepo_row_id, 'b4')\n "} 2024-11-13 10:58:17,011 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_df88f39f01a84b5b92f43177d6c0f242__20210827_20230215&limit=2' 2024-11-13 10:58:17,013 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-11-13 10:58:17,025 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_520afa10f9d24e93ab7a26c4c863ce18__20210827_20210928&limit=2' 2024-11-13 10:58:17,025 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-11-13 10:58:17,053 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.174s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a29952d9925e40f48a1c274f118f1f51__20210827_20210902&limit=2 2024-11-13 10:58:17,053 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:17 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eybkkYvl', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:17,054 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"68598166-b4e2-49a0-b025-51a0159f6649","name":"hca_dev_a29952d9925e40f48a1c274f...' 2024-11-13 10:58:17,054 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-9ec7beb6:hca_dev_a29952d9925e40f48a1c274f118f1f51__20210827_20210902:. 2024-11-13 10:58:17,054 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-9ec7beb6.hca_dev_a29952d9925e40f48a1c274f118f1f51__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:17,084 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_16ed4ad8731946b288596fe1c1d73a82__20210830_20210903&limit=2' 2024-11-13 10:58:17,084 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-11-13 10:58:17,203 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.190s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_df88f39f01a84b5b92f43177d6c0f242__20210827_20230215&limit=2 2024-11-13 10:58:17,203 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:17 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pn3Gj7Qq', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:17,204 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"07bd9e9a-f3d5-4ce7-a7b5-a82cf5ede5b9","name":"hca_dev_df88f39f01a84b5b92f43177...' 2024-11-13 10:58:17,205 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-8709b362:hca_dev_df88f39f01a84b5b92f43177d6c0f242__20210827_20230215:. 2024-11-13 10:58:17,206 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-8709b362.hca_dev_df88f39f01a84b5b92f43177d6c0f242__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:17,212 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.187s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_520afa10f9d24e93ab7a26c4c863ce18__20210827_20210928&limit=2 2024-11-13 10:58:17,212 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:17 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a9lPlmg6', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:17,212 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"768c4624-c07b-4496-8b7b-76275a149774","name":"hca_dev_520afa10f9d24e93ab7a26c4...' 2024-11-13 10:58:17,212 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-71de019e:hca_dev_520afa10f9d24e93ab7a26c4c863ce18__20210827_20210928:. 2024-11-13 10:58:17,213 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-71de019e.hca_dev_520afa10f9d24e93ab7a26c4c863ce18__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:17,265 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.180s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_16ed4ad8731946b288596fe1c1d73a82__20210830_20210903&limit=2 2024-11-13 10:58:17,265 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:17 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e4WrVX8W', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:17,265 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"d1437ee2-cfb9-4635-822d-8593da2954fa","name":"hca_dev_16ed4ad8731946b288596fe1...' 2024-11-13 10:58:17,265 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-4de1b9fd:hca_dev_16ed4ad8731946b288596fe1c1d73a82__20210830_20210903:. 2024-11-13 10:58:17,266 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4de1b9fd.hca_dev_16ed4ad8731946b288596fe1c1d73a82__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:17,364 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "bf69068b-f978-4ce2-8e30-a84566e981b4", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-10f0610a.hca_dev_f81efc039f564354aabb6ce819c3d414__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:17,525 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ce33dde2382d448cb6acbfb424644f23__20210827_20210928&limit=2' 2024-11-13 10:58:17,525 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-11-13 10:58:17,552 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "49e91ac4-d165-47fa-8fd4-5761caa3158e", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-baa2812f.hca_dev_0792db3480474e62802c9177c9cd8e28__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:17,592 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "c2f54e68-487c-4a74-accf-b95d05148bde", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-76de829d.hca_dev_2043c65a1cf84828a6569e247d4e64f1__20210831_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:17,691 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.166s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ce33dde2382d448cb6acbfb424644f23__20210827_20210928&limit=2 2024-11-13 10:58:17,691 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:17 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aA3bdK3n', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:17,691 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"104f2254-2af9-4699-9573-00d2da718430","name":"hca_dev_ce33dde2382d448cb6acbfb4...' 2024-11-13 10:58:17,691 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-f4cb2365:hca_dev_ce33dde2382d448cb6acbfb424644f23__20210827_20210928:. 2024-11-13 10:58:17,692 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f4cb2365.hca_dev_ce33dde2382d448cb6acbfb424644f23__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:17,712 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-baa2812f.hca_dev_0792db3480474e62802c9177c9cd8e28__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '9a')\n " 2024-11-13 10:58:17,749 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-76de829d.hca_dev_2043c65a1cf84828a6569e247d4e64f1__20210831_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '5c')\n " 2024-11-13 10:58:17,769 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "844ca0c8-7a1f-41e3-8869-27b85c7bf468", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-38e08b5c.hca_dev_08b794a0519c4516b184c583746254c5__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:17,912 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "9e04a556-deac-4957-b1a9-338102532978", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-9ec7beb6.hca_dev_a29952d9925e40f48a1c274f118f1f51__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:17,927 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-38e08b5c.hca_dev_08b794a0519c4516b184c583746254c5__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:18,086 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "39464d6e-1453-404b-83bf-dee44475247f", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-8709b362.hca_dev_df88f39f01a84b5b92f43177d6c0f242__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:18,092 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-9ec7beb6.hca_dev_a29952d9925e40f48a1c274f118f1f51__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:18,112 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "60c77d40-74a5-47d7-bc84-8702c71e3b74", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-71de019e.hca_dev_520afa10f9d24e93ab7a26c4c863ce18__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:18,276 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "880025fb-eac1-45e2-8223-0e57141c295e", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4de1b9fd.hca_dev_16ed4ad8731946b288596fe1c1d73a82__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:18,296 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-8709b362.hca_dev_df88f39f01a84b5b92f43177d6c0f242__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:18,313 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-71de019e.hca_dev_520afa10f9d24e93ab7a26c4c863ce18__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '8')\n " 2024-11-13 10:58:18,420 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4de1b9fd.hca_dev_16ed4ad8731946b288596fe1c1d73a82__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:18,471 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "1a89d0ce-a38a-48be-9a03-f502dd0f28ec", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-baa2812f.hca_dev_0792db3480474e62802c9177c9cd8e28__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '9a')\n "} 2024-11-13 10:58:18,537 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "036d8588-bea7-41ea-b3b7-21f9890bb3b1", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-76de829d.hca_dev_2043c65a1cf84828a6569e247d4e64f1__20210831_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '5c')\n "} 2024-11-13 10:58:18,543 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "14e12c15-e69f-4705-8c59-6daac7d4b469", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f4cb2365.hca_dev_ce33dde2382d448cb6acbfb424644f23__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:18,660 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0fd8f91862d64b8bac354c53dd601f71__20210830_20210903&limit=2' 2024-11-13 10:58:18,660 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-11-13 10:58:18,698 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f4cb2365.hca_dev_ce33dde2382d448cb6acbfb424644f23__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, 'c')\n " 2024-11-13 10:58:18,713 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_bd40033154b94fccbff66bb8b079ee1f__20210901_20210903&limit=2' 2024-11-13 10:58:18,713 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-11-13 10:58:18,796 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "672aba56-43ee-4c5b-841f-2545b633e471", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-38e08b5c.hca_dev_08b794a0519c4516b184c583746254c5__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:18,838 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.177s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0fd8f91862d64b8bac354c53dd601f71__20210830_20210903&limit=2 2024-11-13 10:58:18,838 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:18 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a0EAnmGq', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:18,838 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"f142a2f7-4c50-458d-a047-27bdb8e0d367","name":"hca_dev_0fd8f91862d64b8bac354c53...' 2024-11-13 10:58:18,838 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-78bae095:hca_dev_0fd8f91862d64b8bac354c53dd601f71__20210830_20210903:. 2024-11-13 10:58:18,839 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-78bae095.hca_dev_0fd8f91862d64b8bac354c53dd601f71__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:18,886 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.173s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_bd40033154b94fccbff66bb8b079ee1f__20210901_20210903&limit=2 2024-11-13 10:58:18,886 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:18 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pomWY1go', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:18,887 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"879a755b-ebc0-4ebb-b4ad-6c89054c4851","name":"hca_dev_bd40033154b94fccbff66bb8...' 2024-11-13 10:58:18,887 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-376d3f4a:hca_dev_bd40033154b94fccbff66bb8b079ee1f__20210901_20210903:. 2024-11-13 10:58:18,887 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-376d3f4a.hca_dev_bd40033154b94fccbff66bb8b079ee1f__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:18,907 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "d813e875-ea71-4a27-9c19-08ab648f13c6", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-9ec7beb6.hca_dev_a29952d9925e40f48a1c274f118f1f51__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:18,940 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f83165c5e2ea4d15a5cf33f3550bffde__20210901_20210908&limit=2' 2024-11-13 10:58:18,940 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-11-13 10:58:19,008 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "6ca630e6-ae54-40e7-9d37-661bf99dce88", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-8709b362.hca_dev_df88f39f01a84b5b92f43177d6c0f242__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:19,057 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e5d455791f5b48c3b568320d93e7ca72__20210827_20210903&limit=2' 2024-11-13 10:58:19,058 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-11-13 10:58:19,126 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "1a9b434c-6c97-4ad4-b5d0-2e3cceb65c17", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-71de019e.hca_dev_520afa10f9d24e93ab7a26c4c863ce18__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '8')\n "} 2024-11-13 10:58:19,127 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.186s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f83165c5e2ea4d15a5cf33f3550bffde__20210901_20210908&limit=2 2024-11-13 10:58:19,128 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:19 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVGrRAzq', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:19,128 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e9fb5a5a-6eca-40b4-a894-3a3c65b7908e","name":"hca_dev_f83165c5e2ea4d15a5cf33f3...' 2024-11-13 10:58:19,128 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-24e9529e:hca_dev_f83165c5e2ea4d15a5cf33f3550bffde__20210901_20210908:. 2024-11-13 10:58:19,129 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-24e9529e.hca_dev_f83165c5e2ea4d15a5cf33f3550bffde__20210901_20210908.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:19,144 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "acfd0c36-4af3-42f5-9072-40a5ffce98a9", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4de1b9fd.hca_dev_16ed4ad8731946b288596fe1c1d73a82__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:19,165 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_091cf39b01bc42e59437f419a66c8a45__20210830_20210903&limit=2' 2024-11-13 10:58:19,166 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-11-13 10:58:19,260 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.202s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e5d455791f5b48c3b568320d93e7ca72__20210827_20210903&limit=2 2024-11-13 10:58:19,260 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:19 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a8zg5Nzk', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:19,260 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"69d49001-0f5f-46a8-8396-b83fd1c41e6b","name":"hca_dev_e5d455791f5b48c3b568320d...' 2024-11-13 10:58:19,261 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-3faef568:hca_dev_e5d455791f5b48c3b568320d93e7ca72__20210827_20210903:. 2024-11-13 10:58:19,261 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3faef568.hca_dev_e5d455791f5b48c3b568320d93e7ca72__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:19,301 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_4d6f6c962a8343d88fe10f53bffd4674__20210901_20210903&limit=2' 2024-11-13 10:58:19,301 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-11-13 10:58:19,319 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_3cfcdff5dee14a7ba591c09c6e850b11__20210827_20210903&limit=2' 2024-11-13 10:58:19,319 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-11-13 10:58:19,365 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.199s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_091cf39b01bc42e59437f419a66c8a45__20210830_20210903&limit=2 2024-11-13 10:58:19,365 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:19 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pLK2jkMZ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:19,365 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e1ab6579-ea65-45a7-abea-869b055b5a6a","name":"hca_dev_091cf39b01bc42e59437f419...' 2024-11-13 10:58:19,365 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-2749da57:hca_dev_091cf39b01bc42e59437f419a66c8a45__20210830_20210903:. 2024-11-13 10:58:19,366 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2749da57.hca_dev_091cf39b01bc42e59437f419a66c8a45__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:19,592 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "9a1dd3d6-7e4b-4601-932f-f13d1ebfd07f", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f4cb2365.hca_dev_ce33dde2382d448cb6acbfb424644f23__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, 'c')\n "} 2024-11-13 10:58:19,611 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.310s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_4d6f6c962a8343d88fe10f53bffd4674__20210901_20210903&limit=2 2024-11-13 10:58:19,612 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:19 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eb13DzJB', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:19,612 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"40f2f1d0-f5f4-4847-9e65-5865f2cea4fe","name":"hca_dev_4d6f6c962a8343d88fe10f53...' 2024-11-13 10:58:19,612 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-f31edbc2:hca_dev_4d6f6c962a8343d88fe10f53bffd4674__20210901_20210903:. 2024-11-13 10:58:19,613 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f31edbc2.hca_dev_4d6f6c962a8343d88fe10f53bffd4674__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:19,616 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.297s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_3cfcdff5dee14a7ba591c09c6e850b11__20210827_20210903&limit=2 2024-11-13 10:58:19,616 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:19 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eOKnxVq4', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:19,617 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"8635ff71-8513-48ea-a8d9-f4432f6fcc32","name":"hca_dev_3cfcdff5dee14a7ba591c09c...' 2024-11-13 10:58:19,617 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-b08233fa:hca_dev_3cfcdff5dee14a7ba591c09c6e850b11__20210827_20210903:. 2024-11-13 10:58:19,617 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b08233fa.hca_dev_3cfcdff5dee14a7ba591c09c6e850b11__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:19,749 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2a72a4e566b2405abb7c1e463e8febb0__20210901_20210903&limit=2' 2024-11-13 10:58:19,749 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-11-13 10:58:19,766 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "f69f8822-56c7-4521-84e5-130c14186a62", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-376d3f4a.hca_dev_bd40033154b94fccbff66bb8b079ee1f__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:19,800 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "21296a02-540c-4a45-a190-ed73942420a6", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-78bae095.hca_dev_0fd8f91862d64b8bac354c53dd601f71__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:19,920 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-376d3f4a.hca_dev_bd40033154b94fccbff66bb8b079ee1f__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:19,943 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-78bae095.hca_dev_0fd8f91862d64b8bac354c53dd601f71__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:19,944 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.195s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2a72a4e566b2405abb7c1e463e8febb0__20210901_20210903&limit=2 2024-11-13 10:58:19,944 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:19 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e2kWvLA1', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:19,945 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"743190c3-fb25-4ccc-9e66-f076ca624c03","name":"hca_dev_2a72a4e566b2405abb7c1e46...' 2024-11-13 10:58:19,945 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-4cf05ce2:hca_dev_2a72a4e566b2405abb7c1e463e8febb0__20210901_20210903:. 2024-11-13 10:58:19,945 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4cf05ce2.hca_dev_2a72a4e566b2405abb7c1e463e8febb0__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:19,968 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "e4880d8f-4d2e-4a03-9033-ecbf35389c45", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-24e9529e.hca_dev_f83165c5e2ea4d15a5cf33f3550bffde__20210901_20210908.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:20,136 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-24e9529e.hca_dev_f83165c5e2ea4d15a5cf33f3550bffde__20210901_20210908.links`\n WHERE STARTS_WITH(datarepo_row_id, 'ee')\n " 2024-11-13 10:58:20,154 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "94dca6b8-7b62-49b9-9dfa-8bb0e2aa6ac7", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2749da57.hca_dev_091cf39b01bc42e59437f419a66c8a45__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:20,256 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "6020846d-9aff-412d-aefd-4b274d5e62f0", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3faef568.hca_dev_e5d455791f5b48c3b568320d93e7ca72__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:20,305 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2749da57.hca_dev_091cf39b01bc42e59437f419a66c8a45__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:20,431 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3faef568.hca_dev_e5d455791f5b48c3b568320d93e7ca72__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:20,451 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "2eab213a-788c-41cc-8d86-7bbc4f62dd19", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f31edbc2.hca_dev_4d6f6c962a8343d88fe10f53bffd4674__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:20,595 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f31edbc2.hca_dev_4d6f6c962a8343d88fe10f53bffd4674__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:20,643 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "3ae4ce59-f0ab-457f-b95a-42fdeb925302", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-376d3f4a.hca_dev_bd40033154b94fccbff66bb8b079ee1f__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:20,652 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "20077379-7d57-47fd-9684-d024ae0e85c8", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b08233fa.hca_dev_3cfcdff5dee14a7ba591c09c6e850b11__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:20,740 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "984f3bcb-3ced-4e19-b54a-fbc07f37ea4a", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-78bae095.hca_dev_0fd8f91862d64b8bac354c53dd601f71__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:20,761 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "8cded3a1-8617-489b-a13c-a61cdb297275", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4cf05ce2.hca_dev_2a72a4e566b2405abb7c1e463e8febb0__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:20,809 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_05657a599f9d4bb9b77b24be13aa5cea__20210827_20230215&limit=2' 2024-11-13 10:58:20,809 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-11-13 10:58:20,824 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b08233fa.hca_dev_3cfcdff5dee14a7ba591c09c6e850b11__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:20,897 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_1c6a960d52ac44eab728a59c7ab9dc8e__20210827_20210928&limit=2' 2024-11-13 10:58:20,897 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-11-13 10:58:20,900 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4cf05ce2.hca_dev_2a72a4e566b2405abb7c1e463e8febb0__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '1f')\n " 2024-11-13 10:58:20,987 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "276d82d7-1178-460c-adf1-34ded7cf0240", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-24e9529e.hca_dev_f83165c5e2ea4d15a5cf33f3550bffde__20210901_20210908.links`\n WHERE STARTS_WITH(datarepo_row_id, 'ee')\n "} 2024-11-13 10:58:21,009 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.200s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_05657a599f9d4bb9b77b24be13aa5cea__20210827_20230215&limit=2 2024-11-13 10:58:21,009 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:21 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aGNYwBv6', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:21,010 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"a3b6a664-1afb-4b4f-bf08-63bab26c848f","name":"hca_dev_05657a599f9d4bb9b77b24be...' 2024-11-13 10:58:21,010 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-3d6d24ad:hca_dev_05657a599f9d4bb9b77b24be13aa5cea__20210827_20230215:. 2024-11-13 10:58:21,010 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3d6d24ad.hca_dev_05657a599f9d4bb9b77b24be13aa5cea__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:21,082 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.184s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_1c6a960d52ac44eab728a59c7ab9dc8e__20210827_20210928&limit=2 2024-11-13 10:58:21,082 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:21 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'plWybv7r', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:21,083 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"8a527b32-5ae3-437e-8a96-12562894849c","name":"hca_dev_1c6a960d52ac44eab728a59c...' 2024-11-13 10:58:21,083 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-135f340c:hca_dev_1c6a960d52ac44eab728a59c7ab9dc8e__20210827_20210928:. 2024-11-13 10:58:21,084 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-135f340c.hca_dev_1c6a960d52ac44eab728a59c7ab9dc8e__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:21,130 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "6cc26b35-b83e-4133-b7fc-a37c1571d027", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2749da57.hca_dev_091cf39b01bc42e59437f419a66c8a45__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:21,196 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_8787c23889ef4636a57d3167e8b54a80__20210827_20210903&limit=2' 2024-11-13 10:58:21,196 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-11-13 10:58:21,264 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "2a4da344-d775-44db-a878-a30cc83434af", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3faef568.hca_dev_e5d455791f5b48c3b568320d93e7ca72__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:21,319 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c715cd2fdc7c44a69cd5b6a6d9f075ae__20210827_20210902&limit=2' 2024-11-13 10:58:21,319 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-11-13 10:58:21,377 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.181s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_8787c23889ef4636a57d3167e8b54a80__20210827_20210903&limit=2 2024-11-13 10:58:21,377 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:21 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eRJwdD78', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:21,378 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"0559efce-d188-4a59-9f6f-2a6258ca7e79","name":"hca_dev_8787c23889ef4636a57d3167...' 2024-11-13 10:58:21,378 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-d0772077:hca_dev_8787c23889ef4636a57d3167e8b54a80__20210827_20210903:. 2024-11-13 10:58:21,378 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d0772077.hca_dev_8787c23889ef4636a57d3167e8b54a80__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:21,425 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_3a69470330844ece9abed935fd5f6748__20210901_20210903&limit=2' 2024-11-13 10:58:21,425 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-11-13 10:58:21,445 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "f10c9a69-3a16-45f6-93bd-681ab58a4e2d", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-f31edbc2.hca_dev_4d6f6c962a8343d88fe10f53bffd4674__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:21,497 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.178s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c715cd2fdc7c44a69cd5b6a6d9f075ae__20210827_20210902&limit=2 2024-11-13 10:58:21,497 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:21 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a5bjZn9m', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:21,498 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"c6e19201-4fae-4213-a16c-edfd0cc11335","name":"hca_dev_c715cd2fdc7c44a69cd5b6a6...' 2024-11-13 10:58:21,498 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-61b8d081:hca_dev_c715cd2fdc7c44a69cd5b6a6d9f075ae__20210827_20210902:. 2024-11-13 10:58:21,498 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-61b8d081.hca_dev_c715cd2fdc7c44a69cd5b6a6d9f075ae__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:21,625 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d012d4768f8c4ff389d6ebbe22c1b5c1__20210827_20210903&limit=2' 2024-11-13 10:58:21,625 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-11-13 10:58:21,644 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "a2a5a011-9acc-415c-998a-20da13ab39ca", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b08233fa.hca_dev_3cfcdff5dee14a7ba591c09c6e850b11__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:21,651 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.226s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_3a69470330844ece9abed935fd5f6748__20210901_20210903&limit=2 2024-11-13 10:58:21,651 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:21 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'poDZEZEj', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:21,651 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"01b1ac88-8144-428e-a84c-88e9ed8ec6a2","name":"hca_dev_3a69470330844ece9abed935...' 2024-11-13 10:58:21,651 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-40283c27:hca_dev_3a69470330844ece9abed935fd5f6748__20210901_20210903:. 2024-11-13 10:58:21,652 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-40283c27.hca_dev_3a69470330844ece9abed935fd5f6748__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:21,689 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "dcb69a61-1351-4e21-a6b6-b8dcb6166841", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4cf05ce2.hca_dev_2a72a4e566b2405abb7c1e463e8febb0__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '1f')\n "} 2024-11-13 10:58:21,807 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d3a4ceac4d66498497042570c0647a56__20210831_20210903&limit=2' 2024-11-13 10:58:21,807 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-11-13 10:58:21,809 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.184s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d012d4768f8c4ff389d6ebbe22c1b5c1__20210827_20210903&limit=2 2024-11-13 10:58:21,810 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:21 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aE4R0MdV', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:21,810 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"1c32d6d0-6249-4b0e-a3a4-3a262ed610ef","name":"hca_dev_d012d4768f8c4ff389d6ebbe...' 2024-11-13 10:58:21,810 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-0d6f73ac:hca_dev_d012d4768f8c4ff389d6ebbe22c1b5c1__20210827_20210903:. 2024-11-13 10:58:21,811 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0d6f73ac.hca_dev_d012d4768f8c4ff389d6ebbe22c1b5c1__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:21,845 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_63b5b6c1bbcd487d8c2e0095150c1ecd__20210830_20210903&limit=2' 2024-11-13 10:58:21,845 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-11-13 10:58:21,985 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "0687b9e8-6c73-41d4-a63c-98d89fee0bde", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3d6d24ad.hca_dev_05657a599f9d4bb9b77b24be13aa5cea__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:21,992 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "a02c610c-5b83-43e0-b063-fa8938ee9f92", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-135f340c.hca_dev_1c6a960d52ac44eab728a59c7ab9dc8e__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:21,995 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.187s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d3a4ceac4d66498497042570c0647a56__20210831_20210903&limit=2 2024-11-13 10:58:21,995 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:22 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pQ8yo2BQ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:21,996 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"ae52c25c-9ee4-4a42-83f2-6e4b20116380","name":"hca_dev_d3a4ceac4d66498497042570...' 2024-11-13 10:58:21,997 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-92c3a1de:hca_dev_d3a4ceac4d66498497042570c0647a56__20210831_20210903:. 2024-11-13 10:58:21,997 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-92c3a1de.hca_dev_d3a4ceac4d66498497042570c0647a56__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:22,019 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.174s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_63b5b6c1bbcd487d8c2e0095150c1ecd__20210830_20210903&limit=2 2024-11-13 10:58:22,019 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:22 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pldNMllr', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:22,019 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"9d173ed8-c0ff-4a43-baf5-eb30ea7fba6d","name":"hca_dev_63b5b6c1bbcd487d8c2e0095...' 2024-11-13 10:58:22,020 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-c3d623dc:hca_dev_63b5b6c1bbcd487d8c2e0095150c1ecd__20210830_20210903:. 2024-11-13 10:58:22,020 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c3d623dc.hca_dev_63b5b6c1bbcd487d8c2e0095150c1ecd__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:22,144 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3d6d24ad.hca_dev_05657a599f9d4bb9b77b24be13aa5cea__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '8')\n " 2024-11-13 10:58:22,163 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-135f340c.hca_dev_1c6a960d52ac44eab728a59c7ab9dc8e__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:22,178 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "b91d1909-60a1-4ea9-8b39-4f411ebd382c", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d0772077.hca_dev_8787c23889ef4636a57d3167e8b54a80__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:22,324 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d0772077.hca_dev_8787c23889ef4636a57d3167e8b54a80__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:22,396 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "d60d4ce9-52b9-4612-81bd-4e08605875d2", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-61b8d081.hca_dev_c715cd2fdc7c44a69cd5b6a6d9f075ae__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:22,556 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-61b8d081.hca_dev_c715cd2fdc7c44a69cd5b6a6d9f075ae__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:22,600 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "f2be2d23-1826-4671-b8d4-043b79b606f3", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-40283c27.hca_dev_3a69470330844ece9abed935fd5f6748__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:22,716 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "6f3101f1-1705-4df7-aa8d-43d25b5cb528", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0d6f73ac.hca_dev_d012d4768f8c4ff389d6ebbe22c1b5c1__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:22,766 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-40283c27.hca_dev_3a69470330844ece9abed935fd5f6748__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, 'c')\n " 2024-11-13 10:58:22,876 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0d6f73ac.hca_dev_d012d4768f8c4ff389d6ebbe22c1b5c1__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:22,892 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "37f9b714-4421-4852-8439-bf16c80382c2", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c3d623dc.hca_dev_63b5b6c1bbcd487d8c2e0095150c1ecd__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:22,966 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "8597a2e5-a25c-418b-a649-c1152758b5b4", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3d6d24ad.hca_dev_05657a599f9d4bb9b77b24be13aa5cea__20210827_20230215.links`\n WHERE STARTS_WITH(datarepo_row_id, '8')\n "} 2024-11-13 10:58:22,970 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "7428272c-20b2-4a96-bb8e-378da306aeeb", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-135f340c.hca_dev_1c6a960d52ac44eab728a59c7ab9dc8e__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:23,008 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "624f297b-2f27-4c46-afd6-8fc8697b4a61", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-92c3a1de.hca_dev_d3a4ceac4d66498497042570c0647a56__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:23,039 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c3d623dc.hca_dev_63b5b6c1bbcd487d8c2e0095150c1ecd__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:23,122 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_996120f9e84f409fa01e732ab58ca8b9__20210827_20210903&limit=2' 2024-11-13 10:58:23,124 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-11-13 10:58:23,128 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_962bd805eb894c54bad2008e497d1307__20210830_20210903&limit=2' 2024-11-13 10:58:23,129 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-11-13 10:58:23,160 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-92c3a1de.hca_dev_d3a4ceac4d66498497042570c0647a56__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:23,179 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "14c0c3ca-eba2-453e-97d7-c142ff2844a0", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d0772077.hca_dev_8787c23889ef4636a57d3167e8b54a80__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:23,316 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.187s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_962bd805eb894c54bad2008e497d1307__20210830_20210903&limit=2 2024-11-13 10:58:23,316 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:23 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6qW7RNqw', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:23,316 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"98f112bc-743e-4f38-8b7a-6efb08802ef0","name":"hca_dev_962bd805eb894c54bad2008e...' 2024-11-13 10:58:23,317 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-4b88b45b:hca_dev_962bd805eb894c54bad2008e497d1307__20210830_20210903:. 2024-11-13 10:58:23,317 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4b88b45b.hca_dev_962bd805eb894c54bad2008e497d1307__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:23,322 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.197s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_996120f9e84f409fa01e732ab58ca8b9__20210827_20210903&limit=2 2024-11-13 10:58:23,323 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:23 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'er5925do', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:23,323 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"830b26f1-f900-40ca-a69d-eb530d73703f","name":"hca_dev_996120f9e84f409fa01e732a...' 2024-11-13 10:58:23,323 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-75589244:hca_dev_996120f9e84f409fa01e732ab58ca8b9__20210827_20210903:. 2024-11-13 10:58:23,323 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-75589244.hca_dev_996120f9e84f409fa01e732ab58ca8b9__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:23,352 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_71436067ac414acebe1b2fbcc2cb02fa__20210827_20210928&limit=2' 2024-11-13 10:58:23,352 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-11-13 10:58:23,383 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "19f9afd2-8ad4-42a2-ba5a-99fcfec5a69b", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-61b8d081.hca_dev_c715cd2fdc7c44a69cd5b6a6d9f075ae__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:23,525 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.173s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_71436067ac414acebe1b2fbcc2cb02fa__20210827_20210928&limit=2 2024-11-13 10:58:23,525 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:23 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a5Mmgv8a', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:23,525 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"2e0b01ae-bf72-43a6-864a-4419af665b80","name":"hca_dev_71436067ac414acebe1b2fbc...' 2024-11-13 10:58:23,526 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-3545971c:hca_dev_71436067ac414acebe1b2fbcc2cb02fa__20210827_20210928:. 2024-11-13 10:58:23,526 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3545971c.hca_dev_71436067ac414acebe1b2fbcc2cb02fa__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:23,545 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e77fed30959d4fadbc15a0a5a85c21d2__20210830_20210903&limit=2' 2024-11-13 10:58:23,545 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-11-13 10:58:23,640 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "bc8060f8-35d9-41e9-8253-7a5353a691e2", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-40283c27.hca_dev_3a69470330844ece9abed935fd5f6748__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, 'c')\n "} 2024-11-13 10:58:23,672 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "a404f70a-abfa-4c41-8170-2499f7bb05d0", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0d6f73ac.hca_dev_d012d4768f8c4ff389d6ebbe22c1b5c1__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:23,724 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.179s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e77fed30959d4fadbc15a0a5a85c21d2__20210830_20210903&limit=2 2024-11-13 10:58:23,725 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:23 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6dDkq58b', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:23,725 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"f5a609de-0760-4a39-b633-9d751aa7d472","name":"hca_dev_e77fed30959d4fadbc15a0a5...' 2024-11-13 10:58:23,725 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-e304a8fe:hca_dev_e77fed30959d4fadbc15a0a5a85c21d2__20210830_20210903:. 2024-11-13 10:58:23,726 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e304a8fe.hca_dev_e77fed30959d4fadbc15a0a5a85c21d2__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:23,833 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "aa1e3fec-d559-4bb6-aa24-148a04471049", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-c3d623dc.hca_dev_63b5b6c1bbcd487d8c2e0095150c1ecd__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:23,849 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a96b71c078a742d188ce83c78925cfeb__20210827_20210902&limit=2' 2024-11-13 10:58:23,849 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-11-13 10:58:23,986 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_4bec484dca7a47b48d488830e06ad6db__20210830_20210903&limit=2' 2024-11-13 10:58:23,987 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-11-13 10:58:24,022 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.173s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a96b71c078a742d188ce83c78925cfeb__20210827_20210902&limit=2 2024-11-13 10:58:24,022 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:24 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e1EZ81WX', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:24,023 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"385eb563-005e-43ed-adb7-d3c9e0a8ae93","name":"hca_dev_a96b71c078a742d188ce83c7...' 2024-11-13 10:58:24,023 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-7b7daff7:hca_dev_a96b71c078a742d188ce83c78925cfeb__20210827_20210902:. 2024-11-13 10:58:24,024 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-7b7daff7.hca_dev_a96b71c078a742d188ce83c78925cfeb__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:24,090 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_7b947aa243a74082afff222a3e3a4635__20210831_20210907&limit=2' 2024-11-13 10:58:24,090 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-11-13 10:58:24,124 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "8667cc82-702f-433b-9cef-357d12817700", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-75589244.hca_dev_996120f9e84f409fa01e732ab58ca8b9__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:24,166 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.179s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_4bec484dca7a47b48d488830e06ad6db__20210830_20210903&limit=2 2024-11-13 10:58:24,166 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:24 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6JrXbmmG', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:24,166 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"f84e6b4a-719c-4c75-891c-be52c106c6b8","name":"hca_dev_4bec484dca7a47b48d488830...' 2024-11-13 10:58:24,167 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-a6c6b953:hca_dev_4bec484dca7a47b48d488830e06ad6db__20210830_20210903:. 2024-11-13 10:58:24,167 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-a6c6b953.hca_dev_4bec484dca7a47b48d488830e06ad6db__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:24,199 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "02837379-483a-47a8-aea4-1a3406ed01c9", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4b88b45b.hca_dev_962bd805eb894c54bad2008e497d1307__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:24,275 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.184s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_7b947aa243a74082afff222a3e3a4635__20210831_20210907&limit=2 2024-11-13 10:58:24,275 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:24 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eXErgMrp', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:24,275 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e0c597f8-4aa4-485c-b19c-c46b564550a5","name":"hca_dev_7b947aa243a74082afff222a...' 2024-11-13 10:58:24,275 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-aba01389:hca_dev_7b947aa243a74082afff222a3e3a4635__20210831_20210907:. 2024-11-13 10:58:24,275 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-aba01389.hca_dev_7b947aa243a74082afff222a3e3a4635__20210831_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:24,297 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-75589244.hca_dev_996120f9e84f409fa01e732ab58ca8b9__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:24,352 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4b88b45b.hca_dev_962bd805eb894c54bad2008e497d1307__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:24,375 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "abb401a0-ee97-43f8-910a-2fb67d657326", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-92c3a1de.hca_dev_d3a4ceac4d66498497042570c0647a56__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:24,448 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "36b2de79-b850-4ac0-90f5-2103658ed1b5", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3545971c.hca_dev_71436067ac414acebe1b2fbcc2cb02fa__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:24,529 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e8808cc84ca0409680f2bba73600cba6__20210902_20210907&limit=2' 2024-11-13 10:58:24,530 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-11-13 10:58:24,538 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "9cdba642-bd17-44bc-8f34-221fbc2a938c", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e304a8fe.hca_dev_e77fed30959d4fadbc15a0a5a85c21d2__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:24,616 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3545971c.hca_dev_71436067ac414acebe1b2fbcc2cb02fa__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:24,733 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e304a8fe.hca_dev_e77fed30959d4fadbc15a0a5a85c21d2__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, 'c')\n " 2024-11-13 10:58:24,796 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.266s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e8808cc84ca0409680f2bba73600cba6__20210902_20210907&limit=2 2024-11-13 10:58:24,796 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:24 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'awJwb9XJ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:24,797 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"cc6e85e6-6e30-4bf0-8c52-56fbd8a1bdaf","name":"hca_dev_e8808cc84ca0409680f2bba7...' 2024-11-13 10:58:24,797 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-6fdac3db:hca_dev_e8808cc84ca0409680f2bba73600cba6__20210902_20210907:. 2024-11-13 10:58:24,798 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-6fdac3db.hca_dev_e8808cc84ca0409680f2bba73600cba6__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:24,880 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "1722deda-75ba-46f8-95df-f442ad969d01", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-7b7daff7.hca_dev_a96b71c078a742d188ce83c78925cfeb__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:24,980 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "2f2bd49e-0795-4ebb-822d-147aa4fb5b14", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-a6c6b953.hca_dev_4bec484dca7a47b48d488830e06ad6db__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:25,046 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-7b7daff7.hca_dev_a96b71c078a742d188ce83c78925cfeb__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:25,066 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "25489fe2-d8dc-4fcc-8b07-101cffc4f5c3", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-aba01389.hca_dev_7b947aa243a74082afff222a3e3a4635__20210831_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:25,141 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-a6c6b953.hca_dev_4bec484dca7a47b48d488830e06ad6db__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:25,152 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "cd55ec3e-7f77-4fa8-9758-d668b618acb1", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-4b88b45b.hca_dev_962bd805eb894c54bad2008e497d1307__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:25,175 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "f1b10dbd-297c-4b4e-ba94-ce74eb152245", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-75589244.hca_dev_996120f9e84f409fa01e732ab58ca8b9__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:25,224 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-aba01389.hca_dev_7b947aa243a74082afff222a3e3a4635__20210831_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:25,310 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_116965f3f09447699d28ae675c1b569c__20210827_20210903&limit=2' 2024-11-13 10:58:25,311 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-11-13 10:58:25,316 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f86f1ab41fbb4510ae353ffd752d4dfc__20210901_20210903&limit=2' 2024-11-13 10:58:25,316 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-11-13 10:58:25,333 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "817fddf9-89f2-4247-839c-d321ec509718", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-3545971c.hca_dev_71436067ac414acebe1b2fbcc2cb02fa__20210827_20210928.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:25,468 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2d8460958a334f3c97d4585bafac13b4__20210902_20210907&limit=2' 2024-11-13 10:58:25,469 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-11-13 10:58:25,501 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.190s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_116965f3f09447699d28ae675c1b569c__20210827_20210903&limit=2 2024-11-13 10:58:25,501 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:25 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a5YgEg9W', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:25,502 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"a21be4c9-9778-4713-bc31-1a1c905a6ad3","name":"hca_dev_116965f3f09447699d28ae67...' 2024-11-13 10:58:25,502 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-ff0a2fe7:hca_dev_116965f3f09447699d28ae675c1b569c__20210827_20210903:. 2024-11-13 10:58:25,502 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ff0a2fe7.hca_dev_116965f3f09447699d28ae675c1b569c__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:25,505 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.189s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f86f1ab41fbb4510ae353ffd752d4dfc__20210901_20210903&limit=2 2024-11-13 10:58:25,505 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:25 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6znowA43', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:25,506 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"9b53159b-d0b8-44e7-8871-ca086529709c","name":"hca_dev_f86f1ab41fbb4510ae353ffd...' 2024-11-13 10:58:25,506 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-67240cf2:hca_dev_f86f1ab41fbb4510ae353ffd752d4dfc__20210901_20210903:. 2024-11-13 10:58:25,506 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-67240cf2.hca_dev_f86f1ab41fbb4510ae353ffd752d4dfc__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:25,579 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "428c93bf-3da2-4695-be58-8f674fae95d1", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e304a8fe.hca_dev_e77fed30959d4fadbc15a0a5a85c21d2__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, 'c')\n "} 2024-11-13 10:58:25,592 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "fd8a338a-aa65-4b70-ac0b-756cd6146c2e", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-6fdac3db.hca_dev_e8808cc84ca0409680f2bba73600cba6__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:25,643 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.174s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2d8460958a334f3c97d4585bafac13b4__20210902_20210907&limit=2 2024-11-13 10:58:25,643 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:25 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pYORzn1A', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:25,643 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"d15b9e6e-dd53-4b80-80f1-4c698300b15a","name":"hca_dev_2d8460958a334f3c97d4585b...' 2024-11-13 10:58:25,644 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-311340f6:hca_dev_2d8460958a334f3c97d4585bafac13b4__20210902_20210907:. 2024-11-13 10:58:25,644 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-311340f6.hca_dev_2d8460958a334f3c97d4585bafac13b4__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:25,735 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2ef3655a973d4d699b4121fa4041eed7__20210827_20210903&limit=2' 2024-11-13 10:58:25,736 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-11-13 10:58:25,737 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-6fdac3db.hca_dev_e8808cc84ca0409680f2bba73600cba6__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '1')\n " 2024-11-13 10:58:25,864 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "4357ce7e-6805-401f-b859-34f8b2e63d00", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-7b7daff7.hca_dev_a96b71c078a742d188ce83c78925cfeb__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:25,916 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.180s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2ef3655a973d4d699b4121fa4041eed7__20210827_20210903&limit=2 2024-11-13 10:58:25,916 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:25 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eOMYLQ44', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:25,917 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"a6ffed95-9d29-4484-a5db-c080a6278665","name":"hca_dev_2ef3655a973d4d699b4121fa...' 2024-11-13 10:58:25,917 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-766bfb76:hca_dev_2ef3655a973d4d699b4121fa4041eed7__20210827_20210903:. 2024-11-13 10:58:25,917 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-766bfb76.hca_dev_2ef3655a973d4d699b4121fa4041eed7__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:25,931 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "7084208d-1096-4f88-8498-b3bad6b0fd9e", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-a6c6b953.hca_dev_4bec484dca7a47b48d488830e06ad6db__20210830_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:26,012 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_dbcd4b1d31bd4eb594e150e8706fa192__20210827_20210902&limit=2' 2024-11-13 10:58:26,012 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-11-13 10:58:26,073 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "ca91f0ed-844e-47e5-baac-d6da4d16eea3", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-aba01389.hca_dev_7b947aa243a74082afff222a3e3a4635__20210831_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:26,080 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c893cb575c9f4f26931221b85be84313__20210901_20210903&limit=2' 2024-11-13 10:58:26,081 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-11-13 10:58:26,190 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.178s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_dbcd4b1d31bd4eb594e150e8706fa192__20210827_20210902&limit=2 2024-11-13 10:58:26,190 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:26 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6zV3RLmM', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:26,191 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"79f24905-a9e2-4328-91da-fc18036b77eb","name":"hca_dev_dbcd4b1d31bd4eb594e150e8...' 2024-11-13 10:58:26,191 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-dbc582d9:hca_dev_dbcd4b1d31bd4eb594e150e8706fa192__20210827_20210902:. 2024-11-13 10:58:26,191 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-dbc582d9.hca_dev_dbcd4b1d31bd4eb594e150e8706fa192__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:26,240 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_946c5add47d1402a97bba5af97e8bce7__20210831_20210903&limit=2' 2024-11-13 10:58:26,241 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-11-13 10:58:26,255 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.175s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c893cb575c9f4f26931221b85be84313__20210901_20210903&limit=2 2024-11-13 10:58:26,255 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:26 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pPLv9JPz', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:26,256 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"403ef1b1-7b7f-4e13-bf4a-d898f047310a","name":"hca_dev_c893cb575c9f4f26931221b8...' 2024-11-13 10:58:26,256 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-71926fdc:hca_dev_c893cb575c9f4f26931221b85be84313__20210901_20210903:. 2024-11-13 10:58:26,256 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-71926fdc.hca_dev_c893cb575c9f4f26931221b85be84313__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:26,376 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "ba8013d7-368b-48d6-8846-96e4aba6b6e5", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ff0a2fe7.hca_dev_116965f3f09447699d28ae675c1b569c__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:26,396 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "35da0a07-d03d-44ed-9df9-f08a58dc37a5", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-67240cf2.hca_dev_f86f1ab41fbb4510ae353ffd752d4dfc__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:26,440 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.199s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_946c5add47d1402a97bba5af97e8bce7__20210831_20210903&limit=2 2024-11-13 10:58:26,440 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:26 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'axRkrqdM', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:26,440 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"d7250e7a-20c6-42ff-9332-4bc5a5fd2470","name":"hca_dev_946c5add47d1402a97bba5af...' 2024-11-13 10:58:26,441 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-59d37b9a:hca_dev_946c5add47d1402a97bba5af97e8bce7__20210831_20210903:. 2024-11-13 10:58:26,441 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-59d37b9a.hca_dev_946c5add47d1402a97bba5af97e8bce7__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:26,544 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ff0a2fe7.hca_dev_116965f3f09447699d28ae675c1b569c__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:26,560 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-67240cf2.hca_dev_f86f1ab41fbb4510ae353ffd752d4dfc__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:26,650 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "3f9cb022-00bd-4586-aea7-e28c281580a9", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-6fdac3db.hca_dev_e8808cc84ca0409680f2bba73600cba6__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '1')\n "} 2024-11-13 10:58:26,664 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "2226bd58-c4ed-49c1-b871-58076c5898da", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-311340f6.hca_dev_2d8460958a334f3c97d4585bafac13b4__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:26,764 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "3ef64d42-15e0-48d8-832f-be6274bcd9d0", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-766bfb76.hca_dev_2ef3655a973d4d699b4121fa4041eed7__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:26,806 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_8c3c290ddfff4553886854ce45f4ba7f__20210902_20210907&limit=2' 2024-11-13 10:58:26,807 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-11-13 10:58:26,812 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-311340f6.hca_dev_2d8460958a334f3c97d4585bafac13b4__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '40')\n " 2024-11-13 10:58:26,930 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-766bfb76.hca_dev_2ef3655a973d4d699b4121fa4041eed7__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:26,985 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.178s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_8c3c290ddfff4553886854ce45f4ba7f__20210902_20210907&limit=2 2024-11-13 10:58:26,985 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:27 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pYAvLbno', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:26,985 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"2d6116af-ceb1-4324-ba47-65fbc4202028","name":"hca_dev_8c3c290ddfff4553886854ce...' 2024-11-13 10:58:26,986 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-0c5c20b5:hca_dev_8c3c290ddfff4553886854ce45f4ba7f__20210902_20210907:. 2024-11-13 10:58:26,986 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0c5c20b5.hca_dev_8c3c290ddfff4553886854ce45f4ba7f__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:27,036 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "52f3c313-95a3-4133-892e-e93e5ec337b5", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-71926fdc.hca_dev_c893cb575c9f4f26931221b85be84313__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:27,136 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "54ee070d-b55f-4e0d-bdb1-d675cb523897", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-dbc582d9.hca_dev_dbcd4b1d31bd4eb594e150e8706fa192__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:27,185 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-71926fdc.hca_dev_c893cb575c9f4f26931221b85be84313__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:27,288 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-dbc582d9.hca_dev_dbcd4b1d31bd4eb594e150e8706fa192__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '3')\n " 2024-11-13 10:58:27,368 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "512745db-581e-4171-a105-dab628ef9878", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-67240cf2.hca_dev_f86f1ab41fbb4510ae353ffd752d4dfc__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:27,514 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_577c946d6de54b55a854cd3fde40bff2__20210827_20210903&limit=2' 2024-11-13 10:58:27,514 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-11-13 10:58:27,600 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "900ebadf-522a-4fd5-9553-aeba6821c319", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-59d37b9a.hca_dev_946c5add47d1402a97bba5af97e8bce7__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:27,625 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "25196233-84cc-41e1-a22d-6d7ceb66ad1b", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-311340f6.hca_dev_2d8460958a334f3c97d4585bafac13b4__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '40')\n "} 2024-11-13 10:58:27,653 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "e079f0d6-11aa-493a-a5c5-b965ceb21373", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-ff0a2fe7.hca_dev_116965f3f09447699d28ae675c1b569c__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:27,709 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.195s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_577c946d6de54b55a854cd3fde40bff2__20210827_20210903&limit=2 2024-11-13 10:58:27,709 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:27 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a0MJ4wPQ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:27,711 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"32cfbe46-2cd9-4b13-95c0-e2670373dd9a","name":"hca_dev_577c946d6de54b55a854cd3f...' 2024-11-13 10:58:27,712 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-319b80f7:hca_dev_577c946d6de54b55a854cd3fde40bff2__20210827_20210903:. 2024-11-13 10:58:27,712 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-319b80f7.hca_dev_577c946d6de54b55a854cd3fde40bff2__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:27,733 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "a2799d86-3f1e-4857-9811-abf70f808d74", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-766bfb76.hca_dev_2ef3655a973d4d699b4121fa4041eed7__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:27,747 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (193 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-59d37b9a.hca_dev_946c5add47d1402a97bba5af97e8bce7__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '4')\n " 2024-11-13 10:58:27,781 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_1bdcecde16be420888f478cd2133d11d__20220401_20220404&limit=2' 2024-11-13 10:58:27,781 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-11-13 10:58:27,796 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_2620497955a349b28d2b53e0bdfcb176__20220404_20220404&limit=2' 2024-11-13 10:58:27,796 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-11-13 10:58:27,879 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "d5e3c3b2-8abb-46f7-a3b2-7016ab272995", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0c5c20b5.hca_dev_8c3c290ddfff4553886854ce45f4ba7f__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:27,884 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_20037472ea1d4ddb9cd356a11a6f0f76__20220401_20220404_lm2&limit=2' 2024-11-13 10:58:27,884 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-11-13 10:58:27,916 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "00005f45-846c-445f-b373-3e1e4f2aab01", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-71926fdc.hca_dev_c893cb575c9f4f26931221b85be84313__20210901_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:27,951 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.170s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_1bdcecde16be420888f478cd2133d11d__20220401_20220404&limit=2 2024-11-13 10:58:27,951 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:27 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6BxJzRY0', 'Content-Type': 'application/json', 'Content-Length': '952', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:27,952 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"96c6482b-7949-4d6e-894b-371149e85134","name":"lungmap_dev_1bdcecde16be420888f4...' 2024-11-13 10:58:27,952 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-5d9526e0:lungmap_dev_1bdcecde16be420888f478cd2133d11d__20220401_20220404:. 2024-11-13 10:58:27,952 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (196 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-5d9526e0.lungmap_dev_1bdcecde16be420888f478cd2133d11d__20220401_20220404.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:27,986 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.189s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_2620497955a349b28d2b53e0bdfcb176__20220404_20220404&limit=2 2024-11-13 10:58:27,986 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eZ85rx0J', 'Content-Type': 'application/json', 'Content-Length': '952', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:27,986 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"23f0064e-3615-4009-9dfc-60583f92064e","name":"lungmap_dev_2620497955a349b28d2b...' 2024-11-13 10:58:27,986 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-8de6d66b:lungmap_dev_2620497955a349b28d2b53e0bdfcb176__20220404_20220404:. 2024-11-13 10:58:27,987 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (196 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-8de6d66b.lungmap_dev_2620497955a349b28d2b53e0bdfcb176__20220404_20220404.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:28,052 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (194 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0c5c20b5.hca_dev_8c3c290ddfff4553886854ce45f4ba7f__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, 'fe')\n " 2024-11-13 10:58:28,063 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "04132385-5e4f-4dc3-90c6-ed71843c8107", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-dbc582d9.hca_dev_dbcd4b1d31bd4eb594e150e8706fa192__20210827_20210902.links`\n WHERE STARTS_WITH(datarepo_row_id, '3')\n "} 2024-11-13 10:58:28,065 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.180s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_20037472ea1d4ddb9cd356a11a6f0f76__20220401_20220404_lm2&limit=2 2024-11-13 10:58:28,065 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e2kjNQVo', 'Content-Type': 'application/json', 'Content-Length': '960', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:28,065 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"3739a9ee-e7d7-4ced-860d-cf89e81d4437","name":"lungmap_dev_20037472ea1d4ddb9cd3...' 2024-11-13 10:58:28,065 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-2e9ef7fd:lungmap_dev_20037472ea1d4ddb9cd356a11a6f0f76__20220401_20220404_lm2:. 2024-11-13 10:58:28,066 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (200 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2e9ef7fd.lungmap_dev_20037472ea1d4ddb9cd356a11a6f0f76__20220401_20220404_lm2.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:28,077 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_f899709cae2c4bb988f0131142e6c7ec__20220401_20220629_lm2&limit=2' 2024-11-13 10:58:28,077 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-11-13 10:58:28,245 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_00f056f273ff43ac97ff69ca10e38c89__20220404_20220404_lm2&limit=2' 2024-11-13 10:58:28,245 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-11-13 10:58:28,251 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.174s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_f899709cae2c4bb988f0131142e6c7ec__20220401_20220629_lm2&limit=2 2024-11-13 10:58:28,251 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eRGV8Mn4', 'Content-Type': 'application/json', 'Content-Length': '960', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:28,251 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"a45481be-52fe-4458-b926-37b82fb0b04a","name":"lungmap_dev_f899709cae2c4bb988f0...' 2024-11-13 10:58:28,252 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-d57fd0c5:lungmap_dev_f899709cae2c4bb988f0131142e6c7ec__20220401_20220629_lm2:. 2024-11-13 10:58:28,252 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (200 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d57fd0c5.lungmap_dev_f899709cae2c4bb988f0131142e6c7ec__20220401_20220629_lm2.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:28,452 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.207s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_00f056f273ff43ac97ff69ca10e38c89__20220404_20220404_lm2&limit=2 2024-11-13 10:58:28,453 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6qNZ3Og5', 'Content-Type': 'application/json', 'Content-Length': '960', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:28,453 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"da13c055-9b6e-4539-be07-230f662b0273","name":"lungmap_dev_00f056f273ff43ac97ff...' 2024-11-13 10:58:28,453 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-b47b6759:lungmap_dev_00f056f273ff43ac97ff69ca10e38c89__20220404_20220404_lm2:. 2024-11-13 10:58:28,453 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (200 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b47b6759.lungmap_dev_00f056f273ff43ac97ff69ca10e38c89__20220404_20220404_lm2.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:28,471 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "31fd3fa2-9c89-4e25-9fad-49f1c7e5a9e8", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-319b80f7.hca_dev_577c946d6de54b55a854cd3fde40bff2__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:28,516 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "a59a51e4-9cd7-4057-8402-5cb79aaade51", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-59d37b9a.hca_dev_946c5add47d1402a97bba5af97e8bce7__20210831_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '4')\n "} 2024-11-13 10:58:28,658 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (192 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-319b80f7.hca_dev_577c946d6de54b55a854cd3fde40bff2__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:28,817 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "8f7491c4-d5da-43fe-ac0b-78cb246078a8", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-0c5c20b5.hca_dev_8c3c290ddfff4553886854ce45f4ba7f__20210902_20210907.links`\n WHERE STARTS_WITH(datarepo_row_id, 'fe')\n "} 2024-11-13 10:58:28,828 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "39c2c518-f524-4763-a115-37cdab29800c", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-8de6d66b.lungmap_dev_2620497955a349b28d2b53e0bdfcb176__20220404_20220404.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:28,868 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "93e8c63b-3126-4a09-8a60-dd4d56122f8e", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-5d9526e0.lungmap_dev_1bdcecde16be420888f478cd2133d11d__20220401_20220404.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:28,976 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (196 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-8de6d66b.lungmap_dev_2620497955a349b28d2b53e0bdfcb176__20220404_20220404.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:29,027 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (196 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-5d9526e0.lungmap_dev_1bdcecde16be420888f478cd2133d11d__20220401_20220404.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:29,098 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "53c59292-f1af-4ca8-9623-350daf08cf3e", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d57fd0c5.lungmap_dev_f899709cae2c4bb988f0131142e6c7ec__20220401_20220629_lm2.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:29,116 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "87bbe0cb-4f46-4ad6-9caf-4cdef63cd941", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2e9ef7fd.lungmap_dev_20037472ea1d4ddb9cd356a11a6f0f76__20220401_20220404_lm2.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:29,263 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (200 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d57fd0c5.lungmap_dev_f899709cae2c4bb988f0131142e6c7ec__20220401_20220629_lm2.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:29,272 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (200 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2e9ef7fd.lungmap_dev_20037472ea1d4ddb9cd356a11a6f0f76__20220401_20220404_lm2.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:29,289 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "86b54988-ff8b-41fe-9739-01b4e7b10e94", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b47b6759.lungmap_dev_00f056f273ff43ac97ff69ca10e38c89__20220404_20220404_lm2.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:29,435 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "4a9c64e6-efd6-4e61-bf21-69c1b9d01c44", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-319b80f7.hca_dev_577c946d6de54b55a854cd3fde40bff2__20210827_20210903.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:29,472 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (200 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b47b6759.lungmap_dev_00f056f273ff43ac97ff69ca10e38c89__20220404_20220404_lm2.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-11-13 10:58:29,740 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "dd305f73-6aa6-4d82-a191-414f3c2c98df", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-5d9526e0.lungmap_dev_1bdcecde16be420888f478cd2133d11d__20220401_20220404.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:29,867 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "a424091e-b6cb-4f2b-aa1f-f50929e7e53e", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-8de6d66b.lungmap_dev_2620497955a349b28d2b53e0bdfcb176__20220404_20220404.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:30,041 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "f35fe6a1-b96d-4328-b106-db621de8a93a", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-d57fd0c5.lungmap_dev_f899709cae2c4bb988f0131142e6c7ec__20220401_20220629_lm2.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:30,071 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "5acddaca-85d1-4871-957c-11359e15a2ec", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-2e9ef7fd.lungmap_dev_20037472ea1d4ddb9cd356a11a6f0f76__20220401_20220404_lm2.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:30,231 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "fc773842-38d6-47f9-8e6e-5eca7facc13b", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-b47b6759.lungmap_dev_00f056f273ff43ac97ff69ca10e38c89__20220404_20220404_lm2.links`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-11-13 10:58:30,396 INFO MainThread azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/roleMap' 2024-11-13 10:58:30,396 DEBUG MainThread azul.terra: … without request body 2024-11-13 10:58:30,852 INFO MainThread azul.terra: Got 200 response after 0.456s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/roleMap 2024-11-13 10:58:30,852 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:30 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e3qvRWB0', 'Content-Type': 'application/json', 'Content-Length': '13129', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:30,853 DEBUG MainThread azul.terra: … with response body b'{"roleMap":{"a0925f5f-3d38-4f8a-a09f-f6997072dc23":["reader","aggregate_data_reader","discoverer"],"215793b0-b991-4b73-9584-1...' 2024-11-13 10:58:30,855 INFO MainThread azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/roleMap' 2024-11-13 10:58:30,855 DEBUG MainThread azul.terra: … without request body 2024-11-13 10:58:31,091 INFO MainThread azul.terra: Got 200 response after 0.237s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/roleMap 2024-11-13 10:58:31,092 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 13 Nov 2024 18:58:31 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aErq5vlk', 'Content-Type': 'application/json', 'Content-Length': '13999', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-11-13 10:58:31,092 DEBUG MainThread azul.terra: … with response body b'{"roleMap":{"a0925f5f-3d38-4f8a-a09f-f6997072dc23":["reader","aggregate_data_reader","discoverer"],"215793b0-b991-4b73-9584-1...' python /Users/daniel/repo/azul2/scripts/check_branch.py python /Users/daniel/repo/azul2/lambdas/service/.chalice/config.json.template.py /Users/daniel/repo/azul2/lambdas/service/.chalice/config.json [INFO] 2024-11-13T10:59:32.503Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-11-13T10:59:32.533Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4387751248 Creating /Users/daniel/repo/azul2/lambdas/service/.chalice/config.json python -m unittest -v integration_test 2024-11-13 10:59:33,650 INFO MainThread botocore.credentials: Found credentials in shared credentials file: ~/.aws/credentials 2024-11-13 10:59:33,674 INFO MainThread azul.deployment: Allocated new Boto3 client for 'es' with ID 4646013264 2024-11-13 10:59:34,158 DEBUG MainThread azul.es: Creating ES client [vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443] 2024-11-13 10:59:34,176 INFO MainThread azul.deployment: Allocated new Boto3 client for 'sts' with ID 4646592912 2024-11-13 10:59:34,187 INFO MainThread botocore.credentials: Found credentials in environment variables. 2024-11-13 10:59:34,188 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_files 2024-11-13 10:59:34,188 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:34,580 INFO MainThread elasticsearch: Got 200 response after 0.392s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_files 2024-11-13 10:59:34,580 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_files":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.donor…' 2024-11-13 10:59:34,583 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_files_aggregate 2024-11-13 10:59:34,583 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:34,681 INFO MainThread elasticsearch: Got 200 response after 0.098s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_files_aggregate 2024-11-13 10:59:34,681 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_files_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"cont…' 2024-11-13 10:59:34,684 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_cell_suspensions 2024-11-13 10:59:34,684 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:34,781 INFO MainThread elasticsearch: Got 200 response after 0.097s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_cell_suspensions 2024-11-13 10:59:34,782 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_cell_suspensions":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"con…' 2024-11-13 10:59:34,784 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_cell_suspensions_aggregate 2024-11-13 10:59:34,785 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:34,878 INFO MainThread elasticsearch: Got 200 response after 0.093s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_cell_suspensions_aggregate 2024-11-13 10:59:34,878 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_cell_suspensions_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_m…' 2024-11-13 10:59:34,882 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_samples 2024-11-13 10:59:34,882 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:34,980 INFO MainThread elasticsearch: Got 200 response after 0.098s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_samples 2024-11-13 10:59:34,980 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_samples":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.don…' 2024-11-13 10:59:34,983 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_samples_aggregate 2024-11-13 10:59:34,983 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:35,081 INFO MainThread elasticsearch: Got 200 response after 0.097s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_samples_aggregate 2024-11-13 10:59:35,081 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_samples_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"co…' 2024-11-13 10:59:35,085 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_projects 2024-11-13 10:59:35,085 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:35,180 INFO MainThread elasticsearch: Got 200 response after 0.095s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_projects 2024-11-13 10:59:35,180 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_projects":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.do…' 2024-11-13 10:59:35,184 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_projects_aggregate 2024-11-13 10:59:35,184 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:35,278 INFO MainThread elasticsearch: Got 200 response after 0.094s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_projects_aggregate 2024-11-13 10:59:35,278 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_projects_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"c…' 2024-11-13 10:59:35,281 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_bundles 2024-11-13 10:59:35,281 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:35,376 INFO MainThread elasticsearch: Got 200 response after 0.095s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_bundles 2024-11-13 10:59:35,376 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_bundles":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.don…' 2024-11-13 10:59:35,381 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_bundles_aggregate 2024-11-13 10:59:35,381 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:35,475 INFO MainThread elasticsearch: Got 200 response after 0.094s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_bundles_aggregate 2024-11-13 10:59:35,476 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_bundles_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"co…' 2024-11-13 10:59:35,478 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_replica 2024-11-13 10:59:35,479 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:35,575 INFO MainThread elasticsearch: Got 200 response after 0.097s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_replica 2024-11-13 10:59:35,575 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_replica":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_type":"stri…' 2024-11-13 10:59:35,577 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_files 2024-11-13 10:59:35,577 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:35,677 INFO MainThread elasticsearch: Got 200 response after 0.100s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_files 2024-11-13 10:59:35,677 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_files":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.do…' 2024-11-13 10:59:35,679 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_files_aggregate 2024-11-13 10:59:35,680 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:35,775 INFO MainThread elasticsearch: Got 200 response after 0.096s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_files_aggregate 2024-11-13 10:59:35,775 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_files_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"c…' 2024-11-13 10:59:35,778 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_cell_suspensions 2024-11-13 10:59:35,779 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:35,875 INFO MainThread elasticsearch: Got 200 response after 0.096s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_cell_suspensions 2024-11-13 10:59:35,875 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_cell_suspensions":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"…' 2024-11-13 10:59:35,877 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_cell_suspensions_aggregate 2024-11-13 10:59:35,878 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:35,975 INFO MainThread elasticsearch: Got 200 response after 0.097s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_cell_suspensions_aggregate 2024-11-13 10:59:35,975 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_cell_suspensions_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"pat…' 2024-11-13 10:59:35,978 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_samples 2024-11-13 10:59:35,978 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:36,073 INFO MainThread elasticsearch: Got 200 response after 0.094s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_samples 2024-11-13 10:59:36,073 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_samples":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.…' 2024-11-13 10:59:36,075 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_samples_aggregate 2024-11-13 10:59:36,075 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:36,171 INFO MainThread elasticsearch: Got 200 response after 0.096s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_samples_aggregate 2024-11-13 10:59:36,171 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_samples_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":…' 2024-11-13 10:59:36,174 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_projects 2024-11-13 10:59:36,174 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:36,273 INFO MainThread elasticsearch: Got 200 response after 0.099s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_projects 2024-11-13 10:59:36,273 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_projects":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents…' 2024-11-13 10:59:36,276 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_projects_aggregate 2024-11-13 10:59:36,276 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:36,369 INFO MainThread elasticsearch: Got 200 response after 0.092s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_projects_aggregate 2024-11-13 10:59:36,369 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_projects_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match"…' 2024-11-13 10:59:36,372 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_bundles 2024-11-13 10:59:36,372 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:36,467 INFO MainThread elasticsearch: Got 200 response after 0.095s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_bundles 2024-11-13 10:59:36,467 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_bundles":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.…' 2024-11-13 10:59:36,470 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_bundles_aggregate 2024-11-13 10:59:36,471 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:36,566 INFO MainThread elasticsearch: Got 200 response after 0.095s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_bundles_aggregate 2024-11-13 10:59:36,566 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_bundles_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":…' 2024-11-13 10:59:36,570 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_replica 2024-11-13 10:59:36,570 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:36,661 INFO MainThread elasticsearch: Got 200 response after 0.091s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_replica 2024-11-13 10:59:36,662 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_replica":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_type":"s…' 2024-11-13 10:59:36,664 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_files 2024-11-13 10:59:36,664 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:36,758 INFO MainThread elasticsearch: Got 200 response after 0.094s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_files 2024-11-13 10:59:36,759 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_files":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.donors…' 2024-11-13 10:59:36,762 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_files_aggregate 2024-11-13 10:59:36,762 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:36,863 INFO MainThread elasticsearch: Got 200 response after 0.101s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_files_aggregate 2024-11-13 10:59:36,863 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_files_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"conte…' 2024-11-13 10:59:36,867 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_cell_suspensions 2024-11-13 10:59:36,867 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:36,960 INFO MainThread elasticsearch: Got 200 response after 0.093s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_cell_suspensions 2024-11-13 10:59:36,960 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_cell_suspensions":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"cont…' 2024-11-13 10:59:36,962 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_cell_suspensions_aggregate 2024-11-13 10:59:36,963 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:37,060 INFO MainThread elasticsearch: Got 200 response after 0.097s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_cell_suspensions_aggregate 2024-11-13 10:59:37,060 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_cell_suspensions_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_ma…' 2024-11-13 10:59:37,062 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_samples 2024-11-13 10:59:37,062 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:37,157 INFO MainThread elasticsearch: Got 200 response after 0.095s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_samples 2024-11-13 10:59:37,157 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_samples":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.dono…' 2024-11-13 10:59:37,160 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_samples_aggregate 2024-11-13 10:59:37,160 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:37,257 INFO MainThread elasticsearch: Got 200 response after 0.097s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_samples_aggregate 2024-11-13 10:59:37,257 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_samples_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"con…' 2024-11-13 10:59:37,260 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_projects 2024-11-13 10:59:37,260 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:37,352 INFO MainThread elasticsearch: Got 200 response after 0.092s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_projects 2024-11-13 10:59:37,352 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_projects":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.don…' 2024-11-13 10:59:37,357 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_projects_aggregate 2024-11-13 10:59:37,357 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:37,453 INFO MainThread elasticsearch: Got 200 response after 0.096s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_projects_aggregate 2024-11-13 10:59:37,453 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_projects_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"co…' 2024-11-13 10:59:37,457 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_bundles 2024-11-13 10:59:37,457 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:37,552 INFO MainThread elasticsearch: Got 200 response after 0.095s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_bundles 2024-11-13 10:59:37,553 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_bundles":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.dono…' 2024-11-13 10:59:37,556 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_bundles_aggregate 2024-11-13 10:59:37,556 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:37,653 INFO MainThread elasticsearch: Got 200 response after 0.096s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_bundles_aggregate 2024-11-13 10:59:37,653 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_bundles_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"con…' 2024-11-13 10:59:37,656 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_replica 2024-11-13 10:59:37,657 INFO MainThread elasticsearch: … without request body 2024-11-13 10:59:37,748 INFO MainThread elasticsearch: Got 200 response after 0.091s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_replica 2024-11-13 10:59:37,748 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_replica":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_type":"strin…' test_local_chalice (integration_test.AzulChaliceLocalIntegrationTest.test_local_chalice) ... 2024-11-13 10:59:37,810 INFO Thread-2 (process_request_thread) azul.chalice: Received GET request for '/', with {"query": null, "headers": {"host": "127.0.0.1:8000", "user-agent": "python-requests/2.32.2", "accept-encoding": "gzip, deflate, br", "accept": "*/*", "connection": "keep-alive"}}. 2024-11-13 10:59:37,810 INFO Thread-2 (process_request_thread) azul.chalice: Did not authenticate request. 2024-11-13 10:59:37,811 DEBUG Thread-2 (process_request_thread) azul.chalice: Returning 200 response with headers {"Content-Type": "text/html", "Referrer-Policy": "strict-origin-when-cross-origin", "Strict-Transport-Security": "max-age=63072000; includeSubDomains; preload", "X-Content-Type-Options": "nosniff", "X-Frame-Options": "DENY", "X-XSS-Protection": "1; mode=block", "Cache-Control": "public, max-age=0, must-revalidate"}. See next line for the first 1024 characters of the body. Swagger UI