azul2 on  issues/dsotirho-ucsc/5927-layer-and-lambda-race  daniel.local 🐍 v3.11.9 (.venv) at 08/21 10:27:16 ❯ make auto_deploy ; sleep 60 ; make integration_test ; git status ; git rev-parse HEAD ; date :1: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html :1: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html /Library/Developer/CommandLineTools/usr/bin/make -C lambdas /Library/Developer/CommandLineTools/usr/bin/make -C layer layer :1: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html :1: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html python /Users/daniel/repo/azul2/scripts/check_branch.py python .chalice/config.json.template.py .chalice/config.json Creating .chalice/config.json python /Users/daniel/repo/azul2/scripts/stage_layer.py 2024-08-21 10:28:11,111 INFO MainThread botocore.credentials: Found credentials in shared credentials file: ~/.aws/credentials 2024-08-21 10:28:11,143 INFO MainThread azul.deployment: Allocated new Boto3 client for 'iam' with ID 4410130576 2024-08-21 10:28:11,567 INFO MainThread azul.deployment: Allocated new Boto3 client for 'sts' with ID 4417212048 2024-08-21 10:28:11,609 INFO MainThread azul.lambda_layer: Checking for dependencies layer package at s3://edu-ucsc-gi-platform-hca-dev-shared.us-east-1/azul/daniel/lambda_layers/b952d9e3830b69d0e746fd51be86d91e2f009e04.zip. 2024-08-21 10:28:11,633 INFO MainThread azul.deployment: Allocated new Boto3 client for 's3' with ID 4435569616 2024-08-21 10:28:11,753 INFO MainThread azul.boto3: s3.HeadObject: Making HEAD request to https://s3.amazonaws.com/edu-ucsc-gi-platform-hca-dev-shared.us-east-1/azul/daniel/lambda_layers/b952d9e3830b69d0e746fd51be86d91e2f009e04.zip 2024-08-21 10:28:11,753 INFO MainThread azul.boto3: s3.HeadObject: … without request body 2024-08-21 10:28:12,123 INFO MainThread azul.boto3: s3.HeadObject: Got 200 response 2024-08-21 10:28:12,123 INFO MainThread azul.boto3: s3.HeadObject: … with response body b'' 2024-08-21 10:28:12,124 INFO MainThread azul.lambda_layer: Layer package already up-to-date. /Library/Developer/CommandLineTools/usr/bin/make -C indexer package :1: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html :1: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html python /Users/daniel/repo/azul2/scripts/check_branch.py python .chalice/config.json.template.py .chalice/config.json [INFO] 2024-08-21T10:28:13.759Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-08-21T10:28:13.800Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4422976656 Creating .chalice/config.json python vendor/resources/environ.json.template.py vendor/resources/environ.json Creating vendor/resources/environ.json PYTHONHASHSEED=0 python -m compileall \ -f -q --invalidation-mode checked-hash \ vendor vendor/humancellatlas vendor/azul python -m azul.changelog vendor chalice package --stage daniel --pkg-format terraform .chalice/terraform /Users/daniel/repo/azul2/.venv/lib/python3.11/site-packages/_distutils_hack/__init__.py:32: UserWarning: Setuptools is replacing distutils. Support for replacing an already imported distutils is deprecated. In the future, this condition will fail. Register concerns at https://github.com/pypa/setuptools/issues/new?template=distutils-deprecation.yml warnings.warn( [INFO] 2024-08-21T10:28:15.390Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-08-21T10:28:15.418Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4364755664 Creating deployment package. [INFO] 2024-08-21T10:28:15.968Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in environment variables. /Library/Developer/CommandLineTools/usr/bin/make -C service package :1: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html :1: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html python /Users/daniel/repo/azul2/scripts/check_branch.py python .chalice/config.json.template.py .chalice/config.json [INFO] 2024-08-21T10:28:17.761Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-08-21T10:28:17.789Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4385608784 Creating .chalice/config.json python vendor/resources/environ.json.template.py vendor/resources/environ.json Creating vendor/resources/environ.json PYTHONHASHSEED=0 python -m compileall \ -f -q --invalidation-mode checked-hash \ vendor vendor/humancellatlas vendor/azul python -m azul.changelog vendor chalice package --stage daniel --pkg-format terraform .chalice/terraform /Users/daniel/repo/azul2/.venv/lib/python3.11/site-packages/_distutils_hack/__init__.py:32: UserWarning: Setuptools is replacing distutils. Support for replacing an already imported distutils is deprecated. In the future, this condition will fail. Register concerns at https://github.com/pypa/setuptools/issues/new?template=distutils-deprecation.yml warnings.warn( Creating deployment package. [INFO] 2024-08-21T10:28:19.307Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in environment variables. /Library/Developer/CommandLineTools/usr/bin/make -C terraform auto_apply :1: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html :1: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html python /Users/daniel/repo/azul2/scripts/check_branch.py set -o pipefail && git ls-files --ignored --others --directory --exclude-standard | (grep -v '/[^/]' || test $? -eq 1) | xargs -r rm -rv __pycache__//cloudwatch_dashboard.template.json.cpython-311.pyc __pycache__/ api_gateway.tf.json authentication.tf.json backend.tf.json cloudwatch.tf.json common.tf.json dynamo.tf.json lambda_layer.tf.json providers.tf.json s3.tf.json sqs.tf.json step_function.tf.json python providers.tf.json.template.py providers.tf.json Creating providers.tf.json python backend.tf.json.template.py backend.tf.json Creating backend.tf.json terraform init -reconfigure -lockfile=readonly Initializing the backend... Successfully configured the backend "s3"! Terraform will automatically use this backend unless the backend configuration changes. Initializing provider plugins... - Reusing previous version of hashicorp/null from the dependency lock file - Reusing previous version of hashicorp/google from the dependency lock file - Reusing previous version of hashicorp/aws from the dependency lock file - Reusing previous version of opensearch-project/opensearch from the dependency lock file - Reusing previous version of hashicorp/external from the dependency lock file - Using previously-installed opensearch-project/opensearch v2.2.1 - Using previously-installed hashicorp/external v2.2.0 - Using previously-installed hashicorp/null v3.2.0 - Using previously-installed hashicorp/google v4.58.0 - Using previously-installed hashicorp/aws v5.49.0 Terraform has been successfully initialized! You may now begin working with Terraform. Try running "terraform plan" to see any changes that are required for your infrastructure. All Terraform commands should now work. If you ever set or change modules or backend configuration for Terraform, rerun this command to reinitialize your working directory. If you forget, other commands will detect it and remind you to do so if necessary. python /Users/daniel/repo/azul2/scripts/terraform_schema.py check \ || (echo "Schema is stale. Run 'make update_schema' and commit." ; false) 2024-08-21 10:28:25,619 INFO MainThread azul.terraform: Running ['terraform', 'version', '-json'] 2024-08-21 10:28:25,665 INFO MainThread azul.terraform: Terraform output: { "terraform_version": "1.9.4", "platform": "darwin_arm64", "provider_selections": { "registry.terraform.io/hashicorp/aws": "5.49.0", "registry.terraform.io/hashicorp/external": "2.2.0", "registry.terraform.io/hashicorp/google": "4.58.0", "registry.terraform.io/hashicorp/null": "3.2.0", "registry.terraform.io/opensearch-project/opensearch": "2.2.1" }, "terraform_outdated": true } python api_gateway.tf.json.template.py api_gateway.tf.json [INFO] 2024-08-21T10:28:26.930Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'es' with ID 4569307024 Creating api_gateway.tf.json python authentication.tf.json.template.py authentication.tf.json Creating authentication.tf.json python cloudwatch.tf.json.template.py cloudwatch.tf.json Creating cloudwatch.tf.json python common.tf.json.template.py common.tf.json Creating common.tf.json python dynamo.tf.json.template.py dynamo.tf.json Creating dynamo.tf.json python elasticsearch.tf.json.template.py elasticsearch.tf.json python lambda_layer.tf.json.template.py lambda_layer.tf.json Creating lambda_layer.tf.json python s3.tf.json.template.py s3.tf.json Creating s3.tf.json python sqs.tf.json.template.py sqs.tf.json Creating sqs.tf.json python step_function.tf.json.template.py step_function.tf.json [INFO] 2024-08-21T10:28:33.120Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-08-21T10:28:33.160Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4383614544 [INFO] 2024-08-21T10:28:33.619Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'sts' with ID 4384438864 Creating step_function.tf.json terraform validate Success! The configuration is valid. python /Users/daniel/repo/azul2/scripts/rename_resources.py 2024-08-21 10:28:37,547 INFO MainThread azul.terraform: Running ['terraform', 'state', 'list'] python /Users/daniel/repo/azul2/scripts/delete_stale_function_versions.py 2024-08-21 10:28:39,356 INFO MainThread azul.lambdas: Deleting stale versions of AWS Lambda functions 2024-08-21 10:28:39,360 INFO MainThread botocore.credentials: Found credentials in shared credentials file: ~/.aws/credentials 2024-08-21 10:28:39,391 INFO MainThread azul.deployment: Allocated new Boto3 client for 'lambda' with ID 4384942352 2024-08-21 10:28:41,723 INFO MainThread azul.lambdas: Skipping latest version 'azul-indexer-daniel-aggregate_retry' 2024-08-21 10:28:41,723 INFO MainThread azul.lambdas: Skipping latest version 'azul-service-daniel' 2024-08-21 10:28:41,723 INFO MainThread azul.lambdas: Skipping latest version 'azul-indexer-daniel-aggregate' 2024-08-21 10:28:41,723 INFO MainThread azul.lambdas: Skipping latest version 'azul-indexer-daniel-indexercachehealth' 2024-08-21 10:28:41,723 INFO MainThread azul.lambdas: Skipping latest version 'azul-service-daniel-servicecachehealth' 2024-08-21 10:28:41,723 INFO MainThread azul.lambdas: Skipping latest version 'azul-service-daniel-manifest' 2024-08-21 10:28:41,723 INFO MainThread azul.lambdas: Skipping latest version 'azul-indexer-daniel' 2024-08-21 10:28:41,724 INFO MainThread azul.lambdas: Skipping latest version 'azul-indexer-daniel-contribute_retry' 2024-08-21 10:28:41,724 INFO MainThread azul.lambdas: Skipping latest version 'azul-indexer-daniel-contribute' 2024-08-21 10:28:41,724 INFO MainThread azul.lambdas: Deleting version '35' of 'azul-indexer-daniel-indexercachehealth' 2024-08-21 10:28:41,993 INFO MainThread azul.lambdas: Deleting version '35' of 'azul-indexer-daniel-aggregate' 2024-08-21 10:28:42,263 INFO MainThread azul.lambdas: Deleting version '35' of 'azul-indexer-daniel-contribute_retry' 2024-08-21 10:28:42,534 INFO MainThread azul.lambdas: Deleting version '35' of 'azul-indexer-daniel-aggregate_retry' 2024-08-21 10:28:42,792 INFO MainThread azul.lambdas: Deleting version '35' of 'azul-indexer-daniel-contribute' 2024-08-21 10:28:43,042 INFO MainThread azul.lambdas: Deleting version '35' of 'azul-indexer-daniel' 2024-08-21 10:28:43,298 INFO MainThread azul.lambdas: Deleting version '36' of 'azul-service-daniel' 2024-08-21 10:28:43,565 INFO MainThread azul.lambdas: Deleting version '36' of 'azul-service-daniel-manifest' 2024-08-21 10:28:43,849 INFO MainThread azul.lambdas: Deleting version '36' of 'azul-service-daniel-servicecachehealth' terraform plan -no-color -out=plan.bin data.external.elasticsearch_nodes: Reading... null_resource.hmac_secret: Refreshing state... [id=5577006791947779410] aws_acm_certificate.indexer_0: Refreshing state... [id=arn:aws:acm:us-east-1:122796619775:certificate/9df7078f-62c2-487d-b9ab-4c72e2fce35f] aws_acm_certificate.service_1: Refreshing state... [id=arn:aws:acm:us-east-1:122796619775:certificate/ce201833-ad5e-4757-b5ba-007a4508bde8] aws_acm_certificate.service_0: Refreshing state... [id=arn:aws:acm:us-east-1:122796619775:certificate/6f14e47b-d3af-4098-9074-3a51fe1f2370] data.aws_vpc.gitlab: Reading... aws_sqs_queue.notifications_fail: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/122796619775/azul-notifications_fail-daniel] aws_sqs_queue.tallies_fail: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/122796619775/azul-tallies_fail-daniel.fifo] aws_dynamodb_table.object_versions: Refreshing state... [id=azul-object_versions-daniel] aws_s3_bucket.storage: Refreshing state... [id=edu-ucsc-gi-platform-hca-dev-storage-daniel.us-east-1] data.aws_partition.indexer: Reading... data.aws_partition.indexer: Read complete after 0s [id=aws] data.aws_s3_bucket.logs: Reading... data.aws_region.current: Reading... data.aws_subnet.gitlab_public_1: Reading... data.aws_region.current: Read complete after 0s [id=us-east-1] aws_cloudwatch_event_rule.indexer_indexercachehealth: Refreshing state... [id=azul-indexercachehealth-daniel] data.aws_partition.service: Reading... data.aws_partition.service: Read complete after 0s [id=aws] aws_cloudwatch_log_group.waf_api_gateway: Refreshing state... [id=aws-waf-logs-azul-api_gateway-daniel] aws_cloudwatch_event_rule.service_servicecachehealth: Refreshing state... [id=azul-servicecachehealth-daniel] aws_dynamodb_table.sources_cache_by_auth: Refreshing state... [id=azul-sources_cache_by_auth-daniel] data.aws_s3_bucket.logs: Read complete after 0s [id=edu-ucsc-gi-platform-hca-dev-logs.us-east-1] data.aws_caller_identity.service: Reading... data.aws_caller_identity.current: Reading... data.aws_caller_identity.service: Read complete after 0s [id=122796619775] aws_kms_key.manifest: Refreshing state... [id=bd5443c4-469b-490c-a47f-0fe56e8be3b6] data.aws_caller_identity.current: Read complete after 1s [id=122796619775] data.aws_wafv2_ip_set.allowed_v4_ips: Reading... data.external.elasticsearch_nodes: Read complete after 2s [id=-] aws_cloudwatch_log_group.service: Refreshing state... [id=/aws/apigateway/azul-service-daniel] data.aws_subnet.gitlab_public_1: Read complete after 1s [id=subnet-02866d3ce894ba178] aws_cloudwatch_log_group.indexer: Refreshing state... [id=/aws/apigateway/azul-indexer-daniel] data.aws_vpc.gitlab: Read complete after 1s [id=vpc-06931ee1298704867] data.aws_subnet.gitlab_private_0: Reading... data.aws_subnet.gitlab_private_1: Reading... data.aws_region.indexer: Reading... data.aws_region.indexer: Read complete after 0s [id=us-east-1] data.aws_subnet.gitlab_public_0: Reading... aws_lambda_layer_version.dependencies: Refreshing state... [id=arn:aws:lambda:us-east-1:122796619775:layer:azul-dependencies-daniel:239] data.aws_caller_identity.indexer: Reading... data.aws_subnet.gitlab_private_0: Read complete after 0s [id=subnet-03776c9deb0ed1c77] data.aws_route53_zone.dev_singlecell_gi_ucsc_edu: Reading... data.aws_caller_identity.indexer: Read complete after 0s [id=122796619775] data.aws_wafv2_ip_set.blocked_v4_ips: Reading... aws_iam_role.states: Refreshing state... [id=azul-statemachine-daniel] aws_iam_role.service: Refreshing state... [id=azul-service-daniel] data.aws_subnet.gitlab_private_1: Read complete after 0s [id=subnet-07cab4c0971afee67] data.aws_region.service: Reading... data.aws_region.service: Read complete after 0s [id=us-east-1] aws_iam_role.indexer: Refreshing state... [id=azul-indexer-daniel] google_project_iam_custom_role.azul: Refreshing state... [id=projects/platform-hca-dev/roles/azul_daniel_11] data.google_client_config.current: Reading... data.aws_subnet.gitlab_public_0: Read complete after 0s [id=subnet-0c4b13fb5432426c3] aws_sqs_queue.tallies_retry: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/122796619775/azul-tallies_retry-daniel.fifo] data.google_client_config.current: Read complete after 0s [id=projects/platform-hca-dev/regions//zones/] aws_sqs_queue.notifications_retry: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/122796619775/azul-notifications_retry-daniel] data.aws_wafv2_ip_set.allowed_v4_ips: Read complete after 0s [id=0f8a542f-1472-451e-a910-c35334f87df9] aws_security_group.indexer: Refreshing state... [id=sg-0cc391f421dd12e70] aws_security_group.service: Refreshing state... [id=sg-0375b33dbf313a173] aws_kms_alias.manifest: Refreshing state... [id=alias/azul-manifest-daniel] aws_cloudwatch_dashboard.dashboard: Refreshing state... [id=azul-dashboard-daniel] aws_sqs_queue.tallies: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/122796619775/azul-tallies-daniel.fifo] data.aws_wafv2_ip_set.blocked_v4_ips: Read complete after 1s [id=60749613-bc5f-4a3f-9a11-3009cf99319a] aws_sqs_queue.notifications: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/122796619775/azul-notifications-daniel] aws_s3_bucket_inventory.storage: Refreshing state... [id=edu-ucsc-gi-platform-hca-dev-storage-daniel.us-east-1:azul-inventory-daniel] aws_s3_bucket_logging.storage: Refreshing state... [id=edu-ucsc-gi-platform-hca-dev-storage-daniel.us-east-1] aws_s3_bucket_lifecycle_configuration.storage: Refreshing state... [id=edu-ucsc-gi-platform-hca-dev-storage-daniel.us-east-1] data.aws_route53_zone.dev_singlecell_gi_ucsc_edu: Read complete after 1s [id=ZRJRXAKW4OYOA] aws_s3_bucket_public_access_block.storage: Refreshing state... [id=edu-ucsc-gi-platform-hca-dev-storage-daniel.us-east-1] google_service_account.azul_public: Refreshing state... [id=projects/platform-hca-dev/serviceAccounts/azul-ucsc-11-public-daniel@platform-hca-dev.iam.gserviceaccount.com] google_service_account.azul: Refreshing state... [id=projects/platform-hca-dev/serviceAccounts/azul-ucsc-11-daniel@platform-hca-dev.iam.gserviceaccount.com] google_service_account.azul_unregistered: Refreshing state... [id=projects/platform-hca-dev/serviceAccounts/azul-ucsc-11-unreg-daniel@platform-hca-dev.iam.gserviceaccount.com] aws_route53_record.service_domain_validation_1: Refreshing state... [id=ZRJRXAKW4OYOA__93a0125de244a1421bfbb7dc5099f5a0.drs.daniel.dev.singlecell.gi.ucsc.edu._CNAME] aws_route53_record.service_domain_validation_0: Refreshing state... [id=ZRJRXAKW4OYOA__7ec7bd992f8c52f7dc868205af307cd8.service.daniel.dev.singlecell.gi.ucsc.edu._CNAME] aws_route53_record.indexer_domain_validation_0: Refreshing state... [id=ZRJRXAKW4OYOA__8d8629347339c6b9ab5f73af4452501e.indexer.daniel.dev.singlecell.gi.ucsc.edu._CNAME] aws_iam_role_policy.states: Refreshing state... [id=azul-statemachine-daniel:azul-statemachine-daniel] aws_sfn_state_machine.manifest: Refreshing state... [id=arn:aws:states:us-east-1:122796619775:stateMachine:azul-manifest-daniel] aws_lambda_function.service_servicecachehealth: Refreshing state... [id=azul-service-daniel-servicecachehealth] aws_lambda_function.service: Refreshing state... [id=azul-service-daniel] aws_iam_role_policy.service: Refreshing state... [id=azul-service-daniel:service] aws_lambda_function.service_manifest: Refreshing state... [id=azul-service-daniel-manifest] google_project_iam_member.azul: Refreshing state... [id=platform-hca-dev/projects/platform-hca-dev/roles/azul_daniel_11/serviceAccount:azul-ucsc-11-daniel@platform-hca-dev.iam.gserviceaccount.com] aws_wafv2_web_acl.api_gateway: Refreshing state... [id=fbf58fe0-fe9d-4277-9e54-067fe11f2195] aws_lambda_function.indexer_aggregate_retry: Refreshing state... [id=azul-indexer-daniel-aggregate_retry] aws_lambda_function.indexer_contribute: Refreshing state... [id=azul-indexer-daniel-contribute] aws_lambda_function.indexer_aggregate: Refreshing state... [id=azul-indexer-daniel-aggregate] aws_lambda_function.indexer_contribute_retry: Refreshing state... [id=azul-indexer-daniel-contribute_retry] aws_lambda_function.indexer: Refreshing state... [id=azul-indexer-daniel] aws_lambda_function.indexer_indexercachehealth: Refreshing state... [id=azul-indexer-daniel-indexercachehealth] aws_iam_role_policy.indexer: Refreshing state... [id=azul-indexer-daniel:indexer] aws_lambda_function_event_invoke_config.service_servicecachehealth: Refreshing state... [id=azul-service-daniel-servicecachehealth] aws_lambda_permission.service_servicecachehealth: Refreshing state... [id=terraform-20240627175823514300000003] aws_cloudwatch_event_target.service_servicecachehealth: Refreshing state... [id=azul-servicecachehealth-daniel-azul-servicecachehealth-daniel] aws_acm_certificate_validation.service_1: Refreshing state... [id=2024-06-27 17:47:35.911 +0000 UTC] aws_acm_certificate_validation.service_0: Refreshing state... [id=2024-06-27 17:47:36.308 +0000 UTC] aws_acm_certificate_validation.indexer_0: Refreshing state... [id=2024-06-27 17:47:28.016 +0000 UTC] aws_lambda_event_source_mapping.indexer_aggregate_retry: Refreshing state... [id=9bec7800-3b5c-4159-808f-92895e628a4f] aws_lambda_event_source_mapping.indexer_contribute: Refreshing state... [id=2e88dd96-7871-411c-b607-b0eddf26cd04] aws_lambda_event_source_mapping.indexer_aggregate: Refreshing state... [id=40f44561-9d61-4633-8276-2e9a8e8f8d8d] aws_api_gateway_rest_api.service: Refreshing state... [id=xa7lc03ug7] aws_lambda_event_source_mapping.indexer_contribute_retry: Refreshing state... [id=7e20e766-c08c-48e5-85e7-8a340923c993] aws_lambda_function_event_invoke_config.indexer_indexercachehealth: Refreshing state... [id=azul-indexer-daniel-indexercachehealth] aws_cloudwatch_event_target.indexer_indexercachehealth: Refreshing state... [id=azul-indexercachehealth-daniel-azul-indexercachehealth-daniel] aws_lambda_permission.indexer_indexercachehealth: Refreshing state... [id=terraform-20240627175213967300000001] aws_api_gateway_domain_name.service_1: Refreshing state... [id=drs.daniel.dev.singlecell.gi.ucsc.edu] aws_api_gateway_domain_name.service_0: Refreshing state... [id=service.daniel.dev.singlecell.gi.ucsc.edu] aws_api_gateway_rest_api.indexer: Refreshing state... [id=u2f0nkn089] aws_api_gateway_domain_name.indexer_0: Refreshing state... [id=indexer.daniel.dev.singlecell.gi.ucsc.edu] aws_route53_record.indexer_0: Refreshing state... [id=ZRJRXAKW4OYOA_indexer.daniel.dev.singlecell.gi.ucsc.edu_A] aws_route53_record.service_1: Refreshing state... [id=ZRJRXAKW4OYOA_drs.daniel.dev.singlecell.gi.ucsc.edu_A] aws_route53_record.service_0: Refreshing state... [id=ZRJRXAKW4OYOA_service.daniel.dev.singlecell.gi.ucsc.edu_A] aws_lambda_permission.indexer: Refreshing state... [id=terraform-20240627175247425200000002] aws_api_gateway_deployment.indexer: Refreshing state... [id=my9dv6] aws_api_gateway_stage.indexer: Refreshing state... [id=ags-u2f0nkn089-daniel] aws_api_gateway_deployment.service: Refreshing state... [id=r4ywbk] aws_lambda_permission.service: Refreshing state... [id=terraform-20240627175922966700000004] aws_api_gateway_base_path_mapping.indexer_0: Refreshing state... [id=indexer.daniel.dev.singlecell.gi.ucsc.edu/] aws_api_gateway_method_settings.indexer_0: Refreshing state... [id=u2f0nkn089-daniel-*/*] aws_api_gateway_stage.service: Refreshing state... [id=ags-xa7lc03ug7-daniel] aws_api_gateway_base_path_mapping.service_1: Refreshing state... [id=drs.daniel.dev.singlecell.gi.ucsc.edu/] aws_api_gateway_base_path_mapping.service_0: Refreshing state... [id=service.daniel.dev.singlecell.gi.ucsc.edu/] aws_api_gateway_method_settings.service_1: Refreshing state... [id=xa7lc03ug7-daniel-*/*] aws_api_gateway_method_settings.service_0: Refreshing state... [id=xa7lc03ug7-daniel-*/*] aws_wafv2_web_acl_association.service: Refreshing state... [id=arn:aws:wafv2:us-east-1:122796619775:regional/webacl/azul-api_gateway-daniel/fbf58fe0-fe9d-4277-9e54-067fe11f2195,arn:aws:apigateway:us-east-1::/restapis/xa7lc03ug7/stages/daniel] aws_wafv2_web_acl_association.indexer: Refreshing state... [id=arn:aws:wafv2:us-east-1:122796619775:regional/webacl/azul-api_gateway-daniel/fbf58fe0-fe9d-4277-9e54-067fe11f2195,arn:aws:apigateway:us-east-1::/restapis/u2f0nkn089/stages/daniel] aws_wafv2_web_acl_logging_configuration.waf_api_gateway: Refreshing state... [id=arn:aws:wafv2:us-east-1:122796619775:regional/webacl/azul-api_gateway-daniel/fbf58fe0-fe9d-4277-9e54-067fe11f2195] Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following symbols: ~ update in-place Terraform will perform the following actions: # aws_lambda_function.indexer will be updated in-place ~ resource "aws_lambda_function" "indexer" { id = "azul-indexer-daniel" ~ last_modified = "2024-08-21T17:21:11.000+0000" -> (known after apply) ~ publish = false -> true ~ qualified_arn = "arn:aws:lambda:us-east-1:122796619775:function:azul-indexer-daniel:$LATEST" -> (known after apply) ~ qualified_invoke_arn = "arn:aws:apigateway:us-east-1:lambda:path/2015-03-31/functions/arn:aws:lambda:us-east-1:122796619775:function:azul-indexer-daniel:$LATEST/invocations" -> (known after apply) ~ source_code_hash = "vwju+dTpAAKHTEOC08T/PmGanNtt6LMp9XRwtVeltcc=" -> "5nmUsAt+SsJ7Mx2orZqu6/o2wmnHEguNCz3BFgaXtgU=" tags = { "Name" = "azul-indexer-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-indexer" "billing" = "hca" "component" = "azul-indexer" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } ~ version = "$LATEST" -> (known after apply) # (22 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "5c4b4ebea40027ed297a6088f680db97d83f1037" -> "fd989529917e91b4c6dd3f6f3f99ac3a58fdb6b7" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_aggregate will be updated in-place ~ resource "aws_lambda_function" "indexer_aggregate" { id = "azul-indexer-daniel-aggregate" ~ last_modified = "2024-08-21T17:20:46.000+0000" -> (known after apply) ~ publish = false -> true ~ qualified_arn = "arn:aws:lambda:us-east-1:122796619775:function:azul-indexer-daniel-aggregate:$LATEST" -> (known after apply) ~ qualified_invoke_arn = "arn:aws:apigateway:us-east-1:lambda:path/2015-03-31/functions/arn:aws:lambda:us-east-1:122796619775:function:azul-indexer-daniel-aggregate:$LATEST/invocations" -> (known after apply) ~ source_code_hash = "vwju+dTpAAKHTEOC08T/PmGanNtt6LMp9XRwtVeltcc=" -> "5nmUsAt+SsJ7Mx2orZqu6/o2wmnHEguNCz3BFgaXtgU=" tags = { "Name" = "azul-indexer_aggregate-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-indexer" "billing" = "hca" "component" = "azul-indexer_aggregate" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } ~ version = "$LATEST" -> (known after apply) # (22 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "5c4b4ebea40027ed297a6088f680db97d83f1037" -> "fd989529917e91b4c6dd3f6f3f99ac3a58fdb6b7" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_aggregate_retry will be updated in-place ~ resource "aws_lambda_function" "indexer_aggregate_retry" { id = "azul-indexer-daniel-aggregate_retry" ~ last_modified = "2024-08-21T17:23:45.000+0000" -> (known after apply) ~ publish = false -> true ~ qualified_arn = "arn:aws:lambda:us-east-1:122796619775:function:azul-indexer-daniel-aggregate_retry:$LATEST" -> (known after apply) ~ qualified_invoke_arn = "arn:aws:apigateway:us-east-1:lambda:path/2015-03-31/functions/arn:aws:lambda:us-east-1:122796619775:function:azul-indexer-daniel-aggregate_retry:$LATEST/invocations" -> (known after apply) ~ source_code_hash = "vwju+dTpAAKHTEOC08T/PmGanNtt6LMp9XRwtVeltcc=" -> "5nmUsAt+SsJ7Mx2orZqu6/o2wmnHEguNCz3BFgaXtgU=" tags = { "Name" = "azul-indexer_aggregate_retry-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-indexer" "billing" = "hca" "component" = "azul-indexer_aggregate_retry" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } ~ version = "$LATEST" -> (known after apply) # (22 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "5c4b4ebea40027ed297a6088f680db97d83f1037" -> "fd989529917e91b4c6dd3f6f3f99ac3a58fdb6b7" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_contribute will be updated in-place ~ resource "aws_lambda_function" "indexer_contribute" { id = "azul-indexer-daniel-contribute" ~ last_modified = "2024-08-21T17:22:36.000+0000" -> (known after apply) ~ publish = false -> true ~ qualified_arn = "arn:aws:lambda:us-east-1:122796619775:function:azul-indexer-daniel-contribute:$LATEST" -> (known after apply) ~ qualified_invoke_arn = "arn:aws:apigateway:us-east-1:lambda:path/2015-03-31/functions/arn:aws:lambda:us-east-1:122796619775:function:azul-indexer-daniel-contribute:$LATEST/invocations" -> (known after apply) ~ source_code_hash = "vwju+dTpAAKHTEOC08T/PmGanNtt6LMp9XRwtVeltcc=" -> "5nmUsAt+SsJ7Mx2orZqu6/o2wmnHEguNCz3BFgaXtgU=" tags = { "Name" = "azul-indexer_contribute-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-indexer" "billing" = "hca" "component" = "azul-indexer_contribute" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } ~ version = "$LATEST" -> (known after apply) # (22 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "5c4b4ebea40027ed297a6088f680db97d83f1037" -> "fd989529917e91b4c6dd3f6f3f99ac3a58fdb6b7" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_contribute_retry will be updated in-place ~ resource "aws_lambda_function" "indexer_contribute_retry" { id = "azul-indexer-daniel-contribute_retry" ~ last_modified = "2024-08-21T17:21:37.000+0000" -> (known after apply) ~ publish = false -> true ~ qualified_arn = "arn:aws:lambda:us-east-1:122796619775:function:azul-indexer-daniel-contribute_retry:$LATEST" -> (known after apply) ~ qualified_invoke_arn = "arn:aws:apigateway:us-east-1:lambda:path/2015-03-31/functions/arn:aws:lambda:us-east-1:122796619775:function:azul-indexer-daniel-contribute_retry:$LATEST/invocations" -> (known after apply) ~ source_code_hash = "vwju+dTpAAKHTEOC08T/PmGanNtt6LMp9XRwtVeltcc=" -> "5nmUsAt+SsJ7Mx2orZqu6/o2wmnHEguNCz3BFgaXtgU=" tags = { "Name" = "azul-indexer_contribute_retry-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-indexer" "billing" = "hca" "component" = "azul-indexer_contribute_retry" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } ~ version = "$LATEST" -> (known after apply) # (22 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "5c4b4ebea40027ed297a6088f680db97d83f1037" -> "fd989529917e91b4c6dd3f6f3f99ac3a58fdb6b7" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_indexercachehealth will be updated in-place ~ resource "aws_lambda_function" "indexer_indexercachehealth" { id = "azul-indexer-daniel-indexercachehealth" ~ last_modified = "2024-08-21T17:23:19.000+0000" -> (known after apply) ~ publish = false -> true ~ qualified_arn = "arn:aws:lambda:us-east-1:122796619775:function:azul-indexer-daniel-indexercachehealth:$LATEST" -> (known after apply) ~ qualified_invoke_arn = "arn:aws:apigateway:us-east-1:lambda:path/2015-03-31/functions/arn:aws:lambda:us-east-1:122796619775:function:azul-indexer-daniel-indexercachehealth:$LATEST/invocations" -> (known after apply) ~ source_code_hash = "vwju+dTpAAKHTEOC08T/PmGanNtt6LMp9XRwtVeltcc=" -> "5nmUsAt+SsJ7Mx2orZqu6/o2wmnHEguNCz3BFgaXtgU=" tags = { "Name" = "azul-indexer_indexercachehealth-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-indexer" "billing" = "hca" "component" = "azul-indexer_indexercachehealth" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } ~ version = "$LATEST" -> (known after apply) # (22 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "5c4b4ebea40027ed297a6088f680db97d83f1037" -> "fd989529917e91b4c6dd3f6f3f99ac3a58fdb6b7" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.service will be updated in-place ~ resource "aws_lambda_function" "service" { id = "azul-service-daniel" ~ last_modified = "2024-08-21T17:22:10.000+0000" -> (known after apply) ~ publish = false -> true ~ qualified_arn = "arn:aws:lambda:us-east-1:122796619775:function:azul-service-daniel:$LATEST" -> (known after apply) ~ qualified_invoke_arn = "arn:aws:apigateway:us-east-1:lambda:path/2015-03-31/functions/arn:aws:lambda:us-east-1:122796619775:function:azul-service-daniel:$LATEST/invocations" -> (known after apply) ~ source_code_hash = "tG6/3ziD8Exkk1eqFil4CMfS8mf7GJxBYzMVwfBT+0s=" -> "LUQxlC0QMAnANfWBg41vxtPnIwdiNjb8e17c16IsU0U=" tags = { "Name" = "azul-service-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-service" "billing" = "hca" "component" = "azul-service" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } ~ version = "$LATEST" -> (known after apply) # (22 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "5c4b4ebea40027ed297a6088f680db97d83f1037" -> "fd989529917e91b4c6dd3f6f3f99ac3a58fdb6b7" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.service_manifest will be updated in-place ~ resource "aws_lambda_function" "service_manifest" { id = "azul-service-daniel-manifest" ~ last_modified = "2024-08-21T17:22:54.000+0000" -> (known after apply) ~ publish = false -> true ~ qualified_arn = "arn:aws:lambda:us-east-1:122796619775:function:azul-service-daniel-manifest:$LATEST" -> (known after apply) ~ qualified_invoke_arn = "arn:aws:apigateway:us-east-1:lambda:path/2015-03-31/functions/arn:aws:lambda:us-east-1:122796619775:function:azul-service-daniel-manifest:$LATEST/invocations" -> (known after apply) ~ source_code_hash = "tG6/3ziD8Exkk1eqFil4CMfS8mf7GJxBYzMVwfBT+0s=" -> "LUQxlC0QMAnANfWBg41vxtPnIwdiNjb8e17c16IsU0U=" tags = { "Name" = "azul-service_manifest-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-service" "billing" = "hca" "component" = "azul-service_manifest" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } ~ version = "$LATEST" -> (known after apply) # (22 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "5c4b4ebea40027ed297a6088f680db97d83f1037" -> "fd989529917e91b4c6dd3f6f3f99ac3a58fdb6b7" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.service_servicecachehealth will be updated in-place ~ resource "aws_lambda_function" "service_servicecachehealth" { id = "azul-service-daniel-servicecachehealth" ~ last_modified = "2024-08-21T17:24:05.000+0000" -> (known after apply) ~ publish = false -> true ~ qualified_arn = "arn:aws:lambda:us-east-1:122796619775:function:azul-service-daniel-servicecachehealth:$LATEST" -> (known after apply) ~ qualified_invoke_arn = "arn:aws:apigateway:us-east-1:lambda:path/2015-03-31/functions/arn:aws:lambda:us-east-1:122796619775:function:azul-service-daniel-servicecachehealth:$LATEST/invocations" -> (known after apply) ~ source_code_hash = "tG6/3ziD8Exkk1eqFil4CMfS8mf7GJxBYzMVwfBT+0s=" -> "LUQxlC0QMAnANfWBg41vxtPnIwdiNjb8e17c16IsU0U=" tags = { "Name" = "azul-service_servicecachehealth-daniel" "aws-chalice" = "version=1.30.0:stage=daniel:app=azul-service" "billing" = "hca" "component" = "azul-service_servicecachehealth" "deployment" = "daniel" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } ~ version = "$LATEST" -> (known after apply) # (22 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "5c4b4ebea40027ed297a6088f680db97d83f1037" -> "fd989529917e91b4c6dd3f6f3f99ac3a58fdb6b7" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } Plan: 0 to add, 9 to change, 0 to destroy. ──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── Saved the plan to: plan.bin To perform exactly these actions, run the following command to apply: terraform apply "plan.bin" terraform show -json plan.bin > plan.json terraform apply -auto-approve plan.bin aws_lambda_function.indexer: Modifying... [id=azul-indexer-daniel] aws_lambda_function.indexer_aggregate: Modifying... [id=azul-indexer-daniel-aggregate] aws_lambda_function.service_servicecachehealth: Modifying... [id=azul-service-daniel-servicecachehealth] aws_lambda_function.service: Modifying... [id=azul-service-daniel] aws_lambda_function.indexer_contribute: Modifying... [id=azul-indexer-daniel-contribute] aws_lambda_function.indexer_contribute_retry: Modifying... [id=azul-indexer-daniel-contribute_retry] aws_lambda_function.indexer_indexercachehealth: Modifying... [id=azul-indexer-daniel-indexercachehealth] aws_lambda_function.service_manifest: Modifying... [id=azul-service-daniel-manifest] aws_lambda_function.indexer_aggregate_retry: Modifying... [id=azul-indexer-daniel-aggregate_retry] aws_lambda_function.indexer_contribute: Still modifying... [id=azul-indexer-daniel-contribute, 10s elapsed] aws_lambda_function.service: Still modifying... [id=azul-service-daniel, 10s elapsed] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel-aggregate, 10s elapsed] aws_lambda_function.indexer: Still modifying... [id=azul-indexer-daniel, 10s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 10s elapsed] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel-servicecachehealth, 10s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 10s elapsed] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel-aggregate_retry, 10s elapsed] aws_lambda_function.service_manifest: Still modifying... [id=azul-service-daniel-manifest, 10s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 20s elapsed] aws_lambda_function.indexer_contribute: Still modifying... [id=azul-indexer-daniel-contribute, 20s elapsed] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel-servicecachehealth, 20s elapsed] aws_lambda_function.indexer: Still modifying... [id=azul-indexer-daniel, 20s elapsed] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel-aggregate, 20s elapsed] aws_lambda_function.service: Still modifying... [id=azul-service-daniel, 20s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 20s elapsed] aws_lambda_function.service_manifest: Still modifying... [id=azul-service-daniel-manifest, 20s elapsed] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel-aggregate_retry, 20s elapsed] aws_lambda_function.indexer: Modifications complete after 28s [id=azul-indexer-daniel] aws_lambda_function.service_manifest: Still modifying... [id=azul-service-daniel-manifest, 30s elapsed] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel-aggregate, 30s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 30s elapsed] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel-aggregate_retry, 30s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 30s elapsed] aws_lambda_function.indexer_contribute: Still modifying... [id=azul-indexer-daniel-contribute, 30s elapsed] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel-servicecachehealth, 30s elapsed] aws_lambda_function.service: Still modifying... [id=azul-service-daniel, 30s elapsed] aws_lambda_function.service_manifest: Still modifying... [id=azul-service-daniel-manifest, 40s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 40s elapsed] aws_lambda_function.service: Still modifying... [id=azul-service-daniel, 40s elapsed] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel-aggregate, 40s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 40s elapsed] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel-aggregate_retry, 40s elapsed] aws_lambda_function.indexer_contribute: Still modifying... [id=azul-indexer-daniel-contribute, 40s elapsed] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel-servicecachehealth, 40s elapsed] aws_lambda_function.service_manifest: Modifications complete after 47s [id=azul-service-daniel-manifest] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel-aggregate_retry, 50s elapsed] aws_lambda_function.indexer_contribute: Still modifying... [id=azul-indexer-daniel-contribute, 50s elapsed] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel-servicecachehealth, 50s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 50s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 50s elapsed] aws_lambda_function.service: Still modifying... [id=azul-service-daniel, 50s elapsed] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel-aggregate, 50s elapsed] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel-aggregate, 1m0s elapsed] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel-servicecachehealth, 1m0s elapsed] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel-aggregate_retry, 1m0s elapsed] aws_lambda_function.service: Still modifying... [id=azul-service-daniel, 1m0s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 1m0s elapsed] aws_lambda_function.indexer_contribute: Still modifying... [id=azul-indexer-daniel-contribute, 1m0s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 1m0s elapsed] aws_lambda_function.service: Modifications complete after 1m8s [id=azul-service-daniel] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel-aggregate, 1m10s elapsed] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel-aggregate_retry, 1m10s elapsed] aws_lambda_function.indexer_contribute: Still modifying... [id=azul-indexer-daniel-contribute, 1m10s elapsed] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel-servicecachehealth, 1m10s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 1m10s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 1m10s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 1m20s elapsed] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel-aggregate, 1m20s elapsed] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel-aggregate_retry, 1m20s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 1m20s elapsed] aws_lambda_function.indexer_contribute: Still modifying... [id=azul-indexer-daniel-contribute, 1m20s elapsed] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel-servicecachehealth, 1m20s elapsed] aws_lambda_function.indexer_contribute: Modifications complete after 1m28s [id=azul-indexer-daniel-contribute] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel-servicecachehealth, 1m30s elapsed] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel-aggregate_retry, 1m30s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 1m30s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 1m30s elapsed] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel-aggregate, 1m30s elapsed] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel-aggregate, 1m40s elapsed] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel-servicecachehealth, 1m40s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 1m40s elapsed] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel-aggregate_retry, 1m40s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 1m40s elapsed] aws_lambda_function.indexer_aggregate: Modifications complete after 1m47s [id=azul-indexer-daniel-aggregate] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 1m50s elapsed] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel-servicecachehealth, 1m50s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 1m50s elapsed] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel-aggregate_retry, 1m50s elapsed] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel-aggregate_retry, 2m0s elapsed] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel-servicecachehealth, 2m0s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 2m0s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 2m0s elapsed] aws_lambda_function.indexer_aggregate_retry: Modifications complete after 2m10s [id=azul-indexer-daniel-aggregate_retry] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 2m10s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 2m10s elapsed] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel-servicecachehealth, 2m10s elapsed] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel-servicecachehealth, 2m20s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 2m20s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 2m20s elapsed] aws_lambda_function.service_servicecachehealth: Modifications complete after 2m30s [id=azul-service-daniel-servicecachehealth] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 2m30s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 2m30s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 2m40s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 2m40s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel-contribute_retry, 2m50s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 2m50s elapsed] aws_lambda_function.indexer_contribute_retry: Modifications complete after 2m51s [id=azul-indexer-daniel-contribute_retry] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 3m0s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel-indexercachehealth, 3m10s elapsed] aws_lambda_function.indexer_indexercachehealth: Modifications complete after 3m15s [id=azul-indexer-daniel-indexercachehealth] Apply complete! Resources: 0 added, 9 changed, 0 destroyed. python /Users/daniel/repo/azul2/scripts/post_deploy_tdr.py 2024-08-21 10:32:22,706 INFO MainThread botocore.credentials: Found credentials in shared credentials file: ~/.aws/credentials 2024-08-21 10:32:22,734 INFO MainThread azul.deployment: Allocated new Boto3 client for 'secretsmanager' with ID 4403909008 2024-08-21 10:32:23,344 INFO MainThread azul.terra: Making POST request to 'https://sam.dsde-dev.broadinstitute.org/register/user/v1' 2024-08-21 10:32:23,344 DEBUG MainThread azul.terra: … with request body '' 2024-08-21 10:32:23,766 INFO MainThread azul.terra: Got 409 response after 0.422s from POST to https://sam.dsde-dev.broadinstitute.org/register/user/v1 2024-08-21 10:32:23,766 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:22 GMT', 'Server': 'akka-http/10.2.9', 'X-Frame-Options': 'SAMEORIGIN', 'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Referrer-Policy': 'strict-origin-when-cross-origin', 'Access-Control-Allow-Origin': '*', 'Access-Control-Allow-Headers': 'authorization,content-type,accept,origin,x-app-id', 'Access-Control-Allow-Methods': 'GET,POST,PUT,PATCH,DELETE,OPTIONS,HEAD', 'Access-Control-Max-Age': '1728000', 'Content-Type': 'application/json', 'Content-Length': '161', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:23,766 DEBUG MainThread azul.terra: … with response body b'{"causes":[],"message":"user azul-ucsc-11-daniel@platform-hca-dev.iam.gserviceaccount.com is already registered","source":"sa...' 2024-08-21 10:32:23,766 INFO MainThread azul.terra: Google service account 'azul-ucsc-11-daniel@platform-hca-dev.iam.gserviceaccount.com' previously registered with SAM. 2024-08-21 10:32:23,767 INFO MainThread azul.terra: Making GET request to 'https://sam.dsde-dev.broadinstitute.org/register/user/v1' 2024-08-21 10:32:23,767 DEBUG MainThread azul.terra: … without request body 2024-08-21 10:32:24,456 INFO MainThread azul.terra: Got 200 response after 0.688s from GET to https://sam.dsde-dev.broadinstitute.org/register/user/v1 2024-08-21 10:32:24,456 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:24 GMT', 'Server': 'akka-http/10.2.9', 'X-Frame-Options': 'SAMEORIGIN', 'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Referrer-Policy': 'strict-origin-when-cross-origin', 'Access-Control-Allow-Origin': '*', 'Access-Control-Allow-Headers': 'authorization,content-type,accept,origin,x-app-id', 'Access-Control-Allow-Methods': 'GET,POST,PUT,PATCH,DELETE,OPTIONS,HEAD', 'Access-Control-Max-Age': '1728000', 'Content-Type': 'application/json', 'Content-Length': '227', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:24,456 DEBUG MainThread azul.terra: … with response body b'{"enabled":{"tosAccepted":true,"google":true,"ldap":true,"allUsersGroup":true,"adminEnabled":true},"userInfo":{"userEmail":"a...' 2024-08-21 10:32:24,782 INFO MainThread azul.terra: Making POST request to 'https://sam.dsde-dev.broadinstitute.org/register/user/v1' 2024-08-21 10:32:24,782 DEBUG MainThread azul.terra: … with request body '' 2024-08-21 10:32:24,980 INFO MainThread azul.terra: Got 409 response after 0.198s from POST to https://sam.dsde-dev.broadinstitute.org/register/user/v1 2024-08-21 10:32:24,980 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:24 GMT', 'Server': 'akka-http/10.2.9', 'X-Frame-Options': 'SAMEORIGIN', 'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Referrer-Policy': 'strict-origin-when-cross-origin', 'Access-Control-Allow-Origin': '*', 'Access-Control-Allow-Headers': 'authorization,content-type,accept,origin,x-app-id', 'Access-Control-Allow-Methods': 'GET,POST,PUT,PATCH,DELETE,OPTIONS,HEAD', 'Access-Control-Max-Age': '1728000', 'Content-Type': 'application/json', 'Content-Length': '168', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:24,980 DEBUG MainThread azul.terra: … with response body b'{"causes":[],"message":"user azul-ucsc-11-public-daniel@platform-hca-dev.iam.gserviceaccount.com is already registered","sour...' 2024-08-21 10:32:24,980 INFO MainThread azul.terra: Google service account 'azul-ucsc-11-public-daniel@platform-hca-dev.iam.gserviceaccount.com' previously registered with SAM. 2024-08-21 10:32:24,981 INFO MainThread azul.terra: Making GET request to 'https://sam.dsde-dev.broadinstitute.org/register/user/v1' 2024-08-21 10:32:24,981 DEBUG MainThread azul.terra: … without request body 2024-08-21 10:32:25,604 INFO MainThread azul.terra: Got 200 response after 0.623s from GET to https://sam.dsde-dev.broadinstitute.org/register/user/v1 2024-08-21 10:32:25,605 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:25 GMT', 'Server': 'akka-http/10.2.9', 'X-Frame-Options': 'SAMEORIGIN', 'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Referrer-Policy': 'strict-origin-when-cross-origin', 'Access-Control-Allow-Origin': '*', 'Access-Control-Allow-Headers': 'authorization,content-type,accept,origin,x-app-id', 'Access-Control-Allow-Methods': 'GET,POST,PUT,PATCH,DELETE,OPTIONS,HEAD', 'Access-Control-Max-Age': '1728000', 'Content-Type': 'application/json', 'Content-Length': '234', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:25,605 DEBUG MainThread azul.terra: … with response body b'{"enabled":{"tosAccepted":true,"google":true,"ldap":true,"allUsersGroup":true,"adminEnabled":true},"userInfo":{"userEmail":"a...' 2024-08-21 10:32:25,773 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d3a4ceac4d66498497042570c0647a56__20210831_20210903&limit=2' 2024-08-21 10:32:25,773 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_7adede6a0ab745e69b67ffe7466bec1f__20210830_20210903&limit=2' 2024-08-21 10:32:25,773 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:25,773 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_eaefa1b6dae14414953b17b0427d061e__20210827_20210903&limit=2' 2024-08-21 10:32:25,773 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:25,773 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_116965f3f09447699d28ae675c1b569c__20210827_20210903&limit=2' 2024-08-21 10:32:25,774 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0792db3480474e62802c9177c9cd8e28__20210827_20210903&limit=2' 2024-08-21 10:32:25,774 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:25,774 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_b963bd4b4bc14404842569d74bc636b8__20210827_20210928&limit=2' 2024-08-21 10:32:25,774 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ccd1f1ba74ce469b9fc9f6faea623358__20210827_20210902&limit=2' 2024-08-21 10:32:25,774 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:25,775 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_3e329187a9c448ec90e3cc45f7c2311c__20210901_20210903&limit=2' 2024-08-21 10:32:25,775 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:25,776 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:25,776 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:25,776 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:26,808 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 1.031s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_3e329187a9c448ec90e3cc45f7c2311c__20210901_20210903&limit=2 2024-08-21 10:32:26,808 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:26 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pYWkl3N3', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:26,808 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"d5222430-0f7a-4bd1-8706-c58b4397a9b8","name":"hca_dev_3e329187a9c448ec90e3cc45...' 2024-08-21 10:32:26,809 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/d5222430-0f7a-4bd1-8706-c58b4397a9b8' 2024-08-21 10:32:26,810 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:26,824 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 1.051s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d3a4ceac4d66498497042570c0647a56__20210831_20210903&limit=2 2024-08-21 10:32:26,825 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:26 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aD4wYEby', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:26,825 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"ae52c25c-9ee4-4a42-83f2-6e4b20116380","name":"hca_dev_d3a4ceac4d66498497042570...' 2024-08-21 10:32:26,825 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/ae52c25c-9ee4-4a42-83f2-6e4b20116380' 2024-08-21 10:32:26,825 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:26,835 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 1.061s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_7adede6a0ab745e69b67ffe7466bec1f__20210830_20210903&limit=2 2024-08-21 10:32:26,835 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:26 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6vyOQPOn', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:26,835 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"a73ed2f2-12c7-4c71-a09d-3189b0fedc26","name":"hca_dev_7adede6a0ab745e69b67ffe7...' 2024-08-21 10:32:26,835 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/a73ed2f2-12c7-4c71-a09d-3189b0fedc26' 2024-08-21 10:32:26,835 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:26,873 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 1.096s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ccd1f1ba74ce469b9fc9f6faea623358__20210827_20210902&limit=2 2024-08-21 10:32:26,873 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:25 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aA4dNGK7', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:26,873 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"5d9ff6e0-3ec0-44f5-bb5c-32691a09517b","name":"hca_dev_ccd1f1ba74ce469b9fc9f6fa...' 2024-08-21 10:32:26,874 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/5d9ff6e0-3ec0-44f5-bb5c-32691a09517b' 2024-08-21 10:32:26,874 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:26,874 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 1.098s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_b963bd4b4bc14404842569d74bc636b8__20210827_20210928&limit=2 2024-08-21 10:32:26,874 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:26 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aj5VD9Zv', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:26,874 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"c935fa3e-06f7-4e85-9ff1-c58eaa789978","name":"hca_dev_b963bd4b4bc14404842569d7...' 2024-08-21 10:32:26,875 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/c935fa3e-06f7-4e85-9ff1-c58eaa789978' 2024-08-21 10:32:26,875 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:26,999 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 1.223s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_116965f3f09447699d28ae675c1b569c__20210827_20210903&limit=2 2024-08-21 10:32:26,999 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:25 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'axJjrDWj', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:27,000 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"a21be4c9-9778-4713-bc31-1a1c905a6ad3","name":"hca_dev_116965f3f09447699d28ae67...' 2024-08-21 10:32:27,001 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/a21be4c9-9778-4713-bc31-1a1c905a6ad3' 2024-08-21 10:32:27,001 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:27,068 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 1.291s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0792db3480474e62802c9177c9cd8e28__20210827_20210903&limit=2 2024-08-21 10:32:27,068 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:27 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eX1xjB77', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:27,068 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"d74bbb92-2f76-4637-b386-4a60eec93e28","name":"hca_dev_0792db3480474e62802c9177...' 2024-08-21 10:32:27,069 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/d74bbb92-2f76-4637-b386-4a60eec93e28' 2024-08-21 10:32:27,070 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:27,101 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 1.325s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_eaefa1b6dae14414953b17b0427d061e__20210827_20210903&limit=2 2024-08-21 10:32:27,101 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:27 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eOrl1LB8', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:27,101 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"05ed25dc-408d-4045-998d-6166fc2c3293","name":"hca_dev_eaefa1b6dae14414953b17b0...' 2024-08-21 10:32:27,102 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/05ed25dc-408d-4045-998d-6166fc2c3293' 2024-08-21 10:32:27,102 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:27,643 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.807s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/a73ed2f2-12c7-4c71-a09d-3189b0fedc26 2024-08-21 10:32:27,643 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:26 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6Mxk7Q2Z', 'Content-Type': 'application/json', 'Content-Length': '13488', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:27,643 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"id":"a73ed2f2-12c7-4c71-a09d-3189b0fedc26","name":"hca_dev_7adede6a0ab745e69b67ffe7466bec1f__20210830_20210903","descriptio...' 2024-08-21 10:32:27,644 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-4747d8fe:hca_dev_7adede6a0ab745e69b67ffe7466bec1f__20210830_20210903:14/0. 2024-08-21 10:32:27,649 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-4747d8fe.hca_dev_7adede6a0ab745e69b67ffe7466bec1f__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '14')\n GROUP BY prefix\n " 2024-08-21 10:32:27,739 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.929s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/d5222430-0f7a-4bd1-8706-c58b4397a9b8 2024-08-21 10:32:27,739 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:27 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aEQEKJN0', 'Content-Type': 'application/json', 'Content-Length': '13491', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:27,739 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"d5222430-0f7a-4bd1-8706-c58b4397a9b8","name":"hca_dev_3e329187a9c448ec90e3cc45f7c2311c__20210901_20210903","descriptio...' 2024-08-21 10:32:27,740 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-bdc9f342:hca_dev_3e329187a9c448ec90e3cc45f7c2311c__20210901_20210903:9e/0. 2024-08-21 10:32:27,741 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-bdc9f342.hca_dev_3e329187a9c448ec90e3cc45f7c2311c__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '9e')\n GROUP BY prefix\n " 2024-08-21 10:32:27,803 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.978s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/ae52c25c-9ee4-4a42-83f2-6e4b20116380 2024-08-21 10:32:27,804 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:27 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eXBVJ5MQ', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:27,804 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"id":"ae52c25c-9ee4-4a42-83f2-6e4b20116380","name":"hca_dev_d3a4ceac4d66498497042570c0647a56__20210831_20210903","descriptio...' 2024-08-21 10:32:27,804 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-92c3a1de:hca_dev_d3a4ceac4d66498497042570c0647a56__20210831_20210903:/0. 2024-08-21 10:32:27,805 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-92c3a1de.hca_dev_d3a4ceac4d66498497042570c0647a56__20210831_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:27,830 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.956s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/5d9ff6e0-3ec0-44f5-bb5c-32691a09517b 2024-08-21 10:32:27,830 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:27 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'emD8ldXw', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:27,830 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"id":"5d9ff6e0-3ec0-44f5-bb5c-32691a09517b","name":"hca_dev_ccd1f1ba74ce469b9fc9f6faea623358__20210827_20210902","descriptio...' 2024-08-21 10:32:27,831 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-2f4bfe5d:hca_dev_ccd1f1ba74ce469b9fc9f6faea623358__20210827_20210902:e/0. 2024-08-21 10:32:27,831 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-2f4bfe5d.hca_dev_ccd1f1ba74ce469b9fc9f6faea623358__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, 'e')\n GROUP BY prefix\n " 2024-08-21 10:32:27,838 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.837s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/a21be4c9-9778-4713-bc31-1a1c905a6ad3 2024-08-21 10:32:27,838 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:27 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'poQ3nAnZ', 'Content-Type': 'application/json', 'Content-Length': '13476', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:27,839 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"id":"a21be4c9-9778-4713-bc31-1a1c905a6ad3","name":"hca_dev_116965f3f09447699d28ae675c1b569c__20210827_20210903","descriptio...' 2024-08-21 10:32:27,839 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-ff0a2fe7:hca_dev_116965f3f09447699d28ae675c1b569c__20210827_20210903:/0. 2024-08-21 10:32:27,839 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-ff0a2fe7.hca_dev_116965f3f09447699d28ae675c1b569c__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:27,853 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.978s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/c935fa3e-06f7-4e85-9ff1-c58eaa789978 2024-08-21 10:32:27,853 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:27 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'emDYOx4w', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:27,853 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"id":"c935fa3e-06f7-4e85-9ff1-c58eaa789978","name":"hca_dev_b963bd4b4bc14404842569d74bc636b8__20210827_20210928","descriptio...' 2024-08-21 10:32:27,854 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-cd97e83a:hca_dev_b963bd4b4bc14404842569d74bc636b8__20210827_20210928:/0. 2024-08-21 10:32:27,855 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-cd97e83a.hca_dev_b963bd4b4bc14404842569d74bc636b8__20210827_20210928.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:27,895 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.825s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/d74bbb92-2f76-4637-b386-4a60eec93e28 2024-08-21 10:32:27,895 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:27 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e2ny3DN8', 'Content-Type': 'application/json', 'Content-Length': '13484', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:27,896 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"id":"d74bbb92-2f76-4637-b386-4a60eec93e28","name":"hca_dev_0792db3480474e62802c9177c9cd8e28__20210827_20210903","descriptio...' 2024-08-21 10:32:27,896 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-baa2812f:hca_dev_0792db3480474e62802c9177c9cd8e28__20210827_20210903:aa/0. 2024-08-21 10:32:27,896 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-baa2812f.hca_dev_0792db3480474e62802c9177c9cd8e28__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'aa')\n GROUP BY prefix\n " 2024-08-21 10:32:27,899 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.797s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/05ed25dc-408d-4045-998d-6166fc2c3293 2024-08-21 10:32:27,899 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:27 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eXnYJl8Q', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:27,899 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"id":"05ed25dc-408d-4045-998d-6166fc2c3293","name":"hca_dev_eaefa1b6dae14414953b17b0427d061e__20210827_20210903","descriptio...' 2024-08-21 10:32:27,899 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-dbc3e131:hca_dev_eaefa1b6dae14414953b17b0427d061e__20210827_20210903:1/0. 2024-08-21 10:32:27,899 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-dbc3e131.hca_dev_eaefa1b6dae14414953b17b0427d061e__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '1')\n GROUP BY prefix\n " 2024-08-21 10:32:28,552 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "d6c86f6c-08ac-479f-a435-e77665c2dc37", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-4747d8fe.hca_dev_7adede6a0ab745e69b67ffe7466bec1f__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '14')\n GROUP BY prefix\n "} 2024-08-21 10:32:28,619 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "a88ba8de-f7a9-449d-a083-cbaa3b5e74da", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-bdc9f342.hca_dev_3e329187a9c448ec90e3cc45f7c2311c__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '9e')\n GROUP BY prefix\n "} 2024-08-21 10:32:28,736 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a96b71c078a742d188ce83c78925cfeb__20210827_20210902&limit=2' 2024-08-21 10:32:28,737 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:28,758 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "ff164a10-826b-4c5f-9b3e-3ccdee862478", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-92c3a1de.hca_dev_d3a4ceac4d66498497042570c0647a56__20210831_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:28,760 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "63052212-ec0b-44c6-b719-4351871a657a", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-cd97e83a.hca_dev_b963bd4b4bc14404842569d74bc636b8__20210827_20210928.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:28,762 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "59a8f6d7-7cb9-4c44-8ff2-1da9d08e5d76", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-ff0a2fe7.hca_dev_116965f3f09447699d28ae675c1b569c__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:28,793 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "a76b8a7f-deea-4348-8ad2-52e8f0dae513", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-2f4bfe5d.hca_dev_ccd1f1ba74ce469b9fc9f6faea623358__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, 'e')\n GROUP BY prefix\n "} 2024-08-21 10:32:28,806 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a004b1501c364af69bbd070c06dbc17d__20210830_20210903&limit=2' 2024-08-21 10:32:28,807 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:28,818 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "1cc3f5dc-9035-4cce-a93e-8edbb1dc161e", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-baa2812f.hca_dev_0792db3480474e62802c9177c9cd8e28__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'aa')\n GROUP BY prefix\n "} 2024-08-21 10:32:28,837 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "6eb32c5b-0182-43ec-a81f-38574537b6ad", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-dbc3e131.hca_dev_eaefa1b6dae14414953b17b0427d061e__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '1')\n GROUP BY prefix\n "} 2024-08-21 10:32:28,944 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0c3b7785f74d40918616a68757e4c2a8__20210827_20210903&limit=2' 2024-08-21 10:32:28,945 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:28,949 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_520afa10f9d24e93ab7a26c4c863ce18__20210827_20210928&limit=2' 2024-08-21 10:32:28,950 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:28,956 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f81efc039f564354aabb6ce819c3d414__20210827_20210903&limit=2' 2024-08-21 10:32:28,956 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:28,957 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.221s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a96b71c078a742d188ce83c78925cfeb__20210827_20210902&limit=2 2024-08-21 10:32:28,958 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aKdJm3rM', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:28,958 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"385eb563-005e-43ed-adb7-d3c9e0a8ae93","name":"hca_dev_a96b71c078a742d188ce83c7...' 2024-08-21 10:32:28,958 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/385eb563-005e-43ed-adb7-d3c9e0a8ae93' 2024-08-21 10:32:28,958 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:28,962 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d3ac7c1b53024804b611dad9f89c049d__20210827_20230215&limit=2' 2024-08-21 10:32:28,962 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:28,994 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_67a3de0945b949c3a068ff4665daa50e__20210827_20210903&limit=2' 2024-08-21 10:32:28,995 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:29,011 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.205s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a004b1501c364af69bbd070c06dbc17d__20210830_20210903&limit=2 2024-08-21 10:32:29,011 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pPgMLdJx', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:29,012 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"2c4ec571-f489-4277-b215-da8dedd86803","name":"hca_dev_a004b1501c364af69bbd070c...' 2024-08-21 10:32:29,012 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/2c4ec571-f489-4277-b215-da8dedd86803' 2024-08-21 10:32:29,013 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:29,031 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_b51f49b40d2e4cbdbbd504cd171fc2fa__20210830_20210903&limit=2' 2024-08-21 10:32:29,031 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:29,207 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.257s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_520afa10f9d24e93ab7a26c4c863ce18__20210827_20210928&limit=2 2024-08-21 10:32:29,207 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eXAgYzJJ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:29,207 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"768c4624-c07b-4496-8b7b-76275a149774","name":"hca_dev_520afa10f9d24e93ab7a26c4...' 2024-08-21 10:32:29,208 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/768c4624-c07b-4496-8b7b-76275a149774' 2024-08-21 10:32:29,208 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:29,217 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.261s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f81efc039f564354aabb6ce819c3d414__20210827_20210903&limit=2 2024-08-21 10:32:29,217 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6gRVwlQ3', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:29,217 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"2c5901f6-67bf-40cc-aea1-621a60c19baa","name":"hca_dev_f81efc039f564354aabb6ce8...' 2024-08-21 10:32:29,218 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/2c5901f6-67bf-40cc-aea1-621a60c19baa' 2024-08-21 10:32:29,218 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:29,256 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.310s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0c3b7785f74d40918616a68757e4c2a8__20210827_20210903&limit=2 2024-08-21 10:32:29,256 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aEGLB5Ax', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:29,256 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"f012a311-5d55-42ad-8b77-f8a1816f3aa4","name":"hca_dev_0c3b7785f74d40918616a687...' 2024-08-21 10:32:29,257 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/f012a311-5d55-42ad-8b77-f8a1816f3aa4' 2024-08-21 10:32:29,257 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:29,267 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.273s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_67a3de0945b949c3a068ff4665daa50e__20210827_20210903&limit=2 2024-08-21 10:32:29,268 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eky4ob77', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:29,268 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"13c6bf33-41a3-4330-a3f7-1e69f675b01e","name":"hca_dev_67a3de0945b949c3a068ff46...' 2024-08-21 10:32:29,268 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/13c6bf33-41a3-4330-a3f7-1e69f675b01e' 2024-08-21 10:32:29,269 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:29,454 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.441s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/2c4ec571-f489-4277-b215-da8dedd86803 2024-08-21 10:32:29,454 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pYR8gkkY', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:29,455 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"2c4ec571-f489-4277-b215-da8dedd86803","name":"hca_dev_a004b1501c364af69bbd070c06dbc17d__20210830_20210903","descriptio...' 2024-08-21 10:32:29,455 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-d4b988d6:hca_dev_a004b1501c364af69bbd070c06dbc17d__20210830_20210903:/0. 2024-08-21 10:32:29,456 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-d4b988d6.hca_dev_a004b1501c364af69bbd070c06dbc17d__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:29,725 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.694s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_b51f49b40d2e4cbdbbd504cd171fc2fa__20210830_20210903&limit=2 2024-08-21 10:32:29,725 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:29 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a889NbGa', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:29,725 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"806a9a68-1804-4234-85e1-aac7cdbffd73","name":"hca_dev_b51f49b40d2e4cbdbbd504cd...' 2024-08-21 10:32:29,726 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/806a9a68-1804-4234-85e1-aac7cdbffd73' 2024-08-21 10:32:29,726 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:29,728 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.769s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/385eb563-005e-43ed-adb7-d3c9e0a8ae93 2024-08-21 10:32:29,728 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aEGm5zAN', 'Content-Type': 'application/json', 'Content-Length': '13476', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:29,728 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"id":"385eb563-005e-43ed-adb7-d3c9e0a8ae93","name":"hca_dev_a96b71c078a742d188ce83c78925cfeb__20210827_20210902","descriptio...' 2024-08-21 10:32:29,728 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-7b7daff7:hca_dev_a96b71c078a742d188ce83c78925cfeb__20210827_20210902:/0. 2024-08-21 10:32:29,728 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-7b7daff7.hca_dev_a96b71c078a742d188ce83c78925cfeb__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:29,756 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.794s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d3ac7c1b53024804b611dad9f89c049d__20210827_20230215&limit=2 2024-08-21 10:32:29,756 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:29 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6ggqdDNZ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:29,756 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e2af563e-68e2-495a-a51a-041e1e32f037","name":"hca_dev_d3ac7c1b53024804b611dad9...' 2024-08-21 10:32:29,757 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e2af563e-68e2-495a-a51a-041e1e32f037' 2024-08-21 10:32:29,757 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:29,841 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.623s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/2c5901f6-67bf-40cc-aea1-621a60c19baa 2024-08-21 10:32:29,842 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6vDovO0n', 'Content-Type': 'application/json', 'Content-Length': '13476', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:29,842 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"id":"2c5901f6-67bf-40cc-aea1-621a60c19baa","name":"hca_dev_f81efc039f564354aabb6ce819c3d414__20210827_20210903","descriptio...' 2024-08-21 10:32:29,843 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-10f0610a:hca_dev_f81efc039f564354aabb6ce819c3d414__20210827_20210903:/0. 2024-08-21 10:32:29,843 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-10f0610a.hca_dev_f81efc039f564354aabb6ce819c3d414__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:29,913 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.705s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/768c4624-c07b-4496-8b7b-76275a149774 2024-08-21 10:32:29,913 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pY15VZzr', 'Content-Type': 'application/json', 'Content-Length': '13485', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:29,913 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"id":"768c4624-c07b-4496-8b7b-76275a149774","name":"hca_dev_520afa10f9d24e93ab7a26c4c863ce18__20210827_20210928","descriptio...' 2024-08-21 10:32:29,914 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-71de019e:hca_dev_520afa10f9d24e93ab7a26c4c863ce18__20210827_20210928:98/0. 2024-08-21 10:32:29,915 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-71de019e.hca_dev_520afa10f9d24e93ab7a26c4c863ce18__20210827_20210928.links`\n )\n WHERE STARTS_WITH(prefix, '98')\n GROUP BY prefix\n " 2024-08-21 10:32:29,930 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.673s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/f012a311-5d55-42ad-8b77-f8a1816f3aa4 2024-08-21 10:32:29,930 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pY71Rk33', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:29,930 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"id":"f012a311-5d55-42ad-8b77-f8a1816f3aa4","name":"hca_dev_0c3b7785f74d40918616a68757e4c2a8__20210827_20210903","descriptio...' 2024-08-21 10:32:29,931 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-eab7fa76:hca_dev_0c3b7785f74d40918616a68757e4c2a8__20210827_20210903:1/0. 2024-08-21 10:32:29,931 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-eab7fa76.hca_dev_0c3b7785f74d40918616a68757e4c2a8__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '1')\n GROUP BY prefix\n " 2024-08-21 10:32:29,942 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.673s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/13c6bf33-41a3-4330-a3f7-1e69f675b01e 2024-08-21 10:32:29,942 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:28 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e72owoLy', 'Content-Type': 'application/json', 'Content-Length': '13487', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:29,942 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"id":"13c6bf33-41a3-4330-a3f7-1e69f675b01e","name":"hca_dev_67a3de0945b949c3a068ff4665daa50e__20210827_20210903","descriptio...' 2024-08-21 10:32:29,943 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-ecb9c129:hca_dev_67a3de0945b949c3a068ff4665daa50e__20210827_20210903:cd/0. 2024-08-21 10:32:29,943 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-ecb9c129.hca_dev_67a3de0945b949c3a068ff4665daa50e__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'cd')\n GROUP BY prefix\n " 2024-08-21 10:32:30,314 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "73d4fc39-3269-48b8-bfd0-71e2416849a2", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-d4b988d6.hca_dev_a004b1501c364af69bbd070c06dbc17d__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:30,517 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_df88f39f01a84b5b92f43177d6c0f242__20210827_20230215&limit=2' 2024-08-21 10:32:30,518 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:30,572 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "a3f8fc2e-5341-412b-b198-c2d9ac1d2ae4", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-10f0610a.hca_dev_f81efc039f564354aabb6ce819c3d414__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:30,626 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "e8d9bc00-f310-48a9-a17a-c1910285c385", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-7b7daff7.hca_dev_a96b71c078a742d188ce83c78925cfeb__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:30,696 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "145be8fa-c6df-4572-9969-07e867e172a9", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-eab7fa76.hca_dev_0c3b7785f74d40918616a68757e4c2a8__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '1')\n GROUP BY prefix\n "} 2024-08-21 10:32:30,715 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.197s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_df88f39f01a84b5b92f43177d6c0f242__20210827_20230215&limit=2 2024-08-21 10:32:30,715 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:30 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eX1lVx2n', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:30,715 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"07bd9e9a-f3d5-4ce7-a7b5-a82cf5ede5b9","name":"hca_dev_df88f39f01a84b5b92f43177...' 2024-08-21 10:32:30,716 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/07bd9e9a-f3d5-4ce7-a7b5-a82cf5ede5b9' 2024-08-21 10:32:30,716 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:30,730 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "3b69aa89-243e-4c60-ba5b-a5442d65f5e2", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-71de019e.hca_dev_520afa10f9d24e93ab7a26c4c863ce18__20210827_20210928.links`\n )\n WHERE STARTS_WITH(prefix, '98')\n GROUP BY prefix\n "} 2024-08-21 10:32:30,746 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "c8a80935-b827-4c88-9031-3599e22821a1", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-ecb9c129.hca_dev_67a3de0945b949c3a068ff4665daa50e__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'cd')\n GROUP BY prefix\n "} 2024-08-21 10:32:30,790 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_577c946d6de54b55a854cd3fde40bff2__20210827_20210903&limit=2' 2024-08-21 10:32:30,791 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:30,792 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0d4b87ea6e9e456982e41343e0e3259f__20210827_20210903&limit=2' 2024-08-21 10:32:30,792 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:30,866 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_16ed4ad8731946b288596fe1c1d73a82__20210830_20210903&limit=2' 2024-08-21 10:32:30,867 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:30,903 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2d8460958a334f3c97d4585bafac13b4__20210902_20210907&limit=2' 2024-08-21 10:32:30,903 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:30,926 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_414accedeba0440fb721befbc5642bef__20210827_20210903&limit=2' 2024-08-21 10:32:30,926 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:30,928 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.212s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/07bd9e9a-f3d5-4ce7-a7b5-a82cf5ede5b9 2024-08-21 10:32:30,928 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:30 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e2nKKbZ1', 'Content-Type': 'application/json', 'Content-Length': '13475', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:30,928 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"07bd9e9a-f3d5-4ce7-a7b5-a82cf5ede5b9","name":"hca_dev_df88f39f01a84b5b92f43177d6c0f242__20210827_20230215","descriptio...' 2024-08-21 10:32:30,928 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-8709b362:hca_dev_df88f39f01a84b5b92f43177d6c0f242__20210827_20230215:/0. 2024-08-21 10:32:30,928 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-8709b362.hca_dev_df88f39f01a84b5b92f43177d6c0f242__20210827_20230215.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:31,019 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.228s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_577c946d6de54b55a854cd3fde40bff2__20210827_20210903&limit=2 2024-08-21 10:32:31,019 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:30 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6B4nwMQ0', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:31,019 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"32cfbe46-2cd9-4b13-95c0-e2670373dd9a","name":"hca_dev_577c946d6de54b55a854cd3f...' 2024-08-21 10:32:31,020 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/32cfbe46-2cd9-4b13-95c0-e2670373dd9a' 2024-08-21 10:32:31,020 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:31,036 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.243s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0d4b87ea6e9e456982e41343e0e3259f__20210827_20210903&limit=2 2024-08-21 10:32:31,036 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:30 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'err00Exm', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:31,036 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"4c15703d-2502-4863-8d82-fc1b6ccf65f0","name":"hca_dev_0d4b87ea6e9e456982e41343...' 2024-08-21 10:32:31,037 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/4c15703d-2502-4863-8d82-fc1b6ccf65f0' 2024-08-21 10:32:31,037 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:31,068 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.201s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_16ed4ad8731946b288596fe1c1d73a82__20210830_20210903&limit=2 2024-08-21 10:32:31,068 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:30 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'po1vjvN7', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:31,068 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"d1437ee2-cfb9-4635-822d-8593da2954fa","name":"hca_dev_16ed4ad8731946b288596fe1...' 2024-08-21 10:32:31,069 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/d1437ee2-cfb9-4635-822d-8593da2954fa' 2024-08-21 10:32:31,069 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:31,156 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.253s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2d8460958a334f3c97d4585bafac13b4__20210902_20210907&limit=2 2024-08-21 10:32:31,156 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:30 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aEEY5rGE', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:31,156 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"d15b9e6e-dd53-4b80-80f1-4c698300b15a","name":"hca_dev_2d8460958a334f3c97d4585b...' 2024-08-21 10:32:31,157 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/d15b9e6e-dd53-4b80-80f1-4c698300b15a' 2024-08-21 10:32:31,157 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:31,162 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.236s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_414accedeba0440fb721befbc5642bef__20210827_20210903&limit=2 2024-08-21 10:32:31,162 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:30 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a5q3ZnNy', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:31,162 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e612386b-287d-4424-beb8-4ab62f925642","name":"hca_dev_414accedeba0440fb721befb...' 2024-08-21 10:32:31,162 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e612386b-287d-4424-beb8-4ab62f925642' 2024-08-21 10:32:31,163 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:31,301 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 1.575s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/806a9a68-1804-4234-85e1-aac7cdbffd73 2024-08-21 10:32:31,301 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:31 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aE091PZ6', 'Content-Type': 'application/json', 'Content-Length': '13486', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:31,301 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"id":"806a9a68-1804-4234-85e1-aac7cdbffd73","name":"hca_dev_b51f49b40d2e4cbdbbd504cd171fc2fa__20210830_20210903","descriptio...' 2024-08-21 10:32:31,302 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-0b465564:hca_dev_b51f49b40d2e4cbdbbd504cd171fc2fa__20210830_20210903:1/0. 2024-08-21 10:32:31,303 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-0b465564.hca_dev_b51f49b40d2e4cbdbbd504cd171fc2fa__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '1')\n GROUP BY prefix\n " 2024-08-21 10:32:31,352 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 1.594s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e2af563e-68e2-495a-a51a-041e1e32f037 2024-08-21 10:32:31,352 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:31 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6JGVRz4l', 'Content-Type': 'application/json', 'Content-Length': '13481', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:31,352 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"id":"e2af563e-68e2-495a-a51a-041e1e32f037","name":"hca_dev_d3ac7c1b53024804b611dad9f89c049d__20210827_20230215","descriptio...' 2024-08-21 10:32:31,353 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-1005632d:hca_dev_d3ac7c1b53024804b611dad9f89c049d__20210827_20230215:/0. 2024-08-21 10:32:31,353 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-1005632d.hca_dev_d3ac7c1b53024804b611dad9f89c049d__20210827_20230215.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:31,467 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.430s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/4c15703d-2502-4863-8d82-fc1b6ccf65f0 2024-08-21 10:32:31,467 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:30 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ebXlNgYR', 'Content-Type': 'application/json', 'Content-Length': '13476', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:31,467 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"id":"4c15703d-2502-4863-8d82-fc1b6ccf65f0","name":"hca_dev_0d4b87ea6e9e456982e41343e0e3259f__20210827_20210903","descriptio...' 2024-08-21 10:32:31,468 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-fef02a92:hca_dev_0d4b87ea6e9e456982e41343e0e3259f__20210827_20210903:/0. 2024-08-21 10:32:31,468 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-fef02a92.hca_dev_0d4b87ea6e9e456982e41343e0e3259f__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:31,568 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.499s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/d1437ee2-cfb9-4635-822d-8593da2954fa 2024-08-21 10:32:31,568 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:31 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eZAljYlA', 'Content-Type': 'application/json', 'Content-Length': '13481', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:31,568 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"id":"d1437ee2-cfb9-4635-822d-8593da2954fa","name":"hca_dev_16ed4ad8731946b288596fe1c1d73a82__20210830_20210903","descriptio...' 2024-08-21 10:32:31,569 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-4de1b9fd:hca_dev_16ed4ad8731946b288596fe1c1d73a82__20210830_20210903:/0. 2024-08-21 10:32:31,570 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-4de1b9fd.hca_dev_16ed4ad8731946b288596fe1c1d73a82__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:31,604 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.447s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/d15b9e6e-dd53-4b80-80f1-4c698300b15a 2024-08-21 10:32:31,604 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:30 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eXMlkYzr', 'Content-Type': 'application/json', 'Content-Length': '13487', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:31,605 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"id":"d15b9e6e-dd53-4b80-80f1-4c698300b15a","name":"hca_dev_2d8460958a334f3c97d4585bafac13b4__20210902_20210907","descriptio...' 2024-08-21 10:32:31,605 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-311340f6:hca_dev_2d8460958a334f3c97d4585bafac13b4__20210902_20210907:50/0. 2024-08-21 10:32:31,605 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-311340f6.hca_dev_2d8460958a334f3c97d4585bafac13b4__20210902_20210907.links`\n )\n WHERE STARTS_WITH(prefix, '50')\n GROUP BY prefix\n " 2024-08-21 10:32:31,708 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "40683494-407c-4f23-8ae0-88f67900914e", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-8709b362.hca_dev_df88f39f01a84b5b92f43177d6c0f242__20210827_20230215.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:31,724 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.562s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e612386b-287d-4424-beb8-4ab62f925642 2024-08-21 10:32:31,724 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:31 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ajEG8LB6', 'Content-Type': 'application/json', 'Content-Length': '13475', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:31,725 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"id":"e612386b-287d-4424-beb8-4ab62f925642","name":"hca_dev_414accedeba0440fb721befbc5642bef__20210827_20210903","descriptio...' 2024-08-21 10:32:31,725 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-31b3553a:hca_dev_414accedeba0440fb721befbc5642bef__20210827_20210903:/0. 2024-08-21 10:32:31,725 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-31b3553a.hca_dev_414accedeba0440fb721befbc5642bef__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:31,726 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.706s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/32cfbe46-2cd9-4b13-95c0-e2670373dd9a 2024-08-21 10:32:31,726 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:31 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a9QARbRd', 'Content-Type': 'application/json', 'Content-Length': '13477', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:31,727 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"id":"32cfbe46-2cd9-4b13-95c0-e2670373dd9a","name":"hca_dev_577c946d6de54b55a854cd3fde40bff2__20210827_20210903","descriptio...' 2024-08-21 10:32:31,727 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-319b80f7:hca_dev_577c946d6de54b55a854cd3fde40bff2__20210827_20210903:/0. 2024-08-21 10:32:31,727 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-319b80f7.hca_dev_577c946d6de54b55a854cd3fde40bff2__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:31,874 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_90bd693340c048d48d76778c103bf545__20210827_20211110&limit=2' 2024-08-21 10:32:31,875 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:32,102 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "7142fd9f-d3cb-412f-afcd-3e1b4b45d024", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-1005632d.hca_dev_d3ac7c1b53024804b611dad9f89c049d__20210827_20230215.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:32,166 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.291s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_90bd693340c048d48d76778c103bf545__20210827_20211110&limit=2 2024-08-21 10:32:32,166 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:31 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6qn9vEVw', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:32,167 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"8bf100c0-7ac3-4860-80ca-28093f4adb61","name":"hca_dev_90bd693340c048d48d76778c...' 2024-08-21 10:32:32,168 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/8bf100c0-7ac3-4860-80ca-28093f4adb61' 2024-08-21 10:32:32,168 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:32,190 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "3b0013d7-f162-4178-9a6f-5556393c0f25", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-fef02a92.hca_dev_0d4b87ea6e9e456982e41343e0e3259f__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:32,224 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "eef46f84-7093-4fa0-917b-1c017f85ead4", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-0b465564.hca_dev_b51f49b40d2e4cbdbbd504cd171fc2fa__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '1')\n GROUP BY prefix\n "} 2024-08-21 10:32:32,251 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_1c6a960d52ac44eab728a59c7ab9dc8e__20210827_20210928&limit=2' 2024-08-21 10:32:32,251 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:32,358 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f83165c5e2ea4d15a5cf33f3550bffde__20210901_20210908&limit=2' 2024-08-21 10:32:32,359 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:32,391 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_08b794a0519c4516b184c583746254c5__20210901_20210903&limit=2' 2024-08-21 10:32:32,392 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:32,408 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.240s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/8bf100c0-7ac3-4860-80ca-28093f4adb61 2024-08-21 10:32:32,408 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:32 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ekNZ730x', 'Content-Type': 'application/json', 'Content-Length': '13489', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:32,408 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"8bf100c0-7ac3-4860-80ca-28093f4adb61","name":"hca_dev_90bd693340c048d48d76778c103bf545__20210827_20211110","descriptio...' 2024-08-21 10:32:32,409 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-29509483:hca_dev_90bd693340c048d48d76778c103bf545__20210827_20211110:5c/0. 2024-08-21 10:32:32,409 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-29509483.hca_dev_90bd693340c048d48d76778c103bf545__20210827_20211110.links`\n )\n WHERE STARTS_WITH(prefix, '5c')\n GROUP BY prefix\n " 2024-08-21 10:32:32,438 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.187s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_1c6a960d52ac44eab728a59c7ab9dc8e__20210827_20210928&limit=2 2024-08-21 10:32:32,439 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:31 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6J5E9MzG', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:32,439 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"8a527b32-5ae3-437e-8a96-12562894849c","name":"hca_dev_1c6a960d52ac44eab728a59c...' 2024-08-21 10:32:32,439 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/8a527b32-5ae3-437e-8a96-12562894849c' 2024-08-21 10:32:32,440 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:32,446 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "f07e1985-f650-4fc0-b88f-96362087fee0", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-311340f6.hca_dev_2d8460958a334f3c97d4585bafac13b4__20210902_20210907.links`\n )\n WHERE STARTS_WITH(prefix, '50')\n GROUP BY prefix\n "} 2024-08-21 10:32:32,466 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "c7919856-131c-407e-97cb-cf303b51d877", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-31b3553a.hca_dev_414accedeba0440fb721befbc5642bef__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:32,498 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "df315709-de77-42ec-a7ee-eb4d8f57479b", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-4de1b9fd.hca_dev_16ed4ad8731946b288596fe1c1d73a82__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:32,583 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.224s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f83165c5e2ea4d15a5cf33f3550bffde__20210901_20210908&limit=2 2024-08-21 10:32:32,584 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:32 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a509dkoD', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:32,584 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e9fb5a5a-6eca-40b4-a894-3a3c65b7908e","name":"hca_dev_f83165c5e2ea4d15a5cf33f3...' 2024-08-21 10:32:32,585 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e9fb5a5a-6eca-40b4-a894-3a3c65b7908e' 2024-08-21 10:32:32,585 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:32,594 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "b03ee836-f02d-4209-b812-d9affc7c4c10", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-319b80f7.hca_dev_577c946d6de54b55a854cd3fde40bff2__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:32,594 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_42d4f8d454224b78adaee7c3c2ef511c__20210830_20210903&limit=2' 2024-08-21 10:32:32,596 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:32,596 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.204s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_08b794a0519c4516b184c583746254c5__20210901_20210903&limit=2 2024-08-21 10:32:32,597 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:31 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eO5q2j89', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:32,597 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"f7eefeb5-4198-4d9a-b3db-f2db6a567a15","name":"hca_dev_08b794a0519c4516b184c583...' 2024-08-21 10:32:32,597 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/f7eefeb5-4198-4d9a-b3db-f2db6a567a15' 2024-08-21 10:32:32,598 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:32,625 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_bd40033154b94fccbff66bb8b079ee1f__20210901_20210903&limit=2' 2024-08-21 10:32:32,625 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:32,688 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a39728aa70a04201b0a281b7badf3e71__20210830_20210903&limit=2' 2024-08-21 10:32:32,688 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:32,690 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.251s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/8a527b32-5ae3-437e-8a96-12562894849c 2024-08-21 10:32:32,691 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:32 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6qjRbqBw', 'Content-Type': 'application/json', 'Content-Length': '13478', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:32,691 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"id":"8a527b32-5ae3-437e-8a96-12562894849c","name":"hca_dev_1c6a960d52ac44eab728a59c7ab9dc8e__20210827_20210928","descriptio...' 2024-08-21 10:32:32,691 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-135f340c:hca_dev_1c6a960d52ac44eab728a59c7ab9dc8e__20210827_20210928:/0. 2024-08-21 10:32:32,691 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-135f340c.hca_dev_1c6a960d52ac44eab728a59c7ab9dc8e__20210827_20210928.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:32,744 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_4037007b0eff4e6db7bd8dd8eec80143__20210831_20210903&limit=2' 2024-08-21 10:32:32,745 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:32,867 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.271s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_42d4f8d454224b78adaee7c3c2ef511c__20210830_20210903&limit=2 2024-08-21 10:32:32,867 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:32 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aGAVJ59g', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:32,867 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"41d88011-1981-4f50-b6fe-78f7b7d27bab","name":"hca_dev_42d4f8d454224b78adaee7c3...' 2024-08-21 10:32:32,868 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/41d88011-1981-4f50-b6fe-78f7b7d27bab' 2024-08-21 10:32:32,868 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:32,920 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.335s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e9fb5a5a-6eca-40b4-a894-3a3c65b7908e 2024-08-21 10:32:32,920 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:32 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'awYv19Wb', 'Content-Type': 'application/json', 'Content-Length': '13494', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:32,920 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"id":"e9fb5a5a-6eca-40b4-a894-3a3c65b7908e","name":"hca_dev_f83165c5e2ea4d15a5cf33f3550bffde__20210901_20210908","descriptio...' 2024-08-21 10:32:32,920 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-24e9529e:hca_dev_f83165c5e2ea4d15a5cf33f3550bffde__20210901_20210908:fe/0. 2024-08-21 10:32:32,921 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-24e9529e.hca_dev_f83165c5e2ea4d15a5cf33f3550bffde__20210901_20210908.links`\n )\n WHERE STARTS_WITH(prefix, 'fe')\n GROUP BY prefix\n " 2024-08-21 10:32:32,937 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.249s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a39728aa70a04201b0a281b7badf3e71__20210830_20210903&limit=2 2024-08-21 10:32:32,937 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:32 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aN4XVY8Z', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:32,937 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"b580fa04-b2ef-472e-bd39-4a51368e813c","name":"hca_dev_a39728aa70a04201b0a281b7...' 2024-08-21 10:32:32,938 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/b580fa04-b2ef-472e-bd39-4a51368e813c' 2024-08-21 10:32:32,938 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:32,959 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.334s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_bd40033154b94fccbff66bb8b079ee1f__20210901_20210903&limit=2 2024-08-21 10:32:32,960 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:32 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6z0GQ7Xr', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:32,960 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"879a755b-ebc0-4ebb-b4ad-6c89054c4851","name":"hca_dev_bd40033154b94fccbff66bb8...' 2024-08-21 10:32:32,960 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/879a755b-ebc0-4ebb-b4ad-6c89054c4851' 2024-08-21 10:32:32,960 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:32,981 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.236s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_4037007b0eff4e6db7bd8dd8eec80143__20210831_20210903&limit=2 2024-08-21 10:32:32,981 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:32 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e253MG7z', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:32,981 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"f5a52dbb-acad-47fd-8832-436134301ea2","name":"hca_dev_4037007b0eff4e6db7bd8dd8...' 2024-08-21 10:32:32,982 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/f5a52dbb-acad-47fd-8832-436134301ea2' 2024-08-21 10:32:32,982 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:33,041 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.444s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/f7eefeb5-4198-4d9a-b3db-f2db6a567a15 2024-08-21 10:32:33,041 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:33 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pPKLDwxK', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:33,042 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"id":"f7eefeb5-4198-4d9a-b3db-f2db6a567a15","name":"hca_dev_08b794a0519c4516b184c583746254c5__20210901_20210903","descriptio...' 2024-08-21 10:32:33,042 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-38e08b5c:hca_dev_08b794a0519c4516b184c583746254c5__20210901_20210903:/0. 2024-08-21 10:32:33,043 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-38e08b5c.hca_dev_08b794a0519c4516b184c583746254c5__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:33,174 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "57dc1ecf-0893-4614-87cf-0889a591ae22", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-29509483.hca_dev_90bd693340c048d48d76778c103bf545__20210827_20211110.links`\n )\n WHERE STARTS_WITH(prefix, '5c')\n GROUP BY prefix\n "} 2024-08-21 10:32:33,272 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.404s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/41d88011-1981-4f50-b6fe-78f7b7d27bab 2024-08-21 10:32:33,272 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:32 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aG1o3BZv', 'Content-Type': 'application/json', 'Content-Length': '13476', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:33,273 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"id":"41d88011-1981-4f50-b6fe-78f7b7d27bab","name":"hca_dev_42d4f8d454224b78adaee7c3c2ef511c__20210830_20210903","descriptio...' 2024-08-21 10:32:33,274 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-4e5ffd52:hca_dev_42d4f8d454224b78adaee7c3c2ef511c__20210830_20210903:/0. 2024-08-21 10:32:33,274 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-4e5ffd52.hca_dev_42d4f8d454224b78adaee7c3c2ef511c__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:33,359 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f86f1ab41fbb4510ae353ffd752d4dfc__20210901_20210903&limit=2' 2024-08-21 10:32:33,359 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:33,413 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.431s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/f5a52dbb-acad-47fd-8832-436134301ea2 2024-08-21 10:32:33,413 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:33 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pLMzq0qV', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:33,413 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"id":"f5a52dbb-acad-47fd-8832-436134301ea2","name":"hca_dev_4037007b0eff4e6db7bd8dd8eec80143__20210831_20210903","descriptio...' 2024-08-21 10:32:33,414 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-ec07c8d8:hca_dev_4037007b0eff4e6db7bd8dd8eec80143__20210831_20210903:7/0. 2024-08-21 10:32:33,414 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-ec07c8d8.hca_dev_4037007b0eff4e6db7bd8dd8eec80143__20210831_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '7')\n GROUP BY prefix\n " 2024-08-21 10:32:33,487 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.549s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/b580fa04-b2ef-472e-bd39-4a51368e813c 2024-08-21 10:32:33,487 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:32 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'emy9BNJe', 'Content-Type': 'application/json', 'Content-Length': '13482', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:33,488 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"id":"b580fa04-b2ef-472e-bd39-4a51368e813c","name":"hca_dev_a39728aa70a04201b0a281b7badf3e71__20210830_20210903","descriptio...' 2024-08-21 10:32:33,489 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-d3d5bbfa:hca_dev_a39728aa70a04201b0a281b7badf3e71__20210830_20210903:1/0. 2024-08-21 10:32:33,489 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-d3d5bbfa.hca_dev_a39728aa70a04201b0a281b7badf3e71__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '1')\n GROUP BY prefix\n " 2024-08-21 10:32:33,524 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.564s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/879a755b-ebc0-4ebb-b4ad-6c89054c4851 2024-08-21 10:32:33,524 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:33 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6dlMJbxo', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:33,524 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"id":"879a755b-ebc0-4ebb-b4ad-6c89054c4851","name":"hca_dev_bd40033154b94fccbff66bb8b079ee1f__20210901_20210903","descriptio...' 2024-08-21 10:32:33,525 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-376d3f4a:hca_dev_bd40033154b94fccbff66bb8b079ee1f__20210901_20210903:/0. 2024-08-21 10:32:33,525 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-376d3f4a.hca_dev_bd40033154b94fccbff66bb8b079ee1f__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:33,654 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "80bbace9-6fb8-42f6-94b3-f4267d508d53", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-135f340c.hca_dev_1c6a960d52ac44eab728a59c7ab9dc8e__20210827_20210928.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:33,659 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.299s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f86f1ab41fbb4510ae353ffd752d4dfc__20210901_20210903&limit=2 2024-08-21 10:32:33,659 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:33 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVLWxJ5D', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:33,659 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"9b53159b-d0b8-44e7-8871-ca086529709c","name":"hca_dev_f86f1ab41fbb4510ae353ffd...' 2024-08-21 10:32:33,660 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/9b53159b-d0b8-44e7-8871-ca086529709c' 2024-08-21 10:32:33,660 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:33,718 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "c7eb953e-4920-44fb-9bd4-fb9dd774603f", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-24e9529e.hca_dev_f83165c5e2ea4d15a5cf33f3550bffde__20210901_20210908.links`\n )\n WHERE STARTS_WITH(prefix, 'fe')\n GROUP BY prefix\n "} 2024-08-21 10:32:33,873 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c715cd2fdc7c44a69cd5b6a6d9f075ae__20210827_20210902&limit=2' 2024-08-21 10:32:33,874 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:33,879 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f48e7c39cc6740559d79bc437892840c__20210830_20211007&limit=2' 2024-08-21 10:32:33,879 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:33,885 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.225s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/9b53159b-d0b8-44e7-8871-ca086529709c 2024-08-21 10:32:33,885 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:33 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aEK39Jl0', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:33,885 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"9b53159b-d0b8-44e7-8871-ca086529709c","name":"hca_dev_f86f1ab41fbb4510ae353ffd752d4dfc__20210901_20210903","descriptio...' 2024-08-21 10:32:33,886 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-67240cf2:hca_dev_f86f1ab41fbb4510ae353ffd752d4dfc__20210901_20210903:/0. 2024-08-21 10:32:33,886 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-67240cf2.hca_dev_f86f1ab41fbb4510ae353ffd752d4dfc__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:33,921 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "7076ee69-c207-44d7-a854-4dbced395407", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-38e08b5c.hca_dev_08b794a0519c4516b184c583746254c5__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:34,106 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2ef3655a973d4d699b4121fa4041eed7__20210827_20210903&limit=2' 2024-08-21 10:32:34,107 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:34,122 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "fa36b7b7-a677-444f-8940-31bb70b26d42", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-4e5ffd52.hca_dev_42d4f8d454224b78adaee7c3c2ef511c__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:34,143 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.264s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f48e7c39cc6740559d79bc437892840c__20210830_20211007&limit=2 2024-08-21 10:32:34,144 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:33 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pl2mNPXx', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:34,144 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"dc4c099e-1d33-4810-aca5-036a026f3aae","name":"hca_dev_f48e7c39cc6740559d79bc43...' 2024-08-21 10:32:34,144 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/dc4c099e-1d33-4810-aca5-036a026f3aae' 2024-08-21 10:32:34,145 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:34,246 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "46d3dd41-8649-40e2-a2b7-cf3ccb15a77c", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-376d3f4a.hca_dev_bd40033154b94fccbff66bb8b079ee1f__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:34,248 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "e69f7749-29bc-48a7-9e6d-bd85dd1dc8fd", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-ec07c8d8.hca_dev_4037007b0eff4e6db7bd8dd8eec80143__20210831_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '7')\n GROUP BY prefix\n "} 2024-08-21 10:32:34,301 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_41fb1734a121461695c73b732c9433c7__20210830_20210903&limit=2' 2024-08-21 10:32:34,302 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:34,322 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.215s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2ef3655a973d4d699b4121fa4041eed7__20210827_20210903&limit=2 2024-08-21 10:32:34,322 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:33 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6zyMZgz3', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:34,322 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"a6ffed95-9d29-4484-a5db-c080a6278665","name":"hca_dev_2ef3655a973d4d699b4121fa...' 2024-08-21 10:32:34,323 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/a6ffed95-9d29-4484-a5db-c080a6278665' 2024-08-21 10:32:34,323 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:34,336 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.463s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c715cd2fdc7c44a69cd5b6a6d9f075ae__20210827_20210902&limit=2 2024-08-21 10:32:34,336 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:33 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ekW9gRmO', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:34,337 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"c6e19201-4fae-4213-a16c-edfd0cc11335","name":"hca_dev_c715cd2fdc7c44a69cd5b6a6...' 2024-08-21 10:32:34,337 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/c6e19201-4fae-4213-a16c-edfd0cc11335' 2024-08-21 10:32:34,337 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:34,390 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "50c967fe-a5ab-4942-bf97-4f5b2d064a1a", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-d3d5bbfa.hca_dev_a39728aa70a04201b0a281b7badf3e71__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '1')\n GROUP BY prefix\n "} 2024-08-21 10:32:34,402 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_996120f9e84f409fa01e732ab58ca8b9__20210827_20210903&limit=2' 2024-08-21 10:32:34,402 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:34,410 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_03c6fce7789e4e78a27a664d562bb738__20210902_20210907&limit=2' 2024-08-21 10:32:34,410 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:34,419 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.274s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/dc4c099e-1d33-4810-aca5-036a026f3aae 2024-08-21 10:32:34,419 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:34 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pY552Xyb', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:34,419 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"id":"dc4c099e-1d33-4810-aca5-036a026f3aae","name":"hca_dev_f48e7c39cc6740559d79bc437892840c__20210830_20211007","descriptio...' 2024-08-21 10:32:34,419 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-b51e6694:hca_dev_f48e7c39cc6740559d79bc437892840c__20210830_20211007:/0. 2024-08-21 10:32:34,419 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-b51e6694.hca_dev_f48e7c39cc6740559d79bc437892840c__20210830_20211007.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:34,534 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_51f02950ee254f4b8d0759aa99bb3498__20210827_20230215&limit=2' 2024-08-21 10:32:34,534 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:34,539 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.216s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/a6ffed95-9d29-4484-a5db-c080a6278665 2024-08-21 10:32:34,539 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:34 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aA9OxJW7', 'Content-Type': 'application/json', 'Content-Length': '13476', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:34,539 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"id":"a6ffed95-9d29-4484-a5db-c080a6278665","name":"hca_dev_2ef3655a973d4d699b4121fa4041eed7__20210827_20210903","descriptio...' 2024-08-21 10:32:34,540 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-766bfb76:hca_dev_2ef3655a973d4d699b4121fa4041eed7__20210827_20210903:/0. 2024-08-21 10:32:34,540 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-766bfb76.hca_dev_2ef3655a973d4d699b4121fa4041eed7__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:34,610 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.208s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_996120f9e84f409fa01e732ab58ca8b9__20210827_20210903&limit=2 2024-08-21 10:32:34,610 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:34 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pV4rgdyy', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:34,610 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"830b26f1-f900-40ca-a69d-eb530d73703f","name":"hca_dev_996120f9e84f409fa01e732a...' 2024-08-21 10:32:34,611 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/830b26f1-f900-40ca-a69d-eb530d73703f' 2024-08-21 10:32:34,611 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:34,646 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "ad5053d5-3d3e-48e9-b54f-d76181b176ab", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-67240cf2.hca_dev_f86f1ab41fbb4510ae353ffd752d4dfc__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:34,726 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.191s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_51f02950ee254f4b8d0759aa99bb3498__20210827_20230215&limit=2 2024-08-21 10:32:34,726 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:34 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e2WA7BY9', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:34,727 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"9e33ae37-eb19-47b5-a5fd-e2e8a41d3574","name":"hca_dev_51f02950ee254f4b8d0759aa...' 2024-08-21 10:32:34,728 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/9e33ae37-eb19-47b5-a5fd-e2e8a41d3574' 2024-08-21 10:32:34,728 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:34,825 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_7b947aa243a74082afff222a3e3a4635__20210831_20210907&limit=2' 2024-08-21 10:32:34,826 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:34,829 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.218s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/830b26f1-f900-40ca-a69d-eb530d73703f 2024-08-21 10:32:34,830 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:34 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6ggvb521', 'Content-Type': 'application/json', 'Content-Length': '13482', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:34,830 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"id":"830b26f1-f900-40ca-a69d-eb530d73703f","name":"hca_dev_996120f9e84f409fa01e732ab58ca8b9__20210827_20210903","descriptio...' 2024-08-21 10:32:34,830 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-75589244:hca_dev_996120f9e84f409fa01e732ab58ca8b9__20210827_20210903:/0. 2024-08-21 10:32:34,830 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-75589244.hca_dev_996120f9e84f409fa01e732ab58ca8b9__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:35,021 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.195s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_7b947aa243a74082afff222a3e3a4635__20210831_20210907&limit=2 2024-08-21 10:32:35,022 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:34 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eXxgzVxQ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:35,022 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e0c597f8-4aa4-485c-b19c-c46b564550a5","name":"hca_dev_7b947aa243a74082afff222a...' 2024-08-21 10:32:35,023 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e0c597f8-4aa4-485c-b19c-c46b564550a5' 2024-08-21 10:32:35,023 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:35,043 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.315s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/9e33ae37-eb19-47b5-a5fd-e2e8a41d3574 2024-08-21 10:32:35,043 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:34 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eZ8KXnkQ', 'Content-Type': 'application/json', 'Content-Length': '13476', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:35,044 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"id":"9e33ae37-eb19-47b5-a5fd-e2e8a41d3574","name":"hca_dev_51f02950ee254f4b8d0759aa99bb3498__20210827_20230215","descriptio...' 2024-08-21 10:32:35,044 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-b46086a9:hca_dev_51f02950ee254f4b8d0759aa99bb3498__20210827_20230215:/0. 2024-08-21 10:32:35,045 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-b46086a9.hca_dev_51f02950ee254f4b8d0759aa99bb3498__20210827_20230215.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:35,265 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "2abfee87-a15b-43a6-ae83-a83ebdf26103", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-b51e6694.hca_dev_f48e7c39cc6740559d79bc437892840c__20210830_20211007.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:35,268 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.244s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e0c597f8-4aa4-485c-b19c-c46b564550a5 2024-08-21 10:32:35,268 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:34 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ebn53gly', 'Content-Type': 'application/json', 'Content-Length': '13477', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:35,268 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"e0c597f8-4aa4-485c-b19c-c46b564550a5","name":"hca_dev_7b947aa243a74082afff222a3e3a4635__20210831_20210907","descriptio...' 2024-08-21 10:32:35,269 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-aba01389:hca_dev_7b947aa243a74082afff222a3e3a4635__20210831_20210907:/0. 2024-08-21 10:32:35,270 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-aba01389.hca_dev_7b947aa243a74082afff222a3e3a4635__20210831_20210907.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:35,391 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "0253198b-7cef-4cc7-b50c-d56a36761375", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-766bfb76.hca_dev_2ef3655a973d4d699b4121fa4041eed7__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:35,519 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e8808cc84ca0409680f2bba73600cba6__20210902_20210907&limit=2' 2024-08-21 10:32:35,519 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:35,546 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "d7aeb6f9-e88c-408e-a6a3-bb45f962261f", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-75589244.hca_dev_996120f9e84f409fa01e732ab58ca8b9__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:35,623 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_52b29aa4c8d642b4807ab35be94469ca__20210830_20210903&limit=2' 2024-08-21 10:32:35,624 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:35,713 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e5d455791f5b48c3b568320d93e7ca72__20210827_20210903&limit=2' 2024-08-21 10:32:35,714 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:35,723 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 1.421s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_41fb1734a121461695c73b732c9433c7__20210830_20210903&limit=2 2024-08-21 10:32:35,723 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:34 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ajy3K4Jy', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:35,723 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"dc7a86a7-e75c-4012-934b-86e7f7ff21eb","name":"hca_dev_41fb1734a121461695c73b73...' 2024-08-21 10:32:35,724 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/dc7a86a7-e75c-4012-934b-86e7f7ff21eb' 2024-08-21 10:32:35,724 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:35,736 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 1.326s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_03c6fce7789e4e78a27a664d562bb738__20210902_20210907&limit=2 2024-08-21 10:32:35,737 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:34 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pP48NENK', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:35,737 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"79abca77-cb9b-4905-8853-190367e397dc","name":"hca_dev_03c6fce7789e4e78a27a664d...' 2024-08-21 10:32:35,737 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/79abca77-cb9b-4905-8853-190367e397dc' 2024-08-21 10:32:35,737 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:35,753 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.234s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e8808cc84ca0409680f2bba73600cba6__20210902_20210907&limit=2 2024-08-21 10:32:35,753 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:35 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ebLE48YJ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:35,753 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"cc6e85e6-6e30-4bf0-8c52-56fbd8a1bdaf","name":"hca_dev_e8808cc84ca0409680f2bba7...' 2024-08-21 10:32:35,754 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/cc6e85e6-6e30-4bf0-8c52-56fbd8a1bdaf' 2024-08-21 10:32:35,754 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:35,775 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 1.438s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/c6e19201-4fae-4213-a16c-edfd0cc11335 2024-08-21 10:32:35,776 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:34 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6MG8zy1G', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:35,776 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"id":"c6e19201-4fae-4213-a16c-edfd0cc11335","name":"hca_dev_c715cd2fdc7c44a69cd5b6a6d9f075ae__20210827_20210902","descriptio...' 2024-08-21 10:32:35,776 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-61b8d081:hca_dev_c715cd2fdc7c44a69cd5b6a6d9f075ae__20210827_20210902:/0. 2024-08-21 10:32:35,776 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-61b8d081.hca_dev_c715cd2fdc7c44a69cd5b6a6d9f075ae__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:35,817 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.193s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_52b29aa4c8d642b4807ab35be94469ca__20210830_20210903&limit=2 2024-08-21 10:32:35,817 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:35 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aA8lyyMG', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:35,817 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"1e63b2ce-88ec-4c56-b016-56e9bd7f35e5","name":"hca_dev_52b29aa4c8d642b4807ab35b...' 2024-08-21 10:32:35,818 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/1e63b2ce-88ec-4c56-b016-56e9bd7f35e5' 2024-08-21 10:32:35,818 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:35,870 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "e74e1781-8b5b-4d1b-a027-b5912c179f5f", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-b46086a9.hca_dev_51f02950ee254f4b8d0759aa99bb3498__20210827_20230215.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:35,987 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.273s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e5d455791f5b48c3b568320d93e7ca72__20210827_20210903&limit=2 2024-08-21 10:32:35,987 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:35 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'axxBXyj2', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:35,987 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"69d49001-0f5f-46a8-8396-b83fd1c41e6b","name":"hca_dev_e5d455791f5b48c3b568320d...' 2024-08-21 10:32:35,989 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/69d49001-0f5f-46a8-8396-b83fd1c41e6b' 2024-08-21 10:32:35,989 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:36,042 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_091cf39b01bc42e59437f419a66c8a45__20210830_20210903&limit=2' 2024-08-21 10:32:36,042 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:36,058 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "413094d6-4489-4ac0-84e2-4f2f3f3d3067", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-aba01389.hca_dev_7b947aa243a74082afff222a3e3a4635__20210831_20210907.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:36,120 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.396s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/dc7a86a7-e75c-4012-934b-86e7f7ff21eb 2024-08-21 10:32:36,120 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:35 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6vDkAPxZ', 'Content-Type': 'application/json', 'Content-Length': '13479', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:36,120 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"id":"dc7a86a7-e75c-4012-934b-86e7f7ff21eb","name":"hca_dev_41fb1734a121461695c73b732c9433c7__20210830_20210903","descriptio...' 2024-08-21 10:32:36,121 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-b4789901:hca_dev_41fb1734a121461695c73b732c9433c7__20210830_20210903:/0. 2024-08-21 10:32:36,121 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-b4789901.hca_dev_41fb1734a121461695c73b732c9433c7__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:36,211 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_faeedcb0e0464be7b1ad80a3eeabb066__20210831_20210903&limit=2' 2024-08-21 10:32:36,211 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:36,287 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.245s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_091cf39b01bc42e59437f419a66c8a45__20210830_20210903&limit=2 2024-08-21 10:32:36,287 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:35 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aEz3EY0Z', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:36,287 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e1ab6579-ea65-45a7-abea-869b055b5a6a","name":"hca_dev_091cf39b01bc42e59437f419...' 2024-08-21 10:32:36,289 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e1ab6579-ea65-45a7-abea-869b055b5a6a' 2024-08-21 10:32:36,289 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:36,357 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.604s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/cc6e85e6-6e30-4bf0-8c52-56fbd8a1bdaf 2024-08-21 10:32:36,358 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:35 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVKJrLlr', 'Content-Type': 'application/json', 'Content-Length': '13487', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:36,358 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"id":"cc6e85e6-6e30-4bf0-8c52-56fbd8a1bdaf","name":"hca_dev_e8808cc84ca0409680f2bba73600cba6__20210902_20210907","descriptio...' 2024-08-21 10:32:36,359 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-6fdac3db:hca_dev_e8808cc84ca0409680f2bba73600cba6__20210902_20210907:28/0. 2024-08-21 10:32:36,359 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-6fdac3db.hca_dev_e8808cc84ca0409680f2bba73600cba6__20210902_20210907.links`\n )\n WHERE STARTS_WITH(prefix, '28')\n GROUP BY prefix\n " 2024-08-21 10:32:36,373 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.636s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/79abca77-cb9b-4905-8853-190367e397dc 2024-08-21 10:32:36,373 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:35 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pYA8bXlP', 'Content-Type': 'application/json', 'Content-Length': '13489', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:36,374 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"id":"79abca77-cb9b-4905-8853-190367e397dc","name":"hca_dev_03c6fce7789e4e78a27a664d562bb738__20210902_20210907","descriptio...' 2024-08-21 10:32:36,374 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-e2ab8487:hca_dev_03c6fce7789e4e78a27a664d562bb738__20210902_20210907:af/0. 2024-08-21 10:32:36,374 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-e2ab8487.hca_dev_03c6fce7789e4e78a27a664d562bb738__20210902_20210907.links`\n )\n WHERE STARTS_WITH(prefix, 'af')\n GROUP BY prefix\n " 2024-08-21 10:32:36,462 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.251s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_faeedcb0e0464be7b1ad80a3eeabb066__20210831_20210903&limit=2 2024-08-21 10:32:36,462 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:35 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eb8Nglr3', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:36,462 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"9bf03ef5-4f42-4afb-b451-21923c6ff468","name":"hca_dev_faeedcb0e0464be7b1ad80a3...' 2024-08-21 10:32:36,463 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.645s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/1e63b2ce-88ec-4c56-b016-56e9bd7f35e5 2024-08-21 10:32:36,463 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/9bf03ef5-4f42-4afb-b451-21923c6ff468' 2024-08-21 10:32:36,464 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:35 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eXWRPrra', 'Content-Type': 'application/json', 'Content-Length': '13485', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:36,464 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:36,464 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"id":"1e63b2ce-88ec-4c56-b016-56e9bd7f35e5","name":"hca_dev_52b29aa4c8d642b4807ab35be94469ca__20210830_20210903","descriptio...' 2024-08-21 10:32:36,465 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-ffcf8b00:hca_dev_52b29aa4c8d642b4807ab35be94469ca__20210830_20210903:3/0. 2024-08-21 10:32:36,466 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-ffcf8b00.hca_dev_52b29aa4c8d642b4807ab35be94469ca__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '3')\n GROUP BY prefix\n " 2024-08-21 10:32:36,476 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.487s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/69d49001-0f5f-46a8-8396-b83fd1c41e6b 2024-08-21 10:32:36,476 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:35 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aA5lgn3n', 'Content-Type': 'application/json', 'Content-Length': '13476', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:36,476 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"id":"69d49001-0f5f-46a8-8396-b83fd1c41e6b","name":"hca_dev_e5d455791f5b48c3b568320d93e7ca72__20210827_20210903","descriptio...' 2024-08-21 10:32:36,477 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-3faef568:hca_dev_e5d455791f5b48c3b568320d93e7ca72__20210827_20210903:/0. 2024-08-21 10:32:36,477 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-3faef568.hca_dev_e5d455791f5b48c3b568320d93e7ca72__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:36,566 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "b18b8eb8-de1e-4287-a13b-91abce9db1f0", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-61b8d081.hca_dev_c715cd2fdc7c44a69cd5b6a6d9f075ae__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:36,570 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.281s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e1ab6579-ea65-45a7-abea-869b055b5a6a 2024-08-21 10:32:36,570 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:35 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eOGAgoED', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:36,571 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"id":"e1ab6579-ea65-45a7-abea-869b055b5a6a","name":"hca_dev_091cf39b01bc42e59437f419a66c8a45__20210830_20210903","descriptio...' 2024-08-21 10:32:36,571 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-2749da57:hca_dev_091cf39b01bc42e59437f419a66c8a45__20210830_20210903:/0. 2024-08-21 10:32:36,572 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-2749da57.hca_dev_091cf39b01bc42e59437f419a66c8a45__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:36,723 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_027c51c60719469fa7f5640fe57cbece__20210827_20210902&limit=2' 2024-08-21 10:32:36,724 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:36,729 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.265s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/9bf03ef5-4f42-4afb-b451-21923c6ff468 2024-08-21 10:32:36,729 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:35 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a830ZLVk', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:36,729 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"9bf03ef5-4f42-4afb-b451-21923c6ff468","name":"hca_dev_faeedcb0e0464be7b1ad80a3eeabb066__20210831_20210903","descriptio...' 2024-08-21 10:32:36,730 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-96d8e08c:hca_dev_faeedcb0e0464be7b1ad80a3eeabb066__20210831_20210903:e/0. 2024-08-21 10:32:36,730 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-96d8e08c.hca_dev_faeedcb0e0464be7b1ad80a3eeabb066__20210831_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'e')\n GROUP BY prefix\n " 2024-08-21 10:32:36,899 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "b9cccbce-14fd-44f3-ac2c-e5fc183626ac", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-b4789901.hca_dev_41fb1734a121461695c73b732c9433c7__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:36,916 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.192s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_027c51c60719469fa7f5640fe57cbece__20210827_20210902&limit=2 2024-08-21 10:32:36,916 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:36 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aEQMOlwZ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:36,917 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"7b6a1bb0-7da1-4975-bd61-04865a1dc296","name":"hca_dev_027c51c60719469fa7f5640f...' 2024-08-21 10:32:36,917 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/7b6a1bb0-7da1-4975-bd61-04865a1dc296' 2024-08-21 10:32:36,917 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:37,075 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_8787c23889ef4636a57d3167e8b54a80__20210827_20210903&limit=2' 2024-08-21 10:32:37,075 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:37,166 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "66173c17-354a-4224-a836-65144081fe55", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-6fdac3db.hca_dev_e8808cc84ca0409680f2bba73600cba6__20210902_20210907.links`\n )\n WHERE STARTS_WITH(prefix, '28')\n GROUP BY prefix\n "} 2024-08-21 10:32:37,170 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.253s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/7b6a1bb0-7da1-4975-bd61-04865a1dc296 2024-08-21 10:32:37,171 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:36 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aKwg7WAV', 'Content-Type': 'application/json', 'Content-Length': '13477', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:37,171 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"id":"7b6a1bb0-7da1-4975-bd61-04865a1dc296","name":"hca_dev_027c51c60719469fa7f5640fe57cbece__20210827_20210902","descriptio...' 2024-08-21 10:32:37,171 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-c148d39c:hca_dev_027c51c60719469fa7f5640fe57cbece__20210827_20210902:/0. 2024-08-21 10:32:37,171 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-c148d39c.hca_dev_027c51c60719469fa7f5640fe57cbece__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:37,199 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "3093d9f0-dea5-4517-ae3b-b0bbac80cb81", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-e2ab8487.hca_dev_03c6fce7789e4e78a27a664d562bb738__20210902_20210907.links`\n )\n WHERE STARTS_WITH(prefix, 'af')\n GROUP BY prefix\n "} 2024-08-21 10:32:37,276 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.201s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_8787c23889ef4636a57d3167e8b54a80__20210827_20210903&limit=2 2024-08-21 10:32:37,276 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:37 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aNON0X1O', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:37,276 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"0559efce-d188-4a59-9f6f-2a6258ca7e79","name":"hca_dev_8787c23889ef4636a57d3167...' 2024-08-21 10:32:37,277 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/0559efce-d188-4a59-9f6f-2a6258ca7e79' 2024-08-21 10:32:37,277 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:37,290 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "d82f5029-5f2c-40ec-abf8-2f0d29d0763a", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-ffcf8b00.hca_dev_52b29aa4c8d642b4807ab35be94469ca__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '3')\n GROUP BY prefix\n "} 2024-08-21 10:32:37,306 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "61c9f654-e6e6-4c3a-8961-ac374226b7b9", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-3faef568.hca_dev_e5d455791f5b48c3b568320d93e7ca72__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:37,323 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_dbd836cfbfc241f0983441cc6c0b235a__20210827_20210902&limit=2' 2024-08-21 10:32:37,323 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:37,363 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f8aa201c4ff145a4890e840d63459ca2__20210901_20210903&limit=2' 2024-08-21 10:32:37,363 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:37,411 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "033f6404-c5d4-4344-bdb5-e899d50f7200", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-2749da57.hca_dev_091cf39b01bc42e59437f419a66c8a45__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:37,445 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_4bec484dca7a47b48d488830e06ad6db__20210830_20210903&limit=2' 2024-08-21 10:32:37,445 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:37,482 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_3a69470330844ece9abed935fd5f6748__20210901_20210903&limit=2' 2024-08-21 10:32:37,482 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:37,503 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.226s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/0559efce-d188-4a59-9f6f-2a6258ca7e79 2024-08-21 10:32:37,503 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:36 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6Mxmxk2X', 'Content-Type': 'application/json', 'Content-Length': '13479', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:37,503 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"id":"0559efce-d188-4a59-9f6f-2a6258ca7e79","name":"hca_dev_8787c23889ef4636a57d3167e8b54a80__20210827_20210903","descriptio...' 2024-08-21 10:32:37,504 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-d0772077:hca_dev_8787c23889ef4636a57d3167e8b54a80__20210827_20210903:/0. 2024-08-21 10:32:37,504 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-d0772077.hca_dev_8787c23889ef4636a57d3167e8b54a80__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:37,530 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.207s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_dbd836cfbfc241f0983441cc6c0b235a__20210827_20210902&limit=2 2024-08-21 10:32:37,530 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:37 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'er5D77OK', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:37,531 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"fcc6b9e5-3e37-464f-8d5b-2b7b3d40f128","name":"hca_dev_dbd836cfbfc241f0983441cc...' 2024-08-21 10:32:37,531 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/fcc6b9e5-3e37-464f-8d5b-2b7b3d40f128' 2024-08-21 10:32:37,531 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:37,557 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_7880637a35a14047b422b5eac2a2a358__20210901_20210903&limit=2' 2024-08-21 10:32:37,558 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:37,558 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.196s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_f8aa201c4ff145a4890e840d63459ca2__20210901_20210903&limit=2 2024-08-21 10:32:37,558 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:37 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'poBgYGr8', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:37,559 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"251c52e6-3bda-48df-a4f2-50aa759d7d80","name":"hca_dev_f8aa201c4ff145a4890e840d...' 2024-08-21 10:32:37,559 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/251c52e6-3bda-48df-a4f2-50aa759d7d80' 2024-08-21 10:32:37,559 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:37,654 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "464c93bd-4c6a-4736-bf2b-0e4b84e720da", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-96d8e08c.hca_dev_faeedcb0e0464be7b1ad80a3eeabb066__20210831_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'e')\n GROUP BY prefix\n "} 2024-08-21 10:32:37,693 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.211s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_3a69470330844ece9abed935fd5f6748__20210901_20210903&limit=2 2024-08-21 10:32:37,693 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:37 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6zAvk4LO', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:37,694 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"01b1ac88-8144-428e-a84c-88e9ed8ec6a2","name":"hca_dev_3a69470330844ece9abed935...' 2024-08-21 10:32:37,694 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/01b1ac88-8144-428e-a84c-88e9ed8ec6a2' 2024-08-21 10:32:37,694 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:37,702 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.257s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_4bec484dca7a47b48d488830e06ad6db__20210830_20210903&limit=2 2024-08-21 10:32:37,703 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:36 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eyWGvAm5', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:37,703 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"f84e6b4a-719c-4c75-891c-be52c106c6b8","name":"hca_dev_4bec484dca7a47b48d488830...' 2024-08-21 10:32:37,703 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/f84e6b4a-719c-4c75-891c-be52c106c6b8' 2024-08-21 10:32:37,703 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:37,757 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.199s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_7880637a35a14047b422b5eac2a2a358__20210901_20210903&limit=2 2024-08-21 10:32:37,757 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:37 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eX05Wj4l', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:37,757 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"58a0eacf-0caa-449b-9fc8-4fe629e99176","name":"hca_dev_7880637a35a14047b422b5ea...' 2024-08-21 10:32:37,759 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/58a0eacf-0caa-449b-9fc8-4fe629e99176' 2024-08-21 10:32:37,759 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:37,816 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2a64db431b554639aabb8dba0145689d__20210830_20210903&limit=2' 2024-08-21 10:32:37,816 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:37,883 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.324s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/251c52e6-3bda-48df-a4f2-50aa759d7d80 2024-08-21 10:32:37,883 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:37 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'erxBv127', 'Content-Type': 'application/json', 'Content-Length': '13487', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:37,883 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"id":"251c52e6-3bda-48df-a4f2-50aa759d7d80","name":"hca_dev_f8aa201c4ff145a4890e840d63459ca2__20210901_20210903","descriptio...' 2024-08-21 10:32:37,884 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-e8e0a59a:hca_dev_f8aa201c4ff145a4890e840d63459ca2__20210901_20210903:0/0. 2024-08-21 10:32:37,884 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-e8e0a59a.hca_dev_f8aa201c4ff145a4890e840d63459ca2__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '0')\n GROUP BY prefix\n " 2024-08-21 10:32:37,903 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.371s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/fcc6b9e5-3e37-464f-8d5b-2b7b3d40f128 2024-08-21 10:32:37,903 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:37 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'emdOMRBR', 'Content-Type': 'application/json', 'Content-Length': '13476', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:37,903 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"id":"fcc6b9e5-3e37-464f-8d5b-2b7b3d40f128","name":"hca_dev_dbd836cfbfc241f0983441cc6c0b235a__20210827_20210902","descriptio...' 2024-08-21 10:32:37,903 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-848e2d4f:hca_dev_dbd836cfbfc241f0983441cc6c0b235a__20210827_20210902:/0. 2024-08-21 10:32:37,903 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-848e2d4f.hca_dev_dbd836cfbfc241f0983441cc6c0b235a__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:37,994 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "7c898eb2-09f4-4d92-9668-5a955094c4d6", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-c148d39c.hca_dev_027c51c60719469fa7f5640fe57cbece__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:38,090 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.273s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2a64db431b554639aabb8dba0145689d__20210830_20210903&limit=2 2024-08-21 10:32:38,090 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:37 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aAXoG7nZ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:38,090 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"31d19143-1faa-471a-8575-4a8052fdcf19","name":"hca_dev_2a64db431b554639aabb8dba...' 2024-08-21 10:32:38,091 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/31d19143-1faa-471a-8575-4a8052fdcf19' 2024-08-21 10:32:38,091 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:38,143 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ce33dde2382d448cb6acbfb424644f23__20210827_20210928&limit=2' 2024-08-21 10:32:38,143 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:38,166 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.407s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/58a0eacf-0caa-449b-9fc8-4fe629e99176 2024-08-21 10:32:38,166 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:37 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e1NyoJ48', 'Content-Type': 'application/json', 'Content-Length': '13484', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:38,166 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"id":"58a0eacf-0caa-449b-9fc8-4fe629e99176","name":"hca_dev_7880637a35a14047b422b5eac2a2a358__20210901_20210903","descriptio...' 2024-08-21 10:32:38,167 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-12b7a9e1:hca_dev_7880637a35a14047b422b5eac2a2a358__20210901_20210903:e/0. 2024-08-21 10:32:38,167 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-12b7a9e1.hca_dev_7880637a35a14047b422b5eac2a2a358__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'e')\n GROUP BY prefix\n " 2024-08-21 10:32:38,211 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.508s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/f84e6b4a-719c-4c75-891c-be52c106c6b8 2024-08-21 10:32:38,211 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:38 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ekyxgvo4', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:38,212 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"id":"f84e6b4a-719c-4c75-891c-be52c106c6b8","name":"hca_dev_4bec484dca7a47b48d488830e06ad6db__20210830_20210903","descriptio...' 2024-08-21 10:32:38,212 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-a6c6b953:hca_dev_4bec484dca7a47b48d488830e06ad6db__20210830_20210903:/0. 2024-08-21 10:32:38,212 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-a6c6b953.hca_dev_4bec484dca7a47b48d488830e06ad6db__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:38,291 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "2ecee443-5409-4bb4-9cec-14335c19163b", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-d0772077.hca_dev_8787c23889ef4636a57d3167e8b54a80__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:38,354 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.211s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ce33dde2382d448cb6acbfb424644f23__20210827_20210928&limit=2 2024-08-21 10:32:38,354 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:37 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6zv4yOw6', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:38,354 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"104f2254-2af9-4699-9573-00d2da718430","name":"hca_dev_ce33dde2382d448cb6acbfb4...' 2024-08-21 10:32:38,355 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/104f2254-2af9-4699-9573-00d2da718430' 2024-08-21 10:32:38,355 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:38,379 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.288s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/31d19143-1faa-471a-8575-4a8052fdcf19 2024-08-21 10:32:38,380 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:37 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e3OWAE2w', 'Content-Type': 'application/json', 'Content-Length': '13478', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:38,380 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"31d19143-1faa-471a-8575-4a8052fdcf19","name":"hca_dev_2a64db431b554639aabb8dba0145689d__20210830_20210903","descriptio...' 2024-08-21 10:32:38,380 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-38f08cd8:hca_dev_2a64db431b554639aabb8dba0145689d__20210830_20210903:/0. 2024-08-21 10:32:38,381 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-38f08cd8.hca_dev_2a64db431b554639aabb8dba0145689d__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:38,414 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.720s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/01b1ac88-8144-428e-a84c-88e9ed8ec6a2 2024-08-21 10:32:38,414 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:38 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aG87vNlR', 'Content-Type': 'application/json', 'Content-Length': '13485', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:38,415 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"id":"01b1ac88-8144-428e-a84c-88e9ed8ec6a2","name":"hca_dev_3a69470330844ece9abed935fd5f6748__20210901_20210903","descriptio...' 2024-08-21 10:32:38,415 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-40283c27:hca_dev_3a69470330844ece9abed935fd5f6748__20210901_20210903:d/0. 2024-08-21 10:32:38,415 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-40283c27.hca_dev_3a69470330844ece9abed935fd5f6748__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'd')\n GROUP BY prefix\n " 2024-08-21 10:32:38,444 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_8185730f411340d39cc3929271784c2b__20210830_20210903&limit=2' 2024-08-21 10:32:38,444 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:38,642 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "78e59cc7-8c34-4b35-a712-34c788becc20", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-e8e0a59a.hca_dev_f8aa201c4ff145a4890e840d63459ca2__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '0')\n GROUP BY prefix\n "} 2024-08-21 10:32:38,661 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "ed2c4bbf-8eb9-4fa7-9092-eb94302ff87b", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-848e2d4f.hca_dev_dbd836cfbfc241f0983441cc6c0b235a__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:38,665 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.221s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_8185730f411340d39cc3929271784c2b__20210830_20210903&limit=2 2024-08-21 10:32:38,666 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:38 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6JrGJYyd', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:38,666 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e470d283-fd86-45b3-bec2-0c1663c16a67","name":"hca_dev_8185730f411340d39cc39292...' 2024-08-21 10:32:38,667 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e470d283-fd86-45b3-bec2-0c1663c16a67' 2024-08-21 10:32:38,667 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:38,694 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.339s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/104f2254-2af9-4699-9573-00d2da718430 2024-08-21 10:32:38,694 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:38 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eX4bzkwW', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:38,694 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"id":"104f2254-2af9-4699-9573-00d2da718430","name":"hca_dev_ce33dde2382d448cb6acbfb424644f23__20210827_20210928","descriptio...' 2024-08-21 10:32:38,695 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-f4cb2365:hca_dev_ce33dde2382d448cb6acbfb424644f23__20210827_20210928:d/0. 2024-08-21 10:32:38,695 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-f4cb2365.hca_dev_ce33dde2382d448cb6acbfb424644f23__20210827_20210928.links`\n )\n WHERE STARTS_WITH(prefix, 'd')\n GROUP BY prefix\n " 2024-08-21 10:32:38,797 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_946c5add47d1402a97bba5af97e8bce7__20210831_20210903&limit=2' 2024-08-21 10:32:38,797 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:38,808 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ae71be1dddd84feb9bed24c3ddb6e1ad__20210916_20210916&limit=2' 2024-08-21 10:32:38,809 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:38,938 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "fce2a89c-b301-4f6a-ae7b-700428f5251d", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-a6c6b953.hca_dev_4bec484dca7a47b48d488830e06ad6db__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:38,939 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.272s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e470d283-fd86-45b3-bec2-0c1663c16a67 2024-08-21 10:32:38,939 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:38 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6gB9mO1p', 'Content-Type': 'application/json', 'Content-Length': '13479', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:38,940 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"id":"e470d283-fd86-45b3-bec2-0c1663c16a67","name":"hca_dev_8185730f411340d39cc3929271784c2b__20210830_20210903","descriptio...' 2024-08-21 10:32:38,941 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-bf3a4c8a:hca_dev_8185730f411340d39cc3929271784c2b__20210830_20210903:/0. 2024-08-21 10:32:38,941 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-bf3a4c8a.hca_dev_8185730f411340d39cc3929271784c2b__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:38,987 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "184bbd4f-0fb8-48d1-a571-3d4914c824b8", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-12b7a9e1.hca_dev_7880637a35a14047b422b5eac2a2a358__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'e')\n GROUP BY prefix\n "} 2024-08-21 10:32:38,988 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.191s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_946c5add47d1402a97bba5af97e8bce7__20210831_20210903&limit=2 2024-08-21 10:32:38,989 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:38 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6gwWlr4E', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:38,989 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"d7250e7a-20c6-42ff-9332-4bc5a5fd2470","name":"hca_dev_946c5add47d1402a97bba5af...' 2024-08-21 10:32:38,990 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/d7250e7a-20c6-42ff-9332-4bc5a5fd2470' 2024-08-21 10:32:38,991 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:39,006 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.197s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ae71be1dddd84feb9bed24c3ddb6e1ad__20210916_20210916&limit=2 2024-08-21 10:32:39,006 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:38 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6Wg81O1o', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:39,006 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"69525f31-1a87-4a22-9ea3-e10ade1b7343","name":"hca_dev_ae71be1dddd84feb9bed24c3...' 2024-08-21 10:32:39,007 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/69525f31-1a87-4a22-9ea3-e10ade1b7343' 2024-08-21 10:32:39,007 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:39,095 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_403c3e7668144a2da5805dd5de38c7ff__20210827_20210903&limit=2' 2024-08-21 10:32:39,096 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:39,139 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_3cfcdff5dee14a7ba591c09c6e850b11__20210827_20210903&limit=2' 2024-08-21 10:32:39,139 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:39,173 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "489cf6e2-eced-482d-8f33-dbbe4beb9064", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-40283c27.hca_dev_3a69470330844ece9abed935fd5f6748__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'd')\n GROUP BY prefix\n "} 2024-08-21 10:32:39,195 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "42385c6d-f57d-4a93-82d4-ba0b05b6bcde", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-38f08cd8.hca_dev_2a64db431b554639aabb8dba0145689d__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:39,242 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.252s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/d7250e7a-20c6-42ff-9332-4bc5a5fd2470 2024-08-21 10:32:39,242 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:38 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVM7j0K8', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:39,243 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"id":"d7250e7a-20c6-42ff-9332-4bc5a5fd2470","name":"hca_dev_946c5add47d1402a97bba5af97e8bce7__20210831_20210903","descriptio...' 2024-08-21 10:32:39,243 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-59d37b9a:hca_dev_946c5add47d1402a97bba5af97e8bce7__20210831_20210903:5/0. 2024-08-21 10:32:39,243 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-59d37b9a.hca_dev_946c5add47d1402a97bba5af97e8bce7__20210831_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '5')\n GROUP BY prefix\n " 2024-08-21 10:32:39,286 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.279s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/69525f31-1a87-4a22-9ea3-e10ade1b7343 2024-08-21 10:32:39,287 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:38 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eXvno84o', 'Content-Type': 'application/json', 'Content-Length': '13489', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:39,287 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"id":"69525f31-1a87-4a22-9ea3-e10ade1b7343","name":"hca_dev_ae71be1dddd84feb9bed24c3ddb6e1ad__20210916_20210916","descriptio...' 2024-08-21 10:32:39,288 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-1dce87e5:hca_dev_ae71be1dddd84feb9bed24c3ddb6e1ad__20210916_20210916:bb/0. 2024-08-21 10:32:39,288 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-1dce87e5.hca_dev_ae71be1dddd84feb9bed24c3ddb6e1ad__20210916_20210916.links`\n )\n WHERE STARTS_WITH(prefix, 'bb')\n GROUP BY prefix\n " 2024-08-21 10:32:39,305 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_dc1a41f69e0942a6959e3be23db6da56__20210827_20220228_dcp14&limit=2' 2024-08-21 10:32:39,305 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:39,325 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.185s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_3cfcdff5dee14a7ba591c09c6e850b11__20210827_20210903&limit=2 2024-08-21 10:32:39,325 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:38 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6BxngVYA', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:39,325 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"8635ff71-8513-48ea-a8d9-f4432f6fcc32","name":"hca_dev_3cfcdff5dee14a7ba591c09c...' 2024-08-21 10:32:39,326 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/8635ff71-8513-48ea-a8d9-f4432f6fcc32' 2024-08-21 10:32:39,326 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:39,353 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_455b46e6d8ea4611861ede720a562ada__20210901_20210903&limit=2' 2024-08-21 10:32:39,353 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:39,425 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.329s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_403c3e7668144a2da5805dd5de38c7ff__20210827_20210903&limit=2 2024-08-21 10:32:39,425 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:39 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aKEKR85V', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:39,425 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"139ecf31-b6bb-419a-97c8-1245029631bb","name":"hca_dev_403c3e7668144a2da5805dd5...' 2024-08-21 10:32:39,426 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/139ecf31-b6bb-419a-97c8-1245029631bb' 2024-08-21 10:32:39,426 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:39,438 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "ea6c954a-7a15-41e1-aa79-dd03c2f9134e", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-f4cb2365.hca_dev_ce33dde2382d448cb6acbfb424644f23__20210827_20210928.links`\n )\n WHERE STARTS_WITH(prefix, 'd')\n GROUP BY prefix\n "} 2024-08-21 10:32:39,505 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.200s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_dc1a41f69e0942a6959e3be23db6da56__20210827_20220228_dcp14&limit=2 2024-08-21 10:32:39,505 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:39 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ajL3JVLO', 'Content-Type': 'application/json', 'Content-Length': '956', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:39,506 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e785046f-93af-4c79-94b1-d8d0b4c04689","name":"hca_dev_dc1a41f69e0942a6959e3be2...' 2024-08-21 10:32:39,506 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e785046f-93af-4c79-94b1-d8d0b4c04689' 2024-08-21 10:32:39,506 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:39,650 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.324s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/8635ff71-8513-48ea-a8d9-f4432f6fcc32 2024-08-21 10:32:39,653 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "988f1f93-5b18-480f-869f-90db1f5464f8", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-bf3a4c8a.hca_dev_8185730f411340d39cc3929271784c2b__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:39,653 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.300s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_455b46e6d8ea4611861ede720a562ada__20210901_20210903&limit=2 2024-08-21 10:32:39,653 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:38 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'erY5z5E8', 'Content-Type': 'application/json', 'Content-Length': '13476', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:39,654 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c5f4661568de4cf4bbc2a0ae10f08243__20210827_20230215&limit=2' 2024-08-21 10:32:39,655 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:39 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pQ4M99QQ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:39,656 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"id":"8635ff71-8513-48ea-a8d9-f4432f6fcc32","name":"hca_dev_3cfcdff5dee14a7ba591c09c6e850b11__20210827_20210903","descriptio...' 2024-08-21 10:32:39,656 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:39,656 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e0664f4e-cf09-488a-841d-4baf2cbf1507","name":"hca_dev_455b46e6d8ea4611861ede72...' 2024-08-21 10:32:39,657 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-b08233fa:hca_dev_3cfcdff5dee14a7ba591c09c6e850b11__20210827_20210903:/0. 2024-08-21 10:32:39,659 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e0664f4e-cf09-488a-841d-4baf2cbf1507' 2024-08-21 10:32:39,660 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-b08233fa.hca_dev_3cfcdff5dee14a7ba591c09c6e850b11__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:39,660 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:39,789 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a9c022b4c7714468b769cabcf9738de3__20210827_20210903&limit=2' 2024-08-21 10:32:39,789 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:39,791 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.285s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e785046f-93af-4c79-94b1-d8d0b4c04689 2024-08-21 10:32:39,791 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:39 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eZ3qDZL1', 'Content-Type': 'application/json', 'Content-Length': '13493', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:39,791 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"id":"e785046f-93af-4c79-94b1-d8d0b4c04689","name":"hca_dev_dc1a41f69e0942a6959e3be23db6da56__20210827_20220228_dcp14","desc...' 2024-08-21 10:32:39,792 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-3b058b81:hca_dev_dc1a41f69e0942a6959e3be23db6da56__20210827_20220228_dcp14:/0. 2024-08-21 10:32:39,792 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (339 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-3b058b81.hca_dev_dc1a41f69e0942a6959e3be23db6da56__20210827_20220228_dcp14.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:39,974 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.316s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c5f4661568de4cf4bbc2a0ae10f08243__20210827_20230215&limit=2 2024-08-21 10:32:39,976 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:39 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e1Lw1Gq8', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:39,977 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"356c3be6-78c2-47e0-b71a-5d0ffd6603de","name":"hca_dev_c5f4661568de4cf4bbc2a0ae...' 2024-08-21 10:32:39,977 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/356c3be6-78c2-47e0-b71a-5d0ffd6603de' 2024-08-21 10:32:39,978 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:40,105 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.316s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a9c022b4c7714468b769cabcf9738de3__20210827_20210903&limit=2 2024-08-21 10:32:40,106 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:39 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eZOz8DNJ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:40,106 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"daa3a6f0-c1e0-4e38-b6aa-235fa509daf5","name":"hca_dev_a9c022b4c7714468b769cabc...' 2024-08-21 10:32:40,106 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.446s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e0664f4e-cf09-488a-841d-4baf2cbf1507 2024-08-21 10:32:40,107 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/daa3a6f0-c1e0-4e38-b6aa-235fa509daf5' 2024-08-21 10:32:40,107 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:39 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ax5dWV5M', 'Content-Type': 'application/json', 'Content-Length': '13481', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:40,107 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:40,107 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"e0664f4e-cf09-488a-841d-4baf2cbf1507","name":"hca_dev_455b46e6d8ea4611861ede720a562ada__20210901_20210903","descriptio...' 2024-08-21 10:32:40,108 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-5ef7f2e2:hca_dev_455b46e6d8ea4611861ede720a562ada__20210901_20210903:a/0. 2024-08-21 10:32:40,109 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-5ef7f2e2.hca_dev_455b46e6d8ea4611861ede720a562ada__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'a')\n GROUP BY prefix\n " 2024-08-21 10:32:40,111 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.686s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/139ecf31-b6bb-419a-97c8-1245029631bb 2024-08-21 10:32:40,111 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:39 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVKGy8Gl', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:40,112 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"id":"139ecf31-b6bb-419a-97c8-1245029631bb","name":"hca_dev_403c3e7668144a2da5805dd5de38c7ff__20210827_20210903","descriptio...' 2024-08-21 10:32:40,112 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-c0ec174a:hca_dev_403c3e7668144a2da5805dd5de38c7ff__20210827_20210903:f/0. 2024-08-21 10:32:40,112 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-c0ec174a.hca_dev_403c3e7668144a2da5805dd5de38c7ff__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'f')\n GROUP BY prefix\n " 2024-08-21 10:32:40,284 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "8ef2ea99-298e-4e88-bf02-92d004e8e943", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-59d37b9a.hca_dev_946c5add47d1402a97bba5af97e8bce7__20210831_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '5')\n GROUP BY prefix\n "} 2024-08-21 10:32:40,285 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "ac092e98-1995-4011-a232-eb91a6f6ab6b", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-1dce87e5.hca_dev_ae71be1dddd84feb9bed24c3ddb6e1ad__20210916_20210916.links`\n )\n WHERE STARTS_WITH(prefix, 'bb')\n GROUP BY prefix\n "} 2024-08-21 10:32:40,320 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.342s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/356c3be6-78c2-47e0-b71a-5d0ffd6603de 2024-08-21 10:32:40,321 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:39 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pQQNKQLj', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:40,321 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"id":"356c3be6-78c2-47e0-b71a-5d0ffd6603de","name":"hca_dev_c5f4661568de4cf4bbc2a0ae10f08243__20210827_20230215","descriptio...' 2024-08-21 10:32:40,321 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-27c50fbc:hca_dev_c5f4661568de4cf4bbc2a0ae10f08243__20210827_20230215:/0. 2024-08-21 10:32:40,322 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-27c50fbc.hca_dev_c5f4661568de4cf4bbc2a0ae10f08243__20210827_20230215.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:40,436 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c893cb575c9f4f26931221b85be84313__20210901_20210903&limit=2' 2024-08-21 10:32:40,437 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:40,439 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "27214b6b-e509-4240-97f2-1025691ed183", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-b08233fa.hca_dev_3cfcdff5dee14a7ba591c09c6e850b11__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:40,446 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_4d6f6c962a8343d88fe10f53bffd4674__20210901_20210903&limit=2' 2024-08-21 10:32:40,446 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:40,592 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_962bd805eb894c54bad2008e497d1307__20210830_20210903&limit=2' 2024-08-21 10:32:40,592 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:40,601 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.494s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/daa3a6f0-c1e0-4e38-b6aa-235fa509daf5 2024-08-21 10:32:40,602 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:39 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'plgX3wM1', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:40,602 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"id":"daa3a6f0-c1e0-4e38-b6aa-235fa509daf5","name":"hca_dev_a9c022b4c7714468b769cabcf9738de3__20210827_20210903","descriptio...' 2024-08-21 10:32:40,602 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-58610528:hca_dev_a9c022b4c7714468b769cabcf9738de3__20210827_20210903:/0. 2024-08-21 10:32:40,603 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-58610528.hca_dev_a9c022b4c7714468b769cabcf9738de3__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:40,624 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.187s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c893cb575c9f4f26931221b85be84313__20210901_20210903&limit=2 2024-08-21 10:32:40,624 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:40 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aGRmY2mr', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:40,624 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"403ef1b1-7b7f-4e13-bf4a-d898f047310a","name":"hca_dev_c893cb575c9f4f26931221b8...' 2024-08-21 10:32:40,625 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/403ef1b1-7b7f-4e13-bf4a-d898f047310a' 2024-08-21 10:32:40,625 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:40,626 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.180s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_4d6f6c962a8343d88fe10f53bffd4674__20210901_20210903&limit=2 2024-08-21 10:32:40,626 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:39 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6z3EO4Ey', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:40,626 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"40f2f1d0-f5f4-4847-9e65-5865f2cea4fe","name":"hca_dev_4d6f6c962a8343d88fe10f53...' 2024-08-21 10:32:40,627 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/40f2f1d0-f5f4-4847-9e65-5865f2cea4fe' 2024-08-21 10:32:40,627 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:40,646 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "05e83c5b-5b92-4210-9a9b-4cbcc60b2b75", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-3b058b81.hca_dev_dc1a41f69e0942a6959e3be23db6da56__20210827_20220228_dcp14.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:40,788 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.196s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_962bd805eb894c54bad2008e497d1307__20210830_20210903&limit=2 2024-08-21 10:32:40,789 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:40 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pQ3VzXPg', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:40,789 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"98f112bc-743e-4f38-8b7a-6efb08802ef0","name":"hca_dev_962bd805eb894c54bad2008e...' 2024-08-21 10:32:40,790 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/98f112bc-743e-4f38-8b7a-6efb08802ef0' 2024-08-21 10:32:40,790 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:40,817 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_99101928d9b14aafb759e97958ac7403__20210830_20210903&limit=2' 2024-08-21 10:32:40,818 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:40,914 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "d24242c6-f39b-4e59-841b-cb6c0022e435", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-c0ec174a.hca_dev_403c3e7668144a2da5805dd5de38c7ff__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'f')\n GROUP BY prefix\n "} 2024-08-21 10:32:40,945 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.320s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/403ef1b1-7b7f-4e13-bf4a-d898f047310a 2024-08-21 10:32:40,945 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:40 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6dgVjkbp', 'Content-Type': 'application/json', 'Content-Length': '13481', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:40,945 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"id":"403ef1b1-7b7f-4e13-bf4a-d898f047310a","name":"hca_dev_c893cb575c9f4f26931221b85be84313__20210901_20210903","descriptio...' 2024-08-21 10:32:40,946 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-71926fdc:hca_dev_c893cb575c9f4f26931221b85be84313__20210901_20210903:/0. 2024-08-21 10:32:40,946 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-71926fdc.hca_dev_c893cb575c9f4f26931221b85be84313__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:40,952 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.325s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/40f2f1d0-f5f4-4847-9e65-5865f2cea4fe 2024-08-21 10:32:40,952 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:40 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ek525k9z', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:40,952 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"id":"40f2f1d0-f5f4-4847-9e65-5865f2cea4fe","name":"hca_dev_4d6f6c962a8343d88fe10f53bffd4674__20210901_20210903","descriptio...' 2024-08-21 10:32:40,952 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-f31edbc2:hca_dev_4d6f6c962a8343d88fe10f53bffd4674__20210901_20210903:/0. 2024-08-21 10:32:40,952 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-f31edbc2.hca_dev_4d6f6c962a8343d88fe10f53bffd4674__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:41,031 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.213s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_99101928d9b14aafb759e97958ac7403__20210830_20210903&limit=2 2024-08-21 10:32:41,031 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:40 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eyxdlyWj', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:41,031 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"cddb722a-4229-47bb-ba86-736b7898406f","name":"hca_dev_99101928d9b14aafb759e979...' 2024-08-21 10:32:41,032 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/cddb722a-4229-47bb-ba86-736b7898406f' 2024-08-21 10:32:41,032 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:41,067 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_23587fb31a4a4f58ad74cc9a4cb4c254__20210827_20210909&limit=2' 2024-08-21 10:32:41,067 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:41,084 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "cc6e2118-faeb-4c6c-afa2-9e4727b716d0", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-27c50fbc.hca_dev_c5f4661568de4cf4bbc2a0ae10f08243__20210827_20230215.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:41,090 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.300s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/98f112bc-743e-4f38-8b7a-6efb08802ef0 2024-08-21 10:32:41,090 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:40 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aD9GJd3q', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:41,090 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"id":"98f112bc-743e-4f38-8b7a-6efb08802ef0","name":"hca_dev_962bd805eb894c54bad2008e497d1307__20210830_20210903","descriptio...' 2024-08-21 10:32:41,091 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-4b88b45b:hca_dev_962bd805eb894c54bad2008e497d1307__20210830_20210903:/0. 2024-08-21 10:32:41,091 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-4b88b45b.hca_dev_962bd805eb894c54bad2008e497d1307__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:41,116 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "3dbae9f5-9cbc-416b-978c-2db94dcc41e9", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-5ef7f2e2.hca_dev_455b46e6d8ea4611861ede720a562ada__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'a')\n GROUP BY prefix\n "} 2024-08-21 10:32:41,271 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_5ee710d7e2d54fe2818d15f5e31dae32__20210901_20210903&limit=2' 2024-08-21 10:32:41,271 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:41,293 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c6ad8f9bd26a4811b2ba93d487978446__20210827_20210903&limit=2' 2024-08-21 10:32:41,293 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.261s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/cddb722a-4229-47bb-ba86-736b7898406f 2024-08-21 10:32:41,293 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:41,293 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:40 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a84x93NR', 'Content-Type': 'application/json', 'Content-Length': '13486', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:41,294 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.226s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_23587fb31a4a4f58ad74cc9a4cb4c254__20210827_20210909&limit=2 2024-08-21 10:32:41,294 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"id":"cddb722a-4229-47bb-ba86-736b7898406f","name":"hca_dev_99101928d9b14aafb759e97958ac7403__20210830_20210903","descriptio...' 2024-08-21 10:32:41,294 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:40 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pPGlko4e', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:41,295 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-02c59b72:hca_dev_99101928d9b14aafb759e97958ac7403__20210830_20210903:6a/0. 2024-08-21 10:32:41,295 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"7138a5ec-41de-458d-9ac3-2fa2b0575787","name":"hca_dev_23587fb31a4a4f58ad74cc9a...' 2024-08-21 10:32:41,295 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-02c59b72.hca_dev_99101928d9b14aafb759e97958ac7403__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '6a')\n GROUP BY prefix\n " 2024-08-21 10:32:41,296 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/7138a5ec-41de-458d-9ac3-2fa2b0575787' 2024-08-21 10:32:41,296 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:41,419 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "15fa092e-8b02-4fe4-ada1-45e516a54dfb", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-58610528.hca_dev_a9c022b4c7714468b769cabcf9738de3__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:41,487 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.216s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_5ee710d7e2d54fe2818d15f5e31dae32__20210901_20210903&limit=2 2024-08-21 10:32:41,487 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:40 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pnDV81nZ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:41,488 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"006f69b6-7f42-4eba-81df-86805c22dd3d","name":"hca_dev_5ee710d7e2d54fe2818d15f5...' 2024-08-21 10:32:41,489 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/006f69b6-7f42-4eba-81df-86805c22dd3d' 2024-08-21 10:32:41,489 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:41,536 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.242s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_c6ad8f9bd26a4811b2ba93d487978446__20210827_20210903&limit=2 2024-08-21 10:32:41,536 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:41 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6vDBxVq4', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:41,536 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"0ab78bd0-2e02-4536-b3c9-bdd7a57d7988","name":"hca_dev_c6ad8f9bd26a4811b2ba93d4...' 2024-08-21 10:32:41,537 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/0ab78bd0-2e02-4536-b3c9-bdd7a57d7988' 2024-08-21 10:32:41,537 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:41,576 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_78b2406dbff246fc8b6120690e602227__20210827_20210902&limit=2' 2024-08-21 10:32:41,576 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:41,582 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.285s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/7138a5ec-41de-458d-9ac3-2fa2b0575787 2024-08-21 10:32:41,582 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:40 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'poz5rVBZ', 'Content-Type': 'application/json', 'Content-Length': '13487', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:41,583 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"id":"7138a5ec-41de-458d-9ac3-2fa2b0575787","name":"hca_dev_23587fb31a4a4f58ad74cc9a4cb4c254__20210827_20210909","descriptio...' 2024-08-21 10:32:41,583 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-23782220:hca_dev_23587fb31a4a4f58ad74cc9a4cb4c254__20210827_20210909:4c/0. 2024-08-21 10:32:41,583 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-23782220.hca_dev_23587fb31a4a4f58ad74cc9a4cb4c254__20210827_20210909.links`\n )\n WHERE STARTS_WITH(prefix, '4c')\n GROUP BY prefix\n " 2024-08-21 10:32:41,770 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "7bb51eee-54e1-4c0f-94bf-d1474f7b3818", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-71926fdc.hca_dev_c893cb575c9f4f26931221b85be84313__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:41,804 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "39123ae3-1e3d-48ce-ad38-0fdf61195281", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-f31edbc2.hca_dev_4d6f6c962a8343d88fe10f53bffd4674__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:41,817 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.328s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/006f69b6-7f42-4eba-81df-86805c22dd3d 2024-08-21 10:32:41,817 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.241s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_78b2406dbff246fc8b6120690e602227__20210827_20210902&limit=2 2024-08-21 10:32:41,817 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:40 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6Wwy1Zjw', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:41,817 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:40 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eOMwMPmG', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:41,817 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"id":"006f69b6-7f42-4eba-81df-86805c22dd3d","name":"hca_dev_5ee710d7e2d54fe2818d15f5e31dae32__20210901_20210903","descriptio...' 2024-08-21 10:32:41,817 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"90d35849-38f1-4259-86dd-b91023a6b9d8","name":"hca_dev_78b2406dbff246fc8b612069...' 2024-08-21 10:32:41,818 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-279f1986:hca_dev_5ee710d7e2d54fe2818d15f5e31dae32__20210901_20210903:9/0. 2024-08-21 10:32:41,819 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/90d35849-38f1-4259-86dd-b91023a6b9d8' 2024-08-21 10:32:41,819 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-279f1986.hca_dev_5ee710d7e2d54fe2818d15f5e31dae32__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '9')\n GROUP BY prefix\n " 2024-08-21 10:32:41,819 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:41,856 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "8645e33e-4b1a-4bd9-95b4-76a4820d6c51", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-4b88b45b.hca_dev_962bd805eb894c54bad2008e497d1307__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:41,861 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.323s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/0ab78bd0-2e02-4536-b3c9-bdd7a57d7988 2024-08-21 10:32:41,861 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:40 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'emVXjr2B', 'Content-Type': 'application/json', 'Content-Length': '13484', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:41,861 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"0ab78bd0-2e02-4536-b3c9-bdd7a57d7988","name":"hca_dev_c6ad8f9bd26a4811b2ba93d487978446__20210827_20210903","descriptio...' 2024-08-21 10:32:41,862 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-990234a8:hca_dev_c6ad8f9bd26a4811b2ba93d487978446__20210827_20210903:f7/0. 2024-08-21 10:32:41,862 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-990234a8.hca_dev_c6ad8f9bd26a4811b2ba93d487978446__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'f7')\n GROUP BY prefix\n " 2024-08-21 10:32:41,923 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_b4a7d12f6c2f40a39e359756997857e3__20210831_20210903&limit=2' 2024-08-21 10:32:41,923 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:41,954 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_005d611a14d54fbf846e571a1f874f70__20210827_20210903&limit=2' 2024-08-21 10:32:41,954 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:42,007 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_24c654a5caa5440a8f02582921f2db4a__20210830_20210903&limit=2' 2024-08-21 10:32:42,007 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:42,044 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.224s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/90d35849-38f1-4259-86dd-b91023a6b9d8 2024-08-21 10:32:42,044 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:41 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'axPVZBjY', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:42,045 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"id":"90d35849-38f1-4259-86dd-b91023a6b9d8","name":"hca_dev_78b2406dbff246fc8b6120690e602227__20210827_20210902","descriptio...' 2024-08-21 10:32:42,045 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-7913b094:hca_dev_78b2406dbff246fc8b6120690e602227__20210827_20210902:8/0. 2024-08-21 10:32:42,045 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-7913b094.hca_dev_78b2406dbff246fc8b6120690e602227__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '8')\n GROUP BY prefix\n " 2024-08-21 10:32:42,063 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "28accd64-e8ec-4f28-bdef-a28aa48f1840", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-02c59b72.hca_dev_99101928d9b14aafb759e97958ac7403__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '6a')\n GROUP BY prefix\n "} 2024-08-21 10:32:42,107 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.184s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_b4a7d12f6c2f40a39e359756997857e3__20210831_20210903&limit=2 2024-08-21 10:32:42,107 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:42 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eO412J1G', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:42,107 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"a36cb7cb-0122-40af-8942-1d5ec9372e77","name":"hca_dev_b4a7d12f6c2f40a39e359756...' 2024-08-21 10:32:42,108 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/a36cb7cb-0122-40af-8942-1d5ec9372e77' 2024-08-21 10:32:42,108 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:42,147 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.193s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_005d611a14d54fbf846e571a1f874f70__20210827_20210903&limit=2 2024-08-21 10:32:42,147 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:41 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aNKDjxQO', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:42,147 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"90c2d68f-a000-4c8d-a493-8be93a71b44d","name":"hca_dev_005d611a14d54fbf846e571a...' 2024-08-21 10:32:42,148 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/90c2d68f-a000-4c8d-a493-8be93a71b44d' 2024-08-21 10:32:42,148 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:42,184 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.177s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_24c654a5caa5440a8f02582921f2db4a__20210830_20210903&limit=2 2024-08-21 10:32:42,184 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:41 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e3qYD396', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:42,184 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"c594fc9a-f1c5-4770-acaa-013c2852e660","name":"hca_dev_24c654a5caa5440a8f025829...' 2024-08-21 10:32:42,185 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/c594fc9a-f1c5-4770-acaa-013c2852e660' 2024-08-21 10:32:42,185 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:42,214 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_60ea42e1af4942f58164d641fdb696bc__20210827_20210903&limit=2' 2024-08-21 10:32:42,215 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:42,370 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "d769b0c1-8954-4e6e-958f-4c2251661a35", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-23782220.hca_dev_23587fb31a4a4f58ad74cc9a4cb4c254__20210827_20210909.links`\n )\n WHERE STARTS_WITH(prefix, '4c')\n GROUP BY prefix\n "} 2024-08-21 10:32:42,511 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2a72a4e566b2405abb7c1e463e8febb0__20210901_20210903&limit=2' 2024-08-21 10:32:42,512 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:42,516 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.301s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_60ea42e1af4942f58164d641fdb696bc__20210827_20210903&limit=2 2024-08-21 10:32:42,516 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:42 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e2MvbOwx', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:42,516 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"155a019c-ca47-432d-939b-6e51d5bec730","name":"hca_dev_60ea42e1af4942f58164d641...' 2024-08-21 10:32:42,517 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/155a019c-ca47-432d-939b-6e51d5bec730' 2024-08-21 10:32:42,517 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:42,546 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "179aa0a6-3a5d-43ab-9873-30dfdf37766a", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-990234a8.hca_dev_c6ad8f9bd26a4811b2ba93d487978446__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'f7')\n GROUP BY prefix\n "} 2024-08-21 10:32:42,570 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.462s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/a36cb7cb-0122-40af-8942-1d5ec9372e77 2024-08-21 10:32:42,570 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:42 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aDNlP18D', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:42,570 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"id":"a36cb7cb-0122-40af-8942-1d5ec9372e77","name":"hca_dev_b4a7d12f6c2f40a39e359756997857e3__20210831_20210903","descriptio...' 2024-08-21 10:32:42,571 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-b2004d1c:hca_dev_b4a7d12f6c2f40a39e359756997857e3__20210831_20210903:/0. 2024-08-21 10:32:42,571 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-b2004d1c.hca_dev_b4a7d12f6c2f40a39e359756997857e3__20210831_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:42,587 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.439s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/90c2d68f-a000-4c8d-a493-8be93a71b44d 2024-08-21 10:32:42,587 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.402s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/c594fc9a-f1c5-4770-acaa-013c2852e660 2024-08-21 10:32:42,587 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:42 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eRMZ83yQ', 'Content-Type': 'application/json', 'Content-Length': '13478', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:42,587 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:42 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pQwXvWDj', 'Content-Type': 'application/json', 'Content-Length': '13475', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:42,587 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"id":"90c2d68f-a000-4c8d-a493-8be93a71b44d","name":"hca_dev_005d611a14d54fbf846e571a1f874f70__20210827_20210903","descriptio...' 2024-08-21 10:32:42,587 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"id":"c594fc9a-f1c5-4770-acaa-013c2852e660","name":"hca_dev_24c654a5caa5440a8f02582921f2db4a__20210830_20210903","descriptio...' 2024-08-21 10:32:42,588 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-a9252919:hca_dev_005d611a14d54fbf846e571a1f874f70__20210827_20210903:/0. 2024-08-21 10:32:42,588 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-1c2c69d9:hca_dev_24c654a5caa5440a8f02582921f2db4a__20210830_20210903:/0. 2024-08-21 10:32:42,588 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-a9252919.hca_dev_005d611a14d54fbf846e571a1f874f70__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:42,588 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-1c2c69d9.hca_dev_24c654a5caa5440a8f02582921f2db4a__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:42,689 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "483be3aa-7564-4b62-92b6-732f3b3e44a9", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-279f1986.hca_dev_5ee710d7e2d54fe2818d15f5e31dae32__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '9')\n GROUP BY prefix\n "} 2024-08-21 10:32:42,701 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.189s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2a72a4e566b2405abb7c1e463e8febb0__20210901_20210903&limit=2 2024-08-21 10:32:42,701 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:42 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eOkEEYdj', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:42,702 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"743190c3-fb25-4ccc-9e66-f076ca624c03","name":"hca_dev_2a72a4e566b2405abb7c1e46...' 2024-08-21 10:32:42,702 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/743190c3-fb25-4ccc-9e66-f076ca624c03' 2024-08-21 10:32:42,702 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:42,708 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a29952d9925e40f48a1c274f118f1f51__20210827_20210902&limit=2' 2024-08-21 10:32:42,708 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:42,744 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.227s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/155a019c-ca47-432d-939b-6e51d5bec730 2024-08-21 10:32:42,744 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:42 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pn2ZK8wy', 'Content-Type': 'application/json', 'Content-Length': '13487', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:42,744 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"id":"155a019c-ca47-432d-939b-6e51d5bec730","name":"hca_dev_60ea42e1af4942f58164d641fdb696bc__20210827_20210903","descriptio...' 2024-08-21 10:32:42,745 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-da221b1a:hca_dev_60ea42e1af4942f58164d641fdb696bc__20210827_20210903:97/0. 2024-08-21 10:32:42,745 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-da221b1a.hca_dev_60ea42e1af4942f58164d641fdb696bc__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '97')\n GROUP BY prefix\n " 2024-08-21 10:32:42,847 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_83f5188e3bf749569544cea4f8997756__20210929_20211007&limit=2' 2024-08-21 10:32:42,847 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:42,918 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.210s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_a29952d9925e40f48a1c274f118f1f51__20210827_20210902&limit=2 2024-08-21 10:32:42,919 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:42 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'awvlxNJd', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:42,919 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"68598166-b4e2-49a0-b025-51a0159f6649","name":"hca_dev_a29952d9925e40f48a1c274f...' 2024-08-21 10:32:42,920 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/68598166-b4e2-49a0-b025-51a0159f6649' 2024-08-21 10:32:42,920 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:42,938 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "99d18e0d-fc96-4eb4-b492-75bf01a792e3", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-7913b094.hca_dev_78b2406dbff246fc8b6120690e602227__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '8')\n GROUP BY prefix\n "} 2024-08-21 10:32:42,977 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.275s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/743190c3-fb25-4ccc-9e66-f076ca624c03 2024-08-21 10:32:42,977 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:42 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6B0YJnwl', 'Content-Type': 'application/json', 'Content-Length': '13490', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:42,977 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"id":"743190c3-fb25-4ccc-9e66-f076ca624c03","name":"hca_dev_2a72a4e566b2405abb7c1e463e8febb0__20210901_20210903","descriptio...' 2024-08-21 10:32:42,978 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-4cf05ce2:hca_dev_2a72a4e566b2405abb7c1e463e8febb0__20210901_20210903:2f/0. 2024-08-21 10:32:42,978 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-4cf05ce2.hca_dev_2a72a4e566b2405abb7c1e463e8febb0__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '2f')\n GROUP BY prefix\n " 2024-08-21 10:32:43,033 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.186s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_83f5188e3bf749569544cea4f8997756__20210929_20211007&limit=2 2024-08-21 10:32:43,033 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:42 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a9qkJYnY', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:43,033 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"92166035-2bfc-412b-91a5-fdff874967b2","name":"hca_dev_83f5188e3bf749569544cea4...' 2024-08-21 10:32:43,034 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/92166035-2bfc-412b-91a5-fdff874967b2' 2024-08-21 10:32:43,034 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:43,091 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ccef38d7aa9240109621c4c7b1182647__20210831_20210903&limit=2' 2024-08-21 10:32:43,092 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:43,162 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.242s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/68598166-b4e2-49a0-b025-51a0159f6649 2024-08-21 10:32:43,162 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:42 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a5YQAmb8', 'Content-Type': 'application/json', 'Content-Length': '13485', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:43,162 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"68598166-b4e2-49a0-b025-51a0159f6649","name":"hca_dev_a29952d9925e40f48a1c274f118f1f51__20210827_20210902","descriptio...' 2024-08-21 10:32:43,163 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-9ec7beb6:hca_dev_a29952d9925e40f48a1c274f118f1f51__20210827_20210902:/0. 2024-08-21 10:32:43,163 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-9ec7beb6.hca_dev_a29952d9925e40f48a1c274f118f1f51__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:43,236 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.202s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/92166035-2bfc-412b-91a5-fdff874967b2 2024-08-21 10:32:43,236 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:43 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aDmDKm0y', 'Content-Type': 'application/json', 'Content-Length': '13492', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:43,236 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"id":"92166035-2bfc-412b-91a5-fdff874967b2","name":"hca_dev_83f5188e3bf749569544cea4f8997756__20210929_20211007","descriptio...' 2024-08-21 10:32:43,237 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-560ee3d1:hca_dev_83f5188e3bf749569544cea4f8997756__20210929_20211007:c4/0. 2024-08-21 10:32:43,237 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-560ee3d1.hca_dev_83f5188e3bf749569544cea4f8997756__20210929_20211007.links`\n )\n WHERE STARTS_WITH(prefix, 'c4')\n GROUP BY prefix\n " 2024-08-21 10:32:43,291 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.199s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_ccef38d7aa9240109621c4c7b1182647__20210831_20210903&limit=2 2024-08-21 10:32:43,291 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:42 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6qEPgPQX', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:43,292 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"70c0ed2f-0db6-4245-b1c5-d140cc6c712c","name":"hca_dev_ccef38d7aa9240109621c4c7...' 2024-08-21 10:32:43,293 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/70c0ed2f-0db6-4245-b1c5-d140cc6c712c' 2024-08-21 10:32:43,293 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:43,324 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "71ae8437-11cc-4666-b811-33763338e5cc", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-b2004d1c.hca_dev_b4a7d12f6c2f40a39e359756997857e3__20210831_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:43,388 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "c964d759-8332-4302-a757-0c1baaf730e9", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-1c2c69d9.hca_dev_24c654a5caa5440a8f02582921f2db4a__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:43,463 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "45057748-a7b8-4abc-91cf-fe9aa0356403", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-da221b1a.hca_dev_60ea42e1af4942f58164d641fdb696bc__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '97')\n GROUP BY prefix\n "} 2024-08-21 10:32:43,482 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_dbcd4b1d31bd4eb594e150e8706fa192__20210827_20210902&limit=2' 2024-08-21 10:32:43,482 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:43,520 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "190db791-0cd1-41c9-a82f-d700ac85a448", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-a9252919.hca_dev_005d611a14d54fbf846e571a1f874f70__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:43,521 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.228s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/70c0ed2f-0db6-4245-b1c5-d140cc6c712c 2024-08-21 10:32:43,521 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:42 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6dyrg9Qy', 'Content-Type': 'application/json', 'Content-Length': '13489', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:43,522 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"id":"70c0ed2f-0db6-4245-b1c5-d140cc6c712c","name":"hca_dev_ccef38d7aa9240109621c4c7b1182647__20210831_20210903","descriptio...' 2024-08-21 10:32:43,522 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-aa8357fb:hca_dev_ccef38d7aa9240109621c4c7b1182647__20210831_20210903:22/0. 2024-08-21 10:32:43,522 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-aa8357fb.hca_dev_ccef38d7aa9240109621c4c7b1182647__20210831_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '22')\n GROUP BY prefix\n " 2024-08-21 10:32:43,561 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0fd8f91862d64b8bac354c53dd601f71__20210830_20210903&limit=2' 2024-08-21 10:32:43,561 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:43,626 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_992aad5e7fab46d9a47ddf715e8cfd24__20210830_20210903&limit=2' 2024-08-21 10:32:43,626 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:43,697 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.215s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_dbcd4b1d31bd4eb594e150e8706fa192__20210827_20210902&limit=2 2024-08-21 10:32:43,698 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:42 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVlALdED', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:43,698 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"79f24905-a9e2-4328-91da-fc18036b77eb","name":"hca_dev_dbcd4b1d31bd4eb594e150e8...' 2024-08-21 10:32:43,699 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/79f24905-a9e2-4328-91da-fc18036b77eb' 2024-08-21 10:32:43,699 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:43,711 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_1ce3b3dc02f244a896dad6d107b27a76__20210827_20210903&limit=2' 2024-08-21 10:32:43,712 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:43,751 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "b97683f7-d6fc-42ca-ab16-c0c9cad55b48", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-4cf05ce2.hca_dev_2a72a4e566b2405abb7c1e463e8febb0__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '2f')\n GROUP BY prefix\n "} 2024-08-21 10:32:43,752 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.190s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_0fd8f91862d64b8bac354c53dd601f71__20210830_20210903&limit=2 2024-08-21 10:32:43,753 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:43 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ekW01Nvz', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:43,753 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"f142a2f7-4c50-458d-a047-27bdb8e0d367","name":"hca_dev_0fd8f91862d64b8bac354c53...' 2024-08-21 10:32:43,754 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/f142a2f7-4c50-458d-a047-27bdb8e0d367' 2024-08-21 10:32:43,754 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:43,821 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.194s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_992aad5e7fab46d9a47ddf715e8cfd24__20210830_20210903&limit=2 2024-08-21 10:32:43,821 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:43 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e7lVjV7M', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:43,821 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"924ed952-4c7b-455f-871b-c740b72d405f","name":"hca_dev_992aad5e7fab46d9a47ddf71...' 2024-08-21 10:32:43,822 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/924ed952-4c7b-455f-871b-c740b72d405f' 2024-08-21 10:32:43,822 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:43,911 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d2111fac3fc44f429b6d32cd6a828267__20210830_20230215&limit=2' 2024-08-21 10:32:43,912 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:43,927 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "e3ccdc01-46ee-4457-bd9c-62f7726cb5e6", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-9ec7beb6.hca_dev_a29952d9925e40f48a1c274f118f1f51__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:43,933 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.234s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/79f24905-a9e2-4328-91da-fc18036b77eb 2024-08-21 10:32:43,933 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:43 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eZLQ9Xww', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:43,933 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"id":"79f24905-a9e2-4328-91da-fc18036b77eb","name":"hca_dev_dbcd4b1d31bd4eb594e150e8706fa192__20210827_20210902","descriptio...' 2024-08-21 10:32:43,934 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-dbc582d9:hca_dev_dbcd4b1d31bd4eb594e150e8706fa192__20210827_20210902:4/0. 2024-08-21 10:32:43,934 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-dbc582d9.hca_dev_dbcd4b1d31bd4eb594e150e8706fa192__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '4')\n GROUP BY prefix\n " 2024-08-21 10:32:43,939 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.227s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_1ce3b3dc02f244a896dad6d107b27a76__20210827_20210903&limit=2 2024-08-21 10:32:43,939 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:43 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pV4m0gdD', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:43,939 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"5c3ab1e3-24a9-4ae7-9c56-638422b1ae8b","name":"hca_dev_1ce3b3dc02f244a896dad6d1...' 2024-08-21 10:32:43,939 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/5c3ab1e3-24a9-4ae7-9c56-638422b1ae8b' 2024-08-21 10:32:43,939 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:43,990 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "3d0ed04b-dadc-4a90-830e-c4ba21e3c4ba", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-560ee3d1.hca_dev_83f5188e3bf749569544cea4f8997756__20210929_20211007.links`\n )\n WHERE STARTS_WITH(prefix, 'c4')\n GROUP BY prefix\n "} 2024-08-21 10:32:44,097 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_379ed69ebe0548bcaf5ea7fc589709bf__20210827_20210902&limit=2' 2024-08-21 10:32:44,097 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:44,111 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.358s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/f142a2f7-4c50-458d-a047-27bdb8e0d367 2024-08-21 10:32:44,112 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:43 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ekB2zKGx', 'Content-Type': 'application/json', 'Content-Length': '13479', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:44,112 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"id":"f142a2f7-4c50-458d-a047-27bdb8e0d367","name":"hca_dev_0fd8f91862d64b8bac354c53dd601f71__20210830_20210903","descriptio...' 2024-08-21 10:32:44,113 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-78bae095:hca_dev_0fd8f91862d64b8bac354c53dd601f71__20210830_20210903:/0. 2024-08-21 10:32:44,113 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-78bae095.hca_dev_0fd8f91862d64b8bac354c53dd601f71__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:44,152 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d012d4768f8c4ff389d6ebbe22c1b5c1__20210827_20210903&limit=2' 2024-08-21 10:32:44,152 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:44,153 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.241s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d2111fac3fc44f429b6d32cd6a828267__20210830_20230215&limit=2 2024-08-21 10:32:44,153 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:43 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eRGvnWy2', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:44,153 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"7496e23c-ff51-45fc-9d0f-37659b290038","name":"hca_dev_d2111fac3fc44f429b6d32cd...' 2024-08-21 10:32:44,154 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/7496e23c-ff51-45fc-9d0f-37659b290038' 2024-08-21 10:32:44,154 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:44,173 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.348s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/924ed952-4c7b-455f-871b-c740b72d405f 2024-08-21 10:32:44,173 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:43 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVOxGvZl', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:44,173 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"id":"924ed952-4c7b-455f-871b-c740b72d405f","name":"hca_dev_992aad5e7fab46d9a47ddf715e8cfd24__20210830_20210903","descriptio...' 2024-08-21 10:32:44,174 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-a6312a94:hca_dev_992aad5e7fab46d9a47ddf715e8cfd24__20210830_20210903:9/0. 2024-08-21 10:32:44,174 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-a6312a94.hca_dev_992aad5e7fab46d9a47ddf715e8cfd24__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '9')\n GROUP BY prefix\n " 2024-08-21 10:32:44,248 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.308s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/5c3ab1e3-24a9-4ae7-9c56-638422b1ae8b 2024-08-21 10:32:44,248 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:43 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eRg78RK2', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:44,248 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"id":"5c3ab1e3-24a9-4ae7-9c56-638422b1ae8b","name":"hca_dev_1ce3b3dc02f244a896dad6d107b27a76__20210827_20210903","descriptio...' 2024-08-21 10:32:44,248 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-f5321179:hca_dev_1ce3b3dc02f244a896dad6d107b27a76__20210827_20210903:5/0. 2024-08-21 10:32:44,249 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-f5321179.hca_dev_1ce3b3dc02f244a896dad6d107b27a76__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '5')\n GROUP BY prefix\n " 2024-08-21 10:32:44,289 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.192s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_379ed69ebe0548bcaf5ea7fc589709bf__20210827_20210902&limit=2 2024-08-21 10:32:44,289 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:43 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6vmGmZn2', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:44,289 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"477240da-1ce8-422a-aef4-cc2cf65dd539","name":"hca_dev_379ed69ebe0548bcaf5ea7fc...' 2024-08-21 10:32:44,290 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/477240da-1ce8-422a-aef4-cc2cf65dd539' 2024-08-21 10:32:44,290 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:44,337 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.184s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d012d4768f8c4ff389d6ebbe22c1b5c1__20210827_20210903&limit=2 2024-08-21 10:32:44,337 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:43 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eROqAJY4', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:44,337 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"1c32d6d0-6249-4b0e-a3a4-3a262ed610ef","name":"hca_dev_d012d4768f8c4ff389d6ebbe...' 2024-08-21 10:32:44,339 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/1c32d6d0-6249-4b0e-a3a4-3a262ed610ef' 2024-08-21 10:32:44,339 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:44,370 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "60cc9be1-fb08-4780-a9c7-cc4e236ff872", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-aa8357fb.hca_dev_ccef38d7aa9240109621c4c7b1182647__20210831_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '22')\n GROUP BY prefix\n "} 2024-08-21 10:32:44,380 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.226s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/7496e23c-ff51-45fc-9d0f-37659b290038 2024-08-21 10:32:44,380 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:43 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aNK4Kn4O', 'Content-Type': 'application/json', 'Content-Length': '13485', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:44,380 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"id":"7496e23c-ff51-45fc-9d0f-37659b290038","name":"hca_dev_d2111fac3fc44f429b6d32cd6a828267__20210830_20230215","descriptio...' 2024-08-21 10:32:44,381 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-2a4ab485:hca_dev_d2111fac3fc44f429b6d32cd6a828267__20210830_20230215:fd/0. 2024-08-21 10:32:44,381 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-2a4ab485.hca_dev_d2111fac3fc44f429b6d32cd6a828267__20210830_20230215.links`\n )\n WHERE STARTS_WITH(prefix, 'fd')\n GROUP BY prefix\n " 2024-08-21 10:32:44,620 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_248fcf0316c64a41b6ccaad4d894ca42__20210907_20210907&limit=2' 2024-08-21 10:32:44,620 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:44,630 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.340s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/477240da-1ce8-422a-aef4-cc2cf65dd539 2024-08-21 10:32:44,630 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:43 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aEV8dK9x', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:44,630 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"477240da-1ce8-422a-aef4-cc2cf65dd539","name":"hca_dev_379ed69ebe0548bcaf5ea7fc589709bf__20210827_20210902","descriptio...' 2024-08-21 10:32:44,631 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-1720b3c5:hca_dev_379ed69ebe0548bcaf5ea7fc589709bf__20210827_20210902:/0. 2024-08-21 10:32:44,631 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-1720b3c5.hca_dev_379ed69ebe0548bcaf5ea7fc589709bf__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:44,658 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.319s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/1c32d6d0-6249-4b0e-a3a4-3a262ed610ef 2024-08-21 10:32:44,658 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:43 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eby1Gbxo', 'Content-Type': 'application/json', 'Content-Length': '13476', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:44,658 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"id":"1c32d6d0-6249-4b0e-a3a4-3a262ed610ef","name":"hca_dev_d012d4768f8c4ff389d6ebbe22c1b5c1__20210827_20210903","descriptio...' 2024-08-21 10:32:44,659 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-0d6f73ac:hca_dev_d012d4768f8c4ff389d6ebbe22c1b5c1__20210827_20210903:/0. 2024-08-21 10:32:44,659 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-0d6f73ac.hca_dev_d012d4768f8c4ff389d6ebbe22c1b5c1__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:44,778 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "0d2e8995-313b-480b-87ca-0b42ef8fd157", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-dbc582d9.hca_dev_dbcd4b1d31bd4eb594e150e8706fa192__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '4')\n GROUP BY prefix\n "} 2024-08-21 10:32:44,808 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.187s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_248fcf0316c64a41b6ccaad4d894ca42__20210907_20210907&limit=2 2024-08-21 10:32:44,808 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:44 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a9R0y7bM', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:44,808 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"b1083e8b-4de9-467a-97de-18179c4e6bd1","name":"hca_dev_248fcf0316c64a41b6ccaad4...' 2024-08-21 10:32:44,809 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/b1083e8b-4de9-467a-97de-18179c4e6bd1' 2024-08-21 10:32:44,809 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:44,844 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "e9d0377f-858d-41ca-9d73-c06c55fd3ad2", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-a6312a94.hca_dev_992aad5e7fab46d9a47ddf715e8cfd24__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '9')\n GROUP BY prefix\n "} 2024-08-21 10:32:44,902 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "19847384-2e4e-4c58-9a24-93d9a14990d8", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-78bae095.hca_dev_0fd8f91862d64b8bac354c53dd601f71__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:44,966 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_05657a599f9d4bb9b77b24be13aa5cea__20210827_20230215&limit=2' 2024-08-21 10:32:44,966 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:44,983 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "09c3c74b-30a2-46fd-aacc-fe52f84fb0e2", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-f5321179.hca_dev_1ce3b3dc02f244a896dad6d107b27a76__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '5')\n GROUP BY prefix\n "} 2024-08-21 10:32:44,987 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e77fed30959d4fadbc15a0a5a85c21d2__20210830_20210903&limit=2' 2024-08-21 10:32:44,987 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:45,043 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.234s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/b1083e8b-4de9-467a-97de-18179c4e6bd1 2024-08-21 10:32:45,043 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:44 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6MvV475Z', 'Content-Type': 'application/json', 'Content-Length': '13492', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:45,043 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"id":"b1083e8b-4de9-467a-97de-18179c4e6bd1","name":"hca_dev_248fcf0316c64a41b6ccaad4d894ca42__20210907_20210907","descriptio...' 2024-08-21 10:32:45,043 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-4c3e6011:hca_dev_248fcf0316c64a41b6ccaad4d894ca42__20210907_20210907:e8/0. 2024-08-21 10:32:45,044 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-4c3e6011.hca_dev_248fcf0316c64a41b6ccaad4d894ca42__20210907_20210907.links`\n )\n WHERE STARTS_WITH(prefix, 'e8')\n GROUP BY prefix\n " 2024-08-21 10:32:45,095 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_8c3c290ddfff4553886854ce45f4ba7f__20210902_20210907&limit=2' 2024-08-21 10:32:45,095 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:45,151 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_38449aea70b540db84b31e08f32efe34__20210830_20210903&limit=2' 2024-08-21 10:32:45,151 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:45,183 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "45dc1613-aa33-457a-a972-0d2b147307be", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-2a4ab485.hca_dev_d2111fac3fc44f429b6d32cd6a828267__20210830_20230215.links`\n )\n WHERE STARTS_WITH(prefix, 'fd')\n GROUP BY prefix\n "} 2024-08-21 10:32:45,191 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.225s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_05657a599f9d4bb9b77b24be13aa5cea__20210827_20230215&limit=2 2024-08-21 10:32:45,191 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:44 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ek5gyNvW', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:45,191 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"a3b6a664-1afb-4b4f-bf08-63bab26c848f","name":"hca_dev_05657a599f9d4bb9b77b24be...' 2024-08-21 10:32:45,191 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/a3b6a664-1afb-4b4f-bf08-63bab26c848f' 2024-08-21 10:32:45,191 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:45,199 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.212s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e77fed30959d4fadbc15a0a5a85c21d2__20210830_20210903&limit=2 2024-08-21 10:32:45,199 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:44 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'er5gvE47', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:45,199 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"f5a609de-0760-4a39-b633-9d751aa7d472","name":"hca_dev_e77fed30959d4fadbc15a0a5...' 2024-08-21 10:32:45,199 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/f5a609de-0760-4a39-b633-9d751aa7d472' 2024-08-21 10:32:45,199 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:45,325 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.229s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_8c3c290ddfff4553886854ce45f4ba7f__20210902_20210907&limit=2 2024-08-21 10:32:45,325 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:44 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aD0EWNlv', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:45,325 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"2d6116af-ceb1-4324-ba47-65fbc4202028","name":"hca_dev_8c3c290ddfff4553886854ce...' 2024-08-21 10:32:45,326 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/2d6116af-ceb1-4324-ba47-65fbc4202028' 2024-08-21 10:32:45,326 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:45,332 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_52d10a60c8d14d068a5eaf0d5c0d5034__20210827_20210902&limit=2' 2024-08-21 10:32:45,333 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:45,342 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "08929426-11da-40c4-a726-b2f09c28eddf", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-0d6f73ac.hca_dev_d012d4768f8c4ff389d6ebbe22c1b5c1__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:45,361 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.209s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_38449aea70b540db84b31e08f32efe34__20210830_20210903&limit=2 2024-08-21 10:32:45,361 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:44 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ebOQVmdB', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:45,361 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"cabce9f2-b98b-49f3-9dd4-d7e14c19acd2","name":"hca_dev_38449aea70b540db84b31e08...' 2024-08-21 10:32:45,361 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/cabce9f2-b98b-49f3-9dd4-d7e14c19acd2' 2024-08-21 10:32:45,361 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:45,419 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "0bffae73-b297-4edc-a862-8dd0b12cef6d", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-1720b3c5.hca_dev_379ed69ebe0548bcaf5ea7fc589709bf__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:45,449 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.250s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/f5a609de-0760-4a39-b633-9d751aa7d472 2024-08-21 10:32:45,450 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:44 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pl275rd9', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:45,450 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"id":"f5a609de-0760-4a39-b633-9d751aa7d472","name":"hca_dev_e77fed30959d4fadbc15a0a5a85c21d2__20210830_20210903","descriptio...' 2024-08-21 10:32:45,451 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-e304a8fe:hca_dev_e77fed30959d4fadbc15a0a5a85c21d2__20210830_20210903:d/0. 2024-08-21 10:32:45,451 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-e304a8fe.hca_dev_e77fed30959d4fadbc15a0a5a85c21d2__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'd')\n GROUP BY prefix\n " 2024-08-21 10:32:45,488 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_87d52a86bdc7440cb84d170f7dc346d9__20210830_20210903&limit=2' 2024-08-21 10:32:45,488 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:45,598 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_cddab57b68684be4806f395ed9dd635a__20210831_20210907&limit=2' 2024-08-21 10:32:45,599 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:45,599 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.266s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_52d10a60c8d14d068a5eaf0d5c0d5034__20210827_20210902&limit=2 2024-08-21 10:32:45,600 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:45 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a0d8VkQN', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:45,600 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"60f11345-3c51-43c7-9c40-4d41eae11a17","name":"hca_dev_52d10a60c8d14d068a5eaf0d...' 2024-08-21 10:32:45,601 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/60f11345-3c51-43c7-9c40-4d41eae11a17' 2024-08-21 10:32:45,601 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:45,741 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.414s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/2d6116af-ceb1-4324-ba47-65fbc4202028 2024-08-21 10:32:45,741 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:44 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eyWYVRJD', 'Content-Type': 'application/json', 'Content-Length': '13492', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:45,741 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"id":"2d6116af-ceb1-4324-ba47-65fbc4202028","name":"hca_dev_8c3c290ddfff4553886854ce45f4ba7f__20210902_20210907","descriptio...' 2024-08-21 10:32:45,742 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-0c5c20b5:hca_dev_8c3c290ddfff4553886854ce45f4ba7f__20210902_20210907:0f/0. 2024-08-21 10:32:45,742 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-0c5c20b5.hca_dev_8c3c290ddfff4553886854ce45f4ba7f__20210902_20210907.links`\n )\n WHERE STARTS_WITH(prefix, '0f')\n GROUP BY prefix\n " 2024-08-21 10:32:45,750 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.262s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_87d52a86bdc7440cb84d170f7dc346d9__20210830_20210903&limit=2 2024-08-21 10:32:45,750 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:45 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aGA2EVYE', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:45,750 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"0522bcb4-e8f9-4c0b-936b-b2d729cbcac7","name":"hca_dev_87d52a86bdc7440cb84d170f...' 2024-08-21 10:32:45,750 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/0522bcb4-e8f9-4c0b-936b-b2d729cbcac7' 2024-08-21 10:32:45,750 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:45,823 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "02e07494-fc01-42d1-ba8b-e4dc03500a70", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-4c3e6011.hca_dev_248fcf0316c64a41b6ccaad4d894ca42__20210907_20210907.links`\n )\n WHERE STARTS_WITH(prefix, 'e8')\n GROUP BY prefix\n "} 2024-08-21 10:32:45,863 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.264s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_cddab57b68684be4806f395ed9dd635a__20210831_20210907&limit=2 2024-08-21 10:32:45,863 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:45 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e2kGrZn1', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:45,863 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"5d88275d-d7a5-492b-8e2a-4e93305a0b46","name":"hca_dev_cddab57b68684be4806f395e...' 2024-08-21 10:32:45,865 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/5d88275d-d7a5-492b-8e2a-4e93305a0b46' 2024-08-21 10:32:45,865 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:45,866 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.674s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/a3b6a664-1afb-4b4f-bf08-63bab26c848f 2024-08-21 10:32:45,866 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:45 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e28EP2kB', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:45,866 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"id":"a3b6a664-1afb-4b4f-bf08-63bab26c848f","name":"hca_dev_05657a599f9d4bb9b77b24be13aa5cea__20210827_20230215","descriptio...' 2024-08-21 10:32:45,866 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-3d6d24ad:hca_dev_05657a599f9d4bb9b77b24be13aa5cea__20210827_20230215:9/0. 2024-08-21 10:32:45,866 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-3d6d24ad.hca_dev_05657a599f9d4bb9b77b24be13aa5cea__20210827_20230215.links`\n )\n WHERE STARTS_WITH(prefix, '9')\n GROUP BY prefix\n " 2024-08-21 10:32:45,909 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.547s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/cabce9f2-b98b-49f3-9dd4-d7e14c19acd2 2024-08-21 10:32:45,909 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:45 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e289mdnE', 'Content-Type': 'application/json', 'Content-Length': '13482', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:45,909 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"id":"cabce9f2-b98b-49f3-9dd4-d7e14c19acd2","name":"hca_dev_38449aea70b540db84b31e08f32efe34__20210830_20210903","descriptio...' 2024-08-21 10:32:45,909 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-ac6efd3f:hca_dev_38449aea70b540db84b31e08f32efe34__20210830_20210903:a/0. 2024-08-21 10:32:45,909 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-ac6efd3f.hca_dev_38449aea70b540db84b31e08f32efe34__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'a')\n GROUP BY prefix\n " 2024-08-21 10:32:45,971 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_05be4f374506429bb112506444507d62__20210827_20210902&limit=2' 2024-08-21 10:32:45,971 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:46,049 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.448s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/60f11345-3c51-43c7-9c40-4d41eae11a17 2024-08-21 10:32:46,049 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:45 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eO4BNyDj', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:46,049 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"id":"60f11345-3c51-43c7-9c40-4d41eae11a17","name":"hca_dev_52d10a60c8d14d068a5eaf0d5c0d5034__20210827_20210902","descriptio...' 2024-08-21 10:32:46,050 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-f76414c8:hca_dev_52d10a60c8d14d068a5eaf0d5c0d5034__20210827_20210902:0/0. 2024-08-21 10:32:46,050 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-f76414c8.hca_dev_52d10a60c8d14d068a5eaf0d5c0d5034__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '0')\n GROUP BY prefix\n " 2024-08-21 10:32:46,077 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.326s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/0522bcb4-e8f9-4c0b-936b-b2d729cbcac7 2024-08-21 10:32:46,077 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:45 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6vnwo0d4', 'Content-Type': 'application/json', 'Content-Length': '13479', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:46,077 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"id":"0522bcb4-e8f9-4c0b-936b-b2d729cbcac7","name":"hca_dev_87d52a86bdc7440cb84d170f7dc346d9__20210830_20210903","descriptio...' 2024-08-21 10:32:46,078 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-8eb2ffd1:hca_dev_87d52a86bdc7440cb84d170f7dc346d9__20210830_20210903:/0. 2024-08-21 10:32:46,078 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-8eb2ffd1.hca_dev_87d52a86bdc7440cb84d170f7dc346d9__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:46,143 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.278s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/5d88275d-d7a5-492b-8e2a-4e93305a0b46 2024-08-21 10:32:46,143 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:45 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6MOmn9Ge', 'Content-Type': 'application/json', 'Content-Length': '13487', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:46,143 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"5d88275d-d7a5-492b-8e2a-4e93305a0b46","name":"hca_dev_cddab57b68684be4806f395ed9dd635a__20210831_20210907","descriptio...' 2024-08-21 10:32:46,144 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-24e672db:hca_dev_cddab57b68684be4806f395ed9dd635a__20210831_20210907:1f/0. 2024-08-21 10:32:46,144 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-24e672db.hca_dev_cddab57b68684be4806f395ed9dd635a__20210831_20210907.links`\n )\n WHERE STARTS_WITH(prefix, '1f')\n GROUP BY prefix\n " 2024-08-21 10:32:46,154 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.182s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_05be4f374506429bb112506444507d62__20210827_20210902&limit=2 2024-08-21 10:32:46,154 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:45 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aNwkJZ59', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:46,154 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"ee9a4b92-82c1-4324-85ec-252cd8cea024","name":"hca_dev_05be4f374506429bb1125064...' 2024-08-21 10:32:46,154 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/ee9a4b92-82c1-4324-85ec-252cd8cea024' 2024-08-21 10:32:46,154 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:46,180 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "e44e3889-2a2b-4595-97bc-7645b80f5a32", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-e304a8fe.hca_dev_e77fed30959d4fadbc15a0a5a85c21d2__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'd')\n GROUP BY prefix\n "} 2024-08-21 10:32:46,320 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_6072616c87944b208f52fb15992ea5a4__20210827_20210902&limit=2' 2024-08-21 10:32:46,320 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:46,422 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.268s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/ee9a4b92-82c1-4324-85ec-252cd8cea024 2024-08-21 10:32:46,422 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:45 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ebnmRn8y', 'Content-Type': 'application/json', 'Content-Length': '13486', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:46,423 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"id":"ee9a4b92-82c1-4324-85ec-252cd8cea024","name":"hca_dev_05be4f374506429bb112506444507d62__20210827_20210902","descriptio...' 2024-08-21 10:32:46,423 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-9f4012c9:hca_dev_05be4f374506429bb112506444507d62__20210827_20210902:80/0. 2024-08-21 10:32:46,424 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-9f4012c9.hca_dev_05be4f374506429bb112506444507d62__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '80')\n GROUP BY prefix\n " 2024-08-21 10:32:46,473 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "983e3c03-4906-444f-b416-479208a172ec", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-0c5c20b5.hca_dev_8c3c290ddfff4553886854ce45f4ba7f__20210902_20210907.links`\n )\n WHERE STARTS_WITH(prefix, '0f')\n GROUP BY prefix\n "} 2024-08-21 10:32:46,504 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.184s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_6072616c87944b208f52fb15992ea5a4__20210827_20210902&limit=2 2024-08-21 10:32:46,504 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:45 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eOkY4KqJ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:46,504 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"19510524-bbb9-4883-9228-fcbee947d27e","name":"hca_dev_6072616c87944b208f52fb15...' 2024-08-21 10:32:46,506 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/19510524-bbb9-4883-9228-fcbee947d27e' 2024-08-21 10:32:46,506 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:46,623 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2043c65a1cf84828a6569e247d4e64f1__20210831_20210907&limit=2' 2024-08-21 10:32:46,624 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:46,665 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "aca25c3f-634b-4a2f-aec3-c7000a0c6785", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-3d6d24ad.hca_dev_05657a599f9d4bb9b77b24be13aa5cea__20210827_20230215.links`\n )\n WHERE STARTS_WITH(prefix, '9')\n GROUP BY prefix\n "} 2024-08-21 10:32:46,689 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "25358b2a-05fe-4b67-a94f-2f3297b6f518", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-ac6efd3f.hca_dev_38449aea70b540db84b31e08f32efe34__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, 'a')\n GROUP BY prefix\n "} 2024-08-21 10:32:46,707 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.201s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/19510524-bbb9-4883-9228-fcbee947d27e 2024-08-21 10:32:46,707 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:45 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pQKAGJKg', 'Content-Type': 'application/json', 'Content-Length': '13483', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:46,707 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"id":"19510524-bbb9-4883-9228-fcbee947d27e","name":"hca_dev_6072616c87944b208f52fb15992ea5a4__20210827_20210902","descriptio...' 2024-08-21 10:32:46,708 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-0abea017:hca_dev_6072616c87944b208f52fb15992ea5a4__20210827_20210902:b5/0. 2024-08-21 10:32:46,708 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-0abea017.hca_dev_6072616c87944b208f52fb15992ea5a4__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, 'b5')\n GROUP BY prefix\n " 2024-08-21 10:32:46,820 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_842605c7375a47c59e2ca71c2c00fcad__20210830_20210903&limit=2' 2024-08-21 10:32:46,822 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:46,826 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "a69033aa-2fcb-4844-b063-dc04e3388354", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-f76414c8.hca_dev_52d10a60c8d14d068a5eaf0d5c0d5034__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '0')\n GROUP BY prefix\n "} 2024-08-21 10:32:46,831 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_955dfc2ca8c64d04aa4d907610545d11__20210831_20210903&limit=2' 2024-08-21 10:32:46,831 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:46,873 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.249s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2043c65a1cf84828a6569e247d4e64f1__20210831_20210907&limit=2 2024-08-21 10:32:46,873 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:46 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aN58JMDr', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:46,873 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"e889c6f4-8783-46d6-89bc-8ab9685edf35","name":"hca_dev_2043c65a1cf84828a6569e24...' 2024-08-21 10:32:46,874 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e889c6f4-8783-46d6-89bc-8ab9685edf35' 2024-08-21 10:32:46,874 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:46,985 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "3640449f-981e-4313-81c0-4fe41be53535", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-8eb2ffd1.hca_dev_87d52a86bdc7440cb84d170f7dc346d9__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:46,995 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.173s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_842605c7375a47c59e2ca71c2c00fcad__20210830_20210903&limit=2 2024-08-21 10:32:46,995 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:46 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6J44goon', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:46,995 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"4a245d7b-c43c-4bcb-a738-90ae11378928","name":"hca_dev_842605c7375a47c59e2ca71c...' 2024-08-21 10:32:46,995 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/4a245d7b-c43c-4bcb-a738-90ae11378928' 2024-08-21 10:32:46,995 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:47,006 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "5ba652f9-1ea9-4991-81c0-abbc2d66ad96", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-24e672db.hca_dev_cddab57b68684be4806f395ed9dd635a__20210831_20210907.links`\n )\n WHERE STARTS_WITH(prefix, '1f')\n GROUP BY prefix\n "} 2024-08-21 10:32:47,016 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_1cd1f41ff81a486ba05b66ec60f81dcf__20210901_20210903&limit=2' 2024-08-21 10:32:47,016 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:47,026 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.195s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_955dfc2ca8c64d04aa4d907610545d11__20210831_20210903&limit=2 2024-08-21 10:32:47,027 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:47 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6zmByn2O', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:47,027 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"d8ee3cfa-32c9-49c2-b1ae-af0a7bb1c98d","name":"hca_dev_955dfc2ca8c64d04aa4d9076...' 2024-08-21 10:32:47,027 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/d8ee3cfa-32c9-49c2-b1ae-af0a7bb1c98d' 2024-08-21 10:32:47,028 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:47,118 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.244s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/e889c6f4-8783-46d6-89bc-8ab9685edf35 2024-08-21 10:32:47,118 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:46 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e1WlPDo4', 'Content-Type': 'application/json', 'Content-Length': '13487', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:47,118 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"id":"e889c6f4-8783-46d6-89bc-8ab9685edf35","name":"hca_dev_2043c65a1cf84828a6569e247d4e64f1__20210831_20210907","descriptio...' 2024-08-21 10:32:47,119 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-76de829d:hca_dev_2043c65a1cf84828a6569e247d4e64f1__20210831_20210907:6c/0. 2024-08-21 10:32:47,119 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-76de829d.hca_dev_2043c65a1cf84828a6569e247d4e64f1__20210831_20210907.links`\n )\n WHERE STARTS_WITH(prefix, '6c')\n GROUP BY prefix\n " 2024-08-21 10:32:47,148 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e526d91dcf3a44cb80c5fd7676b55a1d__20210902_20230215&limit=2' 2024-08-21 10:32:47,149 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "c6c2d377-c56c-452c-8f7e-3f05e0db8c1a", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-9f4012c9.hca_dev_05be4f374506429bb112506444507d62__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, '80')\n GROUP BY prefix\n "} 2024-08-21 10:32:47,149 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:47,151 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2af52a1365cb4973b51339be38f2df3f__20210830_20210903&limit=2' 2024-08-21 10:32:47,152 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:47,258 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.241s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_1cd1f41ff81a486ba05b66ec60f81dcf__20210901_20210903&limit=2 2024-08-21 10:32:47,258 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:47 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6gw7WykZ', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:47,258 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"3d661f98-8742-434a-98de-168dde5b5120","name":"hca_dev_1cd1f41ff81a486ba05b66ec...' 2024-08-21 10:32:47,259 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/3d661f98-8742-434a-98de-168dde5b5120' 2024-08-21 10:32:47,259 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:47,291 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_63b5b6c1bbcd487d8c2e0095150c1ecd__20210830_20210903&limit=2' 2024-08-21 10:32:47,291 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:47,311 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.316s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/4a245d7b-c43c-4bcb-a738-90ae11378928 2024-08-21 10:32:47,311 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:46 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aEEQ97oN', 'Content-Type': 'application/json', 'Content-Length': '13475', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:47,311 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"id":"4a245d7b-c43c-4bcb-a738-90ae11378928","name":"hca_dev_842605c7375a47c59e2ca71c2c00fcad__20210830_20210903","descriptio...' 2024-08-21 10:32:47,312 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-bd995e95:hca_dev_842605c7375a47c59e2ca71c2c00fcad__20210830_20210903:/0. 2024-08-21 10:32:47,312 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-bd995e95.hca_dev_842605c7375a47c59e2ca71c2c00fcad__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:47,331 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.304s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/d8ee3cfa-32c9-49c2-b1ae-af0a7bb1c98d 2024-08-21 10:32:47,332 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:47 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e3lDQ4Zl', 'Content-Type': 'application/json', 'Content-Length': '13478', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:47,332 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"id":"d8ee3cfa-32c9-49c2-b1ae-af0a7bb1c98d","name":"hca_dev_955dfc2ca8c64d04aa4d907610545d11__20210831_20210903","descriptio...' 2024-08-21 10:32:47,332 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-788c3b52:hca_dev_955dfc2ca8c64d04aa4d907610545d11__20210831_20210903:/0. 2024-08-21 10:32:47,332 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-788c3b52.hca_dev_955dfc2ca8c64d04aa4d907610545d11__20210831_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:47,384 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.231s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2af52a1365cb4973b51339be38f2df3f__20210830_20210903&limit=2 2024-08-21 10:32:47,384 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:46 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6gwWgd1Z', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:47,385 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"1b3866aa-d2a3-42cf-888d-7fb57a77c5aa","name":"hca_dev_2af52a1365cb4973b51339be...' 2024-08-21 10:32:47,385 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/1b3866aa-d2a3-42cf-888d-7fb57a77c5aa' 2024-08-21 10:32:47,385 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:47,394 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.242s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_e526d91dcf3a44cb80c5fd7676b55a1d__20210902_20230215&limit=2 2024-08-21 10:32:47,394 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:47 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6JxvDA3d', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:47,394 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"5f55707c-6cb2-4b8a-a1b0-9099617fae2e","name":"hca_dev_e526d91dcf3a44cb80c5fd76...' 2024-08-21 10:32:47,394 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/5f55707c-6cb2-4b8a-a1b0-9099617fae2e' 2024-08-21 10:32:47,394 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:47,497 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.205s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_63b5b6c1bbcd487d8c2e0095150c1ecd__20210830_20210903&limit=2 2024-08-21 10:32:47,497 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:47 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVLW7Kqq', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:47,497 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"9d173ed8-c0ff-4a43-baf5-eb30ea7fba6d","name":"hca_dev_63b5b6c1bbcd487d8c2e0095...' 2024-08-21 10:32:47,498 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/9d173ed8-c0ff-4a43-baf5-eb30ea7fba6d' 2024-08-21 10:32:47,498 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:47,526 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "256bce4c-9a34-40a6-86e0-356eff8794b1", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-0abea017.hca_dev_6072616c87944b208f52fb15992ea5a4__20210827_20210902.links`\n )\n WHERE STARTS_WITH(prefix, 'b5')\n GROUP BY prefix\n "} 2024-08-21 10:32:47,542 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.282s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/3d661f98-8742-434a-98de-168dde5b5120 2024-08-21 10:32:47,542 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:47 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'axxg25Jj', 'Content-Type': 'application/json', 'Content-Length': '13481', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:47,542 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"id":"3d661f98-8742-434a-98de-168dde5b5120","name":"hca_dev_1cd1f41ff81a486ba05b66ec60f81dcf__20210901_20210903","descriptio...' 2024-08-21 10:32:47,542 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-86c60513:hca_dev_1cd1f41ff81a486ba05b66ec60f81dcf__20210901_20210903:/0. 2024-08-21 10:32:47,543 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-86c60513.hca_dev_1cd1f41ff81a486ba05b66ec60f81dcf__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:47,645 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.260s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/1b3866aa-d2a3-42cf-888d-7fb57a77c5aa 2024-08-21 10:32:47,645 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:46 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'po1R3KMj', 'Content-Type': 'application/json', 'Content-Length': '13478', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:47,645 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"id":"1b3866aa-d2a3-42cf-888d-7fb57a77c5aa","name":"hca_dev_2af52a1365cb4973b51339be38f2df3f__20210830_20210903","descriptio...' 2024-08-21 10:32:47,646 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-3041c2cf:hca_dev_2af52a1365cb4973b51339be38f2df3f__20210830_20210903:/0. 2024-08-21 10:32:47,646 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-3041c2cf.hca_dev_2af52a1365cb4973b51339be38f2df3f__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:47,686 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_71436067ac414acebe1b2fbcc2cb02fa__20210827_20210928&limit=2' 2024-08-21 10:32:47,686 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:47,750 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.355s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/5f55707c-6cb2-4b8a-a1b0-9099617fae2e 2024-08-21 10:32:47,750 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:46 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'erN2qwZo', 'Content-Type': 'application/json', 'Content-Length': '13484', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:47,750 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"5f55707c-6cb2-4b8a-a1b0-9099617fae2e","name":"hca_dev_e526d91dcf3a44cb80c5fd7676b55a1d__20210902_20230215","descriptio...' 2024-08-21 10:32:47,751 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-e1712bfa:hca_dev_e526d91dcf3a44cb80c5fd7676b55a1d__20210902_20230215:14/0. 2024-08-21 10:32:47,751 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (335 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-e1712bfa.hca_dev_e526d91dcf3a44cb80c5fd7676b55a1d__20210902_20230215.links`\n )\n WHERE STARTS_WITH(prefix, '14')\n GROUP BY prefix\n " 2024-08-21 10:32:47,813 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.316s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/9d173ed8-c0ff-4a43-baf5-eb30ea7fba6d 2024-08-21 10:32:47,814 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:47 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6znBAMBw', 'Content-Type': 'application/json', 'Content-Length': '13479', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:47,814 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"id":"9d173ed8-c0ff-4a43-baf5-eb30ea7fba6d","name":"hca_dev_63b5b6c1bbcd487d8c2e0095150c1ecd__20210830_20210903","descriptio...' 2024-08-21 10:32:47,815 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-c3d623dc:hca_dev_63b5b6c1bbcd487d8c2e0095150c1ecd__20210830_20210903:/0. 2024-08-21 10:32:47,815 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-c3d623dc.hca_dev_63b5b6c1bbcd487d8c2e0095150c1ecd__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:47,881 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "09bec739-9aae-4b2d-a859-a71fc3890a22", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-76de829d.hca_dev_2043c65a1cf84828a6569e247d4e64f1__20210831_20210907.links`\n )\n WHERE STARTS_WITH(prefix, '6c')\n GROUP BY prefix\n "} 2024-08-21 10:32:48,019 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2086eb0510b9432bb7f0169ccc49d270__20210827_20210903&limit=2' 2024-08-21 10:32:48,020 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:48,031 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "342135dd-4050-4a36-9fab-72a42172ab48", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-788c3b52.hca_dev_955dfc2ca8c64d04aa4d907610545d11__20210831_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:48,033 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.347s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_71436067ac414acebe1b2fbcc2cb02fa__20210827_20210928&limit=2 2024-08-21 10:32:48,033 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:48 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eR8EBJE8', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:48,033 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"2e0b01ae-bf72-43a6-864a-4419af665b80","name":"hca_dev_71436067ac414acebe1b2fbc...' 2024-08-21 10:32:48,034 INFO ThreadPoolExecutor-0_4 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/2e0b01ae-bf72-43a6-864a-4419af665b80' 2024-08-21 10:32:48,034 DEBUG ThreadPoolExecutor-0_4 azul.terra: … without request body 2024-08-21 10:32:48,172 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "d727e76c-c822-4b3f-bda2-87d011124e32", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-bd995e95.hca_dev_842605c7375a47c59e2ca71c2c00fcad__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:48,198 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d3446f0c30f34a12b7c36af877c7bb2d__20210901_20210903&limit=2' 2024-08-21 10:32:48,199 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:48,218 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.198s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_2086eb0510b9432bb7f0169ccc49d270__20210827_20210903&limit=2 2024-08-21 10:32:48,218 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:48 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e4Nkbk44', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:48,218 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"fcca83ce-9015-42ae-a846-504cefa7902a","name":"hca_dev_2086eb0510b9432bb7f0169c...' 2024-08-21 10:32:48,220 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/fcca83ce-9015-42ae-a846-504cefa7902a' 2024-08-21 10:32:48,220 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-08-21 10:32:48,319 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_1bdcecde16be420888f478cd2133d11d__20220401_20220404&limit=2' 2024-08-21 10:32:48,320 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:48,344 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "7df0f54c-a9b1-421b-bc92-5438a9e991c0", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-3041c2cf.hca_dev_2af52a1365cb4973b51339be38f2df3f__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:48,352 INFO ThreadPoolExecutor-0_4 azul.terra: Got 200 response after 0.317s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/2e0b01ae-bf72-43a6-864a-4419af665b80 2024-08-21 10:32:48,352 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:48 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a5n7vbOo', 'Content-Type': 'application/json', 'Content-Length': '13475', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:48,352 DEBUG ThreadPoolExecutor-0_4 azul.terra: … with response body b'{"id":"2e0b01ae-bf72-43a6-864a-4419af665b80","name":"hca_dev_71436067ac414acebe1b2fbcc2cb02fa__20210827_20210928","descriptio...' 2024-08-21 10:32:48,352 INFO ThreadPoolExecutor-0_4 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-3545971c:hca_dev_71436067ac414acebe1b2fbcc2cb02fa__20210827_20210928:/0. 2024-08-21 10:32:48,353 DEBUG ThreadPoolExecutor-0_4 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-3545971c.hca_dev_71436067ac414acebe1b2fbcc2cb02fa__20210827_20210928.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:48,377 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "fcbd0ec1-dcfb-448f-8669-1a655ef22df3", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-86c60513.hca_dev_1cd1f41ff81a486ba05b66ec60f81dcf__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:48,405 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.206s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=hca_dev_d3446f0c30f34a12b7c36af877c7bb2d__20210901_20210903&limit=2 2024-08-21 10:32:48,405 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:48 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aDMmlj1M', 'Content-Type': 'application/json', 'Content-Length': '944', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:48,405 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"3011a1cf-1388-4819-8091-fee55e878ea1","name":"hca_dev_d3446f0c30f34a12b7c36af8...' 2024-08-21 10:32:48,406 INFO ThreadPoolExecutor-0_5 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/3011a1cf-1388-4819-8091-fee55e878ea1' 2024-08-21 10:32:48,406 DEBUG ThreadPoolExecutor-0_5 azul.terra: … without request body 2024-08-21 10:32:48,477 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "2ac74d28-7337-4d12-ab8a-e3e352c94881", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 2) AS prefix\n FROM `datarepo-dev-e1712bfa.hca_dev_e526d91dcf3a44cb80c5fd7676b55a1d__20210902_20230215.links`\n )\n WHERE STARTS_WITH(prefix, '14')\n GROUP BY prefix\n "} 2024-08-21 10:32:48,486 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_2620497955a349b28d2b53e0bdfcb176__20220404_20220404&limit=2' 2024-08-21 10:32:48,486 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:48,520 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_00f056f273ff43ac97ff69ca10e38c89__20220404_20220404_lm2&limit=2' 2024-08-21 10:32:48,520 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:48,530 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.210s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_1bdcecde16be420888f478cd2133d11d__20220401_20220404&limit=2 2024-08-21 10:32:48,531 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:48 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'ek5MwLlO', 'Content-Type': 'application/json', 'Content-Length': '952', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:48,531 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"96c6482b-7949-4d6e-894b-371149e85134","name":"lungmap_dev_1bdcecde16be420888f4...' 2024-08-21 10:32:48,531 INFO ThreadPoolExecutor-0_6 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/96c6482b-7949-4d6e-894b-371149e85134' 2024-08-21 10:32:48,532 DEBUG ThreadPoolExecutor-0_6 azul.terra: … without request body 2024-08-21 10:32:48,537 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.318s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/fcca83ce-9015-42ae-a846-504cefa7902a 2024-08-21 10:32:48,537 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:48 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aA58zyKr', 'Content-Type': 'application/json', 'Content-Length': '13478', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:48,538 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"id":"fcca83ce-9015-42ae-a846-504cefa7902a","name":"hca_dev_2086eb0510b9432bb7f0169ccc49d270__20210827_20210903","descriptio...' 2024-08-21 10:32:48,538 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-c808badb:hca_dev_2086eb0510b9432bb7f0169ccc49d270__20210827_20210903:/0. 2024-08-21 10:32:48,538 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (333 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-c808badb.hca_dev_2086eb0510b9432bb7f0169ccc49d270__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:48,566 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "7bf47ff0-04e2-4a3d-8c3e-cc0a3b6597fe", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-c3d623dc.hca_dev_63b5b6c1bbcd487d8c2e0095150c1ecd__20210830_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:48,664 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_f899709cae2c4bb988f0131142e6c7ec__20220401_20220629_lm2&limit=2' 2024-08-21 10:32:48,664 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:48,727 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_20037472ea1d4ddb9cd356a11a6f0f76__20220401_20220404_lm2&limit=2' 2024-08-21 10:32:48,727 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:48,765 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.245s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_00f056f273ff43ac97ff69ca10e38c89__20220404_20220404_lm2&limit=2 2024-08-21 10:32:48,765 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:47 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6vmONMMX', 'Content-Type': 'application/json', 'Content-Length': '960', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:48,766 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"da13c055-9b6e-4539-be07-230f662b0273","name":"lungmap_dev_00f056f273ff43ac97ff...' 2024-08-21 10:32:48,766 INFO ThreadPoolExecutor-0_5 azul.terra: Got 200 response after 0.360s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/3011a1cf-1388-4819-8091-fee55e878ea1 2024-08-21 10:32:48,766 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/da13c055-9b6e-4539-be07-230f662b0273' 2024-08-21 10:32:48,767 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:48 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pVLxEQQy', 'Content-Type': 'application/json', 'Content-Length': '13480', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:48,767 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-08-21 10:32:48,767 DEBUG ThreadPoolExecutor-0_5 azul.terra: … with response body b'{"id":"3011a1cf-1388-4819-8091-fee55e878ea1","name":"hca_dev_d3446f0c30f34a12b7c36af877c7bb2d__20210901_20210903","descriptio...' 2024-08-21 10:32:48,768 INFO ThreadPoolExecutor-0_5 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-b3632667:hca_dev_d3446f0c30f34a12b7c36af877c7bb2d__20210901_20210903:8/0. 2024-08-21 10:32:48,768 DEBUG ThreadPoolExecutor-0_5 azul.terra: Query (334 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-b3632667.hca_dev_d3446f0c30f34a12b7c36af877c7bb2d__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '8')\n GROUP BY prefix\n " 2024-08-21 10:32:48,771 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.285s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_2620497955a349b28d2b53e0bdfcb176__20220404_20220404&limit=2 2024-08-21 10:32:48,771 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:47 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pYGGqvAo', 'Content-Type': 'application/json', 'Content-Length': '952', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:48,772 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"23f0064e-3615-4009-9dfc-60583f92064e","name":"lungmap_dev_2620497955a349b28d2b...' 2024-08-21 10:32:48,772 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/23f0064e-3615-4009-9dfc-60583f92064e' 2024-08-21 10:32:48,772 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-08-21 10:32:48,858 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.194s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_f899709cae2c4bb988f0131142e6c7ec__20220401_20220629_lm2&limit=2 2024-08-21 10:32:48,858 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:48 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'e1758EXw', 'Content-Type': 'application/json', 'Content-Length': '960', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:48,858 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"a45481be-52fe-4458-b926-37b82fb0b04a","name":"lungmap_dev_f899709cae2c4bb988f0...' 2024-08-21 10:32:48,859 INFO ThreadPoolExecutor-0_7 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/a45481be-52fe-4458-b926-37b82fb0b04a' 2024-08-21 10:32:48,859 DEBUG ThreadPoolExecutor-0_7 azul.terra: … without request body 2024-08-21 10:32:48,873 INFO ThreadPoolExecutor-0_6 azul.terra: Got 200 response after 0.341s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/96c6482b-7949-4d6e-894b-371149e85134 2024-08-21 10:32:48,873 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:48 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aG71vjva', 'Content-Type': 'application/json', 'Content-Length': '13485', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:48,873 DEBUG ThreadPoolExecutor-0_6 azul.terra: … with response body b'{"id":"96c6482b-7949-4d6e-894b-371149e85134","name":"lungmap_dev_1bdcecde16be420888f478cd2133d11d__20220401_20220404","descri...' 2024-08-21 10:32:48,874 INFO ThreadPoolExecutor-0_6 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-5d9526e0:lungmap_dev_1bdcecde16be420888f478cd2133d11d__20220401_20220404:/0. 2024-08-21 10:32:48,874 DEBUG ThreadPoolExecutor-0_6 azul.terra: Query (337 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-5d9526e0.lungmap_dev_1bdcecde16be420888f478cd2133d11d__20220401_20220404.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:48,906 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.179s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=lungmap_dev_20037472ea1d4ddb9cd356a11a6f0f76__20220401_20220404_lm2&limit=2 2024-08-21 10:32:48,906 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:48 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aEQvoj9Z', 'Content-Type': 'application/json', 'Content-Length': '960', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:48,906 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"total":161,"filteredTotal":1,"items":[{"id":"3739a9ee-e7d7-4ced-860d-cf89e81d4437","name":"lungmap_dev_20037472ea1d4ddb9cd3...' 2024-08-21 10:32:48,907 INFO ThreadPoolExecutor-0_3 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/3739a9ee-e7d7-4ced-860d-cf89e81d4437' 2024-08-21 10:32:48,907 DEBUG ThreadPoolExecutor-0_3 azul.terra: … without request body 2024-08-21 10:32:49,029 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.262s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/da13c055-9b6e-4539-be07-230f662b0273 2024-08-21 10:32:49,029 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:48 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'poDZwBBr', 'Content-Type': 'application/json', 'Content-Length': '13497', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:49,029 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"id":"da13c055-9b6e-4539-be07-230f662b0273","name":"lungmap_dev_00f056f273ff43ac97ff69ca10e38c89__20220404_20220404_lm2","de...' 2024-08-21 10:32:49,030 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-b47b6759:lungmap_dev_00f056f273ff43ac97ff69ca10e38c89__20220404_20220404_lm2:/0. 2024-08-21 10:32:49,031 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (341 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-b47b6759.lungmap_dev_00f056f273ff43ac97ff69ca10e38c89__20220404_20220404_lm2.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:49,075 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.303s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/23f0064e-3615-4009-9dfc-60583f92064e 2024-08-21 10:32:49,076 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:49 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'a9DjAG1V', 'Content-Type': 'application/json', 'Content-Length': '13491', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:49,076 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"id":"23f0064e-3615-4009-9dfc-60583f92064e","name":"lungmap_dev_2620497955a349b28d2b53e0bdfcb176__20220404_20220404","descri...' 2024-08-21 10:32:49,077 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-8de6d66b:lungmap_dev_2620497955a349b28d2b53e0bdfcb176__20220404_20220404:/0. 2024-08-21 10:32:49,077 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (337 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-8de6d66b.lungmap_dev_2620497955a349b28d2b53e0bdfcb176__20220404_20220404.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:49,111 DEBUG ThreadPoolExecutor-0_4 azul.terra: Job info: {"job_id": "48c0b180-57e3-4830-b101-09a7d69a9fa4", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-3545971c.hca_dev_71436067ac414acebe1b2fbcc2cb02fa__20210827_20210928.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:49,254 INFO ThreadPoolExecutor-0_7 azul.terra: Got 200 response after 0.395s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/a45481be-52fe-4458-b926-37b82fb0b04a 2024-08-21 10:32:49,255 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:49 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aG03vO8e', 'Content-Type': 'application/json', 'Content-Length': '13499', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:49,255 DEBUG ThreadPoolExecutor-0_7 azul.terra: … with response body b'{"id":"a45481be-52fe-4458-b926-37b82fb0b04a","name":"lungmap_dev_f899709cae2c4bb988f0131142e6c7ec__20220401_20220629_lm2","de...' 2024-08-21 10:32:49,256 INFO ThreadPoolExecutor-0_7 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-d57fd0c5:lungmap_dev_f899709cae2c4bb988f0131142e6c7ec__20220401_20220629_lm2:/0. 2024-08-21 10:32:49,256 DEBUG ThreadPoolExecutor-0_7 azul.terra: Query (341 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-d57fd0c5.lungmap_dev_f899709cae2c4bb988f0131142e6c7ec__20220401_20220629_lm2.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:49,282 INFO ThreadPoolExecutor-0_3 azul.terra: Got 200 response after 0.375s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/3739a9ee-e7d7-4ced-860d-cf89e81d4437 2024-08-21 10:32:49,282 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:49 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6J4V07WE', 'Content-Type': 'application/json', 'Content-Length': '13499', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:49,282 DEBUG ThreadPoolExecutor-0_3 azul.terra: … with response body b'{"id":"3739a9ee-e7d7-4ced-860d-cf89e81d4437","name":"lungmap_dev_20037472ea1d4ddb9cd356a11a6f0f76__20220401_20220404_lm2","de...' 2024-08-21 10:32:49,282 INFO ThreadPoolExecutor-0_3 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-2e9ef7fd:lungmap_dev_20037472ea1d4ddb9cd356a11a6f0f76__20220401_20220404_lm2:/0. 2024-08-21 10:32:49,282 DEBUG ThreadPoolExecutor-0_3 azul.terra: Query (341 characters total): "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-2e9ef7fd.lungmap_dev_20037472ea1d4ddb9cd356a11a6f0f76__20220401_20220404_lm2.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n " 2024-08-21 10:32:49,390 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "fd29c89f-3504-4cbe-b346-0f0b9f46bda7", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-c808badb.hca_dev_2086eb0510b9432bb7f0169ccc49d270__20210827_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:49,559 DEBUG ThreadPoolExecutor-0_6 azul.terra: Job info: {"job_id": "4909def5-7a99-4d87-9ca3-c6a0c5bfe93a", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-5d9526e0.lungmap_dev_1bdcecde16be420888f478cd2133d11d__20220401_20220404.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:49,590 DEBUG ThreadPoolExecutor-0_5 azul.terra: Job info: {"job_id": "9c8a7590-b568-4360-92e5-a8c13aebe9f8", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 1) AS prefix\n FROM `datarepo-dev-b3632667.hca_dev_d3446f0c30f34a12b7c36af877c7bb2d__20210901_20210903.links`\n )\n WHERE STARTS_WITH(prefix, '8')\n GROUP BY prefix\n "} 2024-08-21 10:32:49,847 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "f30ef106-39e3-4102-bb93-6e744e813e6e", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-b47b6759.lungmap_dev_00f056f273ff43ac97ff69ca10e38c89__20220404_20220404_lm2.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:49,899 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "b8095c5d-e47b-4dd1-bf51-29134d079b7f", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-8de6d66b.lungmap_dev_2620497955a349b28d2b53e0bdfcb176__20220404_20220404.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:49,959 DEBUG ThreadPoolExecutor-0_3 azul.terra: Job info: {"job_id": "f56a4fa4-0553-4982-849e-b06154df6410", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-2e9ef7fd.lungmap_dev_20037472ea1d4ddb9cd356a11a6f0f76__20220401_20220404_lm2.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:50,139 DEBUG ThreadPoolExecutor-0_7 azul.terra: Job info: {"job_id": "c1d63284-4a6d-496c-a81b-688c370364df", "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT prefix, COUNT(*) AS subgraph_count\n FROM (\n SELECT SUBSTR(links_id, 1, 0) AS prefix\n FROM `datarepo-dev-d57fd0c5.lungmap_dev_f899709cae2c4bb988f0131142e6c7ec__20220401_20220629_lm2.links`\n )\n WHERE STARTS_WITH(prefix, '')\n GROUP BY prefix\n "} 2024-08-21 10:32:50,289 INFO MainThread azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/roleMap' 2024-08-21 10:32:50,289 DEBUG MainThread azul.terra: … without request body 2024-08-21 10:32:50,801 INFO MainThread azul.terra: Got 200 response after 0.512s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/roleMap 2024-08-21 10:32:50,801 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:50 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'eROxyWv8', 'Content-Type': 'application/json', 'Content-Length': '13303', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:50,801 DEBUG MainThread azul.terra: … with response body b'{"roleMap":{"a0925f5f-3d38-4f8a-a09f-f6997072dc23":["discoverer","reader","aggregate_data_reader"],"215793b0-b991-4b73-9584-1...' 2024-08-21 10:32:50,802 INFO MainThread azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/roleMap' 2024-08-21 10:32:50,802 DEBUG MainThread azul.terra: … without request body 2024-08-21 10:32:51,065 INFO MainThread azul.terra: Got 200 response after 0.263s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/roleMap 2024-08-21 10:32:51,065 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Wed, 21 Aug 2024 17:32:51 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pn2OOMdM', 'Content-Type': 'application/json', 'Content-Length': '13999', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-08-21 10:32:51,066 DEBUG MainThread azul.terra: … with response body b'{"roleMap":{"a0925f5f-3d38-4f8a-a09f-f6997072dc23":["discoverer","aggregate_data_reader","reader"],"215793b0-b991-4b73-9584-1...' :1: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html :1: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html python /Users/daniel/repo/azul2/scripts/check_branch.py python /Users/daniel/repo/azul2/lambdas/service/.chalice/config.json.template.py /Users/daniel/repo/azul2/lambdas/service/.chalice/config.json [INFO] 2024-08-21T10:33:52.344Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-08-21T10:33:52.373Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4459129488 Creating /Users/daniel/repo/azul2/lambdas/service/.chalice/config.json python -m unittest -v integration_test 2024-08-21 10:33:53,333 INFO MainThread botocore.credentials: Found credentials in shared credentials file: ~/.aws/credentials 2024-08-21 10:33:53,357 INFO MainThread azul.deployment: Allocated new Boto3 client for 'es' with ID 4417699088 2024-08-21 10:33:53,864 DEBUG MainThread azul.es: Creating ES client [vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443] 2024-08-21 10:33:53,872 INFO MainThread azul.deployment: Allocated new Boto3 client for 'sts' with ID 4417943376 2024-08-21 10:33:53,880 INFO MainThread botocore.credentials: Found credentials in environment variables. 2024-08-21 10:33:53,880 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_files 2024-08-21 10:33:53,880 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:55,315 INFO MainThread elasticsearch: Got 200 response after 1.434s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_files 2024-08-21 10:33:55,315 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_files":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.donor…' 2024-08-21 10:33:55,318 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_files_aggregate 2024-08-21 10:33:55,318 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:55,435 INFO MainThread elasticsearch: Got 200 response after 0.117s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_files_aggregate 2024-08-21 10:33:55,435 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_files_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"cont…' 2024-08-21 10:33:55,439 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_cell_suspensions 2024-08-21 10:33:55,439 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:55,536 INFO MainThread elasticsearch: Got 200 response after 0.097s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_cell_suspensions 2024-08-21 10:33:55,536 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_cell_suspensions":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"con…' 2024-08-21 10:33:55,539 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_cell_suspensions_aggregate 2024-08-21 10:33:55,540 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:55,640 INFO MainThread elasticsearch: Got 200 response after 0.100s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_cell_suspensions_aggregate 2024-08-21 10:33:55,640 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_cell_suspensions_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_m…' 2024-08-21 10:33:55,643 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_samples 2024-08-21 10:33:55,643 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:55,745 INFO MainThread elasticsearch: Got 200 response after 0.102s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_samples 2024-08-21 10:33:55,745 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_samples":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.don…' 2024-08-21 10:33:55,748 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_samples_aggregate 2024-08-21 10:33:55,748 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:55,844 INFO MainThread elasticsearch: Got 200 response after 0.096s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_samples_aggregate 2024-08-21 10:33:55,844 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_samples_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"co…' 2024-08-21 10:33:55,846 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_projects 2024-08-21 10:33:55,846 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:55,941 INFO MainThread elasticsearch: Got 200 response after 0.095s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_projects 2024-08-21 10:33:55,942 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_projects":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.do…' 2024-08-21 10:33:55,943 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_projects_aggregate 2024-08-21 10:33:55,943 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:56,048 INFO MainThread elasticsearch: Got 200 response after 0.104s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_projects_aggregate 2024-08-21 10:33:56,048 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_projects_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"c…' 2024-08-21 10:33:56,050 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_bundles 2024-08-21 10:33:56,050 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:56,149 INFO MainThread elasticsearch: Got 200 response after 0.098s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_bundles 2024-08-21 10:33:56,149 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_bundles":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.don…' 2024-08-21 10:33:56,151 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_bundles_aggregate 2024-08-21 10:33:56,151 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:56,249 INFO MainThread elasticsearch: Got 200 response after 0.098s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_bundles_aggregate 2024-08-21 10:33:56,249 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_bundles_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"co…' 2024-08-21 10:33:56,251 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_replica 2024-08-21 10:33:56,251 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:56,351 INFO MainThread elasticsearch: Got 200 response after 0.100s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_dcp3-it_replica 2024-08-21 10:33:56,351 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_dcp3-it_replica":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_type":"stri…' 2024-08-21 10:33:56,353 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_files 2024-08-21 10:33:56,353 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:56,453 INFO MainThread elasticsearch: Got 200 response after 0.100s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_files 2024-08-21 10:33:56,453 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_files":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.do…' 2024-08-21 10:33:56,455 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_files_aggregate 2024-08-21 10:33:56,455 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:56,550 INFO MainThread elasticsearch: Got 200 response after 0.095s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_files_aggregate 2024-08-21 10:33:56,550 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_files_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"c…' 2024-08-21 10:33:56,553 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_cell_suspensions 2024-08-21 10:33:56,553 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:56,653 INFO MainThread elasticsearch: Got 200 response after 0.100s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_cell_suspensions 2024-08-21 10:33:56,653 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_cell_suspensions":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"…' 2024-08-21 10:33:56,656 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_cell_suspensions_aggregate 2024-08-21 10:33:56,657 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:56,751 INFO MainThread elasticsearch: Got 200 response after 0.094s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_cell_suspensions_aggregate 2024-08-21 10:33:56,751 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_cell_suspensions_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"pat…' 2024-08-21 10:33:56,753 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_samples 2024-08-21 10:33:56,753 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:56,850 INFO MainThread elasticsearch: Got 200 response after 0.097s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_samples 2024-08-21 10:33:56,850 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_samples":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.…' 2024-08-21 10:33:56,852 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_samples_aggregate 2024-08-21 10:33:56,853 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:56,957 INFO MainThread elasticsearch: Got 200 response after 0.105s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_samples_aggregate 2024-08-21 10:33:56,957 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_samples_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":…' 2024-08-21 10:33:56,960 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_projects 2024-08-21 10:33:56,961 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:57,056 INFO MainThread elasticsearch: Got 200 response after 0.095s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_projects 2024-08-21 10:33:57,056 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_projects":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents…' 2024-08-21 10:33:57,059 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_projects_aggregate 2024-08-21 10:33:57,059 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:57,158 INFO MainThread elasticsearch: Got 200 response after 0.099s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_projects_aggregate 2024-08-21 10:33:57,158 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_projects_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match"…' 2024-08-21 10:33:57,161 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_bundles 2024-08-21 10:33:57,162 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:57,260 INFO MainThread elasticsearch: Got 200 response after 0.098s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_bundles 2024-08-21 10:33:57,260 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_bundles":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.…' 2024-08-21 10:33:57,261 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_bundles_aggregate 2024-08-21 10:33:57,261 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:57,358 INFO MainThread elasticsearch: Got 200 response after 0.096s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_bundles_aggregate 2024-08-21 10:33:57,358 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_bundles_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":…' 2024-08-21 10:33:57,360 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_replica 2024-08-21 10:33:57,361 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:57,451 INFO MainThread elasticsearch: Got 200 response after 0.090s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lungmap-it_replica 2024-08-21 10:33:57,451 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lungmap-it_replica":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_type":"s…' 2024-08-21 10:33:57,453 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_files 2024-08-21 10:33:57,454 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:57,548 INFO MainThread elasticsearch: Got 200 response after 0.094s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_files 2024-08-21 10:33:57,548 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_files":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.donors…' 2024-08-21 10:33:57,550 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_files_aggregate 2024-08-21 10:33:57,550 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:57,649 INFO MainThread elasticsearch: Got 200 response after 0.099s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_files_aggregate 2024-08-21 10:33:57,650 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_files_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"conte…' 2024-08-21 10:33:57,652 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_cell_suspensions 2024-08-21 10:33:57,652 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:57,750 INFO MainThread elasticsearch: Got 200 response after 0.098s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_cell_suspensions 2024-08-21 10:33:57,750 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_cell_suspensions":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"cont…' 2024-08-21 10:33:57,752 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_cell_suspensions_aggregate 2024-08-21 10:33:57,752 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:57,846 INFO MainThread elasticsearch: Got 200 response after 0.094s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_cell_suspensions_aggregate 2024-08-21 10:33:57,846 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_cell_suspensions_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_ma…' 2024-08-21 10:33:57,850 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_samples 2024-08-21 10:33:57,850 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:57,950 INFO MainThread elasticsearch: Got 200 response after 0.101s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_samples 2024-08-21 10:33:57,951 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_samples":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.dono…' 2024-08-21 10:33:57,953 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_samples_aggregate 2024-08-21 10:33:57,953 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:58,048 INFO MainThread elasticsearch: Got 200 response after 0.095s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_samples_aggregate 2024-08-21 10:33:58,048 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_samples_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"con…' 2024-08-21 10:33:58,050 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_projects 2024-08-21 10:33:58,051 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:58,148 INFO MainThread elasticsearch: Got 200 response after 0.097s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_projects 2024-08-21 10:33:58,148 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_projects":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.don…' 2024-08-21 10:33:58,151 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_projects_aggregate 2024-08-21 10:33:58,151 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:58,244 INFO MainThread elasticsearch: Got 200 response after 0.094s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_projects_aggregate 2024-08-21 10:33:58,245 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_projects_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"co…' 2024-08-21 10:33:58,248 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_bundles 2024-08-21 10:33:58,248 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:58,345 INFO MainThread elasticsearch: Got 200 response after 0.097s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_bundles 2024-08-21 10:33:58,345 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_bundles":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"contents.dono…' 2024-08-21 10:33:58,348 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_bundles_aggregate 2024-08-21 10:33:58,348 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:58,452 INFO MainThread elasticsearch: Got 200 response after 0.104s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_bundles_aggregate 2024-08-21 10:33:58,452 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_bundles_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"donor_age_range":{"path_match":"con…' 2024-08-21 10:33:58,454 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_replica 2024-08-21 10:33:58,454 INFO MainThread elasticsearch: … without request body 2024-08-21 10:33:58,549 INFO MainThread elasticsearch: Got 200 response after 0.095s from GET to https://vpc-azul-index-sandbox-mcwjphhhdivigzrsrdmxm2uude.us-east-1.es.amazonaws.com:443/azul_v2_daniel_lm2-it_replica 2024-08-21 10:33:58,549 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel_lm2-it_replica":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_type":"strin…' test_local_chalice (integration_test.AzulChaliceLocalIntegrationTest.test_local_chalice) ... 2024-08-21 10:33:58,605 INFO Thread-2 (process_request_thread) azul.chalice: Received GET request for '/', with {"query": null, "headers": {"host": "127.0.0.1:8000", "user-agent": "python-requests/2.32.2", "accept-encoding": "gzip, deflate, br", "accept": "*/*", "connection": "keep-alive"}}. 2024-08-21 10:33:58,605 INFO Thread-2 (process_request_thread) azul.chalice: Did not authenticate request. 2024-08-21 10:33:58,606 DEBUG Thread-2 (process_request_thread) azul.chalice: Returning 200 response with headers {"Content-Type": "text/html", "Strict-Transport-Security": "max-age=31536000; includeSubDomains", "X-Content-Type-Options": "nosniff", "X-Frame-Options": "DENY", "Cache-Control": "public, max-age=0, must-revalidate"}. See next line for the first 1024 characters of the body. Swagger UI