Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Indefinite AWS MFA auth loop when running DBT with Redshift IAM auth #22

Closed
1 of 5 tasks
ags2121 opened this issue Aug 3, 2021 · 2 comments
Closed
1 of 5 tasks
Labels
bug Something isn't working Stale

Comments

@ags2121
Copy link

ags2121 commented Aug 3, 2021

Describe the bug

I'm following the documentation here for now to set up IAM auth with Redshift profiles, but am encountering an issue where I am continually prompted to enter an MFA token.

Steps To Reproduce

See below for command and log output (the model code is trivial, it's just a simple select from a raw/base model):

12:06 $ dbt run --profile dade --target iam --profiles-dir profiles/dev -m assigned_worker
Running with dbt=0.18.0
* Deprecation Warning: dbt v0.17.0 introduces a new config format for the
dbt_project.yml file. Support for the existing version 1 format will be removed
in a future release of dbt. The following packages are currently configured with
config version 1:
 - dbt_analytics
 - dbt_utils
 - redshift

For upgrading instructions, consult the documentation:
  https://docs.getdbt.com/docs/guides/migration-guide/upgrading-to-0-17-0

* Deprecation Warning: The "adapter_macro" macro has been deprecated. Instead,
use the `adapter.dispatch` method to find a macro and call the result.
adapter_macro was called for: dbt_utils.type_string
Found 264 models, 1430 tests, 0 snapshots, 10 analyses, 332 macros, 1 operation, 0 seed files, 167 sources

Enter MFA code for arn:aws:iam::042199655640:mfa/alex: 
Enter MFA code for arn:aws:iam::042199655640:mfa/alex: 
Enter MFA code for arn:aws:iam::042199655640:mfa/alex: 
Enter MFA code for arn:aws:iam::042199655640:mfa/alex: 
Enter MFA code for arn:aws:iam::042199655640:mfa/alex: 
Enter MFA code for arn:aws:iam::042199655640:mfa/alex: 
Enter MFA code for arn:aws:iam::042199655640:mfa/alex: 
Enter MFA code for arn:aws:iam::042199655640:mfa/alex: 
…

And I know it's not necessarily an issue with my AWS config or DBT profiles, as I am able to connect successfully, for example when I run debug like so:

12:05 $ dbt debug --profile dade --target iam --profiles-dir profiles/dev 
Running with dbt=0.18.0
dbt version: 0.18.0
python version: 3.8.10
python path: /Users/silvaale/.pyenv/versions/3.8.10/bin/python3.8
os info: macOS-10.15.7-x86_64-i386-64bit
Using profiles.yml file at profiles/dev/profiles.yml
Using dbt_project.yml file at /Users/silvaale/Documents/data-dbt-analysis/dbt_project.yml

Configuration:
  profiles.yml file [OK found and valid]
  dbt_project.yml file [OK found and valid]

Required dependencies:
 - git [OK found]

Connection:
  host: 10.0.20.70
  port: 5439
  user: alex_iam
  database: dade
  schema: dbt_analytics__alex_iam
  search_path: None
  keepalives_idle: 3600
  sslmode: None
  method: iam
  cluster_id: dw-redshift-dev
  iam_profile: wmops
  iam_duration_seconds: 900
Enter MFA code for arn:aws:iam::042199655640:mfa/alex: 
  Connection test: OK connection ok

Here's the dbt profiles.yml I'm using in this test (FYI, the "transformers" group has the necessary DBT grants, like, create on DB):

config:
  partial_parse: True

dade:
  outputs:
    
    prod:
      type: redshift
      threads: 1
      host: "{{ env_var('DBT_HOST') }}"
      port: 5439
      user: dbt
      password: "{{ env_var('DBT_PASSWORD') }}"
      dbname: "{{ env_var('DBT_DBNAME') }}"
      schema: dbt_analytics

    iam:
      type: redshift
      method: iam
      cluster_id: dw-redshift-dev
      host: 10.0.20.70
      user: alex_iam
      iam_profile: wmops # optional
      iam_duration_seconds: 900  # optional
      autocreate: true           # optional
      db_groups: ['transformers']    # optional

      # Other Redshift configs:
      port: 5439
      dbname: dade
      schema: dbt_analytics__alex_iam
      threads: 1
      keepalives_idle: 3600 # default 0, indicating the system default
      # search_path: public # optional, but not recommended
      #sslmode: [optional, set the sslmode used to connect to the database (in case this parameter is set, will look for ca in ~/.postgresql/root.crt)]

  target: prod

Expected behavior

What I would expect to see instead is to be prompted once, and have that MFA token remain valid for some configurable duration.

Screenshots and log output

This is the log output of the dbt run command pasted above:

2021-08-03 16:06:35.471848 (MainThread): Running with dbt=0.18.0
2021-08-03 16:06:35.666706 (MainThread): running dbt with arguments Namespace(cls=<class 'dbt.task.run.RunTask'>, debug=False, defer=None, exclude=None, fail_fast=False, full_refresh=False, log_cache_events=False, log_format='default', models=['assigned_worker'], partial_parse=None, profile='dade', profiles_dir='profiles/dev', project_dir=None, record_timing_info=None, rpc_method='run', selector_name=None, single_threaded=False, state=None, strict=False, target='iam', test_new_parser=False, threads=None, use_cache=True, use_colors=None, vars='{}', version_check=True, warn_error=False, which='run', write_json=True)
2021-08-03 16:06:35.667153 (MainThread): Tracking: tracking
2021-08-03 16:06:35.692776 (MainThread): Sending event: {'category': 'dbt', 'action': 'invocation', 'label': 'start', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x107d15940>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x107d1df10>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x107d1d910>]}
2021-08-03 16:06:35.851744 (MainThread): profile hash mismatch, cache invalidated
2021-08-03 16:06:35.858492 (MainThread): Parsing macros/business_time__pb.sql
2021-08-03 16:06:35.864497 (MainThread): Parsing macros/get_fiscal_year_dates.sql
2021-08-03 16:06:35.869095 (MainThread): Parsing macros/get_custom_field_name__pb.sql
2021-08-03 16:06:35.889176 (MainThread): Parsing macros/periodic_amount.sql
2021-08-03 16:06:35.892840 (MainThread): Parsing macros/get_fiscal_periods.sql
2021-08-03 16:06:35.896603 (MainThread): Parsing macros/work_age__pb.sql
2021-08-03 16:06:35.902465 (MainThread): Parsing macros/business_hours_per_day__pb.sql
2021-08-03 16:06:35.905195 (MainThread): Parsing macros/try_cast_date.sql
2021-08-03 16:06:35.908347 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:35.909843 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:35.910350 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:35.910871 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:35.913435 (MainThread): Parsing macros/get_date_parts.sql
2021-08-03 16:06:35.916688 (MainThread): Parsing macros/compress_if_full_refresh.sql
2021-08-03 16:06:35.918522 (MainThread): Parsing macros/get_description_line_item_effective_date.sql
2021-08-03 16:06:35.924617 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:35.925722 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:35.928387 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:35.928713 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:35.929299 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:35.929535 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:35.932469 (MainThread): Parsing macros/get_table_name_from_options.sql
2021-08-03 16:06:35.934838 (MainThread): Parsing macros/get_custom_field_select__pb.sql
2021-08-03 16:06:35.937328 (MainThread): Parsing macros/business_open_close__pb.sql
2021-08-03 16:06:35.938716 (MainThread): Parsing macros/get_datestamp.sql
2021-08-03 16:06:35.939923 (MainThread): Parsing macros/strip_deleted_on_from_company_name.sql
2021-08-03 16:06:35.940880 (MainThread): Parsing macros/get_holidays__pb.sql
2021-08-03 16:06:35.942821 (MainThread): Parsing macros/geo_distance.sql
2021-08-03 16:06:35.945618 (MainThread): Parsing macros/get_full_name.sql
2021-08-03 16:06:35.946619 (MainThread): Parsing macros/get_pricing_stratgey_name.sql
2021-08-03 16:06:35.947467 (MainThread): Parsing macros/get_assignment_lifecyle_stage_times_sql.sql
2021-08-03 16:06:35.949606 (MainThread): Parsing macros/catalog.sql
2021-08-03 16:06:35.962517 (MainThread): Parsing macros/relations.sql
2021-08-03 16:06:35.963659 (MainThread): Parsing macros/adapters.sql
2021-08-03 16:06:35.986786 (MainThread): Parsing macros/materializations/snapshot_merge.sql
2021-08-03 16:06:35.988298 (MainThread): Parsing macros/catalog.sql
2021-08-03 16:06:35.990930 (MainThread): Parsing macros/relations.sql
2021-08-03 16:06:35.992574 (MainThread): Parsing macros/adapters.sql
2021-08-03 16:06:36.013348 (MainThread): Parsing macros/materializations/snapshot_merge.sql
2021-08-03 16:06:36.019007 (MainThread): Parsing macros/core.sql
2021-08-03 16:06:36.023778 (MainThread): Parsing macros/materializations/helpers.sql
2021-08-03 16:06:36.033839 (MainThread): Parsing macros/materializations/snapshot/snapshot_merge.sql
2021-08-03 16:06:36.036026 (MainThread): Parsing macros/materializations/snapshot/strategies.sql
2021-08-03 16:06:36.052617 (MainThread): Parsing macros/materializations/snapshot/snapshot.sql
2021-08-03 16:06:36.087185 (MainThread): Parsing macros/materializations/seed/seed.sql
2021-08-03 16:06:36.108958 (MainThread): Parsing macros/materializations/incremental/helpers.sql
2021-08-03 16:06:36.111102 (MainThread): Parsing macros/materializations/incremental/incremental.sql
2021-08-03 16:06:36.143231 (MainThread): Parsing macros/materializations/common/merge.sql
2021-08-03 16:06:36.159458 (MainThread): Parsing macros/materializations/table/table.sql
2021-08-03 16:06:36.167452 (MainThread): Parsing macros/materializations/view/view.sql
2021-08-03 16:06:36.174588 (MainThread): Parsing macros/materializations/view/create_or_replace_view.sql
2021-08-03 16:06:36.181366 (MainThread): Parsing macros/etc/get_custom_alias.sql
2021-08-03 16:06:36.183087 (MainThread): Parsing macros/etc/query.sql
2021-08-03 16:06:36.184873 (MainThread): Parsing macros/etc/is_incremental.sql
2021-08-03 16:06:36.186903 (MainThread): Parsing macros/etc/datetime.sql
2021-08-03 16:06:36.197351 (MainThread): Parsing macros/etc/get_custom_schema.sql
2021-08-03 16:06:36.199863 (MainThread): Parsing macros/etc/get_custom_database.sql
2021-08-03 16:06:36.202025 (MainThread): Parsing macros/adapters/common.sql
2021-08-03 16:06:36.251588 (MainThread): Parsing macros/schema_tests/relationships.sql
2021-08-03 16:06:36.254195 (MainThread): Parsing macros/schema_tests/not_null.sql
2021-08-03 16:06:36.256444 (MainThread): Parsing macros/schema_tests/unique.sql
2021-08-03 16:06:36.259138 (MainThread): Parsing macros/schema_tests/accepted_values.sql
2021-08-03 16:06:36.266467 (MainThread): Parsing macros/cross_db_utils/except.sql
2021-08-03 16:06:36.268474 (MainThread): Parsing macros/cross_db_utils/replace.sql
2021-08-03 16:06:36.270278 (MainThread): Parsing macros/cross_db_utils/concat.sql
2021-08-03 16:06:36.273076 (MainThread): Parsing macros/cross_db_utils/identifer.sql
2021-08-03 16:06:36.276381 (MainThread): Parsing macros/cross_db_utils/datatypes.sql
2021-08-03 16:06:36.284952 (MainThread): Parsing macros/cross_db_utils/_is_relation.sql
2021-08-03 16:06:36.287489 (MainThread): Parsing macros/cross_db_utils/length.sql
2021-08-03 16:06:36.290274 (MainThread): Parsing macros/cross_db_utils/dateadd.sql
2021-08-03 16:06:36.293805 (MainThread): Parsing macros/cross_db_utils/intersect.sql
2021-08-03 16:06:36.295436 (MainThread): Parsing macros/cross_db_utils/right.sql
2021-08-03 16:06:36.298633 (MainThread): Parsing macros/cross_db_utils/datediff.sql
2021-08-03 16:06:36.301864 (MainThread): Parsing macros/cross_db_utils/safe_cast.sql
2021-08-03 16:06:36.304376 (MainThread): Parsing macros/cross_db_utils/hash.sql
2021-08-03 16:06:36.306316 (MainThread): Parsing macros/cross_db_utils/position.sql
2021-08-03 16:06:36.308451 (MainThread): Parsing macros/cross_db_utils/literal.sql
2021-08-03 16:06:36.309810 (MainThread): Parsing macros/cross_db_utils/current_timestamp.sql
2021-08-03 16:06:36.313803 (MainThread): Parsing macros/cross_db_utils/width_bucket.sql
2021-08-03 16:06:36.320144 (MainThread): Parsing macros/cross_db_utils/last_day.sql
2021-08-03 16:06:36.323559 (MainThread): Parsing macros/cross_db_utils/split_part.sql
2021-08-03 16:06:36.325917 (MainThread): Parsing macros/cross_db_utils/date_trunc.sql
2021-08-03 16:06:36.328169 (MainThread): Parsing macros/materializations/insert_by_period_materialization.sql
2021-08-03 16:06:36.355620 (MainThread): Parsing macros/logger/pretty_log_format.sql
2021-08-03 16:06:36.356980 (MainThread): Parsing macros/logger/pretty_time.sql
2021-08-03 16:06:36.358396 (MainThread): Parsing macros/logger/log_info.sql
2021-08-03 16:06:36.359968 (MainThread): Parsing macros/datetime/date_spine.sql
2021-08-03 16:06:36.364875 (MainThread): Parsing macros/web/get_url_host.sql
2021-08-03 16:06:36.366800 (MainThread): Parsing macros/web/get_url_path.sql
2021-08-03 16:06:36.369672 (MainThread): Parsing macros/web/get_url_parameter.sql
2021-08-03 16:06:36.371259 (MainThread): Parsing macros/geo/haversine_distance.sql
2021-08-03 16:06:36.372574 (MainThread): Parsing macros/schema_tests/equal_rowcount.sql
2021-08-03 16:06:36.374434 (MainThread): Parsing macros/schema_tests/relationships_where.sql
2021-08-03 16:06:36.377029 (MainThread): Parsing macros/schema_tests/recency.sql
2021-08-03 16:06:36.378638 (MainThread): Parsing macros/schema_tests/not_constant.sql
2021-08-03 16:06:36.379972 (MainThread): Parsing macros/schema_tests/at_least_one.sql
2021-08-03 16:06:36.381396 (MainThread): Parsing macros/schema_tests/unique_combination_of_columns.sql
2021-08-03 16:06:36.383061 (MainThread): Parsing macros/schema_tests/cardinality_equality.sql
2021-08-03 16:06:36.385031 (MainThread): Parsing macros/schema_tests/expression_is_true.sql
2021-08-03 16:06:36.386622 (MainThread): Parsing macros/schema_tests/equality.sql
2021-08-03 16:06:36.390251 (MainThread): Parsing macros/schema_tests/mutually_exclusive_ranges.sql
2021-08-03 16:06:36.397645 (MainThread): Parsing macros/sql/nullcheck_table.sql
2021-08-03 16:06:36.399137 (MainThread): Parsing macros/sql/generate_series.sql
2021-08-03 16:06:36.403254 (MainThread): Parsing macros/sql/get_relations_by_prefix.sql
2021-08-03 16:06:36.407734 (MainThread): Parsing macros/sql/get_tables_by_prefix_sql.sql
2021-08-03 16:06:36.410829 (MainThread): Parsing macros/sql/star.sql
2021-08-03 16:06:36.414005 (MainThread): Parsing macros/sql/unpivot.sql
2021-08-03 16:06:36.420531 (MainThread): Parsing macros/sql/union.sql
2021-08-03 16:06:36.432087 (MainThread): Parsing macros/sql/groupby.sql
2021-08-03 16:06:36.433759 (MainThread): Parsing macros/sql/surrogate_key.sql
2021-08-03 16:06:36.436302 (MainThread): Parsing macros/sql/nullcheck.sql
2021-08-03 16:06:36.438736 (MainThread): Parsing macros/sql/get_column_values.sql
2021-08-03 16:06:36.443972 (MainThread): Parsing macros/sql/pivot.sql
2021-08-03 16:06:36.447725 (MainThread): Parsing macros/sql/get_query_results_as_dict.sql
2021-08-03 16:06:36.451488 (MainThread): Parsing macros/ddl.sql
2021-08-03 16:06:36.460682 (MainThread): Parsing macros/compression.sql
2021-08-03 16:06:36.479121 (MainThread): Parsing macros/utilities.sql
2021-08-03 16:06:36.480733 (MainThread): Parsing macros/try_cast.sql
2021-08-03 16:06:36.482308 (MainThread): Parsing macros/unload.sql
2021-08-03 16:06:36.488977 (MainThread): Parsing macros/redshift_maintenance_operation.sql
2021-08-03 16:06:36.493495 (MainThread): Parsing macros/introspection.sql
2021-08-03 16:06:36.512359 (MainThread): Parsing macros/queries.sql
2021-08-03 16:06:36.520854 (MainThread): * Deprecation Warning: dbt v0.17.0 introduces a new config format for the
dbt_project.yml file. Support for the existing version 1 format will be removed
in a future release of dbt. The following packages are currently configured with
config version 1:
 - dbt_analytics
 - dbt_utils
 - redshift

For upgrading instructions, consult the documentation:
  https://docs.getdbt.com/docs/guides/migration-guide/upgrading-to-0-17-0

2021-08-03 16:06:36.521009 (MainThread): Sending event: {'category': 'dbt', 'action': 'deprecation', 'label': 'be4ceda5-9e7a-4414-83c6-834981ac4227', 'property_': 'warn', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x107d1d100>]}
2021-08-03 16:06:36.602240 (MainThread): profile hash mismatch, cache invalidated
2021-08-03 16:06:36.682165 (MainThread): Acquiring new redshift connection "model.dbt_analytics.universal_holidays_list__pb".
2021-08-03 16:06:36.702383 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:36.713468 (MainThread): Acquiring new redshift connection "model.dbt_analytics.universal_address__pb".
2021-08-03 16:06:36.724059 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:36.733285 (MainThread): Acquiring new redshift connection "model.dbt_analytics.universal_company_users__pb".
2021-08-03 16:06:36.743875 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:36.756038 (MainThread): Acquiring new redshift connection "model.dbt_analytics.universal_holidays__pb".
2021-08-03 16:06:36.762990 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:36.771648 (MainThread): Acquiring new redshift connection "model.dbt_analytics.universal_company__pb".
2021-08-03 16:06:36.780055 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:36.787440 (MainThread): Acquiring new redshift connection "model.dbt_analytics.universal_user_acl_roles__pb".
2021-08-03 16:06:36.796351 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:36.804414 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_note__pb".
2021-08-03 16:06:36.821309 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:36.828691 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_agingsla__pb".
2021-08-03 16:06:36.871575 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:36.873046 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:36.873486 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:36.873932 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:36.891371 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:36.898530 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_custom_field_values__pb".
2021-08-03 16:06:36.909888 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:36.918025 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_question_answer_pair_details__pb".
2021-08-03 16:06:36.924605 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:36.931978 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_resource_time_tracking_firstoccurrence__pb".
2021-08-03 16:06:36.938117 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:36.944223 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_negotiation_spending__pb".
2021-08-03 16:06:36.952463 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:36.960601 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_aging__pb".
2021-08-03 16:06:36.982794 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:36.989133 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_routing_strategy_details__pb".
2021-08-03 16:06:36.998926 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.007666 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_changelog_status__pb".
2021-08-03 16:06:37.013743 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.019736 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_custom_field_instance_history__pb".
2021-08-03 16:06:37.037314 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.044675 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_custom_field_instance__pb".
2021-08-03 16:06:37.053385 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.060513 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_agingsla_escalations_date_mesh__pb".
2021-08-03 16:06:37.069965 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.077867 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_resource_time_tracking_lastoccurrence__pb".
2021-08-03 16:06:37.085618 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.095507 (MainThread): Acquiring new redshift connection "model.dbt_analytics.first_trip_resolution__pb".
2021-08-03 16:06:37.105952 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.114760 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_parts_usage__pb".
2021-08-03 16:06:37.128780 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.135895 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_sub_status_type_association_details__undeleted__pb".
2021-08-03 16:06:37.145172 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.153156 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_negotiation_scheduling__pb".
2021-08-03 16:06:37.165710 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.173262 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_sub_status_type_association_details__pb".
2021-08-03 16:06:37.183147 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.193693 (MainThread): Acquiring new redshift connection "model.dbt_analytics.callback__pb".
2021-08-03 16:06:37.210108 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.219193 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_milestones_current__pb".
2021-08-03 16:06:37.227568 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.237178 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_note__undeleted__pb".
2021-08-03 16:06:37.246177 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.255657 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_escalation_details__pb".
2021-08-03 16:06:37.270372 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.280300 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_rescheduled_first__pb".
2021-08-03 16:06:37.290420 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.299321 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_resource_assigned_lastoccurrence__pb".
2021-08-03 16:06:37.308273 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.315808 (MainThread): Acquiring new redshift connection "model.dbt_analytics.worker_lob_zone_postalcode__pb".
2021-08-03 16:06:37.329158 (MainThread): * Deprecation Warning: The "adapter_macro" macro has been deprecated. Instead,
use the `adapter.dispatch` method to find a macro and call the result.
adapter_macro was called for: dbt_utils.type_string
2021-08-03 16:06:37.329533 (MainThread): Sending event: {'category': 'dbt', 'action': 'deprecation', 'label': 'be4ceda5-9e7a-4414-83c6-834981ac4227', 'property_': 'warn', 'context': [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x108a87310>]}
2021-08-03 16:06:37.339427 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.346922 (MainThread): Acquiring new redshift connection "model.dbt_analytics.user_custom_field_value__pb".
2021-08-03 16:06:37.361743 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.368584 (MainThread): Acquiring new redshift connection "model.dbt_analytics.worker_company__pb".
2021-08-03 16:06:37.379029 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.387275 (MainThread): Acquiring new redshift connection "model.dbt_analytics.worker_to_site__pb".
2021-08-03 16:06:37.402470 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.411092 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_customfield__field_type__pb".
2021-08-03 16:06:37.417949 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.435527 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__routing_strategy_tracking__pb".
2021-08-03 16:06:37.447329 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.455986 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__location_mapping__pb".
2021-08-03 16:06:37.464662 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.472128 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__invoice__pb".
2021-08-03 16:06:37.480125 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.490376 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_shipment__part_with_tracking_group__pb".
2021-08-03 16:06:37.500556 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.510467 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__location__pb".
2021-08-03 16:06:37.518579 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.526684 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_shipment__shipment_undeleted__pb".
2021-08-03 16:06:37.536333 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.546453 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_acl__acl_group__pb".
2021-08-03 16:06:37.555992 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.564475 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__phone__pb".
2021-08-03 16:06:37.572990 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.585669 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_sub_status_audit__pb".
2021-08-03 16:06:37.595886 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.605308 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__user_group__pb".
2021-08-03 16:06:37.615223 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.624655 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work__pb".
2021-08-03 16:06:37.635986 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.645840 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_customfield__field_option__pb".
2021-08-03 16:06:37.655566 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.666594 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__address__pb".
2021-08-03 16:06:37.684346 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.694400 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_resource__pb".
2021-08-03 16:06:37.704230 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.713077 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_escalation__pb".
2021-08-03 16:06:37.722945 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.733496 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__client_contact__pb".
2021-08-03 16:06:37.743854 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.754033 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__client_contact_phone_association__pb".
2021-08-03 16:06:37.765250 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.773252 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_sub_status_type_association__pb".
2021-08-03 16:06:37.782820 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.791734 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_shipment__shipment_group__pb".
2021-08-03 16:06:37.800433 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.807854 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_undeleted__pb".
2021-08-03 16:06:37.816355 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.825474 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__profile__pb".
2021-08-03 16:06:37.836029 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.845616 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_status_transition_history_summary__pb".
2021-08-03 16:06:37.855494 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.864598 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_negotiation__pb".
2021-08-03 16:06:37.874800 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.885570 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__users__pb".
2021-08-03 16:06:37.900399 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.910699 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_milestones__pb".
2021-08-03 16:06:37.919961 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.929106 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_question_answer_pair__pb".
2021-08-03 16:06:37.941912 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.950268 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_customfield__field_option_selection__pb".
2021-08-03 16:06:37.958380 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.966879 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_sub_status_type__pb".
2021-08-03 16:06:37.975146 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:37.987564 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_acl__acl_group_to_acl_priv__pb".
2021-08-03 16:06:38.029409 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.038975 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__postal_code__pb".
2021-08-03 16:06:38.048855 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.058603 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_shipment__shipment__pb".
2021-08-03 16:06:38.068271 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.080220 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_changelog__pb".
2021-08-03 16:06:38.090365 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.099683 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_acl__acl_priv__pb".
2021-08-03 16:06:38.109191 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.117600 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__group_routing_strategy_association__pb".
2021-08-03 16:06:38.127137 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.136123 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_resource_time_tracking__pb".
2021-08-03 16:06:38.145783 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.152969 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__routing_strategy__pb".
2021-08-03 16:06:38.160762 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.168866 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_customfield__custom_field_definition__pb".
2021-08-03 16:06:38.178256 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.185933 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__note__pb".
2021-08-03 16:06:38.195583 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.203768 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_acl__user_membership__pb".
2021-08-03 16:06:38.211131 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.219620 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_customfield__custom_field_instance__pb".
2021-08-03 16:06:38.228053 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.235431 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_shipment__part_with_tracking__pb".
2021-08-03 16:06:38.243448 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.251008 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_shipment__shipment_group_undeleted__pb".
2021-08-03 16:06:38.260122 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.269447 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__company__pb".
2021-08-03 16:06:38.278255 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.287378 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_employee_spend__pii".
2021-08-03 16:06:38.297467 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.306276 (MainThread): Acquiring new redshift connection "model.dbt_analytics.worker_location".
2021-08-03 16:06:38.321632 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.330482 (MainThread): Acquiring new redshift connection "model.dbt_analytics.top_talent_and_employee_spend".
2021-08-03 16:06:38.343748 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.352213 (MainThread): Acquiring new redshift connection "model.dbt_analytics.order_item_invoice".
2021-08-03 16:06:38.374982 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.382431 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_contractor_spend__pii".
2021-08-03 16:06:38.390357 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.397578 (MainThread): Acquiring new redshift connection "model.dbt_analytics.assignment_final_cost_details".
2021-08-03 16:06:38.414873 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.423684 (MainThread): Acquiring new redshift connection "model.dbt_analytics.dc_worker__pii".
2021-08-03 16:06:38.432576 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.439699 (MainThread): Acquiring new redshift connection "model.dbt_analytics.dc_location__pii".
2021-08-03 16:06:38.447155 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.453869 (MainThread): Acquiring new redshift connection "model.dbt_analytics.dc_assignment__pii".
2021-08-03 16:06:38.465299 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.472795 (MainThread): Acquiring new redshift connection "model.dbt_analytics.talent_pool_members__pii".
2021-08-03 16:06:38.481594 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.489612 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__address__pii".
2021-08-03 16:06:38.496825 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.504253 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__users__pii".
2021-08-03 16:06:38.512556 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:38.519934 (MainThread): Acquiring new redshift connection "model.dbt_analytics.sdlc_metrics".
2021-08-03 16:06:38.531366 (MainThread): Acquiring new redshift connection "model.dbt_analytics.test_metrics__integration_test_cases".
2021-08-03 16:06:38.545742 (MainThread): Acquiring new redshift connection "model.dbt_analytics.test_metrics__mabl".
2021-08-03 16:06:38.558529 (MainThread): Acquiring new redshift connection "model.dbt_analytics.test_metrics__ios_smoke".
2021-08-03 16:06:38.569831 (MainThread): Acquiring new redshift connection "model.dbt_analytics.test_metrics__api".
2021-08-03 16:06:38.581046 (MainThread): Acquiring new redshift connection "model.dbt_analytics.performance_metrics__bulk_upload".
2021-08-03 16:06:38.592159 (MainThread): Acquiring new redshift connection "model.dbt_analytics.performance_metrics__monolith".
2021-08-03 16:06:38.608312 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__role_to_user_undeleted".
2021-08-03 16:06:38.620889 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__feature_type_undeleted".
2021-08-03 16:06:38.633373 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__role_localization_undeleted".
2021-08-03 16:06:38.646329 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__feature_type_localization_undeleted".
2021-08-03 16:06:38.660624 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__permission_localization_undeleted".
2021-08-03 16:06:38.673321 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__permission_undeleted".
2021-08-03 16:06:38.686471 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__role_undeleted".
2021-08-03 16:06:38.703406 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_throughput".
2021-08-03 16:06:38.729017 (MainThread): Acquiring new redshift connection "model.dbt_analytics.assignment_spend_year_over_year_by_project".
2021-08-03 16:06:38.755392 (MainThread): Acquiring new redshift connection "model.dbt_analytics.assignment_status_by_client".
2021-08-03 16:06:38.776586 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_minimal".
2021-08-03 16:06:38.798958 (MainThread): Acquiring new redshift connection "model.dbt_analytics.labor_cloud_status".
2021-08-03 16:06:38.821999 (MainThread): Acquiring new redshift connection "model.dbt_analytics.assignment_staffing_forecast".
2021-08-03 16:06:38.843640 (MainThread): Acquiring new redshift connection "model.dbt_analytics.assignment_total_and_average_spend_by_client".
2021-08-03 16:06:38.864390 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_project_minimal".
2021-08-03 16:06:38.882060 (MainThread): Acquiring new redshift connection "model.dbt_analytics.denorm_work_one".
2021-08-03 16:06:38.909437 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_employee_spend".
2021-08-03 16:06:38.925553 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_contractor_spend".
2021-08-03 16:06:38.944274 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_client_minimal".
2021-08-03 16:06:38.965690 (MainThread): Acquiring new redshift connection "model.dbt_analytics.assignment_operational_metrics_by_project".
2021-08-03 16:06:38.984783 (MainThread): Acquiring new redshift connection "model.dbt_analytics.assignment_spend_year_over_year_by_client".
2021-08-03 16:06:39.004084 (MainThread): Acquiring new redshift connection "model.dbt_analytics.assignment_spend_year_over_year".
2021-08-03 16:06:39.020413 (MainThread): Acquiring new redshift connection "model.dbt_analytics.assignment_status_by_project".
2021-08-03 16:06:39.036553 (MainThread): Acquiring new redshift connection "model.dbt_analytics.assignment_operational_metrics_by_clients".
2021-08-03 16:06:39.056458 (MainThread): Acquiring new redshift connection "model.dbt_analytics.talent_pool_metrics".
2021-08-03 16:06:39.071013 (MainThread): Acquiring new redshift connection "model.dbt_analytics.order_custom_field_value".
2021-08-03 16:06:39.094965 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_durations".
2021-08-03 16:06:39.114258 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_routing_strategy".
2021-08-03 16:06:39.134154 (MainThread): Acquiring new redshift connection "model.dbt_analytics.project_work_association__no_dupes".
2021-08-03 16:06:39.148912 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_time_details".
2021-08-03 16:06:39.166507 (MainThread): Acquiring new redshift connection "model.dbt_analytics.candidate_flow".
2021-08-03 16:06:39.186548 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_company_with_accepted_dates".
2021-08-03 16:06:39.204602 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_history_summary_latest".
2021-08-03 16:06:39.220626 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_custom_field_instance".
2021-08-03 16:06:39.238315 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_milestones_resource_details".
2021-08-03 16:06:39.257117 (MainThread): Acquiring new redshift connection "model.dbt_analytics.paid_work_details".
2021-08-03 16:06:39.274670 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_application".
2021-08-03 16:06:39.292826 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_project".
2021-08-03 16:06:39.314865 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_escalation__with_company".
2021-08-03 16:06:39.335111 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_milestones_negotiation_details".
2021-08-03 16:06:39.353576 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work".
2021-08-03 16:06:39.367213 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_time_metrics".
2021-08-03 16:06:39.387757 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_client_spend".
2021-08-03 16:06:39.403944 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_custom_field".
2021-08-03 16:06:39.419212 (MainThread): Acquiring new redshift connection "model.dbt_analytics.rating__undeleted".
2021-08-03 16:06:39.434156 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_company_with_paid_dates".
2021-08-03 16:06:39.450378 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_resource_time_tracking_firstoccurrence".
2021-08-03 16:06:39.463254 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_closed_with_worker_labels".
2021-08-03 16:06:39.483807 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_question_answer_pair".
2021-08-03 16:06:39.496766 (MainThread): Acquiring new redshift connection "model.dbt_analytics.work_resource_time_tracking_lastoccurrence".
2021-08-03 16:06:39.509401 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_decisionflow__decision_flow_template_undeleted".
2021-08-03 16:06:39.527968 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_decisionflow__decision_flow_undeleted".
2021-08-03 16:06:39.542935 (MainThread): Acquiring new redshift connection "model.dbt_analytics.user_login_history".
2021-08-03 16:06:39.560024 (MainThread): Acquiring new redshift connection "model.dbt_analytics.user_custom_field_value".
2021-08-03 16:06:39.584602 (MainThread): Acquiring new redshift connection "model.dbt_analytics.worker_labels".
2021-08-03 16:06:39.612726 (MainThread): Acquiring new redshift connection "model.dbt_analytics.qualification__undeleted".
2021-08-03 16:06:39.628082 (MainThread): Acquiring new redshift connection "model.dbt_analytics.user_to_qualification__undeleted".
2021-08-03 16:06:39.641177 (MainThread): Acquiring new redshift connection "model.dbt_analytics.assessment_user_choice".
2021-08-03 16:06:39.660182 (MainThread): Acquiring new redshift connection "model.dbt_analytics.assigned_worker".
2021-08-03 16:06:39.674962 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_flowengine__node_undeleted".
2021-08-03 16:06:39.688944 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_flowengine__flow_undeleted".
2021-08-03 16:06:39.701597 (MainThread): Acquiring new redshift connection "model.dbt_analytics.revenue__adhoc".
2021-08-03 16:06:39.719188 (MainThread): Acquiring new redshift connection "model.dbt_analytics.revenue__transactional".
2021-08-03 16:06:39.737662 (MainThread): Acquiring new redshift connection "model.dbt_analytics.creditmemo_time_period_amount_distribution".
2021-08-03 16:06:39.763096 (MainThread): Acquiring new redshift connection "model.dbt_analytics.service_transaction_revenue_effective_dates".
2021-08-03 16:06:39.776024 (MainThread): Acquiring new redshift connection "model.dbt_analytics.revenue__amount_distribution__hour".
2021-08-03 16:06:39.797225 (MainThread): Acquiring new redshift connection "model.dbt_analytics.revenue__type_by_client__month".
2021-08-03 16:06:39.813417 (MainThread): Acquiring new redshift connection "model.dbt_analytics.creditmemo_issued_invoice_line_items".
2021-08-03 16:06:39.831072 (MainThread): Acquiring new redshift connection "model.dbt_analytics.revenue__nonadhoc_amount_distribution".
2021-08-03 16:06:39.847305 (MainThread): Acquiring new redshift connection "model.dbt_analytics.revenue__nonadhoc".
2021-08-03 16:06:39.864939 (MainThread): Acquiring new redshift connection "model.dbt_analytics.revenue__adhoc_amount_distribution".
2021-08-03 16:06:39.881770 (MainThread): Acquiring new redshift connection "model.dbt_analytics.dc_pricing_configuration".
2021-08-03 16:06:39.895014 (MainThread): Acquiring new redshift connection "model.dbt_analytics.dc_worker".
2021-08-03 16:06:39.910128 (MainThread): Acquiring new redshift connection "model.dbt_analytics.dc_payment".
2021-08-03 16:06:39.925799 (MainThread): Acquiring new redshift connection "model.dbt_analytics.dc_assignment".
2021-08-03 16:06:39.941449 (MainThread): Acquiring new redshift connection "model.dbt_analytics.dc_company".
2021-08-03 16:06:39.988047 (MainThread): Acquiring new redshift connection "model.dbt_analytics.dc_location".
2021-08-03 16:06:40.003716 (MainThread): Acquiring new redshift connection "model.dbt_analytics.talent_pool_members".
2021-08-03 16:06:40.017869 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work".
2021-08-03 16:06:40.034809 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_decisionflow__decision_status".
2021-08-03 16:06:40.047369 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_decisionflow__decision_flow".
2021-08-03 16:06:40.059672 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__client_company".
2021-08-03 16:06:40.070026 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_qualification__qualification".
2021-08-03 16:06:40.085540 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__project_work_association".
2021-08-03 16:06:40.096656 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_resource_label".
2021-08-03 16:06:40.109216 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_history_summary".
2021-08-03 16:06:40.123389 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__user_rating_history_summary".
2021-08-03 16:06:40.137278 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_decisionflow__decision_flow_template".
2021-08-03 16:06:40.150326 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_authentication__login_history".
2021-08-03 16:06:40.163356 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__address".
2021-08-03 16:06:40.178862 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_customfield__field_option_selection".
2021-08-03 16:06:40.192750 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__country".
2021-08-03 16:06:40.203535 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__rating".
2021-08-03 16:06:40.217365 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__role_to_permission".
2021-08-03 16:06:40.229779 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_plutus__order_state_type".
2021-08-03 16:06:40.243351 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_plutus__order".
2021-08-03 16:06:40.257390 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_plutus__order_item".
2021-08-03 16:06:40.271513 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__user_to_qualification".
2021-08-03 16:06:40.285716 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__assessment_user_association".
2021-08-03 16:06:40.303020 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_custom_field".
2021-08-03 16:06:40.317935 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_milestones".
2021-08-03 16:06:40.331312 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__plutus_invoice_to_invoice".
2021-08-03 16:06:40.345978 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__login_info".
2021-08-03 16:06:40.361754 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__register_transaction".
2021-08-03 16:06:40.376066 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__role_localization".
2021-08-03 16:06:40.389051 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__assessment".
2021-08-03 16:06:40.403794 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__assessment_item".
2021-08-03 16:06:40.417732 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_escalation".
2021-08-03 16:06:40.432262 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_customfield__field_option".
2021-08-03 16:06:40.445592 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__user_group".
2021-08-03 16:06:40.458823 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_negotiation".
2021-08-03 16:06:40.470120 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__state".
2021-08-03 16:06:40.482580 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__routing_strategy".
2021-08-03 16:06:40.493558 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__users".
2021-08-03 16:06:40.509620 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__permission".
2021-08-03 16:06:40.521841 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_custom_field_group".
2021-08-03 16:06:40.533639 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__assessment_item_choice".
2021-08-03 16:06:40.548275 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_resource_time_tracking".
2021-08-03 16:06:40.561295 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__role".
2021-08-03 16:06:40.574242 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_flowengine__flow".
2021-08-03 16:06:40.588306 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__time_dimension".
2021-08-03 16:06:40.603238 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__time_zone".
2021-08-03 16:06:40.615397 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__service_transaction".
2021-08-03 16:06:40.627366 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_decisionflow__decider_type".
2021-08-03 16:06:40.640931 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_customfield__custom_field_definition".
2021-08-03 16:06:40.654486 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__feature_type".
2021-08-03 16:06:40.666438 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__assessment_attempt".
2021-08-03 16:06:40.677521 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_qualification__qualification_type".
2021-08-03 16:06:40.691370 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__service_transaction_revenue".
2021-08-03 16:06:40.704523 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__feature_type_localization".
2021-08-03 16:06:40.716118 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__user_user_group_association".
2021-08-03 16:06:40.727285 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_decisionflow__decision_step".
2021-08-03 16:06:40.740146 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_plutus__invoice".
2021-08-03 16:06:40.752141 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__permission_localization".
2021-08-03 16:06:40.765089 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_status_transition_history_summary".
2021-08-03 16:06:40.777068 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_permissions__role_to_user".
2021-08-03 16:06:40.789558 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__credit_memo_audit".
2021-08-03 16:06:40.801712 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_plutus__source_type".
2021-08-03 16:06:40.814589 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_resource".
2021-08-03 16:06:40.827844 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_decisionflow__decision".
2021-08-03 16:06:40.839847 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__group_routing_strategy_association".
2021-08-03 16:06:40.850232 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__assessment_attempt_response".
2021-08-03 16:06:40.864249 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_custom_field_saved".
2021-08-03 16:06:40.875775 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__invoice_line_item".
2021-08-03 16:06:40.886301 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_decisionflow__decision_flow_status".
2021-08-03 16:06:40.898064 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__profile".
2021-08-03 16:06:40.907293 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__project".
2021-08-03 16:06:40.919840 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__routing_strategy_tracking".
2021-08-03 16:06:40.929822 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_plutus__invoice_state_type".
2021-08-03 16:06:40.940749 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_question_answer_pair".
2021-08-03 16:06:40.953458 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_plutus__payable_type".
2021-08-03 16:06:40.967106 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__invoice".
2021-08-03 16:06:40.978312 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_customfield__field_type".
2021-08-03 16:06:40.990202 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_flowengine__node".
2021-08-03 16:06:41.003385 (MainThread): Acquiring new redshift connection "model.dbt_analytics.ms_customfield__custom_field_instance".
2021-08-03 16:06:41.015835 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__company".
2021-08-03 16:06:41.024969 (MainThread): Acquiring new redshift connection "model.dbt_analytics.marketcore__work_custom_field_group_association".
2021-08-03 16:06:41.034827 (MainThread): Acquiring new redshift connection "model.dbt_analytics.users".
2021-08-03 16:06:41.047676 (MainThread): Acquiring new redshift connection "model.dbt_analytics.users_with_profile".
2021-08-03 16:06:41.061441 (MainThread): Acquiring new redshift connection "model.dbt_analytics.address".
2021-08-03 16:06:41.073374 (MainThread): Acquiring new redshift connection "model.dbt_analytics.fiscal_periods".
2021-08-03 16:06:41.100926 (MainThread): Acquiring new redshift connection "model.dbt_analytics.company_average_days_to_approval".
2021-08-03 16:06:41.115043 (MainThread): Acquiring new redshift connection "model.dbt_analytics.company_assignment_lifecycle_overview".
2021-08-03 16:06:41.132279 (MainThread): Acquiring new redshift connection "model.dbt_analytics.company_average_rating".
2021-08-03 16:06:41.149809 (MainThread): Acquiring new redshift connection "model.dbt_analytics.company_average_days_to_pay".
2021-08-03 16:06:41.163667 (MainThread): Acquiring new redshift connection "model.dbt_analytics.buyer_company_ratings".
2021-08-03 16:06:41.181058 (MainThread): Acquiring new redshift connection "model.dbt_analytics.invoice_line_item_adhoc_subscription_effective_split".
2021-08-03 16:06:41.192445 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:41.193202 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:41.195970 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:41.196337 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:41.197057 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:41.197309 (MainThread): invalid escape sequence '\d'
2021-08-03 16:06:41.224192 (MainThread): Acquiring new redshift connection "analysis.dbt_analytics.work_with_location_and_start_time".
2021-08-03 16:06:41.239233 (MainThread): Acquiring new redshift connection "analysis.dbt_analytics.work_count_by_company_and_date".
2021-08-03 16:06:41.250463 (MainThread): Acquiring new redshift connection "analysis.dbt_analytics.worker_scorecard".
2021-08-03 16:06:41.262099 (MainThread): Acquiring new redshift connection "analysis.dbt_analytics.staffing_rate_by_company_date_and_routing_strategy".
2021-08-03 16:06:41.271507 (MainThread): Acquiring new redshift connection "analysis.dbt_analytics.throughput_by_company_and_date".
2021-08-03 16:06:41.280577 (MainThread): Acquiring new redshift connection "analysis.dbt_analytics.company_client_risk_metrics".
2021-08-03 16:06:41.295339 (MainThread): Acquiring new redshift connection "analysis.dbt_analytics.company_risk_metrics".
2021-08-03 16:06:41.313398 (MainThread): Acquiring new redshift connection "analysis.dbt_analytics.company_assignment_lifecycle_trend".
2021-08-03 16:06:41.323037 (MainThread): Acquiring new redshift connection "analysis.dbt_analytics.work_project_throughput".
2021-08-03 16:06:41.333867 (MainThread): Acquiring new redshift connection "analysis.dbt_analytics.company_scorecard".
2021-08-03 16:06:41.353263 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_work_history_summary_latest_sent_once".
2021-08-03 16:06:41.362256 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_minimum_years_data__work_history_summary".
2021-08-03 16:06:41.371013 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_creditmemo_issued_invoice_line_items_amount_greater_zero".
2021-08-03 16:06:41.380675 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_minimum_years_data__work".
2021-08-03 16:06:41.389149 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_minimum_years_data__work_resource".
2021-08-03 16:06:41.399175 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_minimum_years_data__work_milestones".
2021-08-03 16:06:41.407866 (MainThread): Acquiring new redshift connection "test.dbt_analytics.unique_marketcore__users_associate_object_id__and_not_blank".
2021-08-03 16:06:41.417671 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_minimum_years_data__group_routing_strategy_association".
2021-08-03 16:06:41.428971 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_minimum_years_data__work_resource_time_tracking".
2021-08-03 16:06:41.438375 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_minimum_years_data__routing_strategy".
2021-08-03 16:06:41.447028 (MainThread): Acquiring new redshift connection "test.dbt_analytics.unique_marketcore__company_org_object_id__and_not_blank".
2021-08-03 16:06:41.455147 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_minimum_years_data__work_status_transition_history_summary".
2021-08-03 16:06:41.463658 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_minimum_years_data__routing_strategy_tracking".
2021-08-03 16:06:41.475014 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_revenue__adhoc_amount_distribution_valid".
2021-08-03 16:06:41.484166 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_worker_company_missing_worker_company__pb".
2021-08-03 16:06:41.494034 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:41.501150 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_stale_custom_field_value_worker_custom_field_instance__pb".
2021-08-03 16:06:41.508943 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:41.517442 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_wrong_worker_company__work_agingsla__pb".
2021-08-03 16:06:41.527825 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:41.534782 (MainThread): Acquiring new redshift connection "test.dbt_analytics.assert_wrong_worker_company_null__work_agingsla__pb".
2021-08-03 16:06:41.546076 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1.
2021-08-03 16:06:41.556709 (MainThread): Acquiring new redshift connection "operation.dbt_analytics.dbt_analytics-on-run-end-0".
2021-08-03 16:06:57.872900 (MainThread): Acquiring new redshift connection "model.redshift.redshift_columns".
2021-08-03 16:06:57.881424 (MainThread): Acquiring new redshift connection "model.redshift.redshift_tables".
2021-08-03 16:06:57.889271 (MainThread): Acquiring new redshift connection "model.redshift.redshift_constraints".
2021-08-03 16:06:57.897938 (MainThread): Acquiring new redshift connection "model.redshift.redshift_sort_dist_keys".
2021-08-03 16:06:57.905571 (MainThread): Acquiring new redshift connection "model.redshift.redshift_admin_queries".
2021-08-03 16:06:57.916754 (MainThread): Acquiring new redshift connection "model.redshift.redshift_admin_users_schema_privileges".
2021-08-03 16:06:57.928091 (MainThread): Acquiring new redshift connection "model.redshift.redshift_admin_dependencies".
2021-08-03 16:06:57.945133 (MainThread): Acquiring new redshift connection "model.redshift.redshift_admin_users_table_view_privileges".
2021-08-03 16:06:57.957302 (MainThread): Acquiring new redshift connection "model.redshift.redshift_admin_table_stats".
2021-08-03 16:06:57.975535 (MainThread): Acquiring new redshift connection "model.redshift.pg_namespace".
2021-08-03 16:06:57.982455 (MainThread): Acquiring new redshift connection "model.redshift.stl_query".
2021-08-03 16:06:58.059277 (MainThread): Acquiring new redshift connection "model.redshift.svv_diskusage".
2021-08-03 16:06:58.066455 (MainThread): Acquiring new redshift connection "model.redshift.pg_user".
2021-08-03 16:06:58.073073 (MainThread): Acquiring new redshift connection "model.redshift.pg_tables".
2021-08-03 16:06:58.079463 (MainThread): Acquiring new redshift connection "model.redshift.redshift_cost".
2021-08-03 16:06:58.087366 (MainThread): Acquiring new redshift connection "model.redshift.stv_tbl_perm".
2021-08-03 16:06:58.094488 (MainThread): Acquiring new redshift connection "model.redshift.stv_blocklist".
2021-08-03 16:06:58.100749 (MainThread): Acquiring new redshift connection "model.redshift.pg_class".
2021-08-03 16:06:58.107047 (MainThread): Acquiring new redshift connection "model.redshift.pg_depend".
2021-08-03 16:06:58.113019 (MainThread): Acquiring new redshift connection "model.redshift.stl_explain".
2021-08-03 16:06:58.118720 (MainThread): Acquiring new redshift connection "model.redshift.pg_attribute".
2021-08-03 16:06:58.124855 (MainThread): Acquiring new redshift connection "model.redshift.pg_views".
2021-08-03 16:06:58.130896 (MainThread): Acquiring new redshift connection "model.redshift.stl_wlm_query".
2021-08-03 16:07:05.058912 (MainThread): Found 264 models, 1430 tests, 0 snapshots, 10 analyses, 332 macros, 1 operation, 0 seed files, 167 sources
2021-08-03 16:07:05.191909 (MainThread): 
2021-08-03 16:07:05.192346 (MainThread): Acquiring new redshift connection "master".
2021-08-03 16:07:05.194861 (ThreadPoolExecutor-0_0): Acquiring new redshift connection "list_dade".
2021-08-03 16:07:05.202996 (ThreadPoolExecutor-0_0): Using redshift connection "list_dade".
2021-08-03 16:07:05.203148 (ThreadPoolExecutor-0_0): On list_dade: /* {"app": "dbt", "dbt_version": "0.18.0", "profile_name": "dade", "target_name": "iam", "connection_name": "list_dade"} */

    select distinct nspname from pg_namespace
  
2021-08-03 16:07:05.203260 (ThreadPoolExecutor-0_0): Opening a new connection, currently in state init
2021-08-03 16:07:05.203343 (ThreadPoolExecutor-0_0): Connecting to Redshift using 'IAM' credentials
2021-08-03 16:07:05.203420 (ThreadPoolExecutor-0_0): Connecting to Redshift using 'IAM'with profile wmops
2021-08-03 16:07:11.068376 (ThreadPoolExecutor-0_0): unclosed <ssl.SSLSocket fd=12, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('192.168.1.98', 53410), raddr=('54.239.21.217', 443)>
2021-08-03 16:07:11.745975 (ThreadPoolExecutor-0_0): SQL status: SELECT in 6.54 seconds
2021-08-03 16:07:11.753228 (ThreadPoolExecutor-0_0): unclosed <ssl.SSLSocket fd=12, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('192.168.1.98', 53411), raddr=('54.239.31.87', 443)>
2021-08-03 16:07:11.754197 (ThreadPoolExecutor-0_0): On list_dade: Close
2021-08-03 16:07:13.671289 (ThreadPoolExecutor-1_0): Acquiring new redshift connection "list_dade_dbt_analytics__alex_iam_pii".
2021-08-03 16:07:13.678812 (ThreadPoolExecutor-1_0): Using redshift connection "list_dade_dbt_analytics__alex_iam_pii".
2021-08-03 16:07:13.678923 (ThreadPoolExecutor-1_0): On list_dade_dbt_analytics__alex_iam_pii: BEGIN
2021-08-03 16:07:13.679018 (ThreadPoolExecutor-1_0): Opening a new connection, currently in state closed
2021-08-03 16:07:13.679102 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'IAM' credentials
2021-08-03 16:07:13.679184 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'IAM'with profile wmops
2021-08-03 16:07:24.161795 (ThreadPoolExecutor-1_0): Error running SQL: BEGIN
2021-08-03 16:07:24.161984 (ThreadPoolExecutor-1_0): Rolling back transaction.
2021-08-03 16:07:24.162127 (ThreadPoolExecutor-1_0): Opening a new connection, currently in state closed
2021-08-03 16:07:24.162232 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'IAM' credentials
2021-08-03 16:07:24.162325 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'IAM'with profile wmops
2021-08-03 16:07:28.038175 (ThreadPoolExecutor-1_0): Error running SQL: macro list_relations_without_caching
2021-08-03 16:07:28.038336 (ThreadPoolExecutor-1_0): Rolling back transaction.
2021-08-03 16:07:28.038463 (ThreadPoolExecutor-1_0): Opening a new connection, currently in state closed
2021-08-03 16:07:28.038555 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'IAM' credentials
2021-08-03 16:07:28.038640 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'IAM'with profile wmops
2021-08-03 16:07:34.957104 (ThreadPoolExecutor-1_0): unclosed <ssl.SSLSocket fd=14, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('192.168.1.98', 53416), raddr=('54.239.21.217', 443)>
2021-08-03 16:07:35.528364 (ThreadPoolExecutor-1_0): On list_dade_dbt_analytics__alex_iam_pii: Close
2021-08-03 16:07:35.529254 (ThreadPoolExecutor-1_0): Acquiring new redshift connection "list_dade_dbt_analytics__alex_iam_pb".
2021-08-03 16:07:35.532012 (ThreadPoolExecutor-1_0): unclosed <ssl.SSLSocket fd=14, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('192.168.1.98', 53417), raddr=('54.239.31.87', 443)>
2021-08-03 16:07:35.534319 (ThreadPoolExecutor-1_0): Using redshift connection "list_dade_dbt_analytics__alex_iam_pb".
2021-08-03 16:07:35.534478 (ThreadPoolExecutor-1_0): On list_dade_dbt_analytics__alex_iam_pb: BEGIN
2021-08-03 16:07:35.534605 (ThreadPoolExecutor-1_0): Opening a new connection, currently in state closed
2021-08-03 16:07:35.534679 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'IAM' credentials
2021-08-03 16:07:35.534747 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'IAM'with profile wmops
2021-08-03 16:07:49.998274 (ThreadPoolExecutor-1_0): Error running SQL: BEGIN
2021-08-03 16:07:49.998403 (ThreadPoolExecutor-1_0): Rolling back transaction.
2021-08-03 16:07:49.998547 (ThreadPoolExecutor-1_0): Opening a new connection, currently in state closed
2021-08-03 16:07:49.998667 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'IAM' credentials
2021-08-03 16:07:49.998816 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'IAM'with profile wmops
2021-08-03 16:08:06.263592 (ThreadPoolExecutor-1_0): unclosed <ssl.SSLSocket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('192.168.1.98', 53429), raddr=('54.239.21.217', 443)>
2021-08-03 16:08:06.978559 (ThreadPoolExecutor-1_0): Error running SQL: macro list_relations_without_caching
2021-08-03 16:08:06.978709 (ThreadPoolExecutor-1_0): Rolling back transaction.
2021-08-03 16:08:06.982698 (ThreadPoolExecutor-1_0): On list_dade_dbt_analytics__alex_iam_pb: Close
2021-08-03 16:08:06.983418 (ThreadPoolExecutor-1_0): Acquiring new redshift connection "list_dade_dbt_analytics__alex_iam".
2021-08-03 16:08:06.985626 (ThreadPoolExecutor-1_0): unclosed <ssl.SSLSocket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('192.168.1.98', 53430), raddr=('54.239.31.87', 443)>
2021-08-03 16:08:06.987386 (ThreadPoolExecutor-1_0): Using redshift connection "list_dade_dbt_analytics__alex_iam".
2021-08-03 16:08:06.987476 (ThreadPoolExecutor-1_0): On list_dade_dbt_analytics__alex_iam: BEGIN
2021-08-03 16:08:06.987733 (ThreadPoolExecutor-1_0): Opening a new connection, currently in state closed
2021-08-03 16:08:06.987931 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'IAM' credentials
2021-08-03 16:08:06.988006 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'IAM'with profile wmops
2021-08-03 16:08:12.749574 (ThreadPoolExecutor-1_0): Error running SQL: BEGIN
2021-08-03 16:08:12.749728 (ThreadPoolExecutor-1_0): Rolling back transaction.
2021-08-03 16:08:12.749857 (ThreadPoolExecutor-1_0): Opening a new connection, currently in state closed
2021-08-03 16:08:12.749952 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'IAM' credentials
2021-08-03 16:08:12.750037 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'IAM'with profile wmops

System information

Which database are you using dbt with?

  • postgres
  • redshift
  • bigquery
  • snowflake
  • other (specify: ____________)

The output of dbt --version:

0.18.0

The operating system you're using:

Mac Catalina 10.15.7 (19H524)

The output of python --version:

Python 3.8.10

Additional context

Potentially relevant issues:

@jtcohen6
Copy link
Contributor

@ags2121 Thanks for opening! This seems frustrating; let's find a way to make it better. I'm also not an AWS/IAM expert, so any input from community members better-versed than me would be greatly appreciated.

I believe the relevant bit of code in dbt-redshift is here:
https://github.com/dbt-labs/dbt/blob/d2dbe6afe4ecff25e4fa8ba471716bc8bd0ef760/plugins/redshift/dbt/adapters/redshift/connections.py#L104-L110

It looks like there are a few older tools + discussions for caching boto3 sessions, specifically with the goal of avoiding repeated MFA:

The suggested approach leverages a standard AWS cache file. So a really hacky version of that might look like (replacing the code above):

else:
    from botocore import credentials
    import botocore.session
    import boto3
    import os

    # By default the cache path is ~/.aws/boto/cache
    cli_cache = os.path.join(os.path.expanduser('~'),'.aws/cli/cache')

    # Construct botocore session with cache
    botocore_session = botocore.session.Session(profile=iam_profile)
    botocore_session.get_component('credential_provider').get_provider('assume-role').cache = credentials.JSONFileCache(cli_cache)

    # Create boto3 session + client
    boto_session = boto3.Session(
        botocore_session=botocore_session,
        profile_name=iam_profile 
    ) 
    boto_client = boto_session.client('redshift') 

So perhaps you could try:

  • cloning this repo
  • editing plugins/redshift/dbt/adapters/redshift/connections.py in the manner above
  • pip install -r editable-requirements.txt in a virtual environment
  • Running your project in that virtual environment

And see if that gets us anywhere?

@jtcohen6 jtcohen6 transferred this issue from dbt-labs/dbt-core Oct 12, 2021
@jtcohen6 jtcohen6 added the bug Something isn't working label Oct 12, 2021
@github-actions
Copy link
Contributor

This issue has been marked as Stale because it has been open for 180 days with no activity. If you would like the issue to remain open, please remove the stale label or comment on the issue, or it will be closed in 7 days.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Stale
Projects
None yet
Development

No branches or pull requests

2 participants