You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
During dbtRunner.invoke, user should be able to supply a configuration set that used for that invocation with the runner.
# this set of params will overwrite attributes that exists on Flags object during initialization of Flags.# Anything set here will be visible to the structured logs and exposed in jinja context.params= {"fail_fast": True, 'version_check': False}
# initializefromdbt.cli.mainimportdbtRunnerdbt=dbtRunner()
# this will fail fast, and not check versiondbt.invoke(['run'], params=params)
Requirement
params will overwrite all other formats of configs(env var, cli specified)(during initialization of Flags)
Add a structure logging event that include the names of params that got passed in via the params in dbt.invoke
Add tests for params that we know dbt-server would want to set/overwrite.
log_format
log_path
version_check
project_dir
profiles_dir
profile_name
target_dir
Make sure dbt-server is unblocked
The text was updated successfully, but these errors were encountered:
github-actionsbot
changed the title
[Feature] Support set programatic_configs in dbtRunner Initialization
[CT-2205] [Feature] Support set programatic_configs in dbtRunner Initialization
Feb 27, 2023
By doing it this way, anything set by params will still be visible (name + value) to the structured logs (MainReportArgs), exposed in jinja context (docs) and in the args dict of run_results.json.
Let's confirm that this is acceptable for the intended use case. If it isn't acceptable, we should proceed with this work as currently scoped, and open a new issue to address SensitiveFlags (whose values should be excluded/scrubbed from logging, artifacts, Jinja context).
ChenyuLInx
changed the title
[CT-2205] [Feature] Support set programatic_configs in dbtRunner Initialization
[CT-2205] [Feature] Support supply params in dbtRunner.invoke to overwrite flags
Feb 28, 2023
Feature description
During
dbtRunner.invoke
, user should be able to supply a configuration set that used for that invocation with the runner.Requirement
dbt-server
would want to set/overwrite.dbt-server
is unblockedThe text was updated successfully, but these errors were encountered: