Add dynamic recording

[emmyoop]

Housekeeping

• I am a maintainer of dbt-common

Short description

We capture too much data with every run. Add the ability to dynamically capture different data.

Acceptance criteria

• we can capture data by record type

Suggested Tests

test the different possible record types

Impact to Other Teams

adapters if any changes are required for them

Will backports be required?

no

Context

Instead of capturing everything for every run, we should be able to specify what data we want to capture.

Exactly what options we want to offer will be part of this ticket. It should start with the minimal requirements (the data we will need to compare the SQL from one run with another run via the diff functionality

Add DBT_RECORD=True to your dbt command (ie. DBT_RECORD=True dbt run). This generates a recording.json in the current working dir.

Options

This can be specified in the RecorderMode.

Use an env var in addition to DBT_RECORD/DBT_REPLAY to specify what we want to record