Add recency tag and conditionally enable recency tests #97
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR Checklist
PR Structure
otherwise).
Thoroughness
Release planning
semver, and I've changed the name of the BRANCH to release/* , feature/* or patch/* .
What
We want to run recency tests asynchronously to building DBT models. This PR:
recency
tag to all recency testsci
(to find test coverage accurately) or when the env variableIS_RECENCY_AIRFLOW_TASK
is set to true. This env var is set to true only indbt_recency_test
dag. See Add separate dag for recency tests stellar-etl-airflow#500Why
The recency tests cause alert fatigue since they run with every model build. We do not need to run them so frequently.
Also, recency tests creates issue in backfilling old tasks if newest task is failing.
Known limitations
None