Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Common sql bugfixes and improvements #26761

Merged
merged 78 commits into from
Oct 26, 2022
Merged

Common sql bugfixes and improvements #26761

Show file tree
Hide file tree
Changes from 43 commits
Commits
Show all changes
78 commits
Select commit Hold shift + click to select a range
711d6bc
Fix BigQueryTableCheckOperator test
denimalpaca Sep 27, 2022
3c97433
Remove job_id generation in table/col check operators
denimalpaca Sep 27, 2022
11a26fd
Rework SQL query building
denimalpaca Sep 28, 2022
de7fafb
Remove self.sql overwrite parameter in BigQuery check operators.
denimalpaca Sep 28, 2022
b315f0b
Add option to fail check operators without retries
denimalpaca Sep 28, 2022
a560b45
Rename and reorder private functions, fix typo
denimalpaca Sep 28, 2022
8c987fd
Update airflow/providers/common/sql/operators/sql.py
denimalpaca Sep 29, 2022
4364a39
Small updates to helper functions
denimalpaca Sep 29, 2022
30839fb
Use _raise_exception when query returns 0 rows
denimalpaca Sep 29, 2022
a787d3a
Update tests and operator code
denimalpaca Sep 29, 2022
9005a4b
Fix _failed_checks() to match update in parent operators
denimalpaca Sep 29, 2022
c00c934
Insert quotes around check_name table op's sql template to fix sql error
denimalpaca Sep 30, 2022
b2eb10a
Fix BigQueryTableCheckOperator test
denimalpaca Sep 27, 2022
e13c59c
Remove job_id generation in table/col check operators
denimalpaca Sep 27, 2022
708ad7a
Rework SQL query building
denimalpaca Sep 28, 2022
62c01bf
Remove self.sql overwrite parameter in BigQuery check operators.
denimalpaca Sep 28, 2022
f66bfe4
Add option to fail check operators without retries
denimalpaca Sep 28, 2022
ef7c2a1
Rename and reorder private functions, fix typo
denimalpaca Sep 28, 2022
586dc39
Update airflow/providers/common/sql/operators/sql.py
denimalpaca Sep 29, 2022
419b167
Small updates to helper functions
denimalpaca Sep 29, 2022
55f9bb8
Use _raise_exception when query returns 0 rows
denimalpaca Sep 29, 2022
e8ce879
Update tests and operator code
denimalpaca Sep 29, 2022
3e8dcd9
Fix _failed_checks() to match update in parent operators
denimalpaca Sep 29, 2022
0ce4b6f
Insert quotes around check_name table op's sql template to fix sql error
denimalpaca Sep 30, 2022
a7c5bd2
Merge branch 'common_sql_bugfixes_and_improvements' of github.com:den…
denimalpaca Oct 3, 2022
bf54c24
Remove unnecessary list comprehension
denimalpaca Oct 4, 2022
c3e64ea
Added assertions in existing column and table tests
denimalpaca Oct 6, 2022
b1262e6
Add new tests for TableCheckOperator
denimalpaca Oct 6, 2022
1a52335
Update operator logic and tests
denimalpaca Oct 7, 2022
62fc3e4
Merge branch 'apache:main' into common_sql_bugfixes_and_improvements
denimalpaca Oct 7, 2022
a60e3e0
Merge branch 'common_sql_bugfixes_and_improvements' of github.com:den…
denimalpaca Oct 7, 2022
46ca885
Add testing for column check operator and line edits
denimalpaca Oct 7, 2022
2014f5e
Merge branch 'main' into common_sql_bugfixes_and_improvements
denimalpaca Oct 10, 2022
9014f65
Change name 'where' to 'partition_clause' in check dictionaries
denimalpaca Oct 11, 2022
ee5f516
Update docs and use f strings
denimalpaca Oct 11, 2022
bdccba7
Edit operator docstring
denimalpaca Oct 11, 2022
888160a
Merge branch 'main' into common_sql_bugfixes_and_improvements
denimalpaca Oct 11, 2022
fe8ba70
Move _raise_exception to base class to simplify method
denimalpaca Oct 12, 2022
3e159c0
Updates from code review
denimalpaca Oct 12, 2022
c3214c2
Merge branch 'common_sql_bugfixes_and_improvements' of github.com:den…
denimalpaca Oct 12, 2022
67c43c8
Merge branch 'main' into common_sql_bugfixes_and_improvements
denimalpaca Oct 12, 2022
37c704f
Update BigQuery Check operators according to code review
denimalpaca Oct 12, 2022
6368a95
Rewrite data-building loop to generator
uranusjr Oct 13, 2022
4b2fc34
Merge branch 'main' into common_sql_bugfixes_and_improvements
denimalpaca Oct 14, 2022
9367ab9
Add new accept_none argument to column check operator
denimalpaca Oct 14, 2022
8745d53
Merge branch 'main' into common_sql_bugfixes_and_improvements
denimalpaca Oct 17, 2022
84e4e01
Merge branch 'main' into common_sql_bugfixes_and_improvements
denimalpaca Oct 18, 2022
e46c233
Merge branch 'main' into common_sql_bugfixes_and_improvements
denimalpaca Oct 18, 2022
4835d61
Merge branch 'main' into common_sql_bugfixes_and_improvements
denimalpaca Oct 19, 2022
1de2b51
Merge branch 'main' into common_sql_bugfixes_and_improvements
denimalpaca Oct 25, 2022
43a33c4
Fix BigQueryTableCheckOperator test
denimalpaca Sep 27, 2022
c761c05
Remove job_id generation in table/col check operators
denimalpaca Sep 27, 2022
d4758cb
Rework SQL query building
denimalpaca Sep 28, 2022
cc87c3a
Remove self.sql overwrite parameter in BigQuery check operators.
denimalpaca Sep 28, 2022
c5d7422
Add option to fail check operators without retries
denimalpaca Sep 28, 2022
8080fc6
Rename and reorder private functions, fix typo
denimalpaca Sep 28, 2022
625d2b8
Update airflow/providers/common/sql/operators/sql.py
denimalpaca Sep 29, 2022
4f3f400
Small updates to helper functions
denimalpaca Sep 29, 2022
9400414
Use _raise_exception when query returns 0 rows
denimalpaca Sep 29, 2022
0a794fb
Update tests and operator code
denimalpaca Sep 29, 2022
efa1f79
Fix _failed_checks() to match update in parent operators
denimalpaca Sep 29, 2022
213d0a2
Insert quotes around check_name table op's sql template to fix sql error
denimalpaca Sep 30, 2022
12c7cef
Remove unnecessary list comprehension
denimalpaca Oct 4, 2022
1ff14c2
Added assertions in existing column and table tests
denimalpaca Oct 6, 2022
e36aaf5
Add new tests for TableCheckOperator
denimalpaca Oct 6, 2022
ac4fca4
Update operator logic and tests
denimalpaca Oct 7, 2022
8beb8ab
Add testing for column check operator and line edits
denimalpaca Oct 7, 2022
385317f
Change name 'where' to 'partition_clause' in check dictionaries
denimalpaca Oct 11, 2022
979def5
Update docs and use f strings
denimalpaca Oct 11, 2022
586f6b4
Edit operator docstring
denimalpaca Oct 11, 2022
c060da0
Move _raise_exception to base class to simplify method
denimalpaca Oct 12, 2022
8498cbf
Updates from code review
denimalpaca Oct 12, 2022
a15e1a2
Update BigQuery Check operators according to code review
denimalpaca Oct 12, 2022
0f9bce3
Rewrite data-building loop to generator
uranusjr Oct 13, 2022
3140a02
Add new accept_none argument to column check operator
denimalpaca Oct 14, 2022
09c7b51
Fix formatting issues after rebase
denimalpaca Oct 26, 2022
473f5ba
Merge branch 'main' into common_sql_bugfixes_and_improvements
denimalpaca Oct 26, 2022
8299a55
Merge branch 'common_sql_bugfixes_and_improvements' of github.com:den…
denimalpaca Oct 26, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading