Signed-off-by: Benji Lampel <benjamin@astronomer.io>

The job_id is automatically generated by hook.insert_job()
if an empty string is passed, so job_id generation in the
operator is removed in favor of the existing code.

Signed-off-by: Benji Lampel <benjamin@astronomer.io>

SQL query building is moved to the init() method of the column
and table check operators to lessen the amount of duplicate code
in the child operator. It also has the added effect of, ideally,
passing a more complete query to OpenLineage.

In doing the above, the column check operator had to be reworked and
now matches the logic of the table check operator in terms of
returning multiple rows and only sending one query to the database.

Adds a new parameter, retry_on_failure, and a new function to
determine if operators should retry or not on test failure.

Co-authored-by: Tzu-ping Chung <uranusjr@gmail.com>

Updates tests to reflect changes in operator code, and fixed
bugs in operators as well. Mainly moving the code to check for
failed tests into the column and table check operators as it works
slightly differently for each and doesn't make much sense as a
top-level function.

Signed-off-by: Benji Lampel <benjamin@astronomer.io>

The job_id is automatically generated by hook.insert_job()
if an empty string is passed, so job_id generation in the
operator is removed in favor of the existing code.

Signed-off-by: Benji Lampel <benjamin@astronomer.io>

SQL query building is moved to the init() method of the column
and table check operators to lessen the amount of duplicate code
in the child operator. It also has the added effect of, ideally,
passing a more complete query to OpenLineage.

In doing the above, the column check operator had to be reworked and
now matches the logic of the table check operator in terms of
returning multiple rows and only sending one query to the database.

Adds a new parameter, retry_on_failure, and a new function to
determine if operators should retry or not on test failure.

Co-authored-by: Tzu-ping Chung <uranusjr@gmail.com>

Updates tests to reflect changes in operator code, and fixed
bugs in operators as well. Mainly moving the code to check for
failed tests into the column and table check operators as it works
slightly differently for each and doesn't make much sense as a
top-level function.

…imalpaca/airflow into common_sql_bugfixes_and_improvements

Adds "where" option in checks dictionaries for column and table
operators, which may be renamed. This allows for check-level
partitioning, whereas the partition_clause param will always be
for all checks. New tests are added for this addition.

…imalpaca/airflow into common_sql_bugfixes_and_improvements

Cleans up operator and adds testing for new generator function.

…imalpaca/airflow into common_sql_bugfixes_and_improvements

The new argument, defaulting to true, will convert Nones returned
from the query to 0s so numeric calculations can be performed
correctly. This allows empty tables to be handled as a row of zeroes.

Additional documentation is also supplied

Signed-off-by: Benji Lampel <benjamin@astronomer.io>

The job_id is automatically generated by hook.insert_job()
if an empty string is passed, so job_id generation in the
operator is removed in favor of the existing code.

Signed-off-by: Benji Lampel <benjamin@astronomer.io>

SQL query building is moved to the init() method of the column
and table check operators to lessen the amount of duplicate code
in the child operator. It also has the added effect of, ideally,
passing a more complete query to OpenLineage.

In doing the above, the column check operator had to be reworked and
now matches the logic of the table check operator in terms of
returning multiple rows and only sending one query to the database.

Adds a new parameter, retry_on_failure, and a new function to
determine if operators should retry or not on test failure.

Co-authored-by: Tzu-ping Chung <uranusjr@gmail.com>

Updates tests to reflect changes in operator code, and fixed
bugs in operators as well. Mainly moving the code to check for
failed tests into the column and table check operators as it works
slightly differently for each and doesn't make much sense as a
top-level function.

Adds "where" option in checks dictionaries for column and table
operators, which may be renamed. This allows for check-level
partitioning, whereas the partition_clause param will always be
for all checks. New tests are added for this addition.

Cleans up operator and adds testing for new generator function.

The new argument, defaulting to true, will convert Nones returned
from the query to 0s so numeric calculations can be performed
correctly. This allows empty tables to be handled as a row of zeroes.

Additional documentation is also supplied

…imalpaca/airflow into common_sql_bugfixes_and_improvements