Skip to content

Commit

Permalink
fix(ingestion/airflow-plugin): fixed the failing pipeline
Browse files Browse the repository at this point in the history
  • Loading branch information
dushayntAW committed May 2, 2024
1 parent 2507b28 commit 5a18105
Showing 1 changed file with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -414,10 +414,10 @@ def on_task_instance_running(
f"DataHub listener finished processing notification about task instance start for {task_instance.task_id}"
)

if not self.config.materialize_iolets:
if not self.config.materialize_iolets and self.graph:
for outlet in datajob.outlets:
if not self.graph.exists(str(outlet)):
logger.warning(f"dataset {str(outlet)} not materialized")
logger.warning(f"Dataset {str(outlet)} not materialized")

def on_task_instance_finish(
self, task_instance: "TaskInstance", status: InstanceRunResult
Expand Down

0 comments on commit 5a18105

Please sign in to comment.