Snowflake CopyFromExternalStageToSnowflake OpenLineage support not working

[rahul-madaan]

Apache Airflow Provider(s)

snowflake

Versions of Apache Airflow Providers

apache_airflow_providers_snowflake-6.0.0

Apache Airflow version

2.9.3

Operating System

Mac OS Sequioa 15.3 (24D60)

Deployment

Official Apache Airflow Helm Chart

Deployment details

I am using breeze, standard deployment

 breeze start-airflow --integration openlineage -b postgres --use-airflow-version 2.9.3

What happened

We are not getting inputs in OpenLineage COMPLETE event.
This is due to a check on status key in the result row from snowflake.
and we have a check on existance of status key, which is passing empty list in the parsing function.

What you think should happen instead

Ideally we should be getting correct inputs in the openlineage COMPLETE event according to the implementation.

The function should check the status value before passing an empty list to the parsing function.

How to reproduce

Use CopyFromExternalStageToSnowflake Operator in Airflow with OpenLineage events enabled, you will not get any inputs in the OL COMPLETE event.

Anything else

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[eladkal]

cc @kacpermuda

[kacpermuda]

Hey Rahul, thanks for the issue. As we discussed on Slack here, there might be some adjustments needed if the result from Snowflake has changed + some test to cover that. Let me know when you have some time to dig into that and prepare a PR, will be happy to review.