Improve error message when SnowflakeSqlApiOperator fails with 422 Unprocessible entity

[rawwar]

Apache Airflow Provider(s)

snowflake

Versions of Apache Airflow Providers

Sometimes, when SnowflakeSqlApiOperator fails with 422 Unprocessible entity error, the error is too vague to understand what happened. This issue is to re look at all the information sent by the Snowflake API and improve the error message we output in task logs.

Apache Airflow version

main

Operating System

Mac OS 15

Deployment

Astronomer

Deployment details

No response

What happened

No response

What you think should happen instead

No response

How to reproduce

Have a snowflake Stored Proc that raises 422 error and review the task logs.

Anything else

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[prdai]

hi @rawwar if you haven't started working on a solution for this, would it be fine if i work on this issue? thanks

[rawwar]

hi @rawwar if you haven't started working on a solution for this, would it be fine if i work on this issue? thanks

Sure. Please give it a try.

[prdai]

Thank You :)

[prdai]

hi @rawwar i created a PR for this #54063, let me know if there are any other changes i should do, thanks! :)

[rawwar]

@Programmer-RD-AI , can you please share the complete API response from snowflake for an example failure? Issue is to look at the complete API response given by snowflake API and then decide what to include in the logs.

[prdai]

hi, so from what I checked the following is the structure

HTTP/1.1 422 Unprocessable Entity
Date: Tue, 04 May 2021 20:24:11 GMT
Content-Type: application/json
{
  "code" : "000904",
  "message" : "SQL compilation error: error line 1 at position 7\ninvalid identifier 'AFAF'",
  "sqlState" : "42000",
  "statementHandle" : "019c0728-0000-df4f-0000-00100006606e"
}

reference: https://docs.snowflake.com/en/developer-guide/sql-api/reference#snowflake-sql-api-reference

how can we proceed with this? let me know, thanks :)

[rawwar]

@Programmer-RD-AI , thanks. I think, your PR looks good. Can you fix the failing tests?

[prdai]

sure will do, thanks :)