Retry on server side failures when checking status of DBT cloud jobs

[rawwar]

Description

I've noticed that, when there are intermittent server-side issues, DbtCloudRunJobOperator under deferrable mode fails. I'm requesting a feature to handle these server-side issues and retry gracefully a few times before failing.

Use case/motivation

This feature intends to make DbtCloudRunJobOperator resilient to intermittent network issues

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[anandkaranubc]

Can I work on this issue please? Thank you!

[jaklan]

@anandkaranubc are you working on that? We are affected by this issue and need a quick solution, so let us know if you can handle that or we should take it over

[rawwar]

@jaklan , your contribution is welcome. Please raise a PR. I don't think @anandkaranubc is working on this now.