-
Notifications
You must be signed in to change notification settings - Fork 14.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
EmrServerlessStartJobOperator causes dag load failure when using XComArg #40103
Comments
@fjmacagno could you share an example DAG which you used here ? |
Works fine until i add the line labeled "important line". |
@fjmacagno EmrServerlessCreateApplicationOperator returns application id which you are using in your DAG here |
Saying that I updated my DAG to use a xcom value which should return a dict, however, still I am getting same parsing error
Verified configuration_overrides is a templated_field |
@fjmacagno @vatsrahul1001 Can you have a look at #40627 |
Apache Airflow Provider(s)
amazon
Versions of Apache Airflow Providers
apache-airflow-providers-amazon==8.23.0
Apache Airflow version
2.9.1
Operating System
Debian GNU/Linux 11 (bullseye)
Deployment
Astronomer
Deployment details
No response
What happened
We get the dag load error
What you think should happen instead
It shouldn't error, and we should see the operator links in the UI.
How to reproduce
Pass an XCom result into the
configuration_overrides
parameter of the EmrServerlessStartJobOperator.Anything else
Happens every time, issue just appears to be that the link function is called before templating is rendered.
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: