Dag processor loses connection to db very often #56497
Description
Apache Airflow version
3.1.0
If "Other Airflow 2 version" selected, which one?
No response
What happened?
In over 6days, the dag processor has restarted 235 times due to
││ dag-processor _mysql.connection.query(self, query)
││ dag-processor sqlalchemy.exc.OperationalError: (MySQLdb.OperationalError) (2013, 'Lost connection to server during query')
What you think should happen instead?
Dag processor should handle loss of connection appropriately
How to reproduce
Deploy airflow 3.1.0 in k8s with mysql as db
Operating System
Debian bookworm
Versions of Apache Airflow Providers
No response
Deployment
Official Apache Airflow Helm Chart
Deployment details
dagProcessor:
enabled: true
replicas: 1
resources:
limits:
memory: 1500Mi
logGroomerSidecar:
retentionDays: 3
Anything else?
Same happens in 3.0.6 too
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct