-
Notifications
You must be signed in to change notification settings - Fork 16.3k
Closed
Labels
area:Schedulerincluding HA (high availability) schedulerincluding HA (high availability) schedulerarea:corearea:data-aware-schedulingassets, datasets, AIP-48assets, datasets, AIP-48
Milestone
Description
Body
The SDK should contain no database-related code, but currently the scheduler uses the evaluate function to check if an asset dependency is “ready”, which involves hitting the database in some cases. We should move it into Airflow core.
The best way to do this is probably similar to how DAGs are turned into SerializedDag. We should create a class in core Airflow to represent BaseAsset subclasses, and put logic there.
Committer
- I acknowledge that I am a maintainer/committer of the Apache Airflow project.
Metadata
Metadata
Assignees
Labels
area:Schedulerincluding HA (high availability) schedulerincluding HA (high availability) schedulerarea:corearea:data-aware-schedulingassets, datasets, AIP-48assets, datasets, AIP-48
Type
Projects
Status
Done