Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(datasets/managers): fix error handling file loc when dataset alias resolved into new datasets #42733

Merged

Conversation

Lee-W
Copy link
Member

@Lee-W Lee-W commented Oct 4, 2024

Why

Detailed in #42704. values should be list of dict instead of dict

What

Pass a list of file locations as a dictionary for DAG priority parsing request when dataset aliases are resolved into new datasets.

Closes: #42704


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@Lee-W Lee-W changed the title fix(datasets/managers): fix error handling fileloc when datasetalias … fix(datasets/managers): fix error handling file loc when dataset alias resolved into new datasets Oct 4, 2024
@Lee-W Lee-W force-pushed the fix-dataset-alias-dag-prority-request branch 4 times, most recently from d7ee817 to 308d9f4 Compare October 7, 2024 09:24
@Lee-W Lee-W force-pushed the fix-dataset-alias-dag-prority-request branch from 308d9f4 to 475e0e7 Compare October 7, 2024 12:54
@shahar1 shahar1 added the area:datasets Issues related to the datasets feature label Oct 7, 2024
@shahar1 shahar1 added type:bug-fix Changelog: Bug Fixes airflow3.0:candidate Potential candidates for Airflow 3.0 labels Oct 7, 2024
@shahar1 shahar1 added this to the Airflow 3.0.0 milestone Oct 7, 2024
@uranusjr uranusjr modified the milestones: Airflow 3.0.0, Airflow 2.10.3 Oct 7, 2024
@uranusjr
Copy link
Member

uranusjr commented Oct 7, 2024

Changing the milestone since this one is the backport PR.

Co-authored-by: Tzu-ping Chung <uranusjr@gmail.com>
@Lee-W
Copy link
Member Author

Lee-W commented Oct 8, 2024

removing airflow-3-candidate. this one is only for v2-10-test. airflow-3 is another pr

@Lee-W Lee-W removed the airflow3.0:candidate Potential candidates for Airflow 3.0 label Oct 8, 2024
@uranusjr uranusjr merged commit 35264c1 into apache:v2-10-test Oct 8, 2024
49 checks passed
@uranusjr uranusjr deleted the fix-dataset-alias-dag-prority-request branch October 8, 2024 04:25
utkarsharma2 pushed a commit that referenced this pull request Oct 23, 2024
…as resolved into new datasets (#42733)

* fix(datasets/managers): fix error handling fileloc when datasetalias resolved into new datasets

* test(datasets/manager): add test case test_register_dataset_change_with_alias

* refactor(datasets/manager): simplify for loop

Co-authored-by: Tzu-ping Chung <uranusjr@gmail.com>

---------

Co-authored-by: Tzu-ping Chung <uranusjr@gmail.com>
utkarsharma2 pushed a commit that referenced this pull request Oct 24, 2024
…as resolved into new datasets (#42733)

* fix(datasets/managers): fix error handling fileloc when datasetalias resolved into new datasets

* test(datasets/manager): add test case test_register_dataset_change_with_alias

* refactor(datasets/manager): simplify for loop

Co-authored-by: Tzu-ping Chung <uranusjr@gmail.com>

---------

Co-authored-by: Tzu-ping Chung <uranusjr@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:datasets Issues related to the datasets feature type:bug-fix Changelog: Bug Fixes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants