Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DF] Implement subquery decorrelation optimizer rules #626

Open
andygrove opened this issue Jul 13, 2022 · 1 comment
Open

[DF] Implement subquery decorrelation optimizer rules #626

andygrove opened this issue Jul 13, 2022 · 1 comment
Labels
enhancement New feature or request needs triage Awaiting triage by a dask-sql maintainer

Comments

@andygrove
Copy link
Contributor

Is your feature request related to a problem? Please describe.
PR apache/datafusion#2885 adds three new optimizer rules for decorrelating subqueries and translating them into joins. This may result in more efficient queries in Dask SQL.

Describe the solution you'd like
Temporarily copy these rules into Dark SQL and try them out. We can provide feedback before the PR gets merged into DataFusion.

Once the PR is merged we can remove our temporary copies of the code.

Describe alternatives you've considered
None

Additional context
None
@andygrove andygrove added enhancement New feature or request needs triage Awaiting triage by a dask-sql maintainer labels Jul 13, 2022
@charlesbluca
Copy link
Collaborator

Looks like these optimizer rules got introduced with #680, though they still don't work for certain queries, for example we see some warnings/errors in #683 (review)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request needs triage Awaiting triage by a dask-sql maintainer
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@andygrove @charlesbluca