Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: use logical plan in delete, delta planner refactoring #2725

Merged
merged 3 commits into from
Aug 6, 2024

Conversation

ion-elgreco
Copy link
Collaborator

@ion-elgreco ion-elgreco commented Aug 4, 2024

Description

Changes delete to use logical plans from the get-go. I had to introduce with_files on DeltaTableProvider in case you want to constraint the scope of files to be read.

Additionally abstracts a DeltaPlanner struct, which was left as TODO, I used this to create a delete MetricObservation node

This one needs to be merged first: #2722

@ion-elgreco ion-elgreco force-pushed the feat/logical_delete branch from 7a7a065 to eab62f5 Compare August 4, 2024 12:25
@github-actions github-actions bot added the binding/rust Issues for the Rust crate label Aug 4, 2024
@ion-elgreco ion-elgreco enabled auto-merge August 4, 2024 12:30
@ion-elgreco ion-elgreco added this to the python v0.19 milestone Aug 4, 2024
@ion-elgreco ion-elgreco disabled auto-merge August 4, 2024 12:32
hntd187
hntd187 previously approved these changes Aug 4, 2024
Copy link
Collaborator

@hntd187 hntd187 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 little nit but otherwise good

crates/core/src/delta_datafusion/planner.rs Outdated Show resolved Hide resolved
@ion-elgreco ion-elgreco enabled auto-merge August 6, 2024 21:17
@rtyler rtyler force-pushed the feat/logical_delete branch from c1889d2 to a6aeeca Compare August 6, 2024 23:18
@ion-elgreco ion-elgreco added this pull request to the merge queue Aug 6, 2024
Merged via the queue into delta-io:main with commit b8162c0 Aug 6, 2024
18 checks passed
@ion-elgreco ion-elgreco deleted the feat/logical_delete branch August 6, 2024 23:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
binding/rust Issues for the Rust crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants