Skip to content

Conversation

adriangb
Copy link
Contributor

@adriangb adriangb commented Oct 8, 2025

Ever since #16014 we've been passing duplicate information in. FileMeta is created entirely from PartitionedFile. This simplifies APIs and removes an unnecessary struct.

@github-actions github-actions bot added core Core DataFusion crate datasource Changes to the datasource crate labels Oct 8, 2025
@adriangb adriangb requested a review from alamb October 8, 2025 05:25
Copy link
Member

@xudong963 xudong963 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good cleaning, thank you.

I saw there are some API changes, so added the api-change label.

@xudong963 xudong963 added the api change Changes the API exposed to users of the crate label Oct 8, 2025
@adriangb
Copy link
Contributor Author

adriangb commented Oct 8, 2025

Do you think it's worth adding this to the upgrade guide? I think it's quite straightforward and will impact few people. So maybe not worth the noise?

&self,
_partition_index: usize,
file_meta: FileMeta,
file: PartitionedFile,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 nit: we probably can name it as partition_file to be the same format as other function params

file_meta: FileMeta,
_file: PartitionedFile,
) -> Result<FileOpenFuture> {
fn open(&self, file: PartitionedFile) -> Result<FileOpenFuture> {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ditto

&self,
partition_index: usize,
file_meta: FileMeta,
file: PartitionedFile,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ditto

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api change Changes the API exposed to users of the crate core Core DataFusion crate datasource Changes to the datasource crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants