Skip to content

Add support for parquet field#20370

Open
SubhamSinghal wants to merge 4 commits intoapache:mainfrom
SubhamSinghal:add-support-for-parquet-field-id
Open

Add support for parquet field#20370
SubhamSinghal wants to merge 4 commits intoapache:mainfrom
SubhamSinghal:add-support-for-parquet-field-id

Conversation

@SubhamSinghal
Copy link
Contributor

Which issue does this PR close?

Rationale for this change

Adding support for reading parquet field_id in DataFusion

What changes are included in this PR?

  1. Add config to enable/disable field_id support
  2. Adds support for reading field_id and store in arrow metadata
  3. Use field_id in projection rebasing

Are these changes tested?

yes, with UT

Are there any user-facing changes?

yes

@github-actions github-actions bot added physical-expr Changes to the physical-expr crates core Core DataFusion crate common Related to common crate proto Related to proto crate datasource Changes to the datasource crate labels Feb 15, 2026
@github-actions github-actions bot added documentation Improvements or additions to documentation sqllogictest SQL Logic Tests (.slt) labels Feb 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

common Related to common crate core Core DataFusion crate datasource Changes to the datasource crate documentation Improvements or additions to documentation physical-expr Changes to the physical-expr crates proto Related to proto crate sqllogictest SQL Logic Tests (.slt)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[native_datafusion] Add support for reading Parquet field ids

1 participant