Skip to content

Conversation

@the-other-tim-brown
Copy link
Contributor

@the-other-tim-brown the-other-tim-brown commented Dec 10, 2025

Describe the issue this Pull Request addresses

Resolves #17571
Updates the Log Reader path and the partitioner paths to take in a HoodieSchema instead of an Avro schema as part of our type system migration

Summary and Changelog

  • Log readers will now take in the HoodieSchema instead of the Avro schema. If the reader requires an Avro schema to read the log block, a toAvroSchema is used on the provided schema
  • Partitioners that require a schema are updated to use HoodieSchema instead of the Avro schema
  • There are many places in the changeset that wrap an Avro schema from the generated java classes

Impact

Moves more code to use our internal schema representation

Risk Level

Low

Documentation Update

Contributor's checklist

  • Read through contributor's guide
  • Enough context is provided in the sections above
  • Adequate tests were added if applicable

@github-actions github-actions bot added the size:L PR with lines of changes in (300, 1000] label Dec 10, 2025
@the-other-tim-brown the-other-tim-brown marked this pull request as ready for review December 11, 2025 14:17
@the-other-tim-brown the-other-tim-brown force-pushed the log-and-partitioner-schema-updates branch from 7cfc9dc to 53a1d9b Compare December 12, 2025 15:09
@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

Copy link
Contributor

@yihua yihua left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@yihua yihua merged commit 192c324 into apache:master Dec 13, 2025
70 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:L PR with lines of changes in (300, 1000]

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Phase 25: Update log readers and partitioners

3 participants