Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove unused fields from DataFile. #914

Merged
merged 1 commit into from
Apr 11, 2020

Conversation

rdblue
Copy link
Contributor

@rdblue rdblue commented Apr 11, 2020

This removes file_ordinal and sort_columns.

The file ordinal has never been used and would need to be replaced because an ordinal is no use without context for which file ordinals were part of a single sort.

Sort columns has also never been used and will be replaced by a sort order ID with the sort order defined in table metadata. This is smaller and can handle more complex ordering specs that include null handling, ascending/descending, transforms, etc.

@rdblue rdblue requested review from aokolnychyi and omalley April 11, 2020 01:02
Copy link
Contributor

@aokolnychyi aokolnychyi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, as discussed

@rdblue rdblue merged commit 3334afc into apache:master Apr 11, 2020
Fokko pushed a commit to Fokko/iceberg that referenced this pull request Apr 21, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants