-
Notifications
You must be signed in to change notification settings - Fork 81
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Iceberg column rename handling #6118
Labels
Milestone
Comments
devinrsmith
added
bug
Something isn't working
triage
parquet
Related to the Parquet integration
iceberg
labels
Sep 24, 2024
https://github.com/apache/iceberg/blob/main/format/spec.md#schema-evolution should be consulted in general for issues about how schema evolution and tracking is supposed to happen. https://www.mail-archive.com/dev@iceberg.apache.org/msg02236.html also talks a bit about Iceberg field-id and Parquet field_id. |
Potentially related to #6124 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Deephaven does not currently handle Iceberg column renames.
Here is an example to produce a set of data that illustrates the issue
https://gist.github.com/devinrsmith/a6d537e5dce3ff0b25ba4b9c62d80ada which will first create the table, add some data, rename a column, and add some more data.
When read into Deephaven, only the latest data files have their data represented:
The text was updated successfully, but these errors were encountered: