Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Prune add file entry using columns stats in Delta checkpoint iterator #25311

Draft
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

chenjian2664
Copy link
Contributor

Description

Additional context and related issues

Release notes

(x) This is not user-visible or is docs only, and no release notes are required.
( ) Release notes are required. Please propose a release note for me.
( ) Release notes are required, with the following suggested text:

## Section
* Fix some things. ({issue}`issuenumber`)

@cla-bot cla-bot bot added the cla-signed label Mar 14, 2025
@chenjian2664 chenjian2664 marked this pull request as draft March 14, 2025 06:34
@github-actions github-actions bot added the delta-lake Delta Lake connector label Mar 14, 2025
@chenjian2664 chenjian2664 force-pushed the prune_checkpoint branch 3 times, most recently from ec3ab17 to eda4dc9 Compare March 14, 2025 07:16
@chenjian2664 chenjian2664 force-pushed the prune_checkpoint branch 3 times, most recently from 7b5cc12 to cf01677 Compare March 28, 2025 04:06
@chenjian2664 chenjian2664 marked this pull request as ready for review March 28, 2025 07:19
@chenjian2664
Copy link
Contributor Author

[Upload test results: testing/trino-product-tests/src/main/java/io/trino/tests/product/deltalake/TestDeltaLakeCreateOrReplaceTableAsSelectCompatibility.java#L66](https://github.com/trinodb/trino/pull/25311/files#annotation_33278177652)
java.sql.SQLException: Query failed (#20250328_064948_00693_c5gfv): Failed to generate splits for default.test_replace_table_with_schema_change_ritx8f6mot

Is it flaky ?

@chenjian2664
Copy link
Contributor Author

chenjian2664 commented Mar 28, 2025

io.trino.spi.TrinoException: Unable to parse value [1961-01-01 01:02:03] from column ts with type timestamp(3) with time zone

@chenjian2664 chenjian2664 marked this pull request as draft March 28, 2025 23:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed delta-lake Delta Lake connector
Development

Successfully merging this pull request may close these issues.

1 participant