Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: apply missing filtering on parquet reader #360

Merged
merged 4 commits into from
Nov 3, 2022

Conversation

ShiKaiWi
Copy link
Member

@ShiKaiWi ShiKaiWi commented Nov 2, 2022

Which issue does this PR close?

Part of #363

Rationale for this change

After #351, the filter result about the row groups is not pushed down to parquet reading procedure.

What changes are included in this PR?

  • Apply the missing filtering results to the parquet reader.

Are there any user-facing changes?

None.

How does this change test

Current module will be updated in the recent future, and more UT should be added later.

@ShiKaiWi ShiKaiWi marked this pull request as ready for review November 2, 2022 07:45
Copy link
Contributor

@jiacai2050 jiacai2050 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ShiKaiWi ShiKaiWi merged commit d8872e2 into apache:main Nov 3, 2022
@ShiKaiWi ShiKaiWi deleted the fix-missing-filter branch January 18, 2023 06:56
chunshao90 pushed a commit to chunshao90/ceresdb that referenced this pull request May 15, 2023
* fix: apply missing filtering on parquet reader

* fix: refactor the sst reader based on parquet

* chore: fix filter test

* chore: rebase main
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants