-
Notifications
You must be signed in to change notification settings - Fork 752
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[feature] partition/file pruning by indexing #1552
Comments
I have a plan on expressions normalization in #1539 , in purpose of providing ability to do complicated partition pruning(e.g. rewrite By the way, it's a very big challeng to do partition prune in a data warehouse, since there may be a large amout of partitions in a single table(says millions), which can bring serious burden to optimizer. The mainstream data warehouse(e.g. Snowflake) has a mechanism like intermidiate partition to reduce the metadata should be read during query optimization. We can have a more robust design on this in the future. |
@leiysky This is the pruning after the optimizer,apply index patch will be launched next week. |
/assignme |
Summary
Impl the
apply_index
against the expression.The text was updated successfully, but these errors were encountered: