You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks for the idea. We are close to implementing this in #12978. It adds support for pushing down like but notably does not add support for starts_with as that will be done in a followup PR.
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
From looking at the pruning logic, it appears that we can prune inputs based on
col = 'string_value'
, but we can't prune oncol LIKE 'value%'
.We should be able to support
LIKE
andNOT LIKE
.Describe the solution you'd like
Extend the pruning logic to generate a pruning filter for
LIKE
andNOT LIKE
.Describe alternatives you've considered
None
Additional context
Spark will push down a
LIKE
filter if it can be converted to astarts_with
, normally by checking if the string doesn't start with%
.The text was updated successfully, but these errors were encountered: