You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem or challenge?
Inspired by PR #7745, the repartition input code as it is now is both a bit messy (needs a #cfg) but also only works for Parqeuet and CSV, where the code is general for any ExecutionPlan.
I would like the code to a trait on ExecutionPlan, which also allows other (user defined) table sources to benefit from this optimization then implement it for Parquet and CSV
Describe alternatives you've considered
No response
Additional context
No response
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem or challenge?
Inspired by PR #7745, the repartition input code as it is now is both a bit messy (needs a
#cfg
) but also only works for Parqeuet and CSV, where the code is general for any ExecutionPlan.https://github.com/apache/arrow-datafusion/blob/0911f1523ec7088bae88684ecb9bca94aa553693/datafusion/core/src/physical_optimizer/enforce_distribution.rs#L1270-L1288
Describe the solution you'd like
I would like the code to a trait on ExecutionPlan, which also allows other (user defined) table sources to benefit from this optimization then implement it for Parquet and CSV
Describe alternatives you've considered
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: