You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
It would be great if the arrow compute kernel could regard a selection vector. Then users won't need to create slices over the existing arrays before applying computations with the compute kernel.
Describe the solution you'd like
A set of new compute APIs that takes a selection vector as the second argument.
For primitives at least, I would expect a filter followed by the existing sum kernel to be very competitive, as it has been my experience that LLVM struggles to vectorise operations involving bitmasks.
We should definitely benchmark any new kernels against this "naive" approach
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
It would be great if the arrow compute kernel could regard a selection vector. Then users won't need to create slices over the existing arrays before applying computations with the compute kernel.
Describe the solution you'd like
A set of new compute APIs that takes a selection vector as the second argument.
For example:
Describe alternatives you've considered
Additional context
apache/datafusion#6003 as a use case where the selection vector would be beneficial.
apache/datafusion#5944 for a similar proposal.
The text was updated successfully, but these errors were encountered: