You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
We are trying to store UUIDs in arrow Arrays and one obvious thing to do is use FixedSizeByteArray
However @samuelcolvin did some experiments (see apache/datafusion#11170) and found that non obviously using Decimal128 was actually faster than FixedSizeByteArray
One reason for this may be that FixedSizeByteArray does not have special case handling in the filter kernel
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
We are trying to store UUIDs in arrow Arrays and one obvious thing to do is use
FixedSizeByteArray
However @samuelcolvin did some experiments (see apache/datafusion#11170) and found that non obviously using
Decimal128
was actually faster thanFixedSizeByteArray
One reason for this may be that
FixedSizeByteArray
does not have special case handling in thefilter
kernelarrow-rs/arrow-select/src/filter.rs
Lines 320 to 383 in f42d242
Describe the solution you'd like
FixedSizeByteArray
Describe alternatives you've considered
Additional context
This was pointed out by @samuelcolvin on apache/datafusion#11170 (comment)
The text was updated successfully, but these errors were encountered: