-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Optimize PrimitiveBuilder::append_trusted_len_iter
#7590
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
15e7ba9 to
94b18ac
Compare
94b18ac to
91d1abb
Compare
PrimitiveBuilder::append_trusted_len_iter
# Which issue does this PR close? - part of #7591 # Rationale for this change I would like a benchmark that shows improvements in #7590 `take` with FixedSizeBinary is the only one I know of now # What changes are included in this PR? Add `fsb` to the take_kernel benchmarks # Are there any user-facing changes? No, this is a benchmark
|
🤖 |
|
🤖: Benchmark completed Details
|
|
I need to spend some time making sure it is actually faster |
|
I think we are going to go with a different approach (use a Vec instead) |
Which issue does this PR close?
PrimitiveBuilder::append_trusted_len_iter#7591Rationale for this change
@Dandandan noted on https://github.com/apache/arrow-rs/pull/7513/files#r2119136807:
What changes are included in this PR?
Use the trusted len iter optimization for extendig PrimitiveBuffers
Are there any user-facing changes?
The only place I can see this used now is
takewith fixed size arrays. Thus this may make that somewhat faster (I will run some benchmarks)I think the real value will be in the APIs sketched out in #7513 to append to StringViewBuilder faster