-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Optimize make_date
#9089
Labels
enhancement
New feature or request
good first issue
Good for newcomers
performance
Make DataFusion faster
Comments
alamb
added
enhancement
New feature or request
good first issue
Good for newcomers
performance
Make DataFusion faster
labels
Jan 31, 2024
A quick experiment replacing |
Sounds pretty great to me -- thanks @r3stl355 |
vojtechtoman
pushed a commit
to vojtechtoman/arrow-datafusion
that referenced
this issue
Mar 13, 2024
* replace the expensive calculation of unix_days_from_ce with a constant * do not use PrimitiveArray builder for the scalar case
Thank you @vojtechtoman -- very exciting |
vojtechtoman
pushed a commit
to vojtechtoman/arrow-datafusion
that referenced
this issue
Mar 14, 2024
* replace the expensive calculation of unix_days_from_ce with a constant * do not use PrimitiveArray builder for the scalar case
vojtechtoman
pushed a commit
to vojtechtoman/arrow-datafusion
that referenced
this issue
Mar 14, 2024
* replace the expensive calculation of unix_days_from_ce with a constant * do not use PrimitiveArray builder for the scalar case
alamb
added a commit
that referenced
this issue
Mar 17, 2024
* Optimize make_date (#9089) * replace the expensive calculation of unix_days_from_ce with a constant * do not use PrimitiveArray builder for the scalar case * Improve function name --------- Co-authored-by: Vojtech Toman <vojtech.toman@graphaware.com> Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
6 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
enhancement
New feature or request
good first issue
Good for newcomers
performance
Make DataFusion faster
Is your feature request related to a problem or challenge?
I think there is significant performance to be had when creating dates and now thanks to @Omega359 there are benchmarks
To run the benchmarks, do:
Describe the solution you'd like
Make the function faster, as defined by the command above
The high level procedure for this is to profile the function and figure out how to make it go faster while still computing the same results
Describe alternatives you've considered
It may not be possible to make this faster and in that case no worries.
Additional context
I think this is actually a pretty good initial project for someone because
The text was updated successfully, but these errors were encountered: