Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use arrow eq kernels in CaseWhen expression evaluation #52

Merged
merged 1 commit into from
Apr 25, 2021

Conversation

Dandandan
Copy link
Contributor

@Dandandan Dandandan commented Apr 24, 2021

Which issue does this PR close?

Closes #51 .

Rationale for this change

Arro kernels are implemented and tested and should be used when available.
Use more of arrows kernels to benefit more from arrow performance / potential future perf improvements.

What changes are included in this PR?

Use more of arrows kernels to benefit more from arrow speed / potential improvements.

Are there any user-facing changes?

No

@Dandandan Dandandan changed the title Use arrow eq kernels Use arrow eq kernels in casewhen Apr 24, 2021
@Dandandan Dandandan changed the title Use arrow eq kernels in casewhen Use arrow eq kernels in CaseWhen expression evaluation Apr 24, 2021
@codecov-commenter
Copy link

Codecov Report

Merging #52 (53f8fc8) into master (9ba214a) will decrease coverage by 0.00%.
The diff coverage is 16.66%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master      #52      +/-   ##
==========================================
- Coverage   76.24%   76.24%   -0.01%     
==========================================
  Files         134      134              
  Lines       23051    23052       +1     
==========================================
  Hits        17576    17576              
- Misses       5475     5476       +1     
Impacted Files Coverage Δ
datafusion/src/physical_plan/expressions/case.rs 72.91% <16.66%> (-0.39%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9ba214a...53f8fc8. Read the comment docs.

Copy link
Member

@jorgecarleitao jorgecarleitao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yap, simpler and likely more efficient 👍

Thanks a lot, @Dandandan !

@andygrove andygrove merged commit 1f1130e into apache:master Apr 25, 2021
@houqp houqp added ballista datafusion Changes in the datafusion crate enhancement New feature or request labels Jul 29, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
datafusion Changes in the datafusion crate enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Use arrow eq kernels in CaseWhen expression evaluation
5 participants