Skip to content

Conversation

alamb
Copy link
Contributor

@alamb alamb commented Apr 8, 2025

Which issue does this PR close?

Rationale for this change

Some of these benchmarks were written for the wonderful analysis by @acking-you in #15462 of bool_or vs count_ones. While they were helpful for that analysis, they really are micro benchmarks for arrow kernels, not DataFusion so I think they don't belong in this repo.

Since most of the binary.rs operations call into arrow kernels, I didn't think adding more was useful at this time.

What changes are included in this PR?

  1. Remove arrow kernel benchmarks
  2. rename the short circuit benchmarks

Are these changes tested?

Are there any user-facing changes?

@github-actions github-actions bot added the physical-expr Changes to the physical-expr crates label Apr 8, 2025
None => false,
}
} else {
bool_and(array).unwrap_or(false)
Copy link
Contributor Author

@alamb alamb Apr 8, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

these are benchmarks for arrow functions bool_and and false_count / true_count so I don't think we need them in DataFusion

Copy link
Member

@xudong963 xudong963 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, also cc @acking-you

@alamb alamb merged commit 1385140 into apache:main Apr 9, 2025
27 checks passed
@alamb
Copy link
Contributor Author

alamb commented Apr 9, 2025

Thank you @Dandandan and @xudong963

@alamb alamb deleted the alamb/binary_op_bench branch April 9, 2025 10:35
nirnayroy pushed a commit to nirnayroy/datafusion that referenced this pull request May 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

physical-expr Changes to the physical-expr crates

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants