Skip to content

Conversation

findepi
Copy link
Member

@findepi findepi commented Sep 4, 2025

Add benchmark exposing

The benchmark can be run with

cargo bench --bench sql_planner -- physical_window_function_partition

@github-actions github-actions bot added the core Core DataFusion crate label Sep 4, 2025
@findepi findepi force-pushed the findepi/benchmark-window-function-with-multiple-partitioning-columns-ba2906 branch from b6693c2 to 58c2faf Compare September 4, 2025 08:35
@findepi findepi requested a review from comphead September 4, 2025 08:35
@findepi
Copy link
Member Author

findepi commented Sep 4, 2025

Results on current main on my busy laptop

physical_window_function_partition_by_4_on_values
                        time:   [485.47 µs 487.78 µs 490.77 µs]
Found 4 outliers among 100 measurements (4.00%)
  1 (1.00%) high mild
  3 (3.00%) high severe

physical_window_function_partition_by_7_on_values
                        time:   [22.820 ms 22.891 ms 22.967 ms]
Found 5 outliers among 100 measurements (5.00%)
  5 (5.00%) high mild

Benchmarking physical_window_function_partition_by_8_on_values: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.4s, or reduce sample count to 50.
physical_window_function_partition_by_8_on_values
                        time:   [98.300 ms 100.62 ms 103.25 ms]
Found 14 outliers among 100 measurements (14.00%)
  5 (5.00%) high mild
  9 (9.00%) high severe

(On DF 45, all times are in microseconds.)

@findepi findepi merged commit ad0beb4 into apache:main Sep 4, 2025
28 checks passed
@findepi findepi deleted the findepi/benchmark-window-function-with-multiple-partitioning-columns-ba2906 branch September 4, 2025 17:06
destrex271 pushed a commit to destrex271/datafusion that referenced this pull request Sep 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Core DataFusion crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants