-
Notifications
You must be signed in to change notification settings - Fork 3.7k
[performance][Exec] scanner merge block before projection #59492
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
|
run buildall |
|
Thank you for your contribution to Apache Doris. Please clearly describe your PR:
|
TPC-H: Total hot run time: 34249 ms |
TPC-DS: Total hot run time: 176204 ms |
ClickBench: Total hot run time: 27.19 s |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
|
run buildall |
TPC-H: Total hot run time: 32509 ms |
TPC-DS: Total hot run time: 173136 ms |
ClickBench: Total hot run time: 27.27 s |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
|
run buildall |
TPC-H: Total hot run time: 32295 ms |
TPC-DS: Total hot run time: 174042 ms |
ClickBench: Total hot run time: 26.95 s |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
|
run buildall |
TPC-H: Total hot run time: 32012 ms |
TPC-DS: Total hot run time: 173401 ms |
ClickBench: Total hot run time: 26.91 s |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
|
run buildall |
|
run buildall |
TPC-H: Total hot run time: 31608 ms |
TPC-DS: Total hot run time: 173375 ms |
ClickBench: Total hot run time: 26.86 s |
|
PR approved by at least one committer and no changes requested. |
|
PR approved by anyone and no changes requested. |
BE UT Coverage ReportIncrement line coverage Increment coverage report
|
BE Regression && UT Coverage ReportIncrement line coverage Increment coverage report
|
What problem does this PR solve?
Description
Add batch size based block fetching strategy with min_batch_size (max of 1/4 of state batch size and 1) to reduce frequent small block processing
Implement block merging logic between _origin_block and _padding_block when total rows do not exceed state batch size
Optimize EOS handling logic to ensure proper output sequence of origin block first then padding block
Add block swap mechanism between origin and padding block for efficient data transfer
Ensure correct column data clearing based on row descriptor's materialized slots count
Release note
None
Check List (For Author)
Test
Behavior changed:
Does this need documentation?
Check List (For Reviewer who merge this PR)