Skip to content

Conversation

@zclllyybb
Copy link
Contributor

cherry-pick #53734

@zclllyybb zclllyybb requested a review from morrySnow as a code owner August 19, 2025 06:11
@Thearas
Copy link
Contributor

Thearas commented Aug 19, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@zclllyybb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32802 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f798195627be6f16c926b409e07451d492f8684f, data reload: false

------ Round 1 ----------------------------------
q1	17942	5457	5486	5457
q2	2041	416	292	292
q3	12556	1290	746	746
q4	10349	883	450	450
q5	9485	2437	2155	2155
q6	185	164	133	133
q7	899	727	625	625
q8	9339	1456	1212	1212
q9	5227	4951	4912	4912
q10	6772	2269	1837	1837
q11	486	285	268	268
q12	328	352	223	223
q13	17758	3595	3040	3040
q14	234	226	208	208
q15	533	472	475	472
q16	421	432	385	385
q17	585	857	363	363
q18	7013	6491	6368	6368
q19	1206	960	541	541
q20	332	335	202	202
q21	2770	2162	1917	1917
q22	1058	1036	996	996
Total cold run time: 107519 ms
Total hot run time: 32802 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5520	5500	5486	5486
q2	230	325	236	236
q3	2273	2664	2313	2313
q4	1385	1794	1380	1380
q5	4442	5046	4975	4975
q6	168	162	126	126
q7	2081	2020	1788	1788
q8	2636	2801	2720	2720
q9	7296	7335	7215	7215
q10	3043	3245	2755	2755
q11	584	514	502	502
q12	685	781	603	603
q13	3376	3780	3204	3204
q14	281	305	275	275
q15	514	480	472	472
q16	436	482	424	424
q17	1238	1737	1274	1274
q18	7704	7408	7407	7407
q19	783	804	1177	804
q20	2011	2075	1914	1914
q21	5437	4907	4658	4658
q22	1103	1073	1018	1018
Total cold run time: 53226 ms
Total hot run time: 51549 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193371 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f798195627be6f16c926b409e07451d492f8684f, data reload: false

query1	975	413	398	398
query2	6238	1964	1886	1886
query3	8693	201	196	196
query4	33283	23968	23628	23628
query5	3774	611	454	454
query6	283	197	187	187
query7	4205	494	313	313
query8	328	255	237	237
query9	9221	2602	2594	2594
query10	487	325	254	254
query11	18120	15462	15287	15287
query12	158	108	106	106
query13	1549	533	412	412
query14	9072	7340	7148	7148
query15	265	195	178	178
query16	8073	718	520	520
query17	1565	773	602	602
query18	2169	414	321	321
query19	239	204	170	170
query20	127	127	129	127
query21	213	134	107	107
query22	4481	4569	4537	4537
query23	35356	34509	34446	34446
query24	7728	2757	2744	2744
query25	548	485	428	428
query26	1186	294	173	173
query27	2023	490	354	354
query28	5158	2260	2230	2230
query29	768	600	470	470
query30	239	204	168	168
query31	1114	933	866	866
query32	94	61	66	61
query33	521	404	325	325
query34	758	860	530	530
query35	781	864	748	748
query36	1012	1057	952	952
query37	110	96	69	69
query38	4037	4091	4011	4011
query39	1537	1494	1489	1489
query40	214	125	110	110
query41	68	57	49	49
query42	119	112	107	107
query43	523	517	495	495
query44	1320	839	823	823
query45	188	185	177	177
query46	896	1083	676	676
query47	1975	1988	1902	1902
query48	423	433	348	348
query49	780	490	426	426
query50	680	689	450	450
query51	7340	7414	7213	7213
query52	104	106	94	94
query53	233	270	202	202
query54	556	542	493	493
query55	87	82	82	82
query56	272	276	290	276
query57	1307	1256	1226	1226
query58	224	213	222	213
query59	3211	3313	3217	3217
query60	290	289	293	289
query61	116	110	109	109
query62	798	750	705	705
query63	229	194	190	190
query64	4729	997	624	624
query65	3395	3313	3255	3255
query66	956	403	308	308
query67	16190	15695	15490	15490
query68	7740	823	536	536
query69	481	300	270	270
query70	1203	1109	1135	1109
query71	383	299	273	273
query72	5812	3742	3837	3742
query73	648	748	349	349
query74	9663	9412	8972	8972
query75	3311	3142	2682	2682
query76	3093	1171	755	755
query77	710	365	282	282
query78	10397	10512	9597	9597
query79	3568	918	593	593
query80	655	520	439	439
query81	493	253	221	221
query82	574	121	88	88
query83	168	158	148	148
query84	278	95	85	85
query85	783	373	294	294
query86	354	318	302	302
query87	4268	4369	4249	4249
query88	4865	2394	2384	2384
query89	397	335	298	298
query90	1799	190	187	187
query91	140	132	113	113
query92	67	57	55	55
query93	2055	907	545	545
query94	681	406	288	288
query95	339	276	268	268
query96	489	602	291	291
query97	3214	3281	3182	3182
query98	229	208	204	204
query99	1540	1383	1295	1295
Total cold run time: 294108 ms
Total hot run time: 193371 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.66 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f798195627be6f16c926b409e07451d492f8684f, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.04	0.03
query3	0.23	0.07	0.07
query4	1.63	0.11	0.11
query5	0.52	0.51	0.54
query6	1.13	0.72	0.72
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.57	0.52	0.50
query10	0.56	0.56	0.56
query11	0.14	0.10	0.10
query12	0.14	0.11	0.10
query13	0.62	0.61	0.59
query14	0.79	0.81	0.79
query15	0.84	0.88	0.83
query16	0.40	0.38	0.37
query17	1.05	0.98	1.02
query18	0.26	0.23	0.23
query19	1.96	1.88	1.75
query20	0.01	0.01	0.00
query21	15.40	0.92	0.57
query22	0.74	0.71	0.64
query23	15.22	1.44	0.55
query24	3.77	0.85	0.73
query25	0.11	0.10	0.18
query26	0.44	0.16	0.12
query27	0.04	0.05	0.05
query28	12.88	1.01	0.43
query29	12.67	3.98	3.30
query30	0.25	0.09	0.07
query31	2.81	0.61	0.38
query32	3.22	0.54	0.46
query33	3.03	3.01	3.10
query34	16.63	5.27	4.56
query35	4.57	4.58	4.57
query36	0.65	0.49	0.49
query37	0.09	0.07	0.06
query38	0.04	0.03	0.04
query39	0.03	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 103.91 s
Total hot run time: 28.66 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 48.87% (65/133) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 45.49% (12726/27973)
Line Coverage 36.39% (113482/311892)
Region Coverage 34.01% (64936/190906)
Branch Coverage 31.05% (34079/109772)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 91.73% (122/133) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 77.62% (21386/27551)
Line Coverage 71.89% (223856/311371)
Region Coverage 69.87% (134017/191806)
Branch Coverage 63.51% (70074/110336)

@zclllyybb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32730 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ad76f218139ccf75b054b4d9790a7925881501b8, data reload: false

------ Round 1 ----------------------------------
q1	17595	5843	5593	5593
q2	2027	411	285	285
q3	11972	1244	765	765
q4	10564	888	455	455
q5	9545	2380	2157	2157
q6	181	165	133	133
q7	900	755	621	621
q8	9338	1422	1152	1152
q9	5165	5004	4976	4976
q10	6760	2260	1798	1798
q11	480	279	259	259
q12	343	353	206	206
q13	17782	3569	3015	3015
q14	222	227	208	208
q15	528	466	461	461
q16	416	430	383	383
q17	586	851	355	355
q18	6783	6635	6257	6257
q19	1214	943	536	536
q20	316	323	204	204
q21	2777	2217	1914	1914
q22	1093	1025	997	997
Total cold run time: 106587 ms
Total hot run time: 32730 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5565	5570	5510	5510
q2	233	331	231	231
q3	2218	2573	2276	2276
q4	1339	1773	1347	1347
q5	4384	4992	4941	4941
q6	170	165	128	128
q7	2052	1968	1850	1850
q8	2623	2794	2667	2667
q9	7235	7235	7237	7235
q10	3016	3269	2736	2736
q11	571	513	518	513
q12	657	735	616	616
q13	3385	3811	3126	3126
q14	278	306	260	260
q15	519	471	462	462
q16	429	493	438	438
q17	1214	1734	1238	1238
q18	7683	7519	7338	7338
q19	802	1138	1034	1034
q20	2015	2038	1895	1895
q21	5346	4834	4550	4550
q22	1072	1089	1016	1016
Total cold run time: 52806 ms
Total hot run time: 51407 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193058 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ad76f218139ccf75b054b4d9790a7925881501b8, data reload: false

query1	935	386	382	382
query2	6236	2039	1872	1872
query3	8684	200	198	198
query4	33522	23913	23540	23540
query5	3616	597	433	433
query6	296	204	186	186
query7	4218	500	326	326
query8	310	258	246	246
query9	9555	2570	2550	2550
query10	455	330	264	264
query11	17796	15466	15186	15186
query12	164	111	106	106
query13	1561	533	413	413
query14	9452	7658	7080	7080
query15	240	192	180	180
query16	8089	661	518	518
query17	1603	798	600	600
query18	2162	419	327	327
query19	250	193	167	167
query20	124	118	115	115
query21	215	137	111	111
query22	4531	4565	4449	4449
query23	34664	34436	34280	34280
query24	7429	2712	2685	2685
query25	514	467	390	390
query26	789	283	167	167
query27	2016	485	350	350
query28	5211	2160	2143	2143
query29	710	585	443	443
query30	236	189	165	165
query31	965	953	830	830
query32	92	57	57	57
query33	487	376	303	303
query34	720	902	541	541
query35	802	851	722	722
query36	1010	1072	982	982
query37	110	103	74	74
query38	3994	4026	3933	3933
query39	1500	1484	1467	1467
query40	206	135	108	108
query41	54	55	54	54
query42	127	111	104	104
query43	526	534	495	495
query44	1326	846	826	826
query45	191	183	175	175
query46	898	1067	692	692
query47	2025	2011	1950	1950
query48	408	429	358	358
query49	765	523	437	437
query50	685	702	443	443
query51	7449	7472	7129	7129
query52	108	101	96	96
query53	245	272	201	201
query54	574	570	480	480
query55	86	80	82	80
query56	307	281	284	281
query57	1268	1272	1234	1234
query58	231	233	229	229
query59	3080	3371	3168	3168
query60	313	283	287	283
query61	117	117	116	116
query62	794	781	712	712
query63	228	199	196	196
query64	3732	1023	663	663
query65	3357	3330	3311	3311
query66	840	409	306	306
query67	16459	15719	15664	15664
query68	7695	827	541	541
query69	498	308	267	267
query70	1208	1096	1100	1096
query71	438	298	262	262
query72	5200	3702	3903	3702
query73	631	733	342	342
query74	10261	9234	9366	9234
query75	4062	3229	2746	2746
query76	3559	1185	785	785
query77	785	371	285	285
query78	10596	10567	9704	9704
query79	2937	905	615	615
query80	740	518	432	432
query81	469	263	218	218
query82	541	123	92	92
query83	166	171	146	146
query84	277	98	80	80
query85	762	367	304	304
query86	361	296	304	296
query87	4323	4349	4294	4294
query88	3412	2390	2365	2365
query89	404	336	301	301
query90	1767	193	193	193
query91	137	148	114	114
query92	69	55	53	53
query93	1163	898	537	537
query94	645	407	287	287
query95	356	277	269	269
query96	481	601	280	280
query97	3199	3258	3150	3150
query98	219	218	205	205
query99	1533	1398	1291	1291
Total cold run time: 290556 ms
Total hot run time: 193058 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.72 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ad76f218139ccf75b054b4d9790a7925881501b8, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.07
query4	1.62	0.11	0.11
query5	0.51	0.51	0.49
query6	1.14	0.73	0.72
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.59	0.52	0.50
query10	0.55	0.56	0.56
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.59
query14	0.78	0.82	0.78
query15	0.84	0.82	0.82
query16	0.37	0.39	0.40
query17	1.08	1.08	1.06
query18	0.24	0.23	0.23
query19	1.94	1.78	1.88
query20	0.02	0.02	0.01
query21	15.40	0.94	0.57
query22	0.72	0.82	0.53
query23	15.26	1.39	0.58
query24	3.56	1.40	0.78
query25	0.21	0.17	0.10
query26	0.25	0.14	0.14
query27	0.04	0.03	0.04
query28	13.69	0.98	0.43
query29	12.63	3.97	3.27
query30	0.24	0.08	0.06
query31	2.84	0.58	0.38
query32	3.22	0.54	0.45
query33	2.99	3.07	3.06
query34	16.71	5.17	4.54
query35	4.58	4.61	4.63
query36	0.64	0.49	0.47
query37	0.09	0.06	0.07
query38	0.04	0.04	0.03
query39	0.03	0.03	0.02
query40	0.17	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 104.45 s
Total hot run time: 28.72 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 48.87% (65/133) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 45.49% (12725/27973)
Line Coverage 36.38% (113473/311892)
Region Coverage 34.01% (64922/190906)
Branch Coverage 31.04% (34077/109772)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 91.73% (122/133) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 76.46% (21030/27503)
Line Coverage 69.83% (217046/310835)
Region Coverage 67.79% (129915/191640)
Branch Coverage 61.35% (67650/110264)

@morrySnow morrySnow merged commit 96ed6ff into apache:branch-3.1 Sep 4, 2025
21 of 22 checks passed
@morrySnow morrySnow mentioned this pull request Sep 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants