Skip to content

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Sep 3, 2025

Cherry-picked from #55610

…55610)

when in cloud mode, segment cache hold no system FD, thus the FD num
limit makes no sense. cloud mode use FDCache to control FD.
@github-actions github-actions bot requested a review from morrySnow as a code owner September 3, 2025 11:42
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring closed this Sep 3, 2025
@dataroaring dataroaring reopened this Sep 3, 2025
@hello-stephen
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33493 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e1f047133391e12e85e611310cf9e0479df97c35, data reload: false

------ Round 1 ----------------------------------
q1	17609	5785	5606	5606
q2	2019	400	291	291
q3	11946	1332	793	793
q4	10542	900	456	456
q5	9522	2490	2268	2268
q6	206	170	145	145
q7	952	774	618	618
q8	9337	1623	1305	1305
q9	5479	5058	5039	5039
q10	6843	2302	1838	1838
q11	503	285	264	264
q12	348	377	214	214
q13	17771	3669	3012	3012
q14	243	228	220	220
q15	522	464	459	459
q16	425	447	378	378
q17	607	911	366	366
q18	6969	6395	6471	6395
q19	1212	1094	587	587
q20	332	358	204	204
q21	2910	2306	2059	2059
q22	1072	1041	976	976
Total cold run time: 107369 ms
Total hot run time: 33493 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5828	5843	5846	5843
q2	248	332	236	236
q3	2250	2637	2304	2304
q4	1391	1891	1365	1365
q5	4614	5171	5154	5154
q6	189	163	126	126
q7	2130	2005	1812	1812
q8	2791	2933	2850	2850
q9	7272	7229	7229	7229
q10	3072	3258	2865	2865
q11	598	515	512	512
q12	722	756	617	617
q13	3457	3906	3144	3144
q14	302	298	272	272
q15	526	467	474	467
q16	456	501	433	433
q17	1333	1824	1306	1306
q18	7628	7529	7345	7345
q19	879	1256	1271	1256
q20	2102	2083	1946	1946
q21	5460	5034	4676	4676
q22	1097	1064	1026	1026
Total cold run time: 54345 ms
Total hot run time: 52784 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 194030 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e1f047133391e12e85e611310cf9e0479df97c35, data reload: false

query1	957	408	387	387
query2	6289	1973	1906	1906
query3	8675	200	198	198
query4	33728	24047	23470	23470
query5	3725	612	459	459
query6	297	201	191	191
query7	4201	497	336	336
query8	313	255	255	255
query9	9363	2603	2595	2595
query10	456	326	266	266
query11	18032	15438	15173	15173
query12	163	104	104	104
query13	1537	544	411	411
query14	8676	7921	7478	7478
query15	256	194	177	177
query16	8117	663	473	473
query17	1573	755	572	572
query18	2186	430	338	338
query19	243	190	186	186
query20	133	126	123	123
query21	208	131	109	109
query22	4556	4759	4507	4507
query23	35038	34347	34430	34347
query24	7576	2747	2739	2739
query25	530	471	414	414
query26	1168	283	170	170
query27	2048	489	364	364
query28	5417	2251	2237	2237
query29	784	573	435	435
query30	239	197	161	161
query31	1011	937	848	848
query32	94	61	57	57
query33	494	364	319	319
query34	776	853	531	531
query35	800	805	733	733
query36	1029	1048	982	982
query37	98	90	65	65
query38	4073	4003	4044	4003
query39	1556	1496	1470	1470
query40	223	128	114	114
query41	48	47	51	47
query42	120	107	103	103
query43	498	522	501	501
query44	1310	833	821	821
query45	184	180	169	169
query46	874	1048	693	693
query47	2016	2014	1931	1931
query48	413	431	360	360
query49	773	490	417	417
query50	671	700	432	432
query51	7407	7412	7311	7311
query52	106	97	91	91
query53	236	254	192	192
query54	548	568	485	485
query55	82	78	78	78
query56	287	263	264	263
query57	1276	1305	1207	1207
query58	252	216	216	216
query59	3186	3215	3133	3133
query60	299	284	270	270
query61	118	110	115	110
query62	799	779	723	723
query63	228	205	191	191
query64	4491	1010	724	724
query65	3394	3381	3306	3306
query66	1001	434	326	326
query67	16022	15599	15710	15599
query68	2181	847	588	588
query69	464	318	286	286
query70	1177	1184	1035	1035
query71	344	290	264	264
query72	6092	3911	4005	3911
query73	641	754	374	374
query74	10058	9340	9103	9103
query75	3173	3194	2712	2712
query76	2646	1155	793	793
query77	487	369	270	270
query78	10405	10453	9738	9738
query79	3387	852	611	611
query80	1656	516	437	437
query81	541	255	220	220
query82	334	114	87	87
query83	240	161	143	143
query84	239	103	81	81
query85	757	341	314	314
query86	492	301	307	301
query87	4324	4360	4228	4228
query88	5572	2430	2411	2411
query89	400	332	295	295
query90	1850	190	191	190
query91	134	137	107	107
query92	63	55	51	51
query93	2813	923	552	552
query94	726	412	302	302
query95	343	275	268	268
query96	494	615	281	281
query97	3182	3307	3177	3177
query98	234	218	205	205
query99	1348	1408	1293	1293
Total cold run time: 290074 ms
Total hot run time: 194030 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.34 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e1f047133391e12e85e611310cf9e0479df97c35, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.06
query4	1.63	0.11	0.11
query5	0.50	0.51	0.52
query6	1.13	0.73	0.73
query7	0.02	0.01	0.02
query8	0.05	0.04	0.03
query9	0.57	0.52	0.49
query10	0.56	0.55	0.55
query11	0.14	0.11	0.10
query12	0.14	0.11	0.12
query13	0.63	0.60	0.59
query14	0.77	0.80	0.78
query15	0.85	0.84	0.83
query16	0.42	0.40	0.40
query17	1.05	1.09	1.03
query18	0.24	0.22	0.22
query19	1.98	1.85	1.86
query20	0.01	0.01	0.01
query21	15.40	0.98	0.56
query22	0.74	0.77	0.67
query23	15.12	1.48	0.53
query24	3.35	1.31	1.24
query25	0.18	0.13	0.16
query26	0.30	0.15	0.13
query27	0.05	0.05	0.04
query28	14.21	1.00	0.43
query29	12.55	3.96	3.26
query30	0.25	0.09	0.07
query31	2.84	0.58	0.38
query32	3.22	0.55	0.47
query33	3.02	3.07	3.05
query34	16.55	5.18	4.54
query35	4.58	4.60	4.58
query36	0.65	0.49	0.48
query37	0.09	0.06	0.06
query38	0.04	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.13	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.53 s
Total hot run time: 29.34 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 0.00% (0/9) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 45.49% (12724/27973)
Line Coverage 36.37% (113455/311936)
Region Coverage 34.00% (64952/191013)
Branch Coverage 31.05% (34103/109816)

@morrySnow
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33413 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e1f047133391e12e85e611310cf9e0479df97c35, data reload: false

------ Round 1 ----------------------------------
q1	17686	5699	5595	5595
q2	2033	514	279	279
q3	11965	1297	792	792
q4	10245	886	463	463
q5	8500	2486	2192	2192
q6	195	169	131	131
q7	910	770	622	622
q8	9334	1466	1255	1255
q9	5424	4982	4954	4954
q10	6830	2308	1836	1836
q11	491	293	277	277
q12	347	369	217	217
q13	17774	3650	3057	3057
q14	232	233	210	210
q15	530	473	471	471
q16	450	452	391	391
q17	609	895	365	365
q18	7243	6488	6614	6488
q19	1329	981	589	589
q20	335	351	206	206
q21	3066	2344	2045	2045
q22	1058	1023	978	978
Total cold run time: 106586 ms
Total hot run time: 33413 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5687	5558	5554	5554
q2	238	335	229	229
q3	2324	2768	2377	2377
q4	1397	1861	1466	1466
q5	4579	5209	5115	5115
q6	180	169	134	134
q7	2116	2028	1849	1849
q8	2713	2930	2806	2806
q9	7295	7312	7261	7261
q10	3119	3240	2816	2816
q11	602	531	502	502
q12	689	787	616	616
q13	3419	3852	3206	3206
q14	302	295	274	274
q15	524	469	487	469
q16	464	491	448	448
q17	1269	1803	1255	1255
q18	7886	7518	7510	7510
q19	887	1252	1183	1183
q20	2038	2081	1912	1912
q21	5638	5096	4601	4601
q22	1082	1043	1027	1027
Total cold run time: 54448 ms
Total hot run time: 52610 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193243 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e1f047133391e12e85e611310cf9e0479df97c35, data reload: false

query1	947	395	400	395
query2	6219	1907	1840	1840
query3	8686	210	211	210
query4	33222	23657	23775	23657
query5	3613	600	459	459
query6	297	197	168	168
query7	4190	487	311	311
query8	298	238	235	235
query9	9456	2665	2658	2658
query10	512	352	265	265
query11	18460	15471	15352	15352
query12	162	109	104	104
query13	1551	554	425	425
query14	10273	6762	7092	6762
query15	264	188	181	181
query16	8080	659	492	492
query17	1578	795	607	607
query18	2194	425	326	326
query19	229	192	173	173
query20	134	126	125	125
query21	209	132	119	119
query22	4524	4563	4513	4513
query23	35466	34424	34324	34324
query24	7226	2695	2759	2695
query25	561	492	429	429
query26	733	296	182	182
query27	1867	486	369	369
query28	5176	2243	2245	2243
query29	746	612	484	484
query30	241	198	166	166
query31	1014	915	866	866
query32	87	62	63	62
query33	511	394	304	304
query34	766	875	525	525
query35	794	805	753	753
query36	1012	1053	960	960
query37	108	100	73	73
query38	4076	4130	3989	3989
query39	1512	1479	1495	1479
query40	214	117	103	103
query41	50	50	46	46
query42	124	113	106	106
query43	506	521	469	469
query44	1342	836	840	836
query45	199	186	176	176
query46	919	1061	701	701
query47	1970	1992	1964	1964
query48	418	425	348	348
query49	741	495	412	412
query50	694	689	450	450
query51	7406	7265	7173	7173
query52	110	105	94	94
query53	244	260	193	193
query54	577	544	472	472
query55	85	84	79	79
query56	277	272	256	256
query57	1286	1284	1259	1259
query58	237	228	232	228
query59	3177	3208	3111	3111
query60	298	281	274	274
query61	117	112	114	112
query62	770	743	704	704
query63	247	199	198	198
query64	3396	1043	666	666
query65	3413	3281	3317	3281
query66	814	415	350	350
query67	16442	15872	15511	15511
query68	7595	847	554	554
query69	502	310	274	274
query70	1214	1164	1121	1121
query71	377	294	273	273
query72	5763	3851	3830	3830
query73	639	747	357	357
query74	10224	9096	9060	9060
query75	3264	3136	2654	2654
query76	3122	1183	778	778
query77	533	376	278	278
query78	10340	10609	9597	9597
query79	3387	910	614	614
query80	656	517	429	429
query81	497	260	222	222
query82	605	123	94	94
query83	162	167	145	145
query84	244	103	86	86
query85	792	370	297	297
query86	403	321	295	295
query87	4355	4340	4248	4248
query88	5310	2426	2433	2426
query89	399	336	298	298
query90	1767	186	189	186
query91	139	155	114	114
query92	64	54	52	52
query93	2035	933	560	560
query94	681	415	319	319
query95	338	276	264	264
query96	504	608	284	284
query97	3207	3246	3174	3174
query98	224	220	196	196
query99	1596	1424	1312	1312
Total cold run time: 294005 ms
Total hot run time: 193243 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.6 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e1f047133391e12e85e611310cf9e0479df97c35, data reload: false

query1	0.04	0.03	0.02
query2	0.06	0.03	0.03
query3	0.24	0.06	0.07
query4	1.62	0.11	0.10
query5	0.53	0.51	0.54
query6	1.13	0.74	0.73
query7	0.02	0.01	0.02
query8	0.04	0.04	0.04
query9	0.58	0.52	0.49
query10	0.58	0.55	0.55
query11	0.14	0.10	0.10
query12	0.14	0.12	0.11
query13	0.61	0.59	0.59
query14	0.77	0.79	0.80
query15	0.85	0.85	0.83
query16	0.39	0.38	0.40
query17	1.06	1.00	1.05
query18	0.25	0.21	0.23
query19	1.84	1.79	1.88
query20	0.01	0.01	0.01
query21	15.43	0.95	0.60
query22	0.74	0.73	0.78
query23	15.02	1.45	0.63
query24	3.01	1.48	1.49
query25	0.14	0.18	0.05
query26	0.29	0.14	0.15
query27	0.05	0.04	0.04
query28	13.83	1.06	0.43
query29	12.59	3.98	3.28
query30	0.25	0.09	0.07
query31	2.82	0.58	0.37
query32	3.23	0.55	0.48
query33	3.01	3.02	3.04
query34	16.80	5.25	4.58
query35	4.58	4.55	4.63
query36	0.63	0.51	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.16	0.14	0.13
query41	0.08	0.02	0.03
query42	0.03	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.8 s
Total hot run time: 29.6 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 0.00% (0/9) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 45.52% (12743/27996)
Line Coverage 36.38% (113652/312394)
Region Coverage 34.00% (65004/191176)
Branch Coverage 31.04% (34116/109918)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (9/9) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 76.24% (20985/27525)
Line Coverage 69.46% (216245/311345)
Region Coverage 67.38% (129310/191915)
Branch Coverage 61.00% (67357/110414)

@morrySnow morrySnow merged commit 74ec1cf into branch-3.1 Sep 4, 2025
22 of 23 checks passed
@github-actions github-actions bot deleted the auto-pick-55610-branch-3.1 branch September 4, 2025 09:19
@morrySnow morrySnow mentioned this pull request Sep 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants