Skip to content

Conversation

@gavinchou
Copy link
Contributor

pick #56031

@Thearas
Copy link
Contributor

Thearas commented Sep 15, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

* make HDFS storage optional when build in cloud mode
* optimize meta-service start script
@gavinchou gavinchou force-pushed the gavin-opt-cloud-start-script-3.1 branch from 313ba89 to 24fc7d1 Compare September 15, 2025 08:58
@gavinchou
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 50.00% (1/2) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 82.20% (1233/1500)
Line Coverage 66.09% (22166/33540)
Region Coverage 67.61% (11137/16473)
Branch Coverage 57.16% (5879/10286)

@doris-robot
Copy link

TPC-H: Total hot run time: 32532 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 24fc7d17df870d7afe0a06044eb731d792cff927, data reload: false

------ Round 1 ----------------------------------
q1	17601	5478	5445	5445
q2	2016	389	277	277
q3	11601	1273	735	735
q4	10248	871	445	445
q5	8646	2385	2137	2137
q6	186	164	135	135
q7	897	742	611	611
q8	9342	1445	1124	1124
q9	5165	4894	4938	4894
q10	6770	2264	1843	1843
q11	465	276	258	258
q12	337	359	212	212
q13	17786	3605	3001	3001
q14	224	225	212	212
q15	522	460	468	460
q16	425	424	369	369
q17	605	863	366	366
q18	6844	6558	6329	6329
q19	1208	952	549	549
q20	327	332	201	201
q21	2783	2112	1945	1945
q22	1069	1014	984	984
Total cold run time: 105067 ms
Total hot run time: 32532 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5591	5518	5486	5486
q2	234	323	230	230
q3	2224	2644	2299	2299
q4	1345	1822	1394	1394
q5	4403	4869	4954	4869
q6	167	168	133	133
q7	2078	1954	1886	1886
q8	2655	2836	2708	2708
q9	7261	7247	7213	7213
q10	3032	3350	2757	2757
q11	574	503	502	502
q12	641	823	627	627
q13	3360	3798	3132	3132
q14	273	310	272	272
q15	522	473	464	464
q16	444	478	440	440
q17	1246	1748	1265	1265
q18	7747	7415	7340	7340
q19	806	1025	1128	1025
q20	2040	2033	1893	1893
q21	5584	4921	4568	4568
q22	1055	1060	1049	1049
Total cold run time: 53282 ms
Total hot run time: 51552 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193343 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 24fc7d17df870d7afe0a06044eb731d792cff927, data reload: false

query1	951	412	402	402
query2	6167	1995	1906	1906
query3	8694	201	197	197
query4	33497	23708	23301	23301
query5	3675	594	449	449
query6	293	208	175	175
query7	4197	496	313	313
query8	294	246	246	246
query9	9470	2611	2608	2608
query10	459	312	264	264
query11	18620	15447	15310	15310
query12	161	110	105	105
query13	1591	543	416	416
query14	9704	6991	7130	6991
query15	250	190	186	186
query16	8002	645	544	544
query17	1565	794	632	632
query18	2115	431	320	320
query19	210	194	168	168
query20	141	132	127	127
query21	206	126	115	115
query22	4609	4682	4691	4682
query23	35318	35213	34594	34594
query24	7523	2694	2760	2694
query25	512	485	463	463
query26	1178	252	175	175
query27	2557	496	357	357
query28	5631	2242	2165	2165
query29	604	567	469	469
query30	253	192	162	162
query31	1007	926	824	824
query32	94	67	59	59
query33	512	398	308	308
query34	775	865	519	519
query35	783	826	779	779
query36	1035	1071	963	963
query37	102	86	68	68
query38	4026	3925	4016	3925
query39	1529	1463	1514	1463
query40	209	123	105	105
query41	55	47	47	47
query42	121	105	106	105
query43	524	536	498	498
query44	1393	836	842	836
query45	182	176	166	166
query46	888	1067	665	665
query47	1964	1979	1922	1922
query48	410	456	361	361
query49	781	520	406	406
query50	681	706	448	448
query51	7446	7364	7316	7316
query52	100	99	95	95
query53	234	252	189	189
query54	553	540	472	472
query55	80	80	78	78
query56	263	279	276	276
query57	1262	1253	1205	1205
query58	238	216	214	214
query59	3070	3284	3105	3105
query60	301	318	281	281
query61	111	107	111	107
query62	809	765	706	706
query63	240	204	195	195
query64	4698	1008	648	648
query65	3433	3356	3307	3307
query66	1002	428	321	321
query67	16626	15947	15607	15607
query68	7757	827	534	534
query69	482	303	270	270
query70	1209	1118	1111	1111
query71	431	311	285	285
query72	5136	3894	3754	3754
query73	664	739	345	345
query74	10559	9185	9108	9108
query75	3748	3158	2677	2677
query76	3418	1175	750	750
query77	784	385	292	292
query78	10407	10411	9592	9592
query79	3835	841	588	588
query80	724	527	433	433
query81	511	256	220	220
query82	586	115	86	86
query83	168	158	143	143
query84	293	104	80	80
query85	781	365	297	297
query86	355	307	296	296
query87	4399	4278	4263	4263
query88	4680	2392	2395	2392
query89	411	335	296	296
query90	1843	193	194	193
query91	137	146	110	110
query92	63	57	55	55
query93	2048	900	545	545
query94	649	418	291	291
query95	349	281	275	275
query96	505	608	288	288
query97	3216	3284	3143	3143
query98	234	205	203	203
query99	1570	1448	1303	1303
Total cold run time: 297936 ms
Total hot run time: 193343 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.35 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 24fc7d17df870d7afe0a06044eb731d792cff927, data reload: false

query1	0.03	0.02	0.03
query2	0.06	0.04	0.03
query3	0.23	0.07	0.07
query4	1.64	0.10	0.10
query5	0.53	0.50	0.50
query6	1.16	0.72	0.73
query7	0.02	0.02	0.02
query8	0.05	0.03	0.03
query9	0.58	0.51	0.50
query10	0.56	0.55	0.55
query11	0.15	0.11	0.11
query12	0.14	0.11	0.11
query13	0.62	0.60	0.59
query14	0.78	0.80	0.80
query15	0.85	0.85	0.82
query16	0.40	0.39	0.37
query17	1.07	1.04	1.05
query18	0.22	0.24	0.23
query19	1.94	1.89	1.74
query20	0.01	0.01	0.01
query21	15.40	0.97	0.59
query22	0.73	0.78	0.68
query23	15.09	1.37	0.57
query24	3.55	0.37	0.78
query25	0.31	0.11	0.10
query26	0.40	0.14	0.12
query27	0.06	0.05	0.07
query28	12.77	1.02	0.43
query29	12.60	3.96	3.28
query30	0.25	0.08	0.07
query31	2.81	0.60	0.38
query32	3.22	0.54	0.47
query33	3.00	3.02	3.03
query34	16.51	5.23	4.52
query35	4.60	4.62	4.56
query36	0.68	0.49	0.48
query37	0.09	0.06	0.06
query38	0.04	0.03	0.03
query39	0.04	0.02	0.02
query40	0.16	0.13	0.12
query41	0.07	0.02	0.02
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.49 s
Total hot run time: 28.35 s

@morrySnow morrySnow merged commit 6734d18 into apache:branch-3.1 Sep 16, 2025
22 checks passed
@morrySnow morrySnow mentioned this pull request Sep 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants