Skip to content

Conversation

@github-actions
Copy link
Contributor

Cherry-picked from #46365

Now some timeout config is not suitable for high concurrency loading on
Mow table, which may lead to frequent lock timeouts.
@github-actions github-actions bot requested a review from dataroaring as a code owner January 29, 2025 23:11
@Thearas
Copy link
Contributor

Thearas commented Jan 29, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Jan 29, 2025
@Thearas
Copy link
Contributor

Thearas commented Jan 29, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41086 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e2e618ac3275115496bda2b02ae125fb5ee1c1d9, data reload: false

------ Round 1 ----------------------------------
q1	17590	7421	7273	7273
q2	2068	188	176	176
q3	10616	1061	1125	1061
q4	10547	737	700	700
q5	7767	2849	2788	2788
q6	239	147	143	143
q7	977	615	622	615
q8	9585	1890	1999	1890
q9	8009	6392	6407	6392
q10	6943	2329	2328	2328
q11	452	268	265	265
q12	397	212	205	205
q13	17797	2996	2980	2980
q14	245	203	210	203
q15	576	527	531	527
q16	665	591	579	579
q17	970	552	622	552
q18	7393	6941	6998	6941
q19	1395	1080	1098	1080
q20	469	199	199	199
q21	3991	3213	3190	3190
q22	1123	1012	999	999
Total cold run time: 109814 ms
Total hot run time: 41086 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7222	7224	7193	7193
q2	334	234	236	234
q3	2970	2988	2896	2896
q4	2057	1851	1824	1824
q5	5683	5765	5765	5765
q6	227	144	143	143
q7	2247	1823	1820	1820
q8	3454	3529	3432	3432
q9	9027	8840	8836	8836
q10	3587	3545	3598	3545
q11	610	509	492	492
q12	805	638	635	635
q13	8909	3171	3094	3094
q14	300	275	271	271
q15	574	534	533	533
q16	690	653	651	651
q17	1846	1591	1570	1570
q18	8225	7774	7544	7544
q19	1652	1432	1515	1432
q20	2107	1859	1868	1859
q21	5606	5130	5227	5130
q22	1162	1080	1007	1007
Total cold run time: 69294 ms
Total hot run time: 59906 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197890 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e2e618ac3275115496bda2b02ae125fb5ee1c1d9, data reload: false

query1	1316	941	906	906
query2	6225	2089	2017	2017
query3	10853	4221	4141	4141
query4	66517	28957	23649	23649
query5	4986	436	463	436
query6	409	165	168	165
query7	5671	323	318	318
query8	294	215	220	215
query9	9290	2703	2700	2700
query10	492	276	253	253
query11	17598	15341	15868	15341
query12	162	101	109	101
query13	1606	445	427	427
query14	10453	7291	7254	7254
query15	208	177	188	177
query16	7006	425	470	425
query17	1088	606	575	575
query18	1863	341	315	315
query19	205	160	151	151
query20	116	106	109	106
query21	213	101	102	101
query22	4713	4474	4724	4474
query23	34539	34079	34413	34079
query24	6166	2968	2922	2922
query25	516	403	406	403
query26	679	165	169	165
query27	1900	357	357	357
query28	4176	2481	2422	2422
query29	726	503	466	466
query30	251	167	168	167
query31	1012	798	822	798
query32	72	57	60	57
query33	445	303	308	303
query34	922	510	527	510
query35	862	801	746	746
query36	1078	961	961	961
query37	122	82	73	73
query38	4161	4091	4062	4062
query39	1570	1487	1501	1487
query40	227	104	110	104
query41	50	51	52	51
query42	117	103	101	101
query43	546	490	480	480
query44	1215	855	845	845
query45	187	167	182	167
query46	1148	744	730	730
query47	2003	1919	1924	1919
query48	493	399	409	399
query49	776	416	418	416
query50	861	433	431	431
query51	7242	7297	7026	7026
query52	100	89	88	88
query53	261	189	187	187
query54	566	478	452	452
query55	78	76	78	76
query56	284	247	254	247
query57	1271	1165	1110	1110
query58	225	221	232	221
query59	3324	3046	2960	2960
query60	281	252	249	249
query61	106	104	107	104
query62	836	731	720	720
query63	216	198	196	196
query64	1383	653	641	641
query65	3227	3175	3186	3175
query66	736	306	297	297
query67	16020	15711	15586	15586
query68	3982	596	569	569
query69	433	266	269	266
query70	1206	1051	1138	1051
query71	354	253	254	253
query72	6349	4137	4068	4068
query73	762	350	354	350
query74	10458	9074	9245	9074
query75	3349	2643	2721	2643
query76	1809	1014	1144	1014
query77	507	276	268	268
query78	10611	9594	9555	9555
query79	1940	597	597	597
query80	1323	427	427	427
query81	533	234	238	234
query82	1276	120	123	120
query83	162	149	140	140
query84	280	77	81	77
query85	989	301	289	289
query86	406	293	308	293
query87	4690	4327	4245	4245
query88	3811	2398	2327	2327
query89	425	290	287	287
query90	1954	186	190	186
query91	185	149	147	147
query92	70	49	52	49
query93	2558	555	553	553
query94	858	260	298	260
query95	357	254	258	254
query96	621	283	279	279
query97	3328	3177	3225	3177
query98	207	199	209	199
query99	1746	1436	1440	1436
Total cold run time: 321799 ms
Total hot run time: 197890 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.25 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e2e618ac3275115496bda2b02ae125fb5ee1c1d9, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.06
query4	1.63	0.10	0.10
query5	0.51	0.49	0.50
query6	1.14	0.74	0.73
query7	0.02	0.01	0.02
query8	0.04	0.03	0.04
query9	0.57	0.51	0.49
query10	0.54	0.55	0.55
query11	0.14	0.10	0.12
query12	0.14	0.11	0.11
query13	0.61	0.60	0.59
query14	2.72	2.84	2.86
query15	0.90	0.82	0.86
query16	0.37	0.38	0.38
query17	1.00	1.05	1.03
query18	0.23	0.21	0.23
query19	1.88	1.91	1.97
query20	0.01	0.01	0.02
query21	15.35	0.58	0.58
query22	2.55	2.04	2.40
query23	16.96	0.92	0.77
query24	3.69	1.77	1.24
query25	0.19	0.12	0.08
query26	0.69	0.14	0.13
query27	0.04	0.04	0.05
query28	9.61	1.12	1.07
query29	12.56	3.16	3.19
query30	0.25	0.06	0.06
query31	2.86	0.40	0.35
query32	3.28	0.47	0.46
query33	2.98	3.01	3.04
query34	16.74	4.49	4.48
query35	4.55	4.48	4.57
query36	0.68	0.48	0.49
query37	0.10	0.06	0.06
query38	0.05	0.03	0.03
query39	0.04	0.02	0.02
query40	0.17	0.12	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.27 s
Total hot run time: 33.25 s

@dataroaring dataroaring merged commit 7950af3 into branch-3.0 Jan 30, 2025
21 of 22 checks passed
@github-actions github-actions bot deleted the auto-pick-46365-branch-3.0 branch January 30, 2025 02:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants