Skip to content

Conversation

@xy720
Copy link
Member

@xy720 xy720 commented Mar 28, 2024

Proposed changes

  1. fix regression test test-table-version.
  2. when dropping partition, only update table version when dropping a non-empty partition.
  3. complete some unfinished work in [enhancement](cloud) add table version to cloud #32738

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@xy720
Copy link
Member Author

xy720 commented Mar 28, 2024

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 37726 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3be22fbd96e64f1b3ef192022d6780548f110031, data reload: false

------ Round 1 ----------------------------------
q1	17608	4254	4103	4103
q2	2120	158	152	152
q3	10637	1233	1227	1227
q4	10696	775	723	723
q5	7724	2972	2946	2946
q6	208	125	127	125
q7	1072	598	576	576
q8	9682	2053	2047	2047
q9	7023	6481	6338	6338
q10	8415	3486	3651	3486
q11	433	222	225	222
q12	430	203	198	198
q13	17787	2882	2853	2853
q14	250	217	214	214
q15	514	458	457	457
q16	486	371	370	370
q17	954	507	578	507
q18	7164	6409	6531	6409
q19	1546	1449	1424	1424
q20	558	255	243	243
q21	3637	2947	2812	2812
q22	343	296	294	294
Total cold run time: 109287 ms
Total hot run time: 37726 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4050	4126	4053	4053
q2	333	236	251	236
q3	3015	2851	2839	2839
q4	1854	1599	1585	1585
q5	5263	5255	5233	5233
q6	195	115	116	115
q7	2193	1843	1844	1843
q8	3178	3365	3277	3277
q9	8478	8480	8439	8439
q10	3807	3779	3730	3730
q11	547	436	431	431
q12	716	534	557	534
q13	10526	2871	2870	2870
q14	280	270	250	250
q15	490	459	458	458
q16	461	423	433	423
q17	1732	1494	1480	1480
q18	7511	7124	7139	7124
q19	1622	1476	1555	1476
q20	1922	1767	1705	1705
q21	4847	4666	4589	4589
q22	546	450	444	444
Total cold run time: 63566 ms
Total hot run time: 53134 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 181798 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3be22fbd96e64f1b3ef192022d6780548f110031, data reload: false

query1	953	360	351	351
query2	6538	1950	1889	1889
query3	6703	206	205	205
query4	31761	21437	21263	21263
query5	4295	402	393	393
query6	268	179	181	179
query7	4626	288	292	288
query8	231	172	177	172
query9	9397	2305	2283	2283
query10	567	243	253	243
query11	15445	14167	14283	14167
query12	141	94	87	87
query13	1629	425	421	421
query14	10250	7436	7403	7403
query15	262	189	182	182
query16	8093	261	262	261
query17	1963	587	551	551
query18	2075	293	281	281
query19	285	158	152	152
query20	96	87	95	87
query21	195	127	129	127
query22	5086	4841	4833	4833
query23	33571	33169	33001	33001
query24	12012	2851	2883	2851
query25	668	399	406	399
query26	1787	165	160	160
query27	2960	334	318	318
query28	7536	1892	1872	1872
query29	1036	644	633	633
query30	303	146	149	146
query31	980	731	746	731
query32	97	63	56	56
query33	771	292	255	255
query34	1030	475	478	475
query35	917	706	694	694
query36	1002	911	916	911
query37	268	63	63	63
query38	3577	3430	3431	3430
query39	1602	1557	1619	1557
query40	294	108	108	108
query41	47	45	47	45
query42	105	99	95	95
query43	476	436	445	436
query44	1203	707	725	707
query45	276	248	269	248
query46	1085	698	682	682
query47	1923	1835	1863	1835
query48	453	367	349	349
query49	1230	325	334	325
query50	761	363	357	357
query51	6727	6731	6648	6648
query52	96	95	93	93
query53	344	272	279	272
query54	310	238	231	231
query55	84	75	84	75
query56	275	231	230	230
query57	1206	1117	1153	1117
query58	232	199	214	199
query59	2805	2663	2546	2546
query60	267	244	240	240
query61	94	96	94	94
query62	647	437	433	433
query63	300	271	283	271
query64	6797	4169	4041	4041
query65	3089	3042	3036	3036
query66	1416	374	361	361
query67	15514	14888	15255	14888
query68	5335	515	521	515
query69	565	384	387	384
query70	1214	1175	1223	1175
query71	435	278	280	278
query72	6289	2683	2510	2510
query73	692	314	324	314
query74	6884	6540	6476	6476
query75	2997	2227	2197	2197
query76	3527	837	896	837
query77	383	269	265	265
query78	10776	10207	10133	10133
query79	8427	526	527	526
query80	1927	406	375	375
query81	520	212	222	212
query82	1459	87	84	84
query83	307	148	143	143
query84	282	83	82	82
query85	1666	323	312	312
query86	488	292	289	289
query87	3738	3588	3543	3543
query88	5291	2306	2306	2306
query89	525	365	378	365
query90	2018	176	177	176
query91	179	140	149	140
query92	60	49	49	49
query93	7058	504	482	482
query94	1201	183	173	173
query95	421	317	302	302
query96	619	272	271	271
query97	2677	2492	2512	2492
query98	245	224	206	206
query99	1212	866	854	854
Total cold run time: 308449 ms
Total hot run time: 181798 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 3be22fbd96e64f1b3ef192022d6780548f110031 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.8 seconds inserted 10000000 Rows, about 724K ops/s

@xy720
Copy link
Member Author

xy720 commented Mar 29, 2024

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38220 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8f2c8e4346360b37fe35e6edc17c8ed791ee66b9, data reload: false

------ Round 1 ----------------------------------
q1	17612	4350	4221	4221
q2	2092	193	180	180
q3	10431	1177	1224	1177
q4	10178	800	799	799
q5	7426	2811	2738	2738
q6	214	131	132	131
q7	1032	613	584	584
q8	9222	2022	2010	2010
q9	7449	6555	6526	6526
q10	8452	3483	3507	3483
q11	462	236	231	231
q12	453	213	206	206
q13	17799	2980	2958	2958
q14	274	231	236	231
q15	515	484	470	470
q16	533	379	377	377
q17	954	614	565	565
q18	7286	6808	6625	6625
q19	3995	1432	1421	1421
q20	694	325	305	305
q21	3346	2673	2825	2673
q22	374	309	315	309
Total cold run time: 110793 ms
Total hot run time: 38220 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4312	4207	4239	4207
q2	390	264	261	261
q3	2991	2669	2694	2669
q4	1888	1477	1569	1477
q5	5293	5233	5241	5233
q6	213	125	128	125
q7	2216	1862	1856	1856
q8	3208	3336	3280	3280
q9	8618	8479	8537	8479
q10	3939	3890	3881	3881
q11	616	505	494	494
q12	815	703	624	624
q13	17997	3283	3212	3212
q14	328	294	282	282
q15	523	459	497	459
q16	508	456	439	439
q17	1809	1486	1470	1470
q18	8016	7904	7897	7897
q19	1686	1546	1501	1501
q20	1976	1800	1875	1800
q21	6948	4892	4994	4892
q22	542	474	481	474
Total cold run time: 74832 ms
Total hot run time: 55012 ms

@xy720
Copy link
Member Author

xy720 commented Mar 29, 2024

run buildall

1 similar comment
@xy720
Copy link
Member Author

xy720 commented Mar 29, 2024

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38706 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d8744eccc94366ff77c8fed25c4fdf9a48fd77c1, data reload: false

------ Round 1 ----------------------------------
q1	17650	4418	4372	4372
q2	2736	213	209	209
q3	11052	1203	1226	1203
q4	10270	841	780	780
q5	7785	2903	2852	2852
q6	223	138	137	137
q7	1066	627	643	627
q8	9249	2044	2019	2019
q9	7368	6598	6547	6547
q10	8501	3492	3500	3492
q11	459	229	242	229
q12	427	223	216	216
q13	18967	2935	2953	2935
q14	279	234	254	234
q15	505	472	471	471
q16	504	387	383	383
q17	964	622	581	581
q18	7347	6828	6599	6599
q19	1816	1476	1429	1429
q20	664	306	314	306
q21	3484	2929	2766	2766
q22	371	320	319	319
Total cold run time: 111687 ms
Total hot run time: 38706 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4246	4163	4189	4163
q2	382	278	275	275
q3	2970	2711	2711	2711
q4	1841	1534	1531	1531
q5	5276	5235	5213	5213
q6	208	123	122	122
q7	2242	1891	1860	1860
q8	3198	3291	3350	3291
q9	8738	8586	8551	8551
q10	3873	3707	3689	3689
q11	576	474	458	458
q12	759	593	574	574
q13	17822	2982	2979	2979
q14	292	282	280	280
q15	506	468	475	468
q16	471	424	421	421
q17	1759	1419	1393	1393
q18	7627	7467	7486	7467
q19	1620	1511	1487	1487
q20	1964	1756	1739	1739
q21	4935	4832	4599	4599
q22	532	460	463	460
Total cold run time: 71837 ms
Total hot run time: 53731 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 182060 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d8744eccc94366ff77c8fed25c4fdf9a48fd77c1, data reload: false

query1	914	1137	1116	1116
query2	7262	1899	1853	1853
query3	6667	214	230	214
query4	33434	21591	21337	21337
query5	4243	402	408	402
query6	233	182	182	182
query7	3992	299	300	299
query8	216	172	178	172
query9	5512	2292	2306	2292
query10	483	235	239	235
query11	14551	14213	14287	14213
query12	140	96	89	89
query13	961	362	364	362
query14	9711	6865	6817	6817
query15	226	185	198	185
query16	6900	273	270	270
query17	1358	576	560	560
query18	1851	291	291	291
query19	214	164	156	156
query20	94	93	90	90
query21	202	131	135	131
query22	4995	4854	4806	4806
query23	33371	32645	32724	32645
query24	12361	2803	2814	2803
query25	646	394	401	394
query26	1902	159	159	159
query27	3252	331	324	324
query28	7337	1880	1848	1848
query29	1003	649	607	607
query30	286	153	152	152
query31	930	725	716	716
query32	67	55	56	55
query33	596	248	242	242
query34	931	472	488	472
query35	872	699	678	678
query36	1043	864	901	864
query37	240	68	69	68
query38	3502	3397	3512	3397
query39	1583	1543	1516	1516
query40	282	126	124	124
query41	50	46	44	44
query42	105	98	98	98
query43	484	465	469	465
query44	1133	734	721	721
query45	276	258	250	250
query46	1067	700	688	688
query47	1926	1821	1843	1821
query48	394	305	297	297
query49	1178	361	370	361
query50	783	396	399	396
query51	6778	6786	6812	6786
query52	105	98	92	92
query53	349	277	284	277
query54	280	243	239	239
query55	86	83	82	82
query56	242	219	220	219
query57	1223	1130	1131	1130
query58	225	205	207	205
query59	2767	2506	2791	2506
query60	254	233	242	233
query61	99	100	101	100
query62	647	443	439	439
query63	307	284	280	280
query64	6693	4166	4157	4157
query65	3161	3083	3056	3056
query66	1451	386	355	355
query67	15307	14955	15101	14955
query68	7794	549	557	549
query69	615	326	325	325
query70	1247	1234	1135	1135
query71	526	280	276	276
query72	6873	2778	2608	2608
query73	783	330	335	330
query74	7184	6365	6382	6365
query75	3380	2309	2321	2309
query76	4215	969	1042	969
query77	607	261	270	261
query78	10831	10252	10117	10117
query79	8315	521	521	521
query80	1457	431	429	429
query81	511	1067	218	218
query82	755	90	89	89
query83	230	173	171	171
query84	264	82	84	82
query85	1086	267	262	262
query86	453	297	293	293
query87	3708	3533	3518	3518
query88	5442	2381	2383	2381
query89	526	374	375	374
query90	1964	174	177	174
query91	128	100	100	100
query92	62	47	47	47
query93	7042	520	508	508
query94	1179	178	188	178
query95	412	304	306	304
query96	606	272	264	264
query97	2710	2479	2499	2479
query98	226	220	216	216
query99	1276	820	864	820
Total cold run time: 304140 ms
Total hot run time: 182060 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.99 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d8744eccc94366ff77c8fed25c4fdf9a48fd77c1, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.04
query3	0.23	0.06	0.06
query4	1.66	0.07	0.08
query5	0.50	0.50	0.49
query6	1.14	0.65	0.65
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.54	0.49	0.51
query10	0.55	0.55	0.54
query11	0.16	0.10	0.11
query12	0.13	0.11	0.11
query13	0.59	0.58	0.57
query14	0.77	0.78	0.78
query15	0.82	0.80	0.81
query16	0.35	0.39	0.37
query17	0.97	0.93	0.97
query18	0.23	0.23	0.24
query19	1.88	1.70	1.64
query20	0.02	0.01	0.01
query21	15.57	0.63	0.63
query22	2.49	3.06	2.34
query23	17.22	1.03	0.79
query24	1.12	0.24	0.20
query25	0.09	0.08	0.09
query26	0.23	0.18	0.17
query27	0.08	0.08	0.07
query28	14.04	0.94	0.93
query29	12.50	3.19	3.20
query30	0.28	0.08	0.07
query31	2.85	0.38	0.37
query32	3.27	0.46	0.46
query33	2.81	2.84	2.83
query34	16.78	4.43	4.36
query35	4.45	4.48	4.50
query36	0.60	0.47	0.46
query37	0.17	0.15	0.16
query38	0.15	0.14	0.14
query39	0.05	0.04	0.03
query40	0.17	0.14	0.16
query41	0.09	0.06	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 105.83 s
Total hot run time: 29.99 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit d8744eccc94366ff77c8fed25c4fdf9a48fd77c1 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.7 seconds inserted 10000000 Rows, about 729K ops/s

@xy720
Copy link
Member Author

xy720 commented Mar 30, 2024

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38036 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 68b00c652489ebbc7ef63325686a604d8e0995f6, data reload: false

------ Round 1 ----------------------------------
q1	17616	4404	4199	4199
q2	2094	190	187	187
q3	10429	1167	1103	1103
q4	10201	743	787	743
q5	7468	2790	2696	2696
q6	222	133	135	133
q7	997	594	592	592
q8	9224	2058	2025	2025
q9	7849	6498	6498	6498
q10	8449	3428	3532	3428
q11	452	253	234	234
q12	476	218	216	216
q13	19045	2969	2950	2950
q14	266	224	231	224
q15	543	478	460	460
q16	502	394	392	392
q17	958	565	536	536
q18	7305	6669	6651	6651
q19	5800	1420	1436	1420
q20	661	310	297	297
q21	3309	2895	2746	2746
q22	358	306	328	306
Total cold run time: 114224 ms
Total hot run time: 38036 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4341	4181	4187	4181
q2	368	275	268	268
q3	2925	2696	2645	2645
q4	1870	1533	1488	1488
q5	5223	5186	5200	5186
q6	210	124	125	124
q7	2222	1821	1843	1821
q8	3175	3265	3279	3265
q9	8464	8478	8432	8432
q10	3973	3836	3869	3836
q11	589	503	517	503
q12	806	648	626	626
q13	18148	3303	3162	3162
q14	337	307	289	289
q15	516	473	482	473
q16	531	479	495	479
q17	1852	1487	1477	1477
q18	8245	8110	7811	7811
q19	1614	1527	1551	1527
q20	2023	1866	1806	1806
q21	7697	4902	4993	4902
q22	524	487	472	472
Total cold run time: 75653 ms
Total hot run time: 54773 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183593 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 68b00c652489ebbc7ef63325686a604d8e0995f6, data reload: false

query1	1252	1118	1113	1113
query2	6199	2087	2011	2011
query3	6658	206	210	206
query4	22785	21295	21452	21295
query5	4127	399	390	390
query6	276	193	166	166
query7	4604	282	288	282
query8	245	165	169	165
query9	8461	2271	2264	2264
query10	405	228	239	228
query11	14904	14322	14216	14216
query12	135	91	87	87
query13	1639	357	369	357
query14	8933	7078	6865	6865
query15	208	177	176	176
query16	7161	268	261	261
query17	1482	594	565	565
query18	1830	288	281	281
query19	208	157	157	157
query20	91	86	86	86
query21	200	133	129	129
query22	5047	4888	4865	4865
query23	33356	33108	32877	32877
query24	12246	3007	2979	2979
query25	618	404	426	404
query26	1234	161	163	161
query27	3169	367	379	367
query28	7158	1877	1877	1877
query29	926	656	648	648
query30	315	165	1067	165
query31	1030	747	768	747
query32	99	55	58	55
query33	732	255	263	255
query34	1293	498	496	496
query35	850	714	743	714
query36	1109	944	918	918
query37	108	71	71	71
query38	3795	3662	3646	3646
query39	1620	1573	1588	1573
query40	182	132	136	132
query41	49	47	51	47
query42	107	104	103	103
query43	475	449	462	449
query44	1207	727	725	725
query45	300	273	279	273
query46	1116	710	718	710
query47	2059	1981	1980	1980
query48	381	307	318	307
query49	901	394	374	374
query50	804	408	413	408
query51	6873	6821	6700	6700
query52	111	92	97	92
query53	380	278	280	278
query54	280	242	227	227
query55	78	77	77	77
query56	244	229	221	221
query57	1224	1168	1182	1168
query58	211	203	207	203
query59	2807	2659	2484	2484
query60	250	225	236	225
query61	93	88	93	88
query62	592	431	433	431
query63	296	275	284	275
query64	5963	4109	4120	4109
query65	3066	3033	3011	3011
query66	836	343	347	343
query67	15703	15080	14931	14931
query68	8856	523	528	523
query69	561	315	311	311
query70	1265	1209	1133	1133
query71	498	266	271	266
query72	6635	2628	2461	2461
query73	1079	326	322	322
query74	7012	6447	6480	6447
query75	3847	2314	2336	2314
query76	5013	886	1014	886
query77	593	242	246	242
query78	11086	10156	10203	10156
query79	12200	508	511	508
query80	2000	418	421	418
query81	507	218	214	214
query82	801	88	88	88
query83	206	167	169	167
query84	265	83	84	83
query85	1401	271	273	271
query86	407	275	293	275
query87	3791	3546	3553	3546
query88	5933	2426	2325	2325
query89	520	374	364	364
query90	1987	177	175	175
query91	122	98	95	95
query92	75	46	45	45
query93	7272	493	496	493
query94	1191	183	177	177
query95	1100	1107	1089	1089
query96	621	269	272	269
query97	2649	2507	2448	2448
query98	244	217	207	207
query99	1167	824	786	786
Total cold run time: 304000 ms
Total hot run time: 183593 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.74 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 68b00c652489ebbc7ef63325686a604d8e0995f6, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.04
query4	1.68	0.07	0.07
query5	0.49	0.52	0.48
query6	1.13	0.67	0.66
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.58	0.50	0.49
query10	0.55	0.56	0.55
query11	0.15	0.09	0.11
query12	0.13	0.11	0.11
query13	0.58	0.57	0.58
query14	0.75	0.77	0.78
query15	0.81	0.80	0.80
query16	0.34	0.38	0.37
query17	1.02	1.01	1.01
query18	0.19	0.28	0.22
query19	1.74	1.63	1.71
query20	0.01	0.00	0.01
query21	15.56	0.65	0.65
query22	2.67	2.87	1.92
query23	17.15	0.97	0.82
query24	1.16	0.24	0.21
query25	0.09	0.08	0.08
query26	0.21	0.17	0.16
query27	0.07	0.07	0.08
query28	14.05	0.93	0.92
query29	12.56	3.28	3.27
query30	0.27	0.08	0.08
query31	2.84	0.37	0.37
query32	3.29	0.46	0.45
query33	2.84	2.84	2.84
query34	16.72	4.42	4.41
query35	4.45	4.53	4.44
query36	0.60	0.46	0.46
query37	0.18	0.15	0.15
query38	0.14	0.13	0.14
query39	0.05	0.04	0.04
query40	0.18	0.15	0.16
query41	0.09	0.04	0.04
query42	0.05	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 105.83 s
Total hot run time: 29.74 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 68b00c652489ebbc7ef63325686a604d8e0995f6 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      33 seconds loaded 861443392 Bytes, about 24 MB/s
Insert into select:       13.8 seconds inserted 10000000 Rows, about 724K ops/s

@xy720 xy720 force-pushed the fix-table-version-regression-test branch from 68b00c6 to 4b13113 Compare March 31, 2024 12:30
@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@xy720
Copy link
Member Author

xy720 commented Mar 31, 2024

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38865 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e340b8a7b1dc40ab9e2bc592f3300442896f7ce3, data reload: false

------ Round 1 ----------------------------------
q1	17944	4245	4204	4204
q2	2534	199	204	199
q3	11394	1286	1467	1286
q4	10350	896	1104	896
q5	7787	2953	2941	2941
q6	217	134	128	128
q7	1009	552	544	544
q8	9402	2057	2049	2049
q9	6770	6244	6178	6178
q10	8415	3529	3499	3499
q11	420	247	235	235
q12	382	219	214	214
q13	17775	2865	2908	2865
q14	274	239	250	239
q15	525	472	475	472
q16	484	385	386	385
q17	952	937	908	908
q18	7330	6529	6405	6405
q19	1594	1546	1538	1538
q20	614	313	329	313
q21	3517	3152	3069	3069
q22	361	298	311	298
Total cold run time: 110050 ms
Total hot run time: 38865 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4041	4066	4037	4037
q2	334	229	221	221
q3	2942	2961	2952	2952
q4	1886	1854	1844	1844
q5	5266	5216	5233	5216
q6	214	122	123	122
q7	1772	1338	1341	1338
q8	3242	3280	3274	3274
q9	8494	8540	8459	8459
q10	3757	3850	3815	3815
q11	537	439	447	439
q12	729	563	538	538
q13	16797	2851	2910	2851
q14	293	268	268	268
q15	529	477	475	475
q16	473	417	417	417
q17	1720	1704	1689	1689
q18	7694	7230	7224	7224
q19	1631	1640	1642	1640
q20	1938	1735	1726	1726
q21	4967	4694	4690	4690
q22	489	439	434	434
Total cold run time: 69745 ms
Total hot run time: 53669 ms

@xy720 xy720 force-pushed the fix-table-version-regression-test branch from 7acec33 to a20c9b1 Compare April 8, 2024 03:06
@xy720
Copy link
Member Author

xy720 commented Apr 8, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38700 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a20c9b1b2f26d815351a658c1d8a9bb959cd08d6, data reload: false

------ Round 1 ----------------------------------
q1	17684	4127	4071	4071
q2	2010	185	178	178
q3	10484	1241	1339	1241
q4	10225	841	942	841
q5	7545	2974	2960	2960
q6	218	131	131	131
q7	1092	622	607	607
q8	9413	1957	2045	1957
q9	6837	6235	6220	6220
q10	8472	3501	3507	3501
q11	420	238	231	231
q12	392	209	206	206
q13	17780	2902	2922	2902
q14	271	229	247	229
q15	523	488	482	482
q16	505	394	376	376
q17	965	936	895	895
q18	7363	6545	6457	6457
q19	1604	1542	1546	1542
q20	567	310	290	290
q21	3521	3105	3086	3086
q22	352	297	319	297
Total cold run time: 108243 ms
Total hot run time: 38700 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4086	4048	4075	4048
q2	325	220	216	216
q3	2970	2942	2931	2931
q4	1892	1876	1813	1813
q5	5242	5207	5256	5207
q6	206	123	121	121
q7	2229	1794	1807	1794
q8	3216	3285	3262	3262
q9	8465	8488	8508	8488
q10	3766	4000	3989	3989
q11	572	459	471	459
q12	773	595	583	583
q13	16572	3088	3103	3088
q14	301	268	266	266
q15	542	473	497	473
q16	499	451	445	445
q17	1789	1765	1752	1752
q18	8354	7697	7684	7684
q19	1750	1690	1695	1690
q20	2017	1822	1817	1817
q21	5235	4910	4960	4910
q22	512	476	440	440
Total cold run time: 71313 ms
Total hot run time: 55476 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183202 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a20c9b1b2f26d815351a658c1d8a9bb959cd08d6, data reload: false

query1	1215	1112	1117	1112
query2	6348	2074	1980	1980
query3	6651	217	206	206
query4	25013	21390	21447	21390
query5	4179	411	411	411
query6	285	194	198	194
query7	4611	298	291	291
query8	238	184	181	181
query9	8480	2241	2229	2229
query10	451	242	251	242
query11	15048	14627	14563	14563
query12	137	92	89	89
query13	1627	377	383	377
query14	8563	6902	6896	6896
query15	220	180	191	180
query16	6882	266	268	266
query17	1005	590	558	558
query18	1858	293	296	293
query19	200	155	160	155
query20	95	91	89	89
query21	200	130	131	130
query22	4943	4846	4779	4779
query23	33496	32785	32752	32752
query24	11617	3280	3135	3135
query25	715	396	410	396
query26	1939	164	168	164
query27	3265	369	386	369
query28	7316	1912	1876	1876
query29	1290	623	618	618
query30	297	173	186	173
query31	991	733	763	733
query32	95	57	55	55
query33	652	245	254	245
query34	1164	495	528	495
query35	851	729	746	729
query36	989	876	889	876
query37	277	76	72	72
query38	3594	3664	3627	3627
query39	1636	1601	1574	1574
query40	230	136	129	129
query41	46	43	45	43
query42	110	105	102	102
query43	496	447	423	423
query44	1145	727	743	727
query45	283	279	268	268
query46	1132	835	819	819
query47	1973	1863	1895	1863
query48	386	309	306	306
query49	955	368	378	368
query50	851	412	414	412
query51	6927	6829	6757	6757
query52	101	105	96	96
query53	366	287	292	287
query54	288	259	260	259
query55	87	75	86	75
query56	255	243	241	241
query57	1271	1188	1174	1174
query58	252	223	232	223
query59	2771	2724	2416	2416
query60	261	245	245	245
query61	114	109	108	108
query62	679	443	462	443
query63	308	285	292	285
query64	5837	3235	3209	3209
query65	3043	3007	3017	3007
query66	1319	314	321	314
query67	15753	14873	14803	14803
query68	8815	570	577	570
query69	552	311	325	311
query70	1316	1131	1148	1131
query71	543	277	269	269
query72	6255	2579	2403	2403
query73	794	315	321	315
query74	6769	6350	6364	6350
query75	3812	2286	2283	2283
query76	6123	1178	1233	1178
query77	726	251	256	251
query78	10959	10222	10062	10062
query79	10505	530	533	530
query80	1422	438	427	427
query81	483	241	232	232
query82	398	97	100	97
query83	214	164	171	164
query84	262	88	88	88
query85	983	285	292	285
query86	363	281	304	281
query87	3620	3499	3491	3491
query88	4007	2272	2273	2272
query89	535	376	369	369
query90	2130	178	181	178
query91	134	105	103	103
query92	61	50	55	50
query93	6684	527	523	523
query94	1269	182	180	180
query95	1099	1102	1101	1101
query96	619	275	276	275
query97	2646	2497	2485	2485
query98	238	213	218	213
query99	1186	833	865	833
Total cold run time: 301194 ms
Total hot run time: 183202 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.5 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a20c9b1b2f26d815351a658c1d8a9bb959cd08d6, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.68	0.06	0.07
query5	0.48	0.47	0.48
query6	1.14	0.66	0.65
query7	0.01	0.01	0.01
query8	0.05	0.04	0.04
query9	0.57	0.53	0.52
query10	0.57	0.57	0.57
query11	0.16	0.12	0.12
query12	0.15	0.12	0.12
query13	0.61	0.60	0.61
query14	0.78	0.80	0.81
query15	0.85	0.85	0.83
query16	0.35	0.36	0.35
query17	0.99	0.98	0.96
query18	0.26	0.25	0.25
query19	1.84	1.70	1.79
query20	0.01	0.00	0.00
query21	15.43	0.64	0.66
query22	3.80	8.24	1.20
query23	17.88	1.31	1.23
query24	1.59	0.19	0.20
query25	0.15	0.08	0.08
query26	0.27	0.16	0.16
query27	0.07	0.08	0.08
query28	13.87	0.97	0.94
query29	12.57	3.30	3.25
query30	0.26	0.06	0.06
query31	2.91	0.40	0.39
query32	3.27	0.48	0.48
query33	2.82	2.91	2.87
query34	15.52	4.33	4.34
query35	4.39	4.37	4.35
query36	0.69	0.47	0.48
query37	0.18	0.17	0.16
query38	0.16	0.14	0.14
query39	0.05	0.03	0.03
query40	0.20	0.15	0.15
query41	0.10	0.05	0.05
query42	0.06	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 107.13 s
Total hot run time: 29.5 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a20c9b1b2f26d815351a658c1d8a9bb959cd08d6 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       15.5 seconds inserted 10000000 Rows, about 645K ops/s

@xy720
Copy link
Member Author

xy720 commented Apr 8, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38442 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 41adcae268db8ccb38287be1dbbda8d52e405d15, data reload: false

------ Round 1 ----------------------------------
q1	17631	4289	4241	4241
q2	2004	186	180	180
q3	10473	1131	1220	1131
q4	10189	826	781	781
q5	7493	2685	2676	2676
q6	219	131	134	131
q7	1008	598	585	585
q8	9222	2062	2024	2024
q9	7923	6533	6517	6517
q10	8616	3562	3518	3518
q11	472	231	234	231
q12	420	221	217	217
q13	17790	2946	2907	2907
q14	280	232	236	232
q15	520	465	479	465
q16	507	386	387	386
q17	960	640	651	640
q18	7322	6697	6742	6697
q19	7730	1517	1510	1510
q20	691	315	306	306
q21	3354	2763	2825	2763
q22	357	304	312	304
Total cold run time: 115181 ms
Total hot run time: 38442 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4441	4204	4213	4204
q2	360	270	251	251
q3	2966	2726	2692	2692
q4	1852	1591	1543	1543
q5	5280	5287	5291	5287
q6	231	126	123	123
q7	2264	1856	1870	1856
q8	3181	3322	3334	3322
q9	8581	8665	8662	8662
q10	4050	3894	3897	3894
q11	615	508	491	491
q12	777	614	638	614
q13	16386	3260	3203	3203
q14	320	294	280	280
q15	510	463	503	463
q16	488	428	424	424
q17	1825	1540	1533	1533
q18	8044	7997	7734	7734
q19	1711	1540	1582	1540
q20	1961	1838	1867	1838
q21	5163	4882	4975	4882
q22	566	486	467	467
Total cold run time: 71572 ms
Total hot run time: 55303 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 182938 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 41adcae268db8ccb38287be1dbbda8d52e405d15, data reload: false

query1	1228	1117	1101	1101
query2	7024	2112	1907	1907
query3	6644	204	199	199
query4	37008	21730	21291	21291
query5	4124	401	412	401
query6	239	186	179	179
query7	4049	291	285	285
query8	226	174	191	174
query9	5781	2284	2287	2284
query10	366	252	259	252
query11	14718	14334	14115	14115
query12	136	92	86	86
query13	984	360	376	360
query14	8523	7002	6892	6892
query15	205	170	184	170
query16	7356	262	260	260
query17	1734	580	560	560
query18	1672	285	288	285
query19	199	154	158	154
query20	95	91	89	89
query21	201	134	131	131
query22	4932	4843	4837	4837
query23	33670	32948	33128	32948
query24	7871	3078	2997	2997
query25	501	378	389	378
query26	723	158	152	152
query27	2871	366	357	357
query28	6052	1968	1945	1945
query29	863	605	601	601
query30	308	172	177	172
query31	943	791	743	743
query32	60	52	50	50
query33	481	248	245	245
query34	907	477	505	477
query35	802	722	715	715
query36	1040	930	930	930
query37	112	71	76	71
query38	3721	3642	3684	3642
query39	1643	1574	1586	1574
query40	200	137	133	133
query41	49	46	46	46
query42	114	102	105	102
query43	527	469	467	467
query44	1168	750	734	734
query45	284	270	268	268
query46	1095	753	756	753
query47	2038	1951	1925	1925
query48	381	293	294	293
query49	927	386	393	386
query50	794	393	396	393
query51	6914	6829	6828	6828
query52	105	99	91	91
query53	359	286	286	286
query54	266	235	252	235
query55	80	72	77	72
query56	257	234	248	234
query57	1259	1155	1207	1155
query58	235	218	220	218
query59	3118	2950	2762	2762
query60	253	243	234	234
query61	112	105	104	104
query62	569	445	454	445
query63	309	278	282	278
query64	3960	3905	3716	3716
query65	3141	3054	3048	3048
query66	731	321	310	310
query67	15842	15093	15064	15064
query68	10514	537	561	537
query69	613	315	297	297
query70	1288	1180	1153	1153
query71	512	268	266	266
query72	6591	2609	2434	2434
query73	1819	316	315	315
query74	7785	6395	6445	6395
query75	3637	2304	2259	2259
query76	6496	1151	1141	1141
query77	626	242	243	242
query78	11070	10156	10071	10071
query79	12030	532	513	513
query80	2717	413	416	413
query81	575	232	229	229
query82	630	94	92	92
query83	204	165	164	164
query84	266	81	81	81
query85	1290	260	257	257
query86	394	290	287	287
query87	3682	3567	3496	3496
query88	5682	2270	2284	2270
query89	531	371	402	371
query90	2306	180	174	174
query91	124	90	92	90
query92	67	45	44	44
query93	6774	500	491	491
query94	1510	173	178	173
query95	410	313	311	311
query96	622	264	257	257
query97	2666	2510	2488	2488
query98	235	214	215	214
query99	1146	843	824	824
Total cold run time: 309911 ms
Total hot run time: 182938 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.06 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 41adcae268db8ccb38287be1dbbda8d52e405d15, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.66	0.07	0.08
query5	0.50	0.50	0.48
query6	1.13	0.65	0.66
query7	0.02	0.01	0.01
query8	0.05	0.03	0.04
query9	0.56	0.49	0.50
query10	0.55	0.55	0.54
query11	0.15	0.11	0.12
query12	0.14	0.12	0.12
query13	0.60	0.58	0.57
query14	0.76	0.76	0.77
query15	0.82	0.80	0.81
query16	0.36	0.38	0.36
query17	0.97	0.95	1.00
query18	0.22	0.25	0.23
query19	1.87	1.69	1.80
query20	0.01	0.01	0.02
query21	15.41	0.64	0.65
query22	3.59	8.32	1.98
query23	18.29	1.20	1.21
query24	1.83	0.28	0.21
query25	0.15	0.09	0.08
query26	0.26	0.16	0.16
query27	0.09	0.08	0.08
query28	13.32	0.99	0.97
query29	12.65	3.32	3.27
query30	0.26	0.06	0.06
query31	2.87	0.37	0.36
query32	3.33	0.45	0.44
query33	2.83	2.79	2.76
query34	17.08	4.41	4.43
query35	4.46	4.43	4.52
query36	0.64	0.46	0.45
query37	0.19	0.16	0.15
query38	0.14	0.15	0.14
query39	0.05	0.04	0.03
query40	0.17	0.14	0.13
query41	0.10	0.04	0.04
query42	0.06	0.05	0.05
query43	0.05	0.03	0.04
Total cold run time: 108.53 s
Total hot run time: 30.06 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 41adcae268db8ccb38287be1dbbda8d52e405d15 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       13.5 seconds inserted 10000000 Rows, about 740K ops/s

@xy720
Copy link
Member Author

xy720 commented Apr 8, 2024

run buildall

@github-actions
Copy link
Contributor

github-actions bot commented Apr 8, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 39651 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e16c82991cfe1682ad4e77d197b5fd04c6197dce, data reload: false

------ Round 1 ----------------------------------
q1	17614	4351	4239	4239
q2	2019	187	191	187
q3	10787	1233	1245	1233
q4	10524	822	801	801
q5	7640	2774	2750	2750
q6	228	133	133	133
q7	1043	641	612	612
q8	9433	2131	2057	2057
q9	8811	7307	7270	7270
q10	8807	3557	3486	3486
q11	464	233	240	233
q12	471	219	217	217
q13	18901	2933	2931	2931
q14	265	229	227	227
q15	520	495	483	483
q16	517	402	381	381
q17	959	719	739	719
q18	7374	6757	6786	6757
q19	1606	1511	1538	1511
q20	700	319	302	302
q21	3293	2823	2839	2823
q22	370	299	303	299
Total cold run time: 112346 ms
Total hot run time: 39651 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4328	4234	4232	4232
q2	381	269	258	258
q3	2963	2750	2757	2750
q4	1877	1626	1594	1594
q5	5323	5341	5330	5330
q6	215	126	124	124
q7	2288	1841	1921	1841
q8	3223	3322	3356	3322
q9	9381	9275	9318	9275
q10	3865	3692	3722	3692
q11	600	490	482	482
q12	757	594	596	594
q13	15024	2938	2912	2912
q14	299	282	275	275
q15	517	472	481	472
q16	468	415	431	415
q17	1786	1483	1526	1483
q18	7343	7431	7430	7430
q19	1638	1557	1482	1482
q20	1991	1801	1732	1732
q21	4999	4727	4751	4727
q22	526	466	473	466
Total cold run time: 69792 ms
Total hot run time: 54888 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 180305 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e16c82991cfe1682ad4e77d197b5fd04c6197dce, data reload: false

query1	895	369	1124	369
query2	6600	2092	1920	1920
query3	6654	201	208	201
query4	37820	21678	21271	21271
query5	4138	404	395	395
query6	229	182	182	182
query7	4052	294	284	284
query8	225	175	174	174
query9	5748	2296	2284	2284
query10	513	248	244	244
query11	14656	14192	14228	14192
query12	143	97	90	90
query13	985	362	355	355
query14	8954	6801	6777	6777
query15	206	180	182	180
query16	7180	257	263	257
query17	1662	581	554	554
query18	1516	281	277	277
query19	207	151	152	151
query20	96	88	92	88
query21	196	129	128	128
query22	4956	4760	4799	4760
query23	33634	32850	32815	32815
query24	12689	2926	2937	2926
query25	563	374	403	374
query26	1858	153	155	153
query27	3070	312	324	312
query28	7564	1888	1873	1873
query29	864	609	598	598
query30	308	164	160	160
query31	920	722	709	709
query32	60	56	56	56
query33	600	251	261	251
query34	872	479	490	479
query35	855	677	684	677
query36	1030	923	885	885
query37	283	73	74	73
query38	3510	3394	3424	3394
query39	1593	1543	1524	1524
query40	282	124	124	124
query41	55	46	46	46
query42	108	99	94	94
query43	504	452	466	452
query44	1368	709	712	709
query45	283	256	268	256
query46	1068	716	716	716
query47	1916	1843	1838	1838
query48	358	286	285	285
query49	1155	364	361	361
query50	754	380	387	380
query51	6673	6544	6638	6544
query52	104	100	96	96
query53	353	279	283	279
query54	264	233	233	233
query55	76	74	71	71
query56	246	229	220	220
query57	1217	1147	1129	1129
query58	230	205	204	204
query59	2885	2666	2605	2605
query60	266	237	236	236
query61	114	111	108	108
query62	654	434	441	434
query63	313	277	281	277
query64	5171	4091	3971	3971
query65	3102	3005	3046	3005
query66	1367	329	336	329
query67	15785	14924	14771	14771
query68	8426	529	534	529
query69	596	307	298	298
query70	1282	1167	1136	1136
query71	541	267	264	264
query72	6796	2596	2422	2422
query73	955	316	311	311
query74	7085	6312	6482	6312
query75	3580	2335	2282	2282
query76	5044	1179	1065	1065
query77	645	237	240	237
query78	10995	10123	10111	10111
query79	11923	501	507	501
query80	2366	412	401	401
query81	536	232	230	230
query82	629	93	93	93
query83	203	162	160	160
query84	264	82	82	82
query85	1135	279	273	273
query86	357	283	291	283
query87	3733	3499	3545	3499
query88	5682	2255	2271	2255
query89	518	370	366	366
query90	2071	174	176	174
query91	118	93	91	91
query92	56	49	47	47
query93	6140	508	494	494
query94	1254	175	174	174
query95	392	303	306	303
query96	605	256	257	256
query97	2703	2489	2445	2445
query98	233	234	207	207
query99	1154	876	839	839
Total cold run time: 312592 ms
Total hot run time: 180305 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.45 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e16c82991cfe1682ad4e77d197b5fd04c6197dce, data reload: false

query1	0.04	0.03	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.08	0.08
query5	0.49	0.49	0.50
query6	1.13	0.65	0.65
query7	0.02	0.02	0.01
query8	0.05	0.04	0.05
query9	0.54	0.49	0.49
query10	0.53	0.56	0.53
query11	0.16	0.11	0.10
query12	0.15	0.12	0.12
query13	0.58	0.58	0.58
query14	0.76	0.78	0.78
query15	0.82	0.79	0.81
query16	0.37	0.36	0.35
query17	1.03	0.94	0.97
query18	0.23	0.24	0.22
query19	1.76	1.67	1.73
query20	0.02	0.01	0.01
query21	15.45	0.65	0.64
query22	4.04	5.73	2.39
query23	18.25	1.32	1.11
query24	1.60	0.32	0.21
query25	0.14	0.08	0.07
query26	0.26	0.15	0.16
query27	0.08	0.08	0.08
query28	13.37	0.99	0.98
query29	12.62	3.31	3.31
query30	0.25	0.06	0.05
query31	2.88	0.38	0.37
query32	3.29	0.45	0.46
query33	2.80	2.80	2.81
query34	17.09	4.42	4.39
query35	4.48	4.46	4.48
query36	0.65	0.46	0.47
query37	0.19	0.14	0.15
query38	0.14	0.14	0.15
query39	0.05	0.03	0.04
query40	0.17	0.14	0.14
query41	0.08	0.04	0.04
query42	0.05	0.04	0.05
query43	0.04	0.04	0.03
Total cold run time: 108.63 s
Total hot run time: 30.45 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit e16c82991cfe1682ad4e77d197b5fd04c6197dce with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       13.5 seconds inserted 10000000 Rows, about 740K ops/s

@xy720
Copy link
Member Author

xy720 commented Apr 8, 2024

run feut

Copy link
Contributor

@cambyzju cambyzju left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 9, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Apr 9, 2024

PR approved by at least one committer and no changes requested.

@xy720 xy720 merged commit 633349b into apache:master Apr 9, 2024
seawinde pushed a commit to seawinde/doris that referenced this pull request Apr 10, 2024
…partition (apache#32989)

1.fix regression test test-table-version.
2.when dropping partition, only update table version when dropping a non-empty partition.
3.complete some unfinished work in apache#32738
xy720 added a commit that referenced this pull request Apr 11, 2024
dataroaring pushed a commit that referenced this pull request Apr 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. meta-change reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants