Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](funcs) map struct construct funcs #39699 #40502

Merged

Conversation

xiaokang
Copy link
Contributor

@xiaokang xiaokang commented Sep 7, 2024

cherry pick from #39699

we should not change the column which is passed from a block when we
execute a function , because this block may be used in other expression
or other exec node
@xiaokang
Copy link
Contributor Author

xiaokang commented Sep 7, 2024

run buildall

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

Status execute_impl(FunctionContext* context, Block& block, const ColumnNumbers& arguments,
size_t result, size_t input_rows_count) override = 0;
/// Notice: We should not change the column in the block, because the column may be shared by multiple expressions or exec nodes.
virtual Status execute_impl(FunctionContext* context, Block& block,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: 'virtual' is redundant since the function is already declared 'override' [modernize-use-override]

Suggested change
virtual Status execute_impl(FunctionContext* context, Block& block,
Status execute_impl(FunctionContext* context, Block& block,

@xiaokang
Copy link
Contributor Author

xiaokang commented Sep 7, 2024

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.85% (8137/21498)
Line Coverage: 29.60% (66987/226336)
Region Coverage: 29.09% (34566/118837)
Branch Coverage: 24.99% (17811/71268)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0b419aa9e16aa65f84da94fab7552cadcaba0120_0b419aa9e16aa65f84da94fab7552cadcaba0120/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 49109 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0b419aa9e16aa65f84da94fab7552cadcaba0120, data reload: false

------ Round 1 ----------------------------------
q1	17738	5895	4402	4402
q2	2088	154	152	152
q3	10446	1890	1955	1890
q4	10227	1255	1330	1255
q5	8508	3949	3876	3876
q6	236	127	124	124
q7	2064	1618	1609	1609
q8	9329	2770	2719	2719
q9	10341	9948	9683	9683
q10	8668	3566	3519	3519
q11	426	249	245	245
q12	477	300	304	300
q13	18354	3974	4005	3974
q14	361	320	327	320
q15	510	456	455	455
q16	540	458	448	448
q17	1139	980	964	964
q18	7300	6958	6898	6898
q19	1708	1579	1502	1502
q20	516	306	306	306
q21	4401	4176	4083	4083
q22	483	395	385	385
Total cold run time: 115860 ms
Total hot run time: 49109 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4315	4324	4315	4315
q2	323	226	219	219
q3	4195	4122	4186	4122
q4	2757	2737	2756	2737
q5	7168	7143	7117	7117
q6	236	118	121	118
q7	3208	2758	2820	2758
q8	4354	4440	4455	4440
q9	13755	13527	13665	13527
q10	4230	4268	4232	4232
q11	742	695	697	695
q12	1012	838	860	838
q13	7456	3708	3770	3708
q14	461	418	419	418
q15	501	449	455	449
q16	635	611	586	586
q17	3803	3825	3761	3761
q18	9095	8722	8735	8722
q19	1722	1674	1666	1666
q20	2373	2102	2096	2096
q21	8423	8427	8468	8427
q22	1060	958	915	915
Total cold run time: 81824 ms
Total hot run time: 75866 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 211885 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0b419aa9e16aa65f84da94fab7552cadcaba0120, data reload: false

query1	946	392	408	392
query2	6539	2287	2157	2157
query3	6921	206	204	204
query4	23407	21560	21609	21560
query5	19737	6544	6469	6469
query6	278	217	239	217
query7	4151	303	315	303
query8	277	256	269	256
query9	3118	2676	2596	2596
query10	422	307	316	307
query11	15640	15173	15126	15126
query12	121	79	77	77
query13	1025	443	443	443
query14	17767	13108	13401	13108
query15	375	220	225	220
query16	6475	279	256	256
query17	1786	948	915	915
query18	883	330	315	315
query19	216	154	155	154
query20	82	77	76	76
query21	192	96	94	94
query22	5205	5018	4948	4948
query23	34314	33544	33412	33412
query24	7806	6361	6402	6361
query25	525	451	422	422
query26	1267	166	163	163
query27	2495	302	295	295
query28	6083	2268	2223	2223
query29	2875	2854	2830	2830
query30	248	167	165	165
query31	958	731	772	731
query32	71	63	60	60
query33	453	270	267	267
query34	867	491	474	474
query35	1112	914	909	909
query36	1350	1167	1251	1167
query37	174	58	61	58
query38	3037	2914	2877	2877
query39	1383	1333	1336	1333
query40	314	98	96	96
query41	38	37	38	37
query42	83	92	82	82
query43	684	618	556	556
query44	1164	730	726	726
query45	253	229	231	229
query46	1218	952	962	952
query47	1962	1860	1627	1627
query48	519	417	418	417
query49	663	385	372	372
query50	874	618	623	618
query51	4813	4717	4642	4642
query52	92	81	82	81
query53	233	187	192	187
query54	2663	2474	2446	2446
query55	96	81	88	81
query56	241	200	210	200
query57	1366	1097	1101	1097
query58	219	209	223	209
query59	3451	3586	3350	3350
query60	220	213	212	212
query61	98	97	96	96
query62	863	467	481	467
query63	201	186	178	178
query64	3519	1586	1385	1385
query65	3605	3547	3523	3523
query66	772	447	422	422
query67	16831	17877	15109	15109
query68	9771	656	662	656
query69	506	271	277	271
query70	1757	1589	1417	1417
query71	409	322	323	322
query72	6738	4611	4814	4611
query73	795	323	317	317
query74	6324	5820	5827	5820
query75	5262	3808	3663	3663
query76	5558	1112	1228	1112
query77	962	261	270	261
query78	12550	11991	11555	11555
query79	8167	649	670	649
query80	1456	381	392	381
query81	493	239	246	239
query82	1640	97	94	94
query83	166	144	132	132
query84	255	72	68	68
query85	891	317	325	317
query86	334	298	293	293
query87	3274	3034	2957	2957
query88	4644	2329	2301	2301
query89	514	304	306	304
query90	1981	220	215	215
query91	158	125	134	125
query92	62	50	55	50
query93	6542	583	601	583
query94	706	206	205	205
query95	1985	1879	1953	1879
query96	641	328	327	327
query97	6347	6360	6373	6360
query98	227	217	226	217
query99	2921	881	847	847
Total cold run time: 321672 ms
Total hot run time: 211885 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.22 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0b419aa9e16aa65f84da94fab7552cadcaba0120, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.04
query4	1.80	0.06	0.06
query5	0.53	0.52	0.52
query6	1.28	0.61	0.61
query7	0.01	0.02	0.01
query8	0.03	0.02	0.03
query9	0.53	0.49	0.48
query10	0.55	0.54	0.54
query11	0.12	0.08	0.08
query12	0.12	0.09	0.09
query13	0.61	0.61	0.61
query14	0.80	0.80	0.80
query15	0.77	0.76	0.75
query16	0.37	0.37	0.36
query17	1.01	1.00	0.96
query18	0.24	0.25	0.23
query19	1.91	1.86	1.81
query20	0.01	0.02	0.01
query21	15.45	0.54	0.58
query22	2.36	2.65	1.51
query23	16.84	0.89	0.97
query24	4.48	0.77	0.90
query25	0.30	0.09	0.04
query26	0.57	0.16	0.17
query27	0.04	0.03	0.03
query28	9.14	0.74	0.71
query29	12.68	2.19	2.24
query30	0.56	0.54	0.54
query31	2.81	0.39	0.37
query32	3.38	0.50	0.50
query33	3.08	3.08	3.04
query34	15.28	4.78	4.79
query35	4.87	4.85	4.87
query36	1.04	1.02	1.02
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.15	0.14
query41	0.07	0.02	0.02
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 104.31 s
Total hot run time: 30.22 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 0b419aa9e16aa65f84da94fab7552cadcaba0120 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.6 seconds inserted 10000000 Rows, about 462K ops/s

@xiaokang
Copy link
Contributor Author

xiaokang commented Sep 8, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 48858 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 19b2e187188d030716e84dc171a67b93d6ef6124, data reload: false

------ Round 1 ----------------------------------
q1	17788	4401	4334	4334
q2	2065	150	141	141
q3	10452	1905	1928	1905
q4	10286	1271	1299	1271
q5	8390	3884	3848	3848
q6	230	126	122	122
q7	2039	1587	1613	1587
q8	9282	2714	2691	2691
q9	10086	9732	9815	9732
q10	8679	3567	3553	3553
q11	420	240	233	233
q12	474	294	303	294
q13	18326	3924	4018	3924
q14	364	331	329	329
q15	506	451	450	450
q16	542	457	451	451
q17	1131	964	932	932
q18	7230	6995	6806	6806
q19	1681	1562	1476	1476
q20	561	324	304	304
q21	4363	4147	4090	4090
q22	481	392	385	385
Total cold run time: 115376 ms
Total hot run time: 48858 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4361	4355	4271	4271
q2	328	224	222	222
q3	4131	4106	4110	4106
q4	2735	2729	2738	2729
q5	7148	7046	7103	7046
q6	234	118	118	118
q7	3228	2824	2860	2824
q8	4308	4417	4529	4417
q9	13658	13735	13424	13424
q10	4224	4254	4276	4254
q11	776	663	679	663
q12	1011	851	841	841
q13	7091	3739	3752	3739
q14	452	425	429	425
q15	513	465	455	455
q16	638	613	577	577
q17	3810	3838	3836	3836
q18	8643	8742	8667	8667
q19	1723	1715	1639	1639
q20	2397	2106	2108	2106
q21	8400	8477	8396	8396
q22	1059	953	949	949
Total cold run time: 80868 ms
Total hot run time: 75704 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.85% (8137/21498)
Line Coverage: 29.59% (66984/226336)
Region Coverage: 29.08% (34561/118835)
Branch Coverage: 24.99% (17809/71266)
Coverage Report: http://coverage.selectdb-in.cc/coverage/19b2e187188d030716e84dc171a67b93d6ef6124_19b2e187188d030716e84dc171a67b93d6ef6124/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 213090 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 19b2e187188d030716e84dc171a67b93d6ef6124, data reload: false

query1	917	386	413	386
query2	6550	2175	2185	2175
query3	6924	202	205	202
query4	23626	21645	21552	21552
query5	19989	6545	6404	6404
query6	306	220	241	220
query7	4337	314	301	301
query8	249	296	261	261
query9	3059	2651	2562	2562
query10	455	298	287	287
query11	15576	15523	15351	15351
query12	131	72	74	72
query13	1030	437	433	433
query14	18522	13367	13445	13367
query15	372	225	229	225
query16	6597	293	262	262
query17	2522	964	947	947
query18	915	331	321	321
query19	215	163	159	159
query20	97	80	78	78
query21	189	100	93	93
query22	5854	5478	5518	5478
query23	34460	33510	33305	33305
query24	7765	6296	6296	6296
query25	508	430	421	421
query26	1272	158	157	157
query27	2337	296	301	296
query28	6079	2262	2210	2210
query29	2898	2671	2823	2671
query30	240	172	168	168
query31	982	734	729	729
query32	66	60	59	59
query33	454	259	258	258
query34	860	460	473	460
query35	1101	899	934	899
query36	1213	1175	1227	1175
query37	175	59	58	58
query38	3068	2901	2910	2901
query39	1376	1333	1347	1333
query40	302	92	94	92
query41	38	44	36	36
query42	89	91	86	86
query43	638	578	591	578
query44	1161	710	714	710
query45	239	237	229	229
query46	1217	965	956	956
query47	1944	1741	1729	1729
query48	495	411	407	407
query49	664	375	381	375
query50	879	583	587	583
query51	4727	4654	4659	4654
query52	84	81	78	78
query53	237	192	179	179
query54	2632	2489	2429	2429
query55	83	81	83	81
query56	224	211	201	201
query57	1336	1137	1179	1137
query58	222	230	225	225
query59	3678	3360	3409	3360
query60	211	213	201	201
query61	98	94	100	94
query62	877	474	467	467
query63	199	173	173	173
query64	3456	1595	1401	1401
query65	3640	3545	3541	3541
query66	762	442	413	413
query67	16284	15324	15561	15324
query68	10433	652	659	652
query69	508	284	278	278
query70	1841	1625	1722	1625
query71	422	321	313	313
query72	6835	4934	4934	4934
query73	781	313	322	313
query74	6289	5831	5760	5760
query75	5452	3594	3621	3594
query76	5932	1171	1174	1171
query77	1013	257	278	257
query78	12644	11408	12368	11408
query79	8423	625	657	625
query80	1116	399	387	387
query81	491	244	237	237
query82	1426	97	98	97
query83	163	133	133	133
query84	254	70	68	68
query85	890	321	313	313
query86	332	296	324	296
query87	3233	2994	3101	2994
query88	4427	2321	2315	2315
query89	518	285	276	276
query90	2085	212	215	212
query91	161	132	121	121
query92	59	52	50	50
query93	6099	561	550	550
query94	753	213	205	205
query95	1983	2009	1947	1947
query96	662	332	328	328
query97	6539	6343	6480	6343
query98	216	206	204	204
query99	2853	817	813	813
Total cold run time: 324535 ms
Total hot run time: 213090 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.11 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 19b2e187188d030716e84dc171a67b93d6ef6124, data reload: false

query1	0.03	0.03	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.05
query4	1.80	0.07	0.07
query5	0.54	0.52	0.52
query6	1.23	0.63	0.62
query7	0.02	0.01	0.01
query8	0.04	0.03	0.02
query9	0.51	0.48	0.48
query10	0.56	0.53	0.53
query11	0.12	0.08	0.08
query12	0.11	0.09	0.09
query13	0.62	0.61	0.62
query14	0.78	0.78	0.79
query15	0.77	0.75	0.75
query16	0.36	0.39	0.38
query17	1.00	1.01	1.01
query18	0.24	0.23	0.24
query19	1.94	1.86	1.80
query20	0.01	0.01	0.01
query21	15.49	0.55	0.58
query22	1.90	2.02	1.86
query23	17.33	0.98	1.01
query24	7.11	1.08	1.10
query25	0.35	0.14	0.04
query26	0.78	0.17	0.16
query27	0.04	0.04	0.04
query28	5.87	0.72	0.74
query29	12.66	2.27	2.33
query30	0.62	0.52	0.55
query31	2.82	0.38	0.36
query32	3.41	0.49	0.50
query33	3.04	3.05	3.06
query34	15.23	4.82	4.79
query35	4.88	4.86	4.85
query36	1.04	1.01	1.02
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.02	0.02
query40	0.16	0.14	0.15
query41	0.06	0.01	0.01
query42	0.02	0.02	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.95 s
Total hot run time: 31.11 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 19b2e187188d030716e84dc171a67b93d6ef6124 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

@xiaokang
Copy link
Contributor Author

xiaokang commented Sep 9, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49279 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bfa788f3188ac13edb8e02bf9c082391d801815b, data reload: false

------ Round 1 ----------------------------------
q1	18113	4480	4333	4333
q2	2068	153	150	150
q3	10432	1877	1876	1876
q4	10336	1237	1305	1237
q5	8548	3909	3908	3908
q6	233	123	123	123
q7	2011	1632	1605	1605
q8	9318	2715	2699	2699
q9	10277	9856	9927	9856
q10	8651	3545	3491	3491
q11	422	237	250	237
q12	480	300	295	295
q13	18363	4032	4013	4013
q14	356	318	320	318
q15	507	464	454	454
q16	546	453	458	453
q17	1137	952	986	952
q18	7327	6971	6974	6971
q19	1696	1544	1546	1544
q20	549	324	303	303
q21	4414	4137	4067	4067
q22	505	394	395	394
Total cold run time: 116289 ms
Total hot run time: 49279 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4333	4280	4273	4273
q2	314	228	223	223
q3	4192	4134	4163	4134
q4	2751	2758	2762	2758
q5	7131	7100	7072	7072
q6	235	118	117	117
q7	3288	2857	2777	2777
q8	4322	4460	4483	4460
q9	13648	13664	13789	13664
q10	4250	4264	4268	4264
q11	748	680	685	680
q12	1032	847	862	847
q13	6500	3714	3744	3714
q14	453	428	416	416
q15	502	472	463	463
q16	630	597	610	597
q17	3860	3870	3830	3830
q18	8723	8649	8727	8649
q19	1715	1651	1664	1651
q20	2370	2142	2094	2094
q21	8596	8404	8495	8404
q22	1001	918	919	918
Total cold run time: 80594 ms
Total hot run time: 76005 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 214588 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bfa788f3188ac13edb8e02bf9c082391d801815b, data reload: false

query1	906	417	382	382
query2	6544	2285	2207	2207
query3	6923	204	206	204
query4	23275	21479	21628	21479
query5	19736	6577	6546	6546
query6	273	223	226	223
query7	4336	315	312	312
query8	248	261	243	243
query9	3134	2692	2632	2632
query10	468	313	309	309
query11	15517	15240	14977	14977
query12	124	82	71	71
query13	1023	456	437	437
query14	17280	13607	13798	13607
query15	376	221	228	221
query16	6470	274	260	260
query17	1778	951	935	935
query18	892	308	307	307
query19	218	154	142	142
query20	81	77	80	77
query21	193	98	94	94
query22	5182	5065	5002	5002
query23	34372	33664	33464	33464
query24	7886	6269	6282	6269
query25	519	435	433	433
query26	1267	171	166	166
query27	2416	296	296	296
query28	6090	2267	2257	2257
query29	2867	2864	2793	2793
query30	244	171	169	169
query31	924	772	801	772
query32	67	66	57	57
query33	454	269	263	263
query34	875	488	460	460
query35	1142	883	962	883
query36	1527	1098	1312	1098
query37	170	58	61	58
query38	3043	2992	2946	2946
query39	1404	1360	1312	1312
query40	304	94	94	94
query41	40	37	37	37
query42	92	85	82	82
query43	637	572	585	572
query44	1156	729	732	729
query45	242	233	233	233
query46	1242	958	975	958
query47	1890	1797	1858	1797
query48	517	416	420	416
query49	652	375	367	367
query50	858	615	610	610
query51	4755	4698	4682	4682
query52	96	76	89	76
query53	232	186	188	186
query54	2693	2519	2462	2462
query55	95	85	82	82
query56	226	201	208	201
query57	1140	1162	1133	1133
query58	217	225	200	200
query59	3607	3419	3360	3360
query60	215	207	202	202
query61	96	93	96	93
query62	787	440	441	440
query63	201	182	178	178
query64	3571	1570	1488	1488
query65	3664	3534	3567	3534
query66	769	394	395	394
query67	15580	17167	16924	16924
query68	9228	676	665	665
query69	483	259	273	259
query70	1682	1335	1248	1248
query71	404	315	314	314
query72	6723	4622	4787	4622
query73	754	317	316	316
query74	6373	5901	5809	5809
query75	4510	3752	3658	3658
query76	4755	1134	1210	1134
query77	634	246	254	246
query78	12484	11737	11739	11737
query79	5982	674	644	644
query80	2420	380	396	380
query81	512	248	237	237
query82	1675	99	96	96
query83	180	132	127	127
query84	254	69	72	69
query85	1369	317	317	317
query86	373	339	301	301
query87	3243	3031	2999	2999
query88	4787	2312	2331	2312
query89	415	300	294	294
query90	1755	208	212	208
query91	157	137	124	124
query92	57	51	52	51
query93	4992	587	575	575
query94	891	208	209	208
query95	1972	2080	1990	1990
query96	640	331	329	329
query97	6408	6389	6419	6389
query98	222	210	207	207
query99	2823	830	946	830
Total cold run time: 314975 ms
Total hot run time: 214588 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.85% (8137/21498)
Line Coverage: 29.60% (66990/226336)
Region Coverage: 29.09% (34567/118835)
Branch Coverage: 24.99% (17812/71266)
Coverage Report: http://coverage.selectdb-in.cc/coverage/bfa788f3188ac13edb8e02bf9c082391d801815b_bfa788f3188ac13edb8e02bf9c082391d801815b/report/index.html

@doris-robot
Copy link

ClickBench: Total hot run time: 30.7 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bfa788f3188ac13edb8e02bf9c082391d801815b, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.03
query3	0.25	0.05	0.05
query4	1.79	0.06	0.06
query5	0.53	0.54	0.52
query6	1.30	0.62	0.62
query7	0.02	0.01	0.01
query8	0.04	0.02	0.02
query9	0.52	0.49	0.48
query10	0.54	0.53	0.54
query11	0.12	0.09	0.09
query12	0.12	0.10	0.09
query13	0.62	0.61	0.61
query14	0.78	0.79	0.79
query15	0.78	0.77	0.77
query16	0.34	0.36	0.36
query17	0.98	1.02	0.97
query18	0.22	0.26	0.23
query19	1.92	1.86	1.84
query20	0.01	0.02	0.01
query21	15.47	0.61	0.54
query22	1.87	1.93	1.58
query23	17.22	1.11	1.03
query24	6.68	0.82	1.12
query25	0.35	0.12	0.04
query26	0.71	0.15	0.16
query27	0.05	0.04	0.03
query28	6.80	0.75	0.75
query29	12.82	2.31	2.37
query30	0.59	0.52	0.50
query31	2.82	0.38	0.38
query32	3.38	0.49	0.50
query33	3.05	3.08	3.10
query34	15.26	4.80	4.79
query35	4.84	4.85	4.86
query36	1.09	1.02	1.02
query37	0.06	0.05	0.05
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.06	0.01	0.02
query42	0.02	0.01	0.02
query43	0.02	0.02	0.01
Total cold run time: 104.34 s
Total hot run time: 30.7 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit bfa788f3188ac13edb8e02bf9c082391d801815b with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@xiaokang xiaokang merged commit 5dc0196 into apache:branch-2.0 Sep 9, 2024
19 of 23 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants