Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[pick](nestedtype)support nested type with agg replace_if_not_null #38716

Merged
merged 5 commits into from
Aug 6, 2024
Merged

[pick](nestedtype)support nested type with agg replace_if_not_null #38716

merged 5 commits into from
Aug 6, 2024

Conversation

amorynan
Copy link
Contributor

@amorynan amorynan commented Aug 1, 2024

Proposed changes

backport: #38304
Issue Number: close #xxx

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions github-actions bot added area/planner Issues or PRs related to the query planner kind/test labels Aug 1, 2024
@xiaokang
Copy link
Contributor

xiaokang commented Aug 1, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49604 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b3eee4eb3c1893b0fcc28e193e43c7c347ebd619, data reload: false

------ Round 1 ----------------------------------
q1	17635	4351	4324	4324
q2	2068	159	149	149
q3	10264	1881	1913	1881
q4	10401	1275	1319	1275
q5	8476	3807	3909	3807
q6	236	125	150	125
q7	1993	1630	1605	1605
q8	9560	2724	2715	2715
q9	11011	10171	10264	10171
q10	8663	3546	3468	3468
q11	419	248	247	247
q12	480	315	318	315
q13	18341	3936	4047	3936
q14	358	334	334	334
q15	501	470	460	460
q16	666	566	563	563
q17	1132	966	946	946
q18	7257	6900	6878	6878
q19	1792	1647	1569	1569
q20	555	312	299	299
q21	4464	4102	4080	4080
q22	539	457	459	457
Total cold run time: 116811 ms
Total hot run time: 49604 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4330	4319	4313	4313
q2	329	231	224	224
q3	4197	4200	4157	4157
q4	2778	2762	2768	2762
q5	7248	7203	7171	7171
q6	236	127	121	121
q7	3247	2864	2837	2837
q8	4407	4521	4566	4521
q9	16977	16911	16967	16911
q10	4399	4476	4401	4401
q11	735	692	711	692
q12	1085	924	914	914
q13	7939	3895	3830	3830
q14	466	442	418	418
q15	519	466	468	466
q16	750	691	697	691
q17	3811	3843	3818	3818
q18	9096	8751	8886	8751
q19	1712	1715	1673	1673
q20	2357	2140	2073	2073
q21	8449	8417	8474	8417
q22	1031	982	948	948
Total cold run time: 86098 ms
Total hot run time: 80109 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203668 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b3eee4eb3c1893b0fcc28e193e43c7c347ebd619, data reload: false

query1	959	388	413	388
query2	6550	3062	2740	2740
query3	6928	209	205	205
query4	20627	17986	17939	17939
query5	19737	6605	6482	6482
query6	337	217	228	217
query7	4463	307	308	307
query8	461	435	439	435
query9	3116	2724	2656	2656
query10	435	306	323	306
query11	11374	10745	10698	10698
query12	126	82	72	72
query13	5634	710	691	691
query14	18180	13588	13765	13588
query15	358	245	244	244
query16	6435	295	262	262
query17	1344	1600	877	877
query18	2282	406	407	406
query19	212	161	158	158
query20	80	81	82	81
query21	187	95	92	92
query22	5215	5063	5047	5047
query23	32430	31890	31997	31890
query24	6734	6529	6473	6473
query25	541	427	410	410
query26	520	169	163	163
query27	1825	305	306	305
query28	6179	2386	2365	2365
query29	2840	2795	2767	2767
query30	246	170	169	169
query31	909	734	738	734
query32	68	62	63	62
query33	417	265	264	264
query34	871	472	478	472
query35	1155	908	924	908
query36	1260	1223	1079	1079
query37	90	59	61	59
query38	3067	2928	2912	2912
query39	1385	1300	1316	1300
query40	202	95	97	95
query41	50	46	46	46
query42	85	81	85	81
query43	709	648	699	648
query44	1136	723	725	723
query45	244	242	245	242
query46	1237	954	1004	954
query47	1975	1743	1823	1743
query48	979	734	729	729
query49	628	376	360	360
query50	853	555	606	555
query51	4777	4699	4658	4658
query52	85	79	81	79
query53	452	330	321	321
query54	2656	2440	2481	2440
query55	93	85	85	85
query56	224	222	201	201
query57	1143	1069	1161	1069
query58	222	193	198	193
query59	4599	4138	4154	4138
query60	226	200	214	200
query61	97	94	99	94
query62	852	443	526	443
query63	496	347	348	347
query64	2520	1526	1397	1397
query65	3648	3573	3554	3554
query66	735	381	375	375
query67	15505	16447	15041	15041
query68	10234	652	673	652
query69	588	370	352	352
query70	1976	1516	1388	1388
query71	420	301	319	301
query72	6631	3508	3495	3495
query73	732	319	324	319
query74	6369	5913	5850	5850
query75	5406	3615	3676	3615
query76	6561	1164	1201	1164
query77	1149	256	254	254
query78	12738	11533	11575	11533
query79	6929	630	643	630
query80	927	416	407	407
query81	484	237	235	235
query82	1625	104	97	97
query83	167	139	136	136
query84	256	72	72	72
query85	882	335	335	335
query86	327	296	300	296
query87	3212	2977	3055	2977
query88	4544	2300	2304	2300
query89	388	296	296	296
query90	1980	217	213	213
query91	177	139	156	139
query92	61	55	57	55
query93	5394	594	555	555
query94	706	211	208	208
query95	1114	1063	1050	1050
query96	644	330	335	330
query97	6424	6336	6348	6336
query98	196	176	185	176
query99	2969	868	888	868
Total cold run time: 314215 ms
Total hot run time: 203668 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.28 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b3eee4eb3c1893b0fcc28e193e43c7c347ebd619, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.05
query4	1.80	0.07	0.06
query5	0.54	0.52	0.54
query6	1.25	0.61	0.62
query7	0.01	0.01	0.01
query8	0.03	0.02	0.03
query9	0.53	0.49	0.48
query10	0.54	0.54	0.53
query11	0.12	0.08	0.08
query12	0.12	0.08	0.09
query13	0.62	0.61	0.60
query14	0.79	0.79	0.78
query15	0.78	0.75	0.75
query16	0.36	0.37	0.37
query17	0.98	1.00	1.04
query18	0.23	0.26	0.25
query19	1.93	1.88	1.81
query20	0.01	0.01	0.01
query21	15.51	0.56	0.57
query22	2.09	2.01	2.24
query23	17.27	0.88	0.94
query24	6.95	1.72	1.16
query25	0.38	0.11	0.05
query26	0.78	0.15	0.16
query27	0.05	0.03	0.03
query28	5.52	0.78	0.75
query29	12.63	2.34	2.34
query30	0.61	0.53	0.54
query31	2.81	0.38	0.38
query32	3.40	0.51	0.49
query33	3.08	3.05	3.06
query34	15.25	4.79	4.77
query35	4.84	4.83	4.83
query36	1.03	1.00	1.01
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.17	0.14	0.14
query41	0.06	0.02	0.01
query42	0.03	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.58 s
Total hot run time: 31.28 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit b3eee4eb3c1893b0fcc28e193e43c7c347ebd619 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.0 seconds inserted 10000000 Rows, about 476K ops/s

@amorynan
Copy link
Contributor Author

amorynan commented Aug 2, 2024

run p0

1 similar comment
@amorynan
Copy link
Contributor Author

amorynan commented Aug 2, 2024

run p0

@xiaokang
Copy link
Contributor

xiaokang commented Aug 2, 2024

run buildall

@xiaokang
Copy link
Contributor

xiaokang commented Aug 2, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49639 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2f7342f8b1d845fd4bb5db2635a5cc28e08ab2e2, data reload: false

------ Round 1 ----------------------------------
q1	17604	4405	4341	4341
q2	2076	160	150	150
q3	10364	1881	1942	1881
q4	10345	1265	1309	1265
q5	8390	3893	3860	3860
q6	235	128	126	126
q7	2035	1600	1594	1594
q8	9555	2718	2700	2700
q9	12678	10301	10153	10153
q10	8665	3542	3492	3492
q11	416	250	247	247
q12	479	308	312	308
q13	18386	3971	3993	3971
q14	350	314	319	314
q15	500	459	465	459
q16	662	584	576	576
q17	1118	954	915	915
q18	7164	6840	6949	6840
q19	1781	1683	1611	1611
q20	533	299	302	299
q21	4464	4086	4101	4086
q22	530	451	459	451
Total cold run time: 118330 ms
Total hot run time: 49639 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4295	4304	4312	4304
q2	324	226	221	221
q3	4153	4121	4167	4121
q4	2752	2737	2743	2737
q5	7136	7081	7042	7042
q6	238	119	120	119
q7	3204	2824	2798	2798
q8	4332	4449	4459	4449
q9	16900	16727	16679	16679
q10	4204	4241	4281	4241
q11	741	686	700	686
q12	1026	840	882	840
q13	6756	3767	3719	3719
q14	468	434	420	420
q15	515	453	456	453
q16	743	676	683	676
q17	3768	3858	3845	3845
q18	8843	8748	8841	8748
q19	1724	1669	1657	1657
q20	2373	2157	2111	2111
q21	8491	8460	8404	8404
q22	1042	1030	1003	1003
Total cold run time: 84028 ms
Total hot run time: 79273 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204826 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2f7342f8b1d845fd4bb5db2635a5cc28e08ab2e2, data reload: false

query1	934	386	414	386
query2	6567	2778	2785	2778
query3	6920	213	202	202
query4	20113	18063	18002	18002
query5	19742	6517	6474	6474
query6	302	221	240	221
query7	4169	306	306	306
query8	438	450	395	395
query9	3079	2664	2591	2591
query10	438	308	283	283
query11	11436	10791	10752	10752
query12	127	79	70	70
query13	5590	690	694	690
query14	17606	13486	13647	13486
query15	369	248	250	248
query16	6827	296	279	279
query17	2698	2310	888	888
query18	2300	425	428	425
query19	221	146	155	146
query20	82	81	82	81
query21	193	104	96	96
query22	5407	5049	4966	4966
query23	32899	32515	32773	32515
query24	7970	6670	6578	6578
query25	529	453	447	447
query26	1260	168	168	168
query27	2349	306	300	300
query28	6249	2374	2338	2338
query29	2971	2746	2806	2746
query30	247	166	166	166
query31	909	745	772	745
query32	67	65	61	61
query33	423	249	267	249
query34	862	491	463	463
query35	1121	908	910	908
query36	1514	1289	1104	1104
query37	169	60	61	60
query38	3037	2905	2901	2901
query39	1377	1306	1339	1306
query40	309	97	95	95
query41	47	45	45	45
query42	83	94	89	89
query43	804	793	700	700
query44	1142	716	728	716
query45	249	238	231	231
query46	1238	951	973	951
query47	1784	1818	1900	1818
query48	1028	736	701	701
query49	653	377	364	364
query50	861	614	608	608
query51	4800	4661	4728	4661
query52	84	76	86	76
query53	463	329	328	328
query54	2651	2470	2486	2470
query55	86	85	87	85
query56	249	221	192	192
query57	1197	1171	1129	1129
query58	211	194	198	194
query59	4292	3964	4154	3964
query60	229	200	198	198
query61	99	95	95	95
query62	830	468	519	468
query63	490	341	347	341
query64	2814	1581	1422	1422
query65	3672	3573	3533	3533
query66	785	388	386	386
query67	15923	15853	15329	15329
query68	9000	675	672	672
query69	593	364	352	352
query70	1573	1418	1526	1418
query71	422	306	321	306
query72	6195	3483	3493	3483
query73	744	324	321	321
query74	6307	5819	5961	5819
query75	5502	3739	3791	3739
query76	5347	1153	1168	1153
query77	893	253	259	253
query78	12597	11628	12811	11628
query79	13767	639	631	631
query80	1426	420	410	410
query81	491	239	230	230
query82	1196	92	97	92
query83	182	133	139	133
query84	264	73	72	72
query85	953	327	330	327
query86	328	292	290	290
query87	3256	2950	3031	2950
query88	5754	2307	2311	2307
query89	456	305	278	278
query90	2559	196	208	196
query91	181	140	153	140
query92	58	53	53	53
query93	6526	559	558	558
query94	1351	208	214	208
query95	1117	1094	1071	1071
query96	644	325	323	323
query97	6451	6390	6382	6382
query98	196	170	177	170
query99	2891	852	865	852
Total cold run time: 325804 ms
Total hot run time: 204826 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.61 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2f7342f8b1d845fd4bb5db2635a5cc28e08ab2e2, data reload: false

query1	0.02	0.03	0.02
query2	0.07	0.03	0.02
query3	0.24	0.05	0.05
query4	1.79	0.10	0.11
query5	0.53	0.53	0.52
query6	1.28	0.65	0.61
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.53	0.48	0.48
query10	0.55	0.55	0.54
query11	0.12	0.08	0.08
query12	0.12	0.09	0.09
query13	0.62	0.61	0.61
query14	0.80	0.79	0.78
query15	0.80	0.76	0.76
query16	0.36	0.39	0.37
query17	0.97	1.02	1.00
query18	0.24	0.26	0.24
query19	1.94	1.85	1.85
query20	0.02	0.01	0.01
query21	15.51	0.56	0.55
query22	2.09	2.75	1.95
query23	17.33	0.97	1.06
query24	4.59	1.89	1.43
query25	0.37	0.10	0.04
query26	0.64	0.15	0.16
query27	0.05	0.03	0.04
query28	7.60	0.71	0.74
query29	12.62	2.38	2.31
query30	0.56	0.53	0.53
query31	2.81	0.40	0.37
query32	3.37	0.50	0.49
query33	3.11	3.03	3.12
query34	15.26	4.78	4.79
query35	4.83	4.86	4.86
query36	1.07	1.02	1.00
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.17	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.01	0.02
query43	0.02	0.01	0.01
Total cold run time: 103.25 s
Total hot run time: 31.61 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 2f7342f8b1d845fd4bb5db2635a5cc28e08ab2e2 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@amorynan
Copy link
Contributor Author

amorynan commented Aug 5, 2024

run buildall

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Aug 5, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 50042 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a1aed4f988fe29887fc21424e07c8e0b843bccd0, data reload: false

------ Round 1 ----------------------------------
q1	17663	4468	4385	4385
q2	2089	162	146	146
q3	10458	1940	1975	1940
q4	10232	1251	1314	1251
q5	8604	3850	3964	3850
q6	234	124	146	124
q7	2065	1604	1612	1604
q8	9299	2747	2728	2728
q9	10780	10464	10239	10239
q10	8656	3520	3519	3519
q11	418	254	246	246
q12	472	298	299	298
q13	18380	3972	4044	3972
q14	355	340	338	338
q15	523	451	459	451
q16	682	580	580	580
q17	1134	935	965	935
q18	7289	6888	7042	6888
q19	1784	1683	1673	1673
q20	574	312	310	310
q21	4491	4159	4129	4129
q22	532	436	445	436
Total cold run time: 116714 ms
Total hot run time: 50042 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4326	4310	4382	4310
q2	328	226	224	224
q3	4202	4128	4148	4128
q4	2759	2761	2791	2761
q5	7235	7146	7165	7146
q6	241	120	123	120
q7	3242	2873	2900	2873
q8	4365	4455	4519	4455
q9	16880	16793	16764	16764
q10	4243	4252	4311	4252
q11	760	683	678	678
q12	1057	857	838	838
q13	6935	3730	3930	3730
q14	453	432	422	422
q15	501	471	455	455
q16	747	689	694	689
q17	3815	3804	3853	3804
q18	8769	8813	8783	8783
q19	1733	1729	1673	1673
q20	2363	2162	2163	2162
q21	8506	8480	8546	8480
q22	1074	961	966	961
Total cold run time: 84534 ms
Total hot run time: 79708 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204779 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a1aed4f988fe29887fc21424e07c8e0b843bccd0, data reload: false

query1	917	387	430	387
query2	6545	3052	2714	2714
query3	6925	214	200	200
query4	20354	17925	18170	17925
query5	19728	6497	6609	6497
query6	289	221	236	221
query7	4154	307	312	307
query8	465	424	442	424
query9	3112	2682	2581	2581
query10	426	312	305	305
query11	11466	10721	10717	10717
query12	126	87	77	77
query13	5601	719	719	719
query14	18090	13765	13908	13765
query15	369	240	262	240
query16	6491	290	268	268
query17	1687	1475	872	872
query18	2297	422	407	407
query19	211	151	149	149
query20	80	80	79	79
query21	189	98	95	95
query22	5203	5104	5001	5001
query23	32443	32152	31974	31974
query24	6909	6536	6463	6463
query25	527	421	442	421
query26	525	164	159	159
query27	1895	292	296	292
query28	6165	2337	2315	2315
query29	2914	2872	2756	2756
query30	240	170	166	166
query31	935	757	742	742
query32	68	65	61	61
query33	409	240	246	240
query34	851	480	473	473
query35	1154	899	875	875
query36	1326	1295	1129	1129
query37	91	62	56	56
query38	3074	2936	2948	2936
query39	1366	1335	1317	1317
query40	214	95	87	87
query41	48	43	46	43
query42	80	85	82	82
query43	652	667	743	667
query44	1138	721	725	721
query45	250	233	237	233
query46	1243	986	967	967
query47	1955	1620	1925	1620
query48	1033	719	736	719
query49	619	388	380	380
query50	865	599	590	590
query51	4798	4659	4704	4659
query52	103	80	87	80
query53	443	324	320	320
query54	2658	2446	2497	2446
query55	85	80	80	80
query56	228	206	208	206
query57	1189	1138	1158	1138
query58	214	205	191	191
query59	4250	4499	4017	4017
query60	217	212	196	196
query61	98	95	94	94
query62	682	464	459	459
query63	495	338	347	338
query64	2573	1550	1448	1448
query65	3627	3601	3569	3569
query66	771	375	378	375
query67	15769	15886	16508	15886
query68	10328	648	664	648
query69	599	357	354	354
query70	1936	1286	1467	1286
query71	426	325	312	312
query72	6534	3508	3491	3491
query73	741	347	325	325
query74	6371	5943	5895	5895
query75	5452	3687	3744	3687
query76	6584	1191	1213	1191
query77	1123	267	267	267
query78	12779	11608	11520	11520
query79	8434	666	629	629
query80	1328	414	416	414
query81	492	242	233	233
query82	1596	99	102	99
query83	169	136	137	136
query84	264	73	72	72
query85	889	345	329	329
query86	340	301	291	291
query87	3258	3047	3059	3047
query88	4678	2295	2299	2295
query89	481	309	320	309
query90	1944	216	216	216
query91	190	139	141	139
query92	57	54	54	54
query93	6416	566	570	566
query94	685	216	216	216
query95	1143	1071	1064	1064
query96	645	337	320	320
query97	6425	6413	6422	6413
query98	185	187	187	187
query99	3042	859	838	838
Total cold run time: 317448 ms
Total hot run time: 204779 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.75% (8104/21466)
Line Coverage: 29.38% (66365/225853)
Region Coverage: 28.90% (34254/118534)
Branch Coverage: 24.78% (17604/71030)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a1aed4f988fe29887fc21424e07c8e0b843bccd0_a1aed4f988fe29887fc21424e07c8e0b843bccd0/report/index.html

@doris-robot
Copy link

ClickBench: Total hot run time: 30.59 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a1aed4f988fe29887fc21424e07c8e0b843bccd0, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.06	0.04
query4	1.79	0.07	0.06
query5	0.53	0.52	0.52
query6	1.24	0.60	0.60
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.53	0.50	0.48
query10	0.54	0.53	0.53
query11	0.13	0.09	0.08
query12	0.12	0.10	0.09
query13	0.62	0.61	0.61
query14	0.79	0.78	0.79
query15	0.77	0.76	0.76
query16	0.37	0.36	0.37
query17	1.00	1.03	0.99
query18	0.22	0.25	0.24
query19	1.93	1.86	1.85
query20	0.02	0.01	0.01
query21	15.46	0.60	0.57
query22	2.26	2.57	1.48
query23	17.20	1.14	0.87
query24	4.25	1.70	1.08
query25	0.36	0.11	0.06
query26	0.55	0.16	0.16
query27	0.04	0.05	0.03
query28	8.14	0.80	0.77
query29	12.62	2.32	2.14
query30	0.56	0.54	0.50
query31	2.81	0.39	0.39
query32	3.35	0.49	0.50
query33	3.09	3.09	3.09
query34	15.27	4.78	4.81
query35	4.84	4.84	4.83
query36	1.06	1.02	1.02
query37	0.06	0.05	0.04
query38	0.04	0.02	0.03
query39	0.02	0.02	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.02
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.23 s
Total hot run time: 30.59 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a1aed4f988fe29887fc21424e07c8e0b843bccd0 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.6 seconds inserted 10000000 Rows, about 462K ops/s

@amorynan
Copy link
Contributor Author

amorynan commented Aug 5, 2024

run buildall

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Aug 5, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 50252 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 13a7cdcc0045d0bd61410fae6e00f5a8c2e4f3ee, data reload: false

------ Round 1 ----------------------------------
q1	17548	4397	4367	4367
q2	2081	163	153	153
q3	10263	1934	1928	1928
q4	10114	1254	1333	1254
q5	8587	3891	3949	3891
q6	237	127	128	127
q7	2029	1635	1585	1585
q8	9482	2725	2707	2707
q9	13943	10949	10524	10524
q10	8674	3544	3557	3544
q11	412	252	245	245
q12	474	311	315	311
q13	18380	3995	4030	3995
q14	361	340	312	312
q15	522	462	455	455
q16	684	566	571	566
q17	1143	942	929	929
q18	7317	6866	6837	6837
q19	1777	1675	1669	1669
q20	563	295	330	295
q21	4428	4115	4109	4109
q22	535	452	449	449
Total cold run time: 119554 ms
Total hot run time: 50252 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4378	4302	4310	4302
q2	320	232	230	230
q3	4216	4134	4188	4134
q4	2767	2744	2754	2744
q5	7168	7100	7062	7062
q6	239	124	120	120
q7	3250	2860	2871	2860
q8	4392	4470	4550	4470
q9	16774	16868	16805	16805
q10	4225	4244	4313	4244
q11	766	665	667	665
q12	1021	854	845	845
q13	6062	3776	3784	3776
q14	463	426	428	426
q15	508	466	458	458
q16	737	671	686	671
q17	3787	3882	3795	3795
q18	8801	8796	8872	8796
q19	1747	1691	1646	1646
q20	2377	2169	2113	2113
q21	8467	8611	8588	8588
q22	1033	964	1001	964
Total cold run time: 83498 ms
Total hot run time: 79714 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.75% (8104/21466)
Line Coverage: 29.39% (66376/225853)
Region Coverage: 28.90% (34260/118534)
Branch Coverage: 24.79% (17607/71030)
Coverage Report: http://coverage.selectdb-in.cc/coverage/13a7cdcc0045d0bd61410fae6e00f5a8c2e4f3ee_13a7cdcc0045d0bd61410fae6e00f5a8c2e4f3ee/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 203956 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 13a7cdcc0045d0bd61410fae6e00f5a8c2e4f3ee, data reload: false

query1	933	416	375	375
query2	6526	2886	2547	2547
query3	6913	206	206	206
query4	20078	18073	17953	17953
query5	19736	6513	6522	6513
query6	297	232	224	224
query7	4158	300	299	299
query8	473	424	456	424
query9	3075	2661	2605	2605
query10	419	305	298	298
query11	11251	10666	10765	10666
query12	125	79	79	79
query13	5612	701	697	697
query14	17945	13688	14023	13688
query15	352	241	254	241
query16	6475	286	261	261
query17	1748	1451	871	871
query18	2328	411	406	406
query19	209	153	152	152
query20	86	80	84	80
query21	196	94	95	94
query22	5080	5081	5051	5051
query23	32713	31960	32018	31960
query24	6944	6497	6567	6497
query25	517	430	416	416
query26	606	163	159	159
query27	1978	291	287	287
query28	6119	2354	2331	2331
query29	2925	2863	2759	2759
query30	246	174	167	167
query31	923	712	739	712
query32	67	67	60	60
query33	414	255	266	255
query34	852	462	459	459
query35	1083	955	940	940
query36	1233	1132	1236	1132
query37	92	61	60	60
query38	3060	2896	2986	2896
query39	1371	1322	1323	1322
query40	202	94	96	94
query41	47	46	44	44
query42	81	87	82	82
query43	743	795	658	658
query44	1135	716	718	716
query45	252	239	235	235
query46	1231	936	989	936
query47	1977	1675	1735	1675
query48	1014	717	717	717
query49	636	367	375	367
query50	856	571	650	571
query51	4800	4678	4665	4665
query52	90	83	85	83
query53	449	333	318	318
query54	2673	2450	2458	2450
query55	82	86	73	73
query56	239	224	211	211
query57	1169	1037	1044	1037
query58	221	207	212	207
query59	4388	3993	4073	3993
query60	209	206	219	206
query61	98	95	107	95
query62	816	472	465	465
query63	500	338	352	338
query64	2631	1559	1497	1497
query65	3643	3586	3553	3553
query66	819	389	384	384
query67	17652	15512	15607	15512
query68	8206	659	653	653
query69	567	363	341	341
query70	1516	1454	1398	1398
query71	394	304	310	304
query72	6576	3471	3499	3471
query73	731	320	318	318
query74	6249	5849	5864	5849
query75	4613	3699	3605	3605
query76	4683	1165	1164	1164
query77	597	255	257	255
query78	12491	11767	11541	11541
query79	9186	641	646	641
query80	1601	394	399	394
query81	498	233	234	233
query82	1679	105	97	97
query83	182	134	136	134
query84	264	74	71	71
query85	893	329	330	329
query86	339	294	346	294
query87	3240	3005	3093	3005
query88	5079	2292	2307	2292
query89	419	290	321	290
query90	1916	202	199	199
query91	189	142	139	139
query92	63	54	54	54
query93	6336	577	555	555
query94	760	204	207	204
query95	1100	1069	1062	1062
query96	650	324	321	321
query97	6464	6391	6320	6320
query98	187	173	172	172
query99	2906	927	989	927
Total cold run time: 314385 ms
Total hot run time: 203956 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.44 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 13a7cdcc0045d0bd61410fae6e00f5a8c2e4f3ee, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.04
query4	1.79	0.06	0.07
query5	0.54	0.52	0.52
query6	1.27	0.61	0.60
query7	0.02	0.01	0.01
query8	0.03	0.03	0.02
query9	0.53	0.49	0.49
query10	0.55	0.54	0.54
query11	0.12	0.09	0.09
query12	0.11	0.09	0.09
query13	0.61	0.60	0.60
query14	0.78	0.78	0.77
query15	0.79	0.76	0.75
query16	0.38	0.36	0.38
query17	1.03	1.02	0.99
query18	0.23	0.23	0.24
query19	1.96	1.88	1.89
query20	0.02	0.01	0.01
query21	15.47	0.63	0.57
query22	2.23	2.49	1.05
query23	16.91	1.12	0.94
query24	7.18	1.19	1.20
query25	0.34	0.12	0.04
query26	0.85	0.16	0.15
query27	0.04	0.04	0.04
query28	5.69	0.73	0.80
query29	12.67	2.27	2.32
query30	0.58	0.54	0.53
query31	2.80	0.39	0.37
query32	3.38	0.49	0.50
query33	3.05	3.07	3.10
query34	15.23	4.80	4.80
query35	4.84	4.83	4.85
query36	1.05	1.02	1.02
query37	0.06	0.05	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.03	0.02	0.02
Total cold run time: 103.8 s
Total hot run time: 30.44 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 13a7cdcc0045d0bd61410fae6e00f5a8c2e4f3ee with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.5 seconds inserted 10000000 Rows, about 465K ops/s

@xiaokang xiaokang merged commit 9925204 into apache:branch-2.0 Aug 6, 2024
20 of 24 checks passed
GoGoWen pushed a commit to GoGoWen/incubator-doris that referenced this pull request Aug 27, 2024
@amorynan
[pick](nestedtype)support nested type with agg replace_if_not_null ap…
ba2d3dd 
…ache#38304 (apache#38716)
xiaokang added a commit that referenced this pull request Nov 18, 2024
@xiaokang
fix problem introduced by #38716
85046ce
xiaokang added a commit to xiaokang/doris that referenced this pull request Nov 18, 2024
@xiaokang
fix problem introduced by apache#38716
821706b
@xiaokang xiaokang mentioned this pull request Nov 18, 2024
Open
xiaokang added a commit that referenced this pull request Nov 19, 2024
@xiaokang
Revert "[pick](nestedtype)support nested type with agg replace_if_not…
0f65853 
…_null #38304 (#38716)"

This reverts commit 9925204.
mongo360 pushed a commit to mongo360/doris that referenced this pull request Dec 11, 2024
Revert "[pick](nestedtype)support nested type with agg replace_if_not…
945ebe9 
…_null apache#38304 (apache#38716)"

This reverts commit ba2d3dd.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
area/planner Issues or PRs related to the query planner kind/test
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@amorynan @doris-robot @xiaokang