Skip to content

Conversation

@vinlee19
Copy link
Contributor

@vinlee19 vinlee19 commented Aug 13, 2025

cherry pick from #53789

@vinlee19 vinlee19 requested a review from morrySnow as a code owner August 13, 2025 09:57
@Thearas
Copy link
Contributor

Thearas commented Aug 13, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@vinlee19
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32828 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dc4197ddeb935e15c20e56cfd18b9f105bda4275, data reload: false

------ Round 1 ----------------------------------
q1	17593	5527	5529	5527
q2	2026	392	278	278
q3	12182	1248	734	734
q4	10288	873	448	448
q5	9074	2405	2177	2177
q6	187	165	135	135
q7	899	742	617	617
q8	9329	1462	1168	1168
q9	5386	4999	4871	4871
q10	6870	2252	1817	1817
q11	475	281	260	260
q12	333	366	234	234
q13	17783	3649	3013	3013
q14	217	225	208	208
q15	531	473	449	449
q16	412	429	373	373
q17	598	873	349	349
q18	6853	6587	6390	6390
q19	1196	969	555	555
q20	326	341	204	204
q21	2860	2260	2009	2009
q22	1028	1014	1012	1012
Total cold run time: 106446 ms
Total hot run time: 32828 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5553	5564	5480	5480
q2	232	330	234	234
q3	2281	2610	2323	2323
q4	1367	1809	1393	1393
q5	4434	5010	5020	5010
q6	176	166	131	131
q7	2121	1968	1833	1833
q8	2688	2858	2722	2722
q9	7257	7236	7206	7206
q10	3045	3307	2748	2748
q11	587	516	507	507
q12	709	790	619	619
q13	3406	3804	3122	3122
q14	285	295	259	259
q15	524	465	481	465
q16	437	469	428	428
q17	1238	1764	1277	1277
q18	7729	7548	7209	7209
q19	872	1087	1176	1087
q20	2064	2060	1886	1886
q21	5258	4947	4584	4584
q22	1066	1048	988	988
Total cold run time: 53329 ms
Total hot run time: 51511 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192421 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dc4197ddeb935e15c20e56cfd18b9f105bda4275, data reload: false

query1	927	413	416	413
query2	6210	2024	1882	1882
query3	8688	196	193	193
query4	33473	24187	23398	23398
query5	3556	584	448	448
query6	302	200	191	191
query7	4204	482	319	319
query8	296	251	237	237
query9	9260	2547	2554	2547
query10	472	323	268	268
query11	18290	15827	15121	15121
query12	162	111	105	105
query13	1563	556	416	416
query14	9897	6736	6797	6736
query15	265	191	183	183
query16	7971	694	507	507
query17	1518	787	607	607
query18	2174	419	315	315
query19	213	197	169	169
query20	136	118	117	117
query21	212	127	110	110
query22	4629	4604	4472	4472
query23	34857	34633	34069	34069
query24	7316	2696	2744	2696
query25	560	493	439	439
query26	836	295	173	173
query27	2235	462	362	362
query28	5479	2208	2176	2176
query29	732	623	479	479
query30	244	190	166	166
query31	1020	916	848	848
query32	104	64	64	64
query33	515	381	325	325
query34	785	880	528	528
query35	792	822	729	729
query36	1016	1067	962	962
query37	102	95	71	71
query38	3989	4047	3987	3987
query39	1524	1459	1507	1459
query40	205	123	107	107
query41	48	49	46	46
query42	132	105	106	105
query43	531	521	477	477
query44	1319	824	856	824
query45	188	183	173	173
query46	888	1074	692	692
query47	1998	1963	1903	1903
query48	411	437	356	356
query49	730	505	424	424
query50	696	706	433	433
query51	7318	7299	7311	7299
query52	106	109	95	95
query53	237	263	193	193
query54	542	562	471	471
query55	82	82	79	79
query56	266	273	260	260
query57	1250	1261	1235	1235
query58	227	217	231	217
query59	3095	3261	3120	3120
query60	299	293	279	279
query61	112	117	123	117
query62	800	744	696	696
query63	227	211	211	211
query64	3824	1014	634	634
query65	3395	3303	3315	3303
query66	811	421	326	326
query67	16400	15755	15601	15601
query68	7710	824	550	550
query69	513	299	278	278
query70	1137	1085	1122	1085
query71	366	298	258	258
query72	5793	3924	3935	3924
query73	646	760	359	359
query74	10252	9228	9257	9228
query75	3236	3091	2688	2688
query76	2944	1180	760	760
query77	515	373	267	267
query78	10350	10394	9634	9634
query79	4087	884	587	587
query80	982	533	433	433
query81	506	253	223	223
query82	1007	125	87	87
query83	177	159	145	145
query84	290	103	84	84
query85	766	348	308	308
query86	392	318	302	302
query87	4341	4248	4208	4208
query88	5313	2396	2368	2368
query89	409	333	300	300
query90	1716	186	187	186
query91	132	144	107	107
query92	62	55	50	50
query93	3085	884	535	535
query94	783	402	282	282
query95	344	282	266	266
query96	493	609	281	281
query97	3200	3266	3141	3141
query98	225	217	196	196
query99	1515	1412	1338	1338
Total cold run time: 295948 ms
Total hot run time: 192421 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.29 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dc4197ddeb935e15c20e56cfd18b9f105bda4275, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.07
query4	1.62	0.10	0.10
query5	0.53	0.52	0.51
query6	1.15	0.72	0.71
query7	0.02	0.01	0.02
query8	0.05	0.03	0.03
query9	0.56	0.50	0.50
query10	0.55	0.56	0.55
query11	0.15	0.11	0.11
query12	0.14	0.10	0.11
query13	0.63	0.59	0.60
query14	0.78	0.80	0.78
query15	0.86	0.85	0.83
query16	0.40	0.40	0.40
query17	1.07	1.10	1.03
query18	0.25	0.22	0.22
query19	1.93	1.77	1.87
query20	0.02	0.02	0.02
query21	15.39	0.91	0.58
query22	0.73	0.77	0.73
query23	15.10	1.38	0.55
query24	3.54	0.38	0.61
query25	0.25	0.19	0.07
query26	0.26	0.14	0.13
query27	0.05	0.05	0.04
query28	12.78	1.05	0.42
query29	12.59	3.86	3.20
query30	0.25	0.09	0.06
query31	2.81	0.60	0.38
query32	3.23	0.54	0.46
query33	3.05	3.02	3.00
query34	16.58	5.12	4.54
query35	4.61	4.57	4.57
query36	0.66	0.49	0.48
query37	0.09	0.07	0.06
query38	0.06	0.04	0.03
query39	0.03	0.02	0.03
query40	0.16	0.14	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 103.44 s
Total hot run time: 28.29 s

@doris-robot
Copy link

TPC-H: Total hot run time: 32619 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 750145093ec052a5e9aafc90afab7273d0b01c81, data reload: false

------ Round 1 ----------------------------------
q1	17604	5539	5414	5414
q2	2028	388	280	280
q3	11675	1242	745	745
q4	10238	877	446	446
q5	8463	2331	2108	2108
q6	182	164	132	132
q7	894	731	620	620
q8	9342	1438	1145	1145
q9	5202	4913	4877	4877
q10	6786	2259	1828	1828
q11	473	278	263	263
q12	332	358	221	221
q13	17784	3614	3008	3008
q14	225	242	225	225
q15	514	462	475	462
q16	418	432	385	385
q17	586	848	373	373
q18	6715	6529	6324	6324
q19	1215	963	554	554
q20	315	337	215	215
q21	2766	2184	2021	2021
q22	1060	1021	973	973
Total cold run time: 104817 ms
Total hot run time: 32619 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5516	5502	5470	5470
q2	232	322	241	241
q3	2294	2634	2357	2357
q4	1378	1827	1387	1387
q5	4443	4878	4927	4878
q6	165	165	134	134
q7	2067	1987	1806	1806
q8	2613	2842	2690	2690
q9	7248	7152	7217	7152
q10	3045	3356	2861	2861
q11	571	508	486	486
q12	685	779	652	652
q13	3455	3874	3356	3356
q14	290	309	269	269
q15	527	463	490	463
q16	457	517	438	438
q17	1252	1778	1292	1292
q18	7840	7801	7505	7505
q19	782	1130	1097	1097
q20	1985	2086	1950	1950
q21	5338	4935	4588	4588
q22	1064	1094	1020	1020
Total cold run time: 53247 ms
Total hot run time: 52092 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191718 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 750145093ec052a5e9aafc90afab7273d0b01c81, data reload: false

query1	949	390	387	387
query2	6220	2075	1952	1952
query3	8684	202	197	197
query4	33785	23718	23441	23441
query5	3681	620	471	471
query6	300	200	191	191
query7	4207	490	318	318
query8	302	247	235	235
query9	9616	2562	2567	2562
query10	481	323	257	257
query11	17946	15744	14937	14937
query12	161	108	103	103
query13	1567	538	414	414
query14	9339	7240	7009	7009
query15	256	188	177	177
query16	8058	673	500	500
query17	1624	778	604	604
query18	2157	421	323	323
query19	229	211	172	172
query20	121	124	123	123
query21	206	139	112	112
query22	4497	4615	4518	4518
query23	35080	34456	33880	33880
query24	7654	2712	2722	2712
query25	570	496	449	449
query26	803	293	173	173
query27	2052	482	367	367
query28	5344	2185	2168	2168
query29	698	591	460	460
query30	238	203	168	168
query31	1003	936	835	835
query32	90	63	59	59
query33	554	374	308	308
query34	742	869	551	551
query35	778	798	733	733
query36	1047	1061	985	985
query37	103	94	74	74
query38	3977	4027	3930	3930
query39	1518	1489	1459	1459
query40	210	117	105	105
query41	50	49	48	48
query42	126	115	104	104
query43	515	519	496	496
query44	1307	839	828	828
query45	180	176	174	174
query46	882	1097	685	685
query47	2019	1993	1913	1913
query48	424	451	353	353
query49	723	507	398	398
query50	666	748	445	445
query51	7350	7250	7148	7148
query52	102	100	92	92
query53	228	262	186	186
query54	526	540	459	459
query55	85	79	75	75
query56	273	284	261	261
query57	1270	1287	1208	1208
query58	233	217	221	217
query59	3145	3219	3044	3044
query60	296	279	277	277
query61	117	111	134	111
query62	812	758	720	720
query63	244	194	187	187
query64	3804	1057	648	648
query65	3377	3268	3313	3268
query66	842	441	318	318
query67	16618	16080	15463	15463
query68	7650	857	546	546
query69	505	306	267	267
query70	1204	1175	1106	1106
query71	375	285	276	276
query72	5832	3772	3886	3772
query73	633	747	358	358
query74	10409	9081	8952	8952
query75	3265	3146	2659	2659
query76	2944	1172	770	770
query77	467	374	287	287
query78	10344	10504	9633	9633
query79	3137	893	589	589
query80	626	531	441	441
query81	510	266	218	218
query82	567	120	93	93
query83	164	162	146	146
query84	232	105	82	82
query85	788	344	299	299
query86	401	317	277	277
query87	4300	4312	4246	4246
query88	4983	2424	2409	2409
query89	412	329	294	294
query90	1802	194	189	189
query91	144	148	113	113
query92	67	56	52	52
query93	1886	913	544	544
query94	688	416	303	303
query95	340	269	267	267
query96	495	617	294	294
query97	3185	3312	3184	3184
query98	221	214	199	199
query99	1769	1409	1308	1308
Total cold run time: 293406 ms
Total hot run time: 191718 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.13 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 750145093ec052a5e9aafc90afab7273d0b01c81, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.03	0.03
query3	0.24	0.07	0.07
query4	1.62	0.12	0.11
query5	0.52	0.50	0.52
query6	1.13	0.72	0.73
query7	0.02	0.01	0.01
query8	0.05	0.04	0.03
query9	0.58	0.54	0.51
query10	0.55	0.54	0.56
query11	0.15	0.10	0.10
query12	0.14	0.10	0.11
query13	0.63	0.60	0.61
query14	0.78	0.80	0.81
query15	0.85	0.84	0.82
query16	0.40	0.37	0.39
query17	1.07	1.08	1.07
query18	0.24	0.22	0.23
query19	1.92	1.90	1.83
query20	0.01	0.01	0.02
query21	15.38	0.89	0.59
query22	0.77	0.75	0.72
query23	15.06	1.39	0.54
query24	2.95	1.50	1.18
query25	0.26	0.12	0.04
query26	0.21	0.15	0.13
query27	0.05	0.05	0.05
query28	13.55	1.03	0.44
query29	12.57	3.89	3.24
query30	0.26	0.09	0.06
query31	2.83	0.60	0.38
query32	3.22	0.54	0.46
query33	2.99	3.00	3.00
query34	16.49	5.23	4.48
query35	4.54	4.60	4.55
query36	0.63	0.49	0.49
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.04	0.03	0.02
query40	0.17	0.13	0.12
query41	0.08	0.03	0.03
query42	0.04	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 103.26 s
Total hot run time: 29.13 s

@vinlee19 vinlee19 force-pushed the show_partition_paimon_3.1 branch from 7501450 to b43a01c Compare August 13, 2025 15:11
@vinlee19
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32432 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b43a01ceb4831bc57459fbbab2898f7469a50bc3, data reload: false

------ Round 1 ----------------------------------
q1	17614	5690	5412	5412
q2	2040	284	166	166
q3	10482	1305	724	724
q4	10211	858	453	453
q5	7678	2405	2134	2134
q6	192	165	136	136
q7	887	756	612	612
q8	9326	1441	1143	1143
q9	5400	4953	4959	4953
q10	6758	2249	1826	1826
q11	497	278	266	266
q12	340	357	209	209
q13	17761	3600	3021	3021
q14	234	222	208	208
q15	526	455	463	455
q16	412	413	372	372
q17	587	870	374	374
q18	7070	6539	6333	6333
q19	1326	965	549	549
q20	316	326	196	196
q21	2871	2133	1926	1926
q22	1032	988	964	964
Total cold run time: 103560 ms
Total hot run time: 32432 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5567	5510	5507	5507
q2	241	345	226	226
q3	2241	2639	2284	2284
q4	1340	1756	1339	1339
q5	4470	4888	5072	4888
q6	177	164	127	127
q7	2065	1985	1841	1841
q8	2620	2854	2705	2705
q9	7257	7237	7180	7180
q10	2956	3264	2820	2820
q11	579	526	477	477
q12	666	737	578	578
q13	3377	3771	3176	3176
q14	282	305	280	280
q15	533	487	466	466
q16	428	471	428	428
q17	1239	1780	1261	1261
q18	7608	7470	7374	7374
q19	804	1153	1089	1089
q20	1986	2002	1907	1907
q21	5278	4789	4550	4550
q22	1106	1114	1045	1045
Total cold run time: 52820 ms
Total hot run time: 51548 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191090 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b43a01ceb4831bc57459fbbab2898f7469a50bc3, data reload: false

query1	972	368	402	368
query2	6535	2015	1961	1961
query3	6709	212	214	212
query4	33889	23682	23561	23561
query5	4373	632	452	452
query6	275	229	189	189
query7	4625	488	312	312
query8	309	248	241	241
query9	9429	2576	2546	2546
query10	479	325	272	272
query11	18094	15431	15357	15357
query12	150	108	103	103
query13	1653	563	403	403
query14	9724	7323	7195	7195
query15	236	198	178	178
query16	8131	676	507	507
query17	1691	786	600	600
query18	2143	443	334	334
query19	232	183	160	160
query20	124	119	119	119
query21	216	129	110	110
query22	4654	4581	4396	4396
query23	34815	33547	33610	33547
query24	7289	2614	2596	2596
query25	518	476	424	424
query26	1205	284	171	171
query27	1983	477	342	342
query28	5085	2146	2104	2104
query29	787	581	460	460
query30	269	188	155	155
query31	945	875	790	790
query32	90	61	61	61
query33	540	376	311	311
query34	750	837	532	532
query35	786	787	706	706
query36	1009	1041	904	904
query37	106	102	70	70
query38	3931	3925	3871	3871
query39	1482	1427	1442	1427
query40	208	117	108	108
query41	55	53	52	52
query42	117	111	111	111
query43	511	505	480	480
query44	1291	809	789	789
query45	186	174	174	174
query46	875	1038	688	688
query47	1879	1891	1833	1833
query48	403	428	355	355
query49	783	495	398	398
query50	665	661	409	409
query51	7191	7204	7021	7021
query52	106	103	93	93
query53	229	249	187	187
query54	536	536	462	462
query55	82	76	79	76
query56	266	269	252	252
query57	1247	1198	1152	1152
query58	249	216	222	216
query59	2968	3058	2902	2902
query60	299	301	258	258
query61	113	115	110	110
query62	803	734	677	677
query63	229	192	184	184
query64	4626	967	611	611
query65	3276	3188	3215	3188
query66	1065	403	310	310
query67	15930	15827	15776	15776
query68	7732	828	539	539
query69	476	307	267	267
query70	1140	1093	1076	1076
query71	547	290	261	261
query72	5659	3748	3519	3519
query73	640	749	366	366
query74	10357	9484	9293	9293
query75	3312	3170	2634	2634
query76	3284	1184	750	750
query77	597	353	288	288
query78	10298	10581	9663	9663
query79	3138	897	598	598
query80	649	539	452	452
query81	494	253	236	236
query82	640	122	92	92
query83	167	157	144	144
query84	235	112	78	78
query85	786	372	302	302
query86	348	289	295	289
query87	4318	4344	4231	4231
query88	4939	2417	2367	2367
query89	406	338	296	296
query90	1886	192	193	192
query91	136	148	106	106
query92	65	56	52	52
query93	1627	916	549	549
query94	696	415	304	304
query95	344	275	269	269
query96	500	631	293	293
query97	3191	3326	3158	3158
query98	226	207	193	193
query99	1537	1399	1314	1314
Total cold run time: 292791 ms
Total hot run time: 191090 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.07 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b43a01ceb4831bc57459fbbab2898f7469a50bc3, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.02
query3	0.24	0.07	0.07
query4	1.62	0.11	0.11
query5	0.53	0.49	0.51
query6	1.14	0.72	0.73
query7	0.02	0.01	0.01
query8	0.05	0.03	0.03
query9	0.58	0.50	0.53
query10	0.55	0.55	0.55
query11	0.16	0.10	0.11
query12	0.14	0.11	0.10
query13	0.62	0.60	0.59
query14	0.78	0.82	0.81
query15	0.86	0.84	0.83
query16	0.37	0.39	0.38
query17	1.00	1.09	1.07
query18	0.23	0.22	0.23
query19	1.98	1.81	1.86
query20	0.01	0.02	0.01
query21	15.39	0.90	0.58
query22	0.75	0.76	0.61
query23	15.22	1.44	0.53
query24	3.08	1.53	1.15
query25	0.31	0.10	0.10
query26	0.29	0.13	0.13
query27	0.05	0.05	0.04
query28	13.19	0.96	0.44
query29	12.60	3.82	3.21
query30	0.25	0.09	0.07
query31	2.82	0.60	0.38
query32	3.23	0.54	0.46
query33	3.02	3.06	3.03
query34	16.88	5.11	4.56
query35	4.54	4.54	4.60
query36	0.65	0.49	0.49
query37	0.10	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.73 s
Total hot run time: 29.07 s

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 0.00% (0/57) 🎉
Increment coverage report
Complete coverage report

@vinlee19
Copy link
Contributor Author

run p0

@morrySnow morrySnow changed the title branch-3.1:[feat][paimon] support show partitions command for paimon catalog branch-3.1: [feat][paimon] support show partitions command for paimon catalog #53789 Aug 14, 2025
@morrySnow morrySnow merged commit 592d488 into apache:branch-3.1 Aug 14, 2025
22 of 24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants