Skip to content

Conversation

@vinlee19
Copy link
Contributor

@vinlee19 vinlee19 commented Jul 23, 2025

What problem does this PR solve?

Implement show partition feature. Prerequisites: PR #54043 date conversion fixes.
Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@vinlee19
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33778 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e62c25aacf3c696dbc51c6faf38008f665685258, data reload: false

------ Round 1 ----------------------------------
q1	17564	5279	5076	5076
q2	1930	287	181	181
q3	10315	1325	709	709
q4	10218	1042	532	532
q5	7464	2490	2294	2294
q6	188	166	131	131
q7	918	762	603	603
q8	9345	1357	1067	1067
q9	6818	5121	5103	5103
q10	6927	2393	1942	1942
q11	483	280	268	268
q12	357	352	216	216
q13	17783	3690	3135	3135
q14	229	227	221	221
q15	572	477	491	477
q16	417	424	370	370
q17	604	879	361	361
q18	7527	7216	7001	7001
q19	1238	967	575	575
q20	338	358	228	228
q21	3883	3169	2318	2318
q22	1054	1013	970	970
Total cold run time: 106172 ms
Total hot run time: 33778 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5190	5140	5109	5109
q2	255	327	223	223
q3	2128	2660	2291	2291
q4	1343	1777	1378	1378
q5	4225	4546	4595	4546
q6	222	175	129	129
q7	2037	2019	1792	1792
q8	2643	2718	2644	2644
q9	7281	7247	7234	7234
q10	3098	3611	2845	2845
q11	579	511	518	511
q12	712	797	642	642
q13	3648	3948	3756	3756
q14	285	310	271	271
q15	523	482	489	482
q16	444	479	452	452
q17	1162	1476	1392	1392
q18	7992	7847	7690	7690
q19	819	821	870	821
q20	2042	2057	1872	1872
q21	5109	4667	4399	4399
q22	1071	1046	990	990
Total cold run time: 52808 ms
Total hot run time: 51469 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188290 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e62c25aacf3c696dbc51c6faf38008f665685258, data reload: false

query1	992	408	414	408
query2	6519	1748	1729	1729
query3	6741	221	213	213
query4	26634	23340	23276	23276
query5	4374	656	505	505
query6	333	240	213	213
query7	4633	515	300	300
query8	283	238	218	218
query9	8611	2879	2863	2863
query10	489	356	303	303
query11	15628	14992	14821	14821
query12	168	122	116	116
query13	1673	543	410	410
query14	8757	6154	6104	6104
query15	212	198	166	166
query16	7185	662	463	463
query17	1226	751	617	617
query18	2006	413	337	337
query19	196	200	175	175
query20	128	123	115	115
query21	213	127	110	110
query22	4228	4227	4169	4169
query23	34006	32885	33153	32885
query24	8113	2427	2431	2427
query25	548	479	405	405
query26	1234	267	165	165
query27	2757	510	350	350
query28	4348	2214	2169	2169
query29	795	578	481	481
query30	284	219	191	191
query31	919	840	765	765
query32	85	74	75	74
query33	550	381	361	361
query34	820	843	527	527
query35	780	834	758	758
query36	974	1000	933	933
query37	123	111	90	90
query38	4186	4191	4081	4081
query39	1457	1410	1398	1398
query40	221	129	122	122
query41	63	56	54	54
query42	123	110	111	110
query43	523	517	483	483
query44	1411	866	862	862
query45	180	167	168	167
query46	886	1018	667	667
query47	1753	1789	1721	1721
query48	390	427	316	316
query49	701	485	389	389
query50	690	695	420	420
query51	5412	5471	5376	5376
query52	116	118	102	102
query53	233	278	189	189
query54	597	627	536	536
query55	93	91	91	91
query56	336	321	328	321
query57	1165	1188	1144	1144
query58	296	284	275	275
query59	2612	2741	2532	2532
query60	364	383	343	343
query61	132	131	122	122
query62	815	726	646	646
query63	235	205	200	200
query64	4331	1043	689	689
query65	4329	4214	4204	4204
query66	1163	411	365	365
query67	15836	15598	15386	15386
query68	8315	920	608	608
query69	496	327	307	307
query70	1282	1182	1150	1150
query71	482	337	315	315
query72	5727	4828	4881	4828
query73	745	647	357	357
query74	9157	9222	8871	8871
query75	3911	3136	2671	2671
query76	3748	1162	755	755
query77	789	402	325	325
query78	10089	10191	9325	9325
query79	2454	799	600	600
query80	619	547	472	472
query81	452	261	225	225
query82	495	136	103	103
query83	289	247	244	244
query84	297	99	85	85
query85	784	371	327	327
query86	335	320	313	313
query87	4388	4469	4260	4260
query88	3238	2226	2232	2226
query89	378	329	284	284
query90	1935	225	223	223
query91	139	141	112	112
query92	87	71	71	71
query93	1750	997	620	620
query94	683	486	301	301
query95	395	313	313	313
query96	484	581	274	274
query97	2673	2716	2678	2678
query98	235	213	212	212
query99	1432	1433	1312	1312
Total cold run time: 276497 ms
Total hot run time: 188290 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.17 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e62c25aacf3c696dbc51c6faf38008f665685258, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.25	0.07	0.07
query4	1.62	0.11	0.11
query5	0.43	0.41	0.40
query6	1.17	0.67	0.69
query7	0.02	0.02	0.02
query8	0.06	0.03	0.03
query9	0.60	0.53	0.50
query10	0.60	0.58	0.58
query11	0.16	0.11	0.11
query12	0.14	0.11	0.12
query13	0.62	0.60	0.61
query14	0.80	0.82	0.82
query15	0.88	0.86	0.86
query16	0.39	0.39	0.40
query17	1.04	1.07	1.03
query18	0.21	0.19	0.20
query19	1.93	1.88	1.84
query20	0.02	0.01	0.02
query21	15.42	0.92	0.56
query22	0.76	1.08	0.70
query23	14.95	1.34	0.62
query24	6.74	1.18	0.54
query25	0.51	0.09	0.14
query26	0.62	0.18	0.14
query27	0.06	0.05	0.05
query28	9.04	0.96	0.41
query29	12.54	3.88	3.24
query30	3.01	2.96	2.91
query31	2.83	0.59	0.37
query32	3.24	0.54	0.47
query33	3.05	3.11	3.12
query34	16.13	5.49	4.84
query35	4.87	4.90	4.89
query36	0.69	0.50	0.49
query37	0.10	0.07	0.06
query38	0.06	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.14	0.14
query41	0.08	0.02	0.03
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.03 s
Total hot run time: 32.17 s

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 0.00% (0/59) 🎉
Increment coverage report
Complete coverage report

@vinlee19
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34064 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ed41b66d708eb398008afa491d9c76bbdb0e0125, data reload: false

------ Round 1 ----------------------------------
q1	17598	5236	5103	5103
q2	1935	296	185	185
q3	10498	1282	689	689
q4	10304	999	534	534
q5	8598	2374	2342	2342
q6	207	162	131	131
q7	901	732	602	602
q8	9323	1302	1096	1096
q9	7283	5108	5132	5108
q10	6950	2397	1960	1960
q11	500	291	277	277
q12	351	348	223	223
q13	17777	3689	3090	3090
q14	235	228	217	217
q15	547	491	485	485
q16	425	430	368	368
q17	605	872	366	366
q18	7426	7233	7156	7156
q19	1117	955	564	564
q20	354	348	220	220
q21	3966	3218	2366	2366
q22	1086	1010	982	982
Total cold run time: 107986 ms
Total hot run time: 34064 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5175	5104	5118	5104
q2	248	328	223	223
q3	2177	2618	2273	2273
q4	1378	1735	1326	1326
q5	4345	4545	4573	4545
q6	219	171	126	126
q7	2038	1989	1844	1844
q8	2658	2724	2626	2626
q9	7570	7201	7307	7201
q10	3060	3313	3076	3076
q11	589	505	508	505
q12	659	765	648	648
q13	3514	3969	3506	3506
q14	313	296	269	269
q15	522	485	479	479
q16	463	493	466	466
q17	1192	1653	1342	1342
q18	7994	7672	7679	7672
q19	798	754	841	754
q20	1982	2074	1924	1924
q21	5096	4610	4242	4242
q22	1057	1046	1002	1002
Total cold run time: 53047 ms
Total hot run time: 51153 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187686 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ed41b66d708eb398008afa491d9c76bbdb0e0125, data reload: false

query1	969	398	405	398
query2	6506	1751	1726	1726
query3	6741	221	219	219
query4	26277	23861	23336	23336
query5	4400	619	483	483
query6	319	225	205	205
query7	4624	498	298	298
query8	289	234	211	211
query9	8581	2862	2847	2847
query10	484	342	277	277
query11	15697	14983	14798	14798
query12	173	119	115	115
query13	1656	526	430	430
query14	8497	5884	5915	5884
query15	208	189	181	181
query16	7303	628	474	474
query17	1209	728	626	626
query18	2012	425	329	329
query19	198	195	171	171
query20	128	125	123	123
query21	219	133	107	107
query22	4436	4402	4262	4262
query23	34172	33008	32840	32840
query24	8107	2340	2321	2321
query25	524	479	437	437
query26	1232	270	160	160
query27	2760	508	341	341
query28	4379	2201	2169	2169
query29	774	565	477	477
query30	280	222	187	187
query31	901	821	777	777
query32	80	81	72	72
query33	540	383	331	331
query34	793	843	517	517
query35	782	831	734	734
query36	957	1002	897	897
query37	120	105	84	84
query38	4074	4115	4008	4008
query39	1452	1423	1411	1411
query40	220	125	117	117
query41	58	58	53	53
query42	118	113	108	108
query43	507	504	483	483
query44	1341	851	858	851
query45	176	167	165	165
query46	846	1016	628	628
query47	1797	1816	1797	1797
query48	385	412	311	311
query49	728	479	397	397
query50	647	699	412	412
query51	5423	5636	5385	5385
query52	118	108	101	101
query53	226	261	192	192
query54	584	585	527	527
query55	92	84	88	84
query56	332	304	325	304
query57	1199	1192	1127	1127
query58	284	280	291	280
query59	2593	2682	2655	2655
query60	356	340	334	334
query61	144	123	122	122
query62	787	715	675	675
query63	225	189	196	189
query64	4316	993	723	723
query65	4248	4154	4192	4154
query66	1188	425	331	331
query67	15874	15588	15467	15467
query68	8596	900	559	559
query69	479	329	283	283
query70	1263	1181	1149	1149
query71	449	343	305	305
query72	5564	4698	4729	4698
query73	743	606	355	355
query74	8949	9038	8889	8889
query75	3940	3074	2574	2574
query76	3664	1142	732	732
query77	806	389	315	315
query78	9808	10074	9370	9370
query79	3603	895	570	570
query80	640	541	474	474
query81	470	251	228	228
query82	281	137	105	105
query83	278	254	224	224
query84	292	97	78	78
query85	737	361	394	361
query86	336	340	316	316
query87	4381	4334	4328	4328
query88	2830	2229	2214	2214
query89	427	316	282	282
query90	2068	221	224	221
query91	137	145	112	112
query92	81	73	67	67
query93	2376	959	626	626
query94	682	383	302	302
query95	394	310	305	305
query96	489	598	274	274
query97	2709	2754	2645	2645
query98	221	212	209	209
query99	1420	1406	1281	1281
Total cold run time: 276778 ms
Total hot run time: 187686 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.36 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ed41b66d708eb398008afa491d9c76bbdb0e0125, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.25	0.08	0.07
query4	1.60	0.11	0.11
query5	0.44	0.41	0.40
query6	1.17	0.65	0.67
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.60	0.53	0.50
query10	0.59	0.58	0.57
query11	0.16	0.11	0.11
query12	0.15	0.12	0.11
query13	0.63	0.61	0.60
query14	0.80	0.81	0.83
query15	0.88	0.86	0.89
query16	0.38	0.38	0.39
query17	1.03	1.03	1.06
query18	0.21	0.20	0.20
query19	2.00	1.85	1.82
query20	0.02	0.01	0.01
query21	15.38	0.91	0.56
query22	0.80	1.12	0.65
query23	14.96	1.36	0.66
query24	6.53	1.07	0.73
query25	0.50	0.15	0.23
query26	0.55	0.16	0.14
query27	0.06	0.06	0.05
query28	10.00	0.90	0.42
query29	12.53	3.87	3.25
query30	3.05	3.04	2.99
query31	2.82	0.60	0.38
query32	3.24	0.53	0.48
query33	3.02	3.13	3.07
query34	15.88	5.41	4.80
query35	4.87	4.86	4.87
query36	0.69	0.50	0.51
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.18	0.14	0.14
query41	0.08	0.02	0.03
query42	0.03	0.03	0.02
query43	0.03	0.02	0.03
Total cold run time: 106.47 s
Total hot run time: 32.36 s

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 0.00% (0/59) 🎉
Increment coverage report
Complete coverage report

@vinlee19
Copy link
Contributor Author

run p0

@vinlee19
Copy link
Contributor Author

run cloud_p0

@vinlee19 vinlee19 force-pushed the show_partitions_paimon branch from ed41b66 to c1e7869 Compare August 4, 2025 03:15
@vinlee19
Copy link
Contributor Author

vinlee19 commented Aug 4, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33952 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c1e786944ef5d60246ebe5561c2868150eae7fc9, data reload: false

------ Round 1 ----------------------------------
q1	17615	5548	5336	5336
q2	1934	305	178	178
q3	10398	1411	723	723
q4	10286	1000	518	518
q5	9750	2344	2354	2344
q6	237	166	132	132
q7	892	765	613	613
q8	9345	1371	1053	1053
q9	6796	5165	5151	5151
q10	6944	2367	1977	1977
q11	462	270	263	263
q12	353	362	229	229
q13	17823	3498	3066	3066
q14	244	239	217	217
q15	564	471	479	471
q16	422	446	399	399
q17	576	845	356	356
q18	7304	7057	7012	7012
q19	1521	985	527	527
q20	552	312	206	206
q21	3485	3046	2229	2229
q22	1053	1077	952	952
Total cold run time: 108556 ms
Total hot run time: 33952 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5419	5298	5292	5292
q2	395	303	216	216
q3	2112	2563	2190	2190
q4	1322	1719	1308	1308
q5	4388	4447	4445	4445
q6	245	189	136	136
q7	1996	1872	1900	1872
q8	2749	2592	2450	2450
q9	7211	7342	7444	7342
q10	3071	3401	3089	3089
q11	601	645	500	500
q12	883	768	631	631
q13	3330	3768	3243	3243
q14	296	316	279	279
q15	494	460	458	458
q16	425	515	522	515
q17	1199	1459	1450	1450
q18	7891	8076	7749	7749
q19	14916	917	856	856
q20	2930	2043	1806	1806
q21	12665	4462	4265	4265
q22	1098	1070	962	962
Total cold run time: 75636 ms
Total hot run time: 51054 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 169582 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c1e786944ef5d60246ebe5561c2868150eae7fc9, data reload: false

============================================
query1	992	392	405	392
query2	6527	1810	1723	1723
query3	6744	221	219	219
query4	26916	23802	23100	23100
query5	4353	632	525	525
query6	327	234	213	213
query7	4629	517	299	299
query8	284	236	227	227
query9	8623	2970	2926	2926
query10	484	338	293	293
query11	15877	15072	14680	14680
query12	183	136	135	135
query13	1659	541	416	416
query14	8488	5789	5785	5785
query15	213	190	165	165
query16	7140	671	499	499
query17	989	807	647	647
query18	2019	460	331	331
query19	223	221	201	201
query20	153	144	143	143
query21	221	132	111	111
query22	4022	4036	3894	3894
query23	34611	34487	34307	34307
query24	8241	2366	2424	2366
query25	565	554	431	431
query26	1236	287	159	159
query27	2711	500	348	348
query28	4353	2319	2301	2301
query29	812	616	493	493
query30	299	231	208	208
query31	883	793	689	689
query32	97	79	81	79
query33	560	410	364	364
query34	830	838	529	529
query35	804	835	771	771
query36	1013	1029	969	969
query37	140	109	94	94
query38	4002	4001	4086	4001
query39	1461	1388	1373	1373
query40	238	141	132	132
query41	61	58	61	58
query42	140	119	129	119
query43	522	544	488	488
query44	1405	890	863	863
query45	201	192	192	192
query46	954	1055	671	671
query47	1817	1850	1785	1785
query48	408	428	314	314
query49	734	504	429	429
query50	669	712	401	401
query51	4200	4198	4142	4142
query52	128	129	115	115
query53	269	285	207	207
query54	632	627	555	555
query55	87	87	85	85
query56	370	361	342	342
query57	1207	1226	1132	1132
query58	334	337	330	330
query59	2600	2621	2515	2515
query60	402	394	390	390
query61	128	134	129	129
query62	818	728	677	677
query63	256	215	213	213
query64	4401	1111	771	771
query65	4253	4100	4110	4100
query66	1138	451	331	331
query67	query68	18301	866	988	866
query69	1014	278	344	278
query70	1311	1097	1104	1097
query71	670	315	320	315
query72	9143	2263	2151	2151
query73	4097	687	353	353
query74	8997	8959	8542	8542
query75	7240	3108	2671	2671
query76	8510	1203	797	797
query77	1178	418	335	335
query78	9730	11236	9174	9174
query79	15267	600	585	585
query80	1876	618	500	500
query81	564	255	230	230
query82	550	153	117	117
query83	376	292	274	274
query84	304	97	85	85
query85	879	369	348	348
query86	380	329	272	272
query87	4379	4298	4112	4112
query88	5509	2227	2193	2193
query89	487	365	316	316
query90	2530	228	228	228
query91	152	142	111	111
query92	89	72	67	67
query93	6547	960	661	661
query94	1151	389	288	288
query95	421	327	318	318
query96	503	593	278	278
query97	2707	2686	2630	2630
query98	249	223	227	223
query99	1464	1355	1275	1275
Total cold run time: 308631 ms
Total hot run time: 169582 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.37 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c1e786944ef5d60246ebe5561c2868150eae7fc9, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.25	0.07	0.07
query4	1.61	0.11	0.11
query5	0.42	0.40	0.43
query6	1.16	0.67	0.66
query7	0.03	0.02	0.02
query8	0.05	0.03	0.04
query9	0.56	0.46	0.47
query10	0.53	0.53	0.52
query11	0.16	0.10	0.10
query12	0.14	0.11	0.11
query13	0.65	0.68	0.64
query14	0.89	1.07	1.06
query15	0.95	0.91	0.86
query16	0.40	0.39	0.38
query17	1.07	1.07	1.07
query18	0.23	0.21	0.20
query19	2.02	1.91	1.89
query20	0.02	0.01	0.02
query21	15.38	0.79	0.55
query22	0.79	1.05	0.86
query23	14.81	1.17	0.62
query24	6.66	1.31	0.84
query25	0.57	0.34	0.06
query26	0.56	0.15	0.14
query27	0.08	0.05	0.06
query28	10.09	0.83	0.44
query29	12.56	3.77	3.27
query30	3.09	2.97	3.03
query31	2.81	0.56	0.39
query32	3.24	0.56	0.52
query33	3.05	3.20	3.21
query34	16.05	5.34	4.98
query35	4.92	5.04	4.94
query36	0.71	0.54	0.51
query37	0.09	0.07	0.07
query38	0.06	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.14	0.14
query41	0.08	0.03	0.03
query42	0.03	0.02	0.03
query43	0.05	0.03	0.03
Total cold run time: 107.14 s
Total hot run time: 33.37 s

@github-actions
Copy link
Contributor

github-actions bot commented Aug 4, 2025

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Aug 4, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Aug 4, 2025

PR approved by anyone and no changes requested.

Copy link
Contributor

@suxiaogang223 suxiaogang223 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@morningman morningman merged commit 48e0ef1 into apache:master Aug 11, 2025
28 of 30 checks passed
morrySnow pushed a commit that referenced this pull request Aug 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/3.1.0-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants