[fix](paimon) get the correct schema when querying paimon table #55070

suxiaogang223 · 2025-08-20T09:49:49Z

What problem does this PR solve?

Get the correct schema when querying paimon table:

Get the latest schema when querying table and branch
Get the schema of snapshot when querying time travel and tag

Problem Summary:

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

hello-stephen · 2025-08-20T09:49:54Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

suxiaogang223 · 2025-08-20T16:21:00Z

run buildall

doris-robot · 2025-08-20T16:38:18Z

TPC-H: Total hot run time: 34459 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0bea6f434ad1437ad5942470e26d92067a613213, data reload: false

------ Round 1 ----------------------------------
q1	17595	5246	5032	5032
q2	1930	290	181	181
q3	10324	1334	753	753
q4	10210	1013	510	510
q5	7497	2402	2320	2320
q6	184	160	134	134
q7	901	735	607	607
q8	9301	1272	1110	1110
q9	7059	5081	5063	5063
q10	6878	2375	1989	1989
q11	479	279	281	279
q12	348	352	226	226
q13	17769	3648	3036	3036
q14	225	239	217	217
q15	555	493	477	477
q16	423	433	368	368
q17	589	855	372	372
q18	7657	7207	6943	6943
q19	1233	965	562	562
q20	361	342	228	228
q21	3872	3280	3083	3083
q22	1073	1045	969	969
Total cold run time: 106463 ms
Total hot run time: 34459 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5198	5120	5174	5120
q2	242	322	219	219
q3	2156	2706	2317	2317
q4	1361	1837	1381	1381
q5	4324	4631	4546	4546
q6	214	171	132	132
q7	2058	1941	1905	1905
q8	2638	2688	2599	2599
q9	7475	7115	7189	7115
q10	3172	3259	2888	2888
q11	590	541	511	511
q12	691	786	633	633
q13	3488	3888	3402	3402
q14	307	330	283	283
q15	506	500	464	464
q16	460	489	478	478
q17	1183	1554	1424	1424
q18	7919	7714	7608	7608
q19	839	882	962	882
q20	1981	2053	1917	1917
q21	4897	4483	4359	4359
q22	1084	1045	984	984
Total cold run time: 52783 ms
Total hot run time: 51167 ms

doris-robot · 2025-08-20T16:49:50Z

TPC-DS: Total hot run time: 185549 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0bea6f434ad1437ad5942470e26d92067a613213, data reload: false

query1	988	388	397	388
query2	6516	1805	1736	1736
query3	6735	218	222	218
query4	26527	23585	23308	23308
query5	4365	608	487	487
query6	313	212	209	209
query7	4624	495	291	291
query8	272	237	218	218
query9	8641	2869	2891	2869
query10	484	322	300	300
query11	15384	15031	14663	14663
query12	167	119	116	116
query13	1654	553	429	429
query14	8869	5800	5856	5800
query15	209	187	172	172
query16	7739	639	503	503
query17	1198	723	603	603
query18	2039	412	321	321
query19	197	185	168	168
query20	129	130	119	119
query21	213	123	108	108
query22	4089	4190	4127	4127
query23	34354	33178	33379	33178
query24	8122	2339	2361	2339
query25	519	448	407	407
query26	1229	268	166	166
query27	2704	485	350	350
query28	4336	2263	2223	2223
query29	740	559	449	449
query30	285	224	184	184
query31	897	800	694	694
query32	86	71	76	71
query33	554	364	341	341
query34	803	845	525	525
query35	801	811	724	724
query36	973	1021	879	879
query37	126	106	86	86
query38	3981	4071	4039	4039
query39	1486	1429	1430	1429
query40	221	121	118	118
query41	62	54	54	54
query42	120	104	112	104
query43	540	508	485	485
query44	1331	850	848	848
query45	172	163	159	159
query46	837	998	654	654
query47	1793	1821	1748	1748
query48	393	419	315	315
query49	722	476	391	391
query50	635	686	410	410
query51	4075	4193	4203	4193
query52	116	115	106	106
query53	239	260	203	203
query54	602	581	535	535
query55	92	87	83	83
query56	317	321	303	303
query57	1189	1208	1150	1150
query58	291	269	257	257
query59	2681	2876	2694	2694
query60	344	336	331	331
query61	124	122	124	122
query62	916	712	671	671
query63	232	188	187	187
query64	4234	1010	715	715
query65	4290	4201	4234	4201
query66	1081	409	332	332
query67	15779	15118	14963	14963
query68	8236	904	569	569
query69	490	341	287	287
query70	1206	1143	1088	1088
query71	484	320	306	306
query72	5559	4840	4929	4840
query73	761	713	355	355
query74	8951	9080	9011	9011
query75	3886	3071	2584	2584
query76	3718	1123	724	724
query77	808	388	320	320
query78	9576	9637	8857	8857
query79	2115	815	577	577
query80	606	541	551	541
query81	475	274	221	221
query82	421	137	104	104
query83	283	252	224	224
query84	311	109	79	79
query85	813	426	324	324
query86	338	292	308	292
query87	4334	4200	4162	4162
query88	2775	2185	2187	2185
query89	380	311	280	280
query90	1896	221	219	219
query91	144	144	111	111
query92	87	66	69	66
query93	1138	972	658	658
query94	669	398	307	307
query95	392	321	306	306
query96	475	591	270	270
query97	2649	2679	2579	2579
query98	236	212	210	210
query99	1437	1390	1324	1324
Total cold run time: 272425 ms
Total hot run time: 185549 ms

doris-robot · 2025-08-20T16:55:18Z

ClickBench: Total hot run time: 32.73 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0bea6f434ad1437ad5942470e26d92067a613213, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.05
query3	0.25	0.08	0.07
query4	1.61	0.11	0.11
query5	0.42	0.42	0.42
query6	1.16	0.64	0.66
query7	0.03	0.03	0.02
query8	0.06	0.04	0.04
query9	0.61	0.52	0.52
query10	0.57	0.55	0.58
query11	0.16	0.11	0.11
query12	0.15	0.11	0.11
query13	0.62	0.61	0.61
query14	0.79	0.83	0.83
query15	0.89	0.84	0.86
query16	0.39	0.39	0.39
query17	1.04	1.05	1.03
query18	0.21	0.19	0.20
query19	1.93	1.79	1.82
query20	0.01	0.01	0.01
query21	15.39	0.96	0.58
query22	0.74	1.21	0.76
query23	14.85	1.36	0.62
query24	6.37	1.28	1.05
query25	0.57	0.24	0.18
query26	0.65	0.15	0.14
query27	0.06	0.06	0.06
query28	10.43	0.91	0.42
query29	12.58	3.85	3.22
query30	3.06	3.01	2.97
query31	2.82	0.59	0.37
query32	3.23	0.54	0.47
query33	3.08	3.01	3.10
query34	15.90	5.45	4.84
query35	4.91	4.87	4.93
query36	0.69	0.51	0.49
query37	0.09	0.07	0.07
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.17	0.14	0.13
query41	0.08	0.03	0.03
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.84 s
Total hot run time: 32.73 s

suxiaogang223 · 2025-08-21T08:48:58Z

run buildall

doris-robot · 2025-08-21T09:16:14Z

TPC-H: Total hot run time: 33885 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7bc49a3b130b9a0865c1d60692a412d745945d51, data reload: false

------ Round 1 ----------------------------------
q1	17582	5313	5162	5162
q2	1910	285	173	173
q3	10327	1300	707	707
q4	10202	991	493	493
q5	7509	2395	2307	2307
q6	187	165	127	127
q7	904	743	588	588
q8	9298	1398	1128	1128
q9	6837	5219	5176	5176
q10	6960	2379	1962	1962
q11	489	277	262	262
q12	338	343	212	212
q13	17784	3645	3031	3031
q14	228	230	212	212
q15	561	470	470	470
q16	428	415	365	365
q17	617	880	359	359
q18	7484	7066	7036	7036
q19	1197	1011	594	594
q20	334	331	206	206
q21	3917	2607	2320	2320
q22	1058	1044	995	995
Total cold run time: 106151 ms
Total hot run time: 33885 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5296	5265	5293	5265
q2	244	323	217	217
q3	2229	2631	2284	2284
q4	1365	1796	1294	1294
q5	4192	4493	4504	4493
q6	236	176	127	127
q7	2069	1897	1868	1868
q8	2728	2685	2644	2644
q9	7275	7288	7212	7212
q10	3109	3327	2893	2893
q11	595	513	488	488
q12	678	780	657	657
q13	3522	3937	3350	3350
q14	309	290	274	274
q15	528	491	470	470
q16	464	506	471	471
q17	1207	1571	1402	1402
q18	8035	7709	7632	7632
q19	857	805	803	803
q20	1915	1993	1824	1824
q21	4750	4291	4256	4256
q22	1071	1024	971	971
Total cold run time: 52674 ms
Total hot run time: 50895 ms

suxiaogang223 · 2025-08-21T09:21:02Z

run buildall

suxiaogang223 · 2025-08-21T09:22:14Z

run buildall

doris-robot · 2025-08-21T09:39:39Z

TPC-H: Total hot run time: 33707 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3edfe210ac90d54ed4358989319bb677a9e4202d, data reload: false

------ Round 1 ----------------------------------
q1	17594	5150	5109	5109
q2	1988	281	178	178
q3	10254	1248	744	744
q4	10208	1017	526	526
q5	7560	2396	2334	2334
q6	175	159	129	129
q7	925	745	596	596
q8	9297	1286	1101	1101
q9	6872	5040	5141	5040
q10	6929	2372	1997	1997
q11	493	288	282	282
q12	344	344	216	216
q13	17791	3659	3013	3013
q14	240	228	218	218
q15	553	477	488	477
q16	422	423	374	374
q17	593	860	355	355
q18	7761	7027	6961	6961
q19	1264	956	566	566
q20	344	318	211	211
q21	3877	3163	2324	2324
q22	1069	998	956	956
Total cold run time: 106553 ms
Total hot run time: 33707 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5132	5074	5096	5074
q2	240	320	222	222
q3	2210	2643	2299	2299
q4	1324	1767	1321	1321
q5	4233	4477	4554	4477
q6	215	172	130	130
q7	1987	2003	1829	1829
q8	2592	2683	2619	2619
q9	7265	7436	7327	7327
q10	3109	3337	2846	2846
q11	594	547	490	490
q12	706	774	624	624
q13	3534	3893	3263	3263
q14	287	303	291	291
q15	523	478	476	476
q16	470	483	441	441
q17	1277	1551	1399	1399
q18	7995	7592	7621	7592
q19	822	809	847	809
q20	1933	1947	1813	1813
q21	4780	4307	4312	4307
q22	1056	1043	1010	1010
Total cold run time: 52284 ms
Total hot run time: 50659 ms

doris-robot · 2025-08-21T09:51:09Z

TPC-DS: Total hot run time: 184758 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3edfe210ac90d54ed4358989319bb677a9e4202d, data reload: false

query1	991	373	427	373
query2	6511	1713	1738	1713
query3	6751	221	210	210
query4	26112	23404	23361	23361
query5	4344	601	472	472
query6	323	208	195	195
query7	4628	498	288	288
query8	282	236	220	220
query9	8628	2912	2899	2899
query10	490	326	279	279
query11	15881	15009	14849	14849
query12	160	114	113	113
query13	1701	556	419	419
query14	8679	5666	5699	5666
query15	221	184	162	162
query16	7374	674	507	507
query17	1226	749	619	619
query18	1998	429	328	328
query19	192	192	159	159
query20	124	117	119	117
query21	219	138	115	115
query22	4271	4309	4011	4011
query23	33849	32924	32913	32913
query24	8130	2362	2352	2352
query25	533	477	408	408
query26	1230	274	155	155
query27	2747	506	338	338
query28	4327	2303	2256	2256
query29	754	567	463	463
query30	288	224	182	182
query31	873	790	741	741
query32	80	72	75	72
query33	551	359	334	334
query34	788	849	509	509
query35	789	819	732	732
query36	965	992	918	918
query37	118	106	82	82
query38	4045	4049	4042	4042
query39	1487	1428	1398	1398
query40	220	124	111	111
query41	59	58	53	53
query42	119	109	106	106
query43	503	493	479	479
query44	1314	844	842	842
query45	181	171	170	170
query46	865	1027	640	640
query47	1810	1786	1745	1745
query48	383	422	305	305
query49	716	476	391	391
query50	636	689	397	397
query51	4124	4102	4080	4080
query52	116	111	102	102
query53	227	261	191	191
query54	590	583	527	527
query55	89	82	82	82
query56	314	325	305	305
query57	1186	1204	1139	1139
query58	276	270	262	262
query59	2596	2826	2623	2623
query60	344	334	324	324
query61	142	121	127	121
query62	786	702	633	633
query63	227	186	198	186
query64	4281	1042	690	690
query65	4213	4169	4228	4169
query66	1151	402	313	313
query67	15473	15273	14991	14991
query68	8152	917	582	582
query69	535	312	278	278
query70	1197	1120	1125	1120
query71	455	319	303	303
query72	5331	4751	4720	4720
query73	730	593	351	351
query74	9120	8745	9012	8745
query75	3754	3097	2657	2657
query76	3694	1148	732	732
query77	781	399	322	322
query78	9621	9821	8855	8855
query79	2132	796	615	615
query80	612	524	464	464
query81	473	321	224	224
query82	436	143	104	104
query83	249	261	234	234
query84	241	94	87	87
query85	790	364	335	335
query86	354	308	311	308
query87	4192	4336	4273	4273
query88	3252	2260	2175	2175
query89	379	316	286	286
query90	1920	218	219	218
query91	140	140	111	111
query92	88	68	68	68
query93	1579	969	647	647
query94	681	402	310	310
query95	383	307	298	298
query96	489	574	278	278
query97	2630	2674	2611	2611
query98	236	212	216	212
query99	1658	1392	1288	1288
Total cold run time: 271885 ms
Total hot run time: 184758 ms

doris-robot · 2025-08-21T09:56:48Z

ClickBench: Total hot run time: 32.48 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3edfe210ac90d54ed4358989319bb677a9e4202d, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.05
query3	0.24	0.07	0.08
query4	1.61	0.11	0.12
query5	0.43	0.41	0.40
query6	1.17	0.64	0.65
query7	0.02	0.03	0.02
query8	0.05	0.03	0.04
query9	0.60	0.52	0.51
query10	0.56	0.56	0.57
query11	0.16	0.11	0.11
query12	0.15	0.11	0.12
query13	0.62	0.61	0.60
query14	0.80	0.84	0.82
query15	0.87	0.84	0.85
query16	0.39	0.39	0.39
query17	1.06	1.08	1.03
query18	0.21	0.20	0.20
query19	1.92	1.87	1.80
query20	0.01	0.02	0.01
query21	15.39	1.01	0.61
query22	0.77	1.13	0.76
query23	14.87	1.40	0.63
query24	6.82	1.05	0.52
query25	0.41	0.12	0.18
query26	0.56	0.15	0.13
query27	0.06	0.05	0.05
query28	9.81	1.02	0.43
query29	12.55	4.01	3.29
query30	3.03	3.06	3.03
query31	2.83	0.60	0.38
query32	3.24	0.59	0.48
query33	3.07	3.15	3.16
query34	16.14	5.51	4.83
query35	4.93	4.92	4.90
query36	0.70	0.51	0.50
query37	0.10	0.07	0.07
query38	0.06	0.04	0.04
query39	0.03	0.02	0.03
query40	0.18	0.14	0.14
query41	0.08	0.03	0.03
query42	0.03	0.02	0.03
query43	0.03	0.03	0.03
Total cold run time: 106.68 s
Total hot run time: 32.48 s

hello-stephen · 2025-08-21T10:21:04Z

FE UT Coverage Report

Increment line coverage 0.00% (0/55) 🎉
Increment coverage report
Complete coverage report

github-actions · 2025-08-21T21:28:52Z

PR approved by at least one committer and no changes requested.

github-actions · 2025-08-21T21:28:54Z

PR approved by anyone and no changes requested.

fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonExternalTable.java

suxiaogang223 · 2025-08-25T18:02:39Z

run buildall

doris-robot · 2025-08-25T18:34:31Z

TPC-H: Total hot run time: 33421 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b5a05ada7f1c0c2ed3fffa11ee3f7ef842322264, data reload: false

------ Round 1 ----------------------------------
q1	17584	5137	5012	5012
q2	1914	287	179	179
q3	10308	1266	708	708
q4	10209	1017	493	493
q5	7497	2369	2334	2334
q6	177	157	126	126
q7	888	742	613	613
q8	9337	1252	1031	1031
q9	6872	5092	5021	5021
q10	6931	2356	1934	1934
q11	474	289	272	272
q12	335	343	203	203
q13	17797	3596	3024	3024
q14	226	234	210	210
q15	568	469	493	469
q16	435	419	380	380
q17	592	839	360	360
q18	7605	7103	7001	7001
q19	1195	930	545	545
q20	338	326	228	228
q21	3832	2540	2317	2317
q22	1046	1032	961	961
Total cold run time: 106160 ms
Total hot run time: 33421 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5134	5100	5055	5055
q2	239	323	221	221
q3	2144	2688	2276	2276
q4	1336	1783	1326	1326
q5	4164	4276	4461	4276
q6	215	171	130	130
q7	1991	1952	1753	1753
q8	2687	2506	2567	2506
q9	7467	7229	7374	7229
q10	3139	3270	2828	2828
q11	579	533	499	499
q12	714	1032	604	604
q13	3447	4050	3221	3221
q14	277	295	268	268
q15	529	471	467	467
q16	467	481	436	436
q17	1189	1757	1375	1375
q18	7650	7732	7597	7597
q19	775	829	880	829
q20	2032	2054	1930	1930
q21	4817	4372	4312	4312
q22	1063	1046	997	997
Total cold run time: 52055 ms
Total hot run time: 50135 ms

doris-robot · 2025-08-25T18:46:02Z

TPC-DS: Total hot run time: 184799 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b5a05ada7f1c0c2ed3fffa11ee3f7ef842322264, data reload: false

query1	1008	383	412	383
query2	6518	1779	1813	1779
query3	6744	220	215	215
query4	26404	23100	22916	22916
query5	4366	612	497	497
query6	293	208	208	208
query7	4625	491	284	284
query8	281	239	225	225
query9	8572	2895	2874	2874
query10	462	342	286	286
query11	15696	15036	14928	14928
query12	160	113	117	113
query13	1655	537	445	445
query14	8663	5779	5867	5779
query15	203	183	176	176
query16	7297	666	492	492
query17	1209	729	602	602
query18	2005	432	327	327
query19	195	197	171	171
query20	127	122	115	115
query21	213	126	114	114
query22	4103	4165	4001	4001
query23	33654	32931	32822	32822
query24	8157	2337	2324	2324
query25	536	481	401	401
query26	1230	268	162	162
query27	2743	503	349	349
query28	4306	2260	2225	2225
query29	768	616	442	442
query30	281	226	193	193
query31	871	810	710	710
query32	83	69	75	69
query33	557	363	327	327
query34	793	859	512	512
query35	797	851	742	742
query36	961	1029	900	900
query37	117	108	88	88
query38	4041	4026	4022	4022
query39	1495	1407	1417	1407
query40	222	120	112	112
query41	59	55	55	55
query42	117	106	114	106
query43	483	496	474	474
query44	1340	866	848	848
query45	179	169	163	163
query46	851	1018	645	645
query47	1742	1841	1733	1733
query48	388	411	315	315
query49	731	477	396	396
query50	640	677	393	393
query51	4168	4135	4027	4027
query52	115	112	101	101
query53	238	262	191	191
query54	589	593	521	521
query55	93	85	87	85
query56	329	340	308	308
query57	1180	1217	1125	1125
query58	287	266	270	266
query59	2676	2776	2617	2617
query60	343	344	330	330
query61	124	149	120	120
query62	831	716	655	655
query63	226	187	187	187
query64	4417	1026	694	694
query65	4370	4184	4210	4184
query66	1172	411	342	342
query67	15370	15248	15121	15121
query68	8276	917	571	571
query69	482	337	295	295
query70	1156	1107	1086	1086
query71	513	335	315	315
query72	5764	4795	4838	4795
query73	738	646	356	356
query74	8969	8938	8898	8898
query75	3909	3065	2652	2652
query76	3753	1137	754	754
query77	782	396	321	321
query78	9782	9672	8880	8880
query79	2249	835	601	601
query80	608	526	470	470
query81	501	258	227	227
query82	455	135	105	105
query83	262	263	236	236
query84	241	102	84	84
query85	786	384	418	384
query86	391	315	297	297
query87	4234	4246	4148	4148
query88	3587	2277	2250	2250
query89	393	315	292	292
query90	1892	221	221	221
query91	141	137	114	114
query92	92	72	66	66
query93	1747	989	633	633
query94	685	399	310	310
query95	401	314	312	312
query96	494	586	283	283
query97	2649	2704	2596	2596
query98	246	237	221	221
query99	1422	1400	1287	1287
Total cold run time: 273069 ms
Total hot run time: 184799 ms

doris-robot · 2025-08-25T18:51:31Z

ClickBench: Total hot run time: 32.22 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b5a05ada7f1c0c2ed3fffa11ee3f7ef842322264, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.24	0.06	0.07
query4	1.63	0.12	0.11
query5	0.44	0.41	0.41
query6	1.17	0.64	0.64
query7	0.02	0.02	0.02
query8	0.06	0.03	0.04
query9	0.61	0.53	0.52
query10	0.58	0.57	0.58
query11	0.15	0.10	0.11
query12	0.15	0.11	0.12
query13	0.63	0.61	0.61
query14	0.81	0.82	0.83
query15	0.90	0.86	0.84
query16	0.39	0.39	0.40
query17	1.07	1.07	1.04
query18	0.21	0.20	0.20
query19	1.94	1.83	1.78
query20	0.02	0.01	0.01
query21	15.41	0.98	0.57
query22	0.75	1.18	0.68
query23	15.01	1.36	0.64
query24	6.88	2.47	0.33
query25	0.28	0.16	0.15
query26	0.68	0.16	0.12
query27	0.06	0.05	0.05
query28	9.50	0.86	0.42
query29	12.56	3.92	3.24
query30	3.10	3.07	3.00
query31	2.81	0.59	0.39
query32	3.23	0.56	0.47
query33	3.07	3.15	3.13
query34	16.17	5.45	4.93
query35	4.92	4.95	4.94
query36	0.67	0.51	0.49
query37	0.09	0.06	0.07
query38	0.05	0.04	0.04
query39	0.04	0.03	0.02
query40	0.16	0.14	0.14
query41	0.07	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.73 s
Total hot run time: 32.22 s

suxiaogang223 · 2025-08-26T08:19:36Z

run buildall

suxiaogang223 · 2025-08-26T08:47:10Z

run buildall

doris-robot · 2025-08-26T09:06:56Z

TPC-H: Total hot run time: 33963 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d4923ee246cb6221013acb4246c4ed18aefa30ad, data reload: false

------ Round 1 ----------------------------------
q1	17575	5330	5089	5089
q2	1951	287	185	185
q3	10299	1284	699	699
q4	10215	997	539	539
q5	7533	2379	2342	2342
q6	186	167	136	136
q7	918	750	614	614
q8	9327	1261	1151	1151
q9	6987	5201	5111	5111
q10	6902	2374	1976	1976
q11	478	279	261	261
q12	348	363	216	216
q13	17792	3669	3030	3030
q14	231	245	210	210
q15	550	488	501	488
q16	431	428	368	368
q17	607	845	372	372
q18	7602	7274	7111	7111
q19	1101	933	536	536
q20	355	338	212	212
q21	3859	2584	2327	2327
q22	1080	1073	990	990
Total cold run time: 106327 ms
Total hot run time: 33963 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5376	5139	5180	5139
q2	252	324	226	226
q3	2182	2689	2310	2310
q4	1386	1792	1299	1299
q5	4165	4562	4600	4562
q6	211	169	126	126
q7	2001	1981	1865	1865
q8	2629	2650	2635	2635
q9	7487	7126	7260	7126
q10	3103	3268	3092	3092
q11	562	502	477	477
q12	680	790	667	667
q13	3540	3890	3355	3355
q14	301	298	281	281
q15	504	469	478	469
q16	468	562	450	450
q17	1198	1665	1390	1390
q18	7980	7668	7513	7513
q19	807	861	847	847
q20	1996	2068	1960	1960
q21	5019	4571	4222	4222
q22	1095	1036	1007	1007
Total cold run time: 52942 ms
Total hot run time: 51018 ms

doris-robot · 2025-08-26T09:18:28Z

TPC-DS: Total hot run time: 185139 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d4923ee246cb6221013acb4246c4ed18aefa30ad, data reload: false

query1	982	396	424	396
query2	6531	1720	1727	1720
query3	6747	226	214	214
query4	26452	23784	23432	23432
query5	4346	616	485	485
query6	323	219	206	206
query7	4633	503	291	291
query8	284	233	215	215
query9	8591	2897	2879	2879
query10	499	318	275	275
query11	16000	14974	15354	14974
query12	181	117	110	110
query13	1663	546	436	436
query14	9885	5761	5753	5753
query15	207	202	166	166
query16	7653	696	487	487
query17	1192	714	595	595
query18	2033	412	345	345
query19	198	188	164	164
query20	126	123	122	122
query21	216	130	107	107
query22	4018	4055	4030	4030
query23	34053	32883	32773	32773
query24	8020	2339	2348	2339
query25	516	482	417	417
query26	1235	270	161	161
query27	2725	517	339	339
query28	4324	2281	2225	2225
query29	722	563	479	479
query30	284	226	189	189
query31	914	810	739	739
query32	88	71	80	71
query33	556	375	335	335
query34	796	838	514	514
query35	785	821	721	721
query36	963	1010	915	915
query37	126	103	94	94
query38	4081	4049	3940	3940
query39	1464	1482	1413	1413
query40	219	128	121	121
query41	61	56	58	56
query42	117	106	110	106
query43	519	513	474	474
query44	1372	875	853	853
query45	177	170	168	168
query46	856	1014	634	634
query47	1744	1809	1730	1730
query48	384	428	308	308
query49	723	490	379	379
query50	657	664	409	409
query51	4058	4156	4128	4128
query52	113	111	99	99
query53	243	261	194	194
query54	593	579	515	515
query55	89	88	87	87
query56	314	308	316	308
query57	1208	1201	1124	1124
query58	273	264	268	264
query59	2659	2750	2659	2659
query60	342	340	318	318
query61	126	132	126	126
query62	834	709	662	662
query63	231	189	188	188
query64	4287	1037	703	703
query65	4291	4204	4217	4204
query66	1074	426	313	313
query67	15658	15311	15113	15113
query68	8354	913	574	574
query69	476	319	300	300
query70	1282	1136	1133	1133
query71	510	344	342	342
query72	5302	4724	4730	4724
query73	726	597	354	354
query74	9002	9262	8806	8806
query75	3808	3083	2636	2636
query76	3697	1229	741	741
query77	776	399	329	329
query78	9512	9778	8858	8858
query79	1390	838	591	591
query80	664	547	465	465
query81	470	254	220	220
query82	243	137	104	104
query83	279	250	247	247
query84	291	113	81	81
query85	863	369	342	342
query86	335	311	285	285
query87	4280	4318	4232	4232
query88	2833	2242	2201	2201
query89	384	318	281	281
query90	2093	218	215	215
query91	140	139	111	111
query92	83	71	67	67
query93	1121	968	644	644
query94	672	423	304	304
query95	394	315	307	307
query96	490	610	274	274
query97	2668	2725	2574	2574
query98	253	220	213	213
query99	1444	1436	1275	1275
Total cold run time: 272469 ms
Total hot run time: 185139 ms

doris-robot · 2025-08-26T09:23:57Z

ClickBench: Total hot run time: 32.67 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d4923ee246cb6221013acb4246c4ed18aefa30ad, data reload: false

query1	0.05	0.03	0.03
query2	0.08	0.05	0.04
query3	0.24	0.07	0.07
query4	1.62	0.11	0.11
query5	0.42	0.40	0.39
query6	1.18	0.64	0.67
query7	0.02	0.02	0.02
query8	0.05	0.04	0.03
query9	0.61	0.53	0.51
query10	0.57	0.57	0.56
query11	0.16	0.11	0.11
query12	0.15	0.13	0.11
query13	0.63	0.60	0.61
query14	0.80	0.83	0.83
query15	0.86	0.85	0.86
query16	0.39	0.40	0.38
query17	1.04	1.06	1.02
query18	0.21	0.19	0.19
query19	1.91	1.80	1.84
query20	0.01	0.01	0.01
query21	15.39	0.95	0.58
query22	0.80	1.21	0.76
query23	14.78	1.38	0.60
query24	6.45	2.29	0.84
query25	0.52	0.26	0.14
query26	0.69	0.16	0.12
query27	0.08	0.06	0.05
query28	9.86	0.97	0.43
query29	12.55	3.88	3.23
query30	3.05	2.99	3.04
query31	2.82	0.58	0.39
query32	3.25	0.55	0.47
query33	3.01	3.09	3.13
query34	16.06	5.44	4.94
query35	4.87	4.91	4.99
query36	0.70	0.51	0.50
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.14	0.15
query41	0.08	0.03	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.38 s
Total hot run time: 32.67 s

hello-stephen · 2025-08-26T09:52:12Z

FE UT Coverage Report

Increment line coverage 0.00% (0/64) 🎉
Increment coverage report
Complete coverage report

github-actions · 2025-08-27T19:11:51Z

PR approved by at least one committer and no changes requested.

… table #55070 #55364 (#55404) bp: - get the correct schema when querying paimon table #55070 - [fix](multi-catalog) check paramType for TableScanParams #55364

### What problem does this PR solve? Related PR: #55051 #55070 #55051 changed the paimon Type from `varchar(2147483647)` to `text` #55070 added the case

### What problem does this PR solve? Related PR: apache#55051 apache#55070 apache#55051 changed the paimon Type from `varchar(2147483647)` to `text` apache#55070 added the case

suxiaogang223 marked this pull request as draft August 20, 2025 09:50

suxiaogang223 marked this pull request as ready for review August 20, 2025 16:20

suxiaogang223 changed the title ~~[fix](paimon) get the correct schema when query paimon table~~ [fix](paimon) get the correct schema when querying paimon table Aug 20, 2025

morningman previously approved these changes Aug 21, 2025

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 21, 2025

github-actions bot added the reviewed label Aug 21, 2025

morningman reviewed Aug 24, 2025

View reviewed changes

fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonExternalTable.java Outdated Show resolved Hide resolved

suxiaogang223 and others added 8 commits August 26, 2025 01:19

get the latest schema for paimon

30dfdd0

add cases

5ec9278

fix

06efcbb

fix

a87f644

fix

dcfbddf

fix

fd52820

add case for iceberg

a62bcb5

fix

a78ff76

github-actions bot removed the approved Indicates a PR has been approved by one committer. label Aug 25, 2025

suxiaogang223 and others added 2 commits August 26, 2025 15:42

msTimeStringToLong

6aad75b

fix case

7ae6457

fix mtmv

d4923ee

morningman approved these changes Aug 27, 2025

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 27, 2025

morningman added the dev/3.1.x label Aug 28, 2025

CalvinKirs approved these changes Aug 28, 2025

View reviewed changes

hubgeter approved these changes Aug 28, 2025

View reviewed changes

suxiaogang223 mentioned this pull request Aug 28, 2025

branch-3.1: [fix](paimon) get the correct schema when querying paimon table #55070 #55364 #55404

Merged

morningman added dev/3.1.0-merged and removed dev/3.1.x labels Aug 28, 2025

morningman merged commit dda75ec into apache:master Sep 1, 2025
33 of 34 checks passed

suxiaogang223 mentioned this pull request Sep 2, 2025

[fix](case) fix test_paimon_schema_change case error #55588

Merged

16 tasks

suxiaogang223 deleted the fix_paimon_schema branch September 23, 2025 03:19

[fix](paimon) get the correct schema when querying paimon table #55070

[fix](paimon) get the correct schema when querying paimon table #55070

Uh oh!

Conversation

suxiaogang223 commented Aug 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

hello-stephen commented Aug 20, 2025

Uh oh!

suxiaogang223 commented Aug 20, 2025

Uh oh!

doris-robot commented Aug 20, 2025

Uh oh!

doris-robot commented Aug 20, 2025

Uh oh!

doris-robot commented Aug 20, 2025

Uh oh!

suxiaogang223 commented Aug 21, 2025

Uh oh!

doris-robot commented Aug 21, 2025

Uh oh!

suxiaogang223 commented Aug 21, 2025

Uh oh!

suxiaogang223 commented Aug 21, 2025

Uh oh!

doris-robot commented Aug 21, 2025

Uh oh!

doris-robot commented Aug 21, 2025

Uh oh!

doris-robot commented Aug 21, 2025

Uh oh!

hello-stephen commented Aug 21, 2025

FE UT Coverage Report

Uh oh!

github-actions bot commented Aug 21, 2025

Uh oh!

github-actions bot commented Aug 21, 2025

Uh oh!

Uh oh!

suxiaogang223 commented Aug 25, 2025

Uh oh!

doris-robot commented Aug 25, 2025

Uh oh!

doris-robot commented Aug 25, 2025

Uh oh!

doris-robot commented Aug 25, 2025

Uh oh!

suxiaogang223 commented Aug 26, 2025

Uh oh!

suxiaogang223 commented Aug 26, 2025

Uh oh!

doris-robot commented Aug 26, 2025

Uh oh!

doris-robot commented Aug 26, 2025

Uh oh!

doris-robot commented Aug 26, 2025

Uh oh!

hello-stephen commented Aug 26, 2025

FE UT Coverage Report

Uh oh!

github-actions bot commented Aug 27, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

suxiaogang223 commented Aug 20, 2025 •

edited

Loading