Skip to content

Conversation

@kaka11chen
Copy link
Contributor

@kaka11chen kaka11chen commented Sep 11, 2025

bp #55894

@Thearas
Copy link
Contributor

Thearas commented Sep 11, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@kaka11chen
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32364 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6e2bc84a8544ff1971eff2f71e161b2e81ac7efc, data reload: false

------ Round 1 ----------------------------------
q1	17616	5491	5336	5336
q2	2016	402	274	274
q3	12325	1230	725	725
q4	10572	866	449	449
q5	9566	2389	2109	2109
q6	197	162	130	130
q7	893	749	617	617
q8	9338	1421	1109	1109
q9	5259	4968	4908	4908
q10	6777	2271	1817	1817
q11	474	283	271	271
q12	329	353	212	212
q13	17776	3614	3008	3008
q14	232	245	206	206
q15	534	459	469	459
q16	413	421	371	371
q17	593	851	361	361
q18	6798	6403	6341	6341
q19	1210	965	543	543
q20	318	334	198	198
q21	2769	2119	1944	1944
q22	1076	1019	976	976
Total cold run time: 107081 ms
Total hot run time: 32364 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5469	5504	5451	5451
q2	238	324	231	231
q3	2253	2583	2246	2246
q4	1324	1836	1359	1359
q5	4417	4969	4970	4969
q6	175	158	137	137
q7	2031	2004	1850	1850
q8	2627	2821	2687	2687
q9	7232	7303	7239	7239
q10	3046	3252	2726	2726
q11	577	513	502	502
q12	649	775	652	652
q13	3392	3806	3126	3126
q14	287	304	286	286
q15	517	467	457	457
q16	444	497	431	431
q17	1215	1736	1278	1278
q18	7697	7490	7301	7301
q19	774	1134	1091	1091
q20	2033	2072	1889	1889
q21	5299	4824	4551	4551
q22	1039	1039	1004	1004
Total cold run time: 52735 ms
Total hot run time: 51463 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192438 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6e2bc84a8544ff1971eff2f71e161b2e81ac7efc, data reload: false

query1	948	404	402	402
query2	6213	1921	1821	1821
query3	8693	204	207	204
query4	33310	23889	23885	23885
query5	3894	609	465	465
query6	302	197	188	188
query7	4195	503	314	314
query8	321	266	253	253
query9	9248	2638	2620	2620
query10	466	337	260	260
query11	18025	15373	15150	15150
query12	162	108	102	102
query13	1549	530	415	415
query14	10745	7059	6535	6535
query15	263	187	178	178
query16	7980	643	504	504
query17	1536	727	600	600
query18	2092	420	317	317
query19	221	195	169	169
query20	129	128	121	121
query21	213	131	105	105
query22	4518	4729	4582	4582
query23	35003	34313	33900	33900
query24	7266	2677	2699	2677
query25	546	505	453	453
query26	1198	289	176	176
query27	1955	475	348	348
query28	5688	2215	2200	2200
query29	786	624	458	458
query30	247	190	159	159
query31	985	964	847	847
query32	86	60	58	58
query33	498	373	329	329
query34	743	861	541	541
query35	798	814	741	741
query36	1023	1048	1013	1013
query37	106	99	75	75
query38	4200	4017	3979	3979
query39	1599	1482	1476	1476
query40	212	118	101	101
query41	47	47	45	45
query42	124	113	103	103
query43	490	509	477	477
query44	1330	833	825	825
query45	185	184	174	174
query46	906	1074	677	677
query47	2048	1990	1980	1980
query48	412	435	373	373
query49	802	488	411	411
query50	699	718	447	447
query51	7317	7302	7244	7244
query52	104	102	91	91
query53	234	280	183	183
query54	555	555	478	478
query55	85	80	78	78
query56	261	282	270	270
query57	1272	1268	1231	1231
query58	238	218	220	218
query59	3049	3252	3077	3077
query60	309	278	273	273
query61	114	114	111	111
query62	802	755	719	719
query63	239	198	193	193
query64	5235	984	629	629
query65	3522	3259	3347	3259
query66	975	429	324	324
query67	16305	16035	15603	15603
query68	7528	828	541	541
query69	497	308	279	279
query70	1189	1126	1128	1126
query71	362	292	269	269
query72	5797	3727	3764	3727
query73	620	746	362	362
query74	10342	9448	8979	8979
query75	3215	3175	2689	2689
query76	2999	1137	768	768
query77	573	357	274	274
query78	10322	10435	9631	9631
query79	3593	901	592	592
query80	743	516	436	436
query81	504	252	225	225
query82	571	120	89	89
query83	162	159	145	145
query84	245	102	79	79
query85	779	357	298	298
query86	393	312	297	297
query87	4292	4366	4272	4272
query88	5205	2417	2411	2411
query89	400	333	294	294
query90	1790	193	204	193
query91	138	137	109	109
query92	67	56	54	54
query93	2517	898	545	545
query94	686	413	311	311
query95	343	279	267	267
query96	489	609	285	285
query97	3198	3297	3155	3155
query98	243	197	195	195
query99	1519	1395	1327	1327
Total cold run time: 296942 ms
Total hot run time: 192438 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.8 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6e2bc84a8544ff1971eff2f71e161b2e81ac7efc, data reload: false

query1	0.04	0.03	0.02
query2	0.07	0.03	0.02
query3	0.23	0.07	0.06
query4	1.62	0.11	0.11
query5	0.51	0.51	0.55
query6	1.13	0.73	0.72
query7	0.03	0.02	0.02
query8	0.04	0.03	0.04
query9	0.57	0.51	0.49
query10	0.58	0.54	0.54
query11	0.15	0.10	0.09
query12	0.14	0.11	0.11
query13	0.61	0.61	0.60
query14	0.77	0.84	0.80
query15	0.83	0.84	0.83
query16	0.39	0.39	0.38
query17	1.05	0.99	1.09
query18	0.23	0.23	0.22
query19	1.87	1.76	1.87
query20	0.01	0.02	0.01
query21	15.39	0.89	0.56
query22	0.75	0.77	0.55
query23	15.24	1.42	0.58
query24	3.39	1.11	1.25
query25	0.13	0.09	0.05
query26	0.31	0.15	0.13
query27	0.06	0.03	0.04
query28	13.61	1.01	0.44
query29	12.61	3.96	3.25
query30	0.25	0.11	0.08
query31	2.81	0.58	0.38
query32	3.22	0.54	0.47
query33	3.03	3.04	3.06
query34	16.44	5.18	4.50
query35	4.55	4.56	4.53
query36	0.60	0.50	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.16	0.13	0.12
query41	0.07	0.02	0.03
query42	0.04	0.02	0.03
query43	0.03	0.04	0.03
Total cold run time: 103.72 s
Total hot run time: 28.8 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 100.00% (1/1) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 45.54% (12761/28023)
Line Coverage 36.37% (113766/312823)
Region Coverage 34.00% (65073/191376)
Branch Coverage 31.03% (34146/110046)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (1/1) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 76.46% (21072/27561)
Line Coverage 69.75% (217515/311852)
Region Coverage 67.73% (130148/192153)
Branch Coverage 61.23% (67696/110560)

@morrySnow morrySnow changed the title [fix](paimon) Fix paimon native reader don't use late materialization. branch-3.1: [fix](paimon) Fix paimon native reader don't use late materialization. #55894 Sep 12, 2025
@morrySnow morrySnow merged commit 3c044cf into apache:branch-3.1 Sep 12, 2025
25 of 26 checks passed
@morrySnow morrySnow mentioned this pull request Sep 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants