Skip to content

Conversation

@csun5285
Copy link
Contributor

@csun5285 csun5285 commented Aug 21, 2025

What problem does this PR solve?

  1. In the old version of variant, the path size of subcolumns was not recorded, so the data type in the segment footer was used to calculate the schema during compaction.

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Aug 21, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@csun5285
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34093 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b91a7d40dd852da22786254f88a76595fdf1ef41, data reload: false

------ Round 1 ----------------------------------
q1	17573	5653	5119	5119
q2	1924	279	180	180
q3	10340	1309	716	716
q4	10213	987	567	567
q5	7503	2381	2378	2378
q6	173	158	134	134
q7	914	759	604	604
q8	9299	1306	1133	1133
q9	7046	5132	5119	5119
q10	6892	2381	1960	1960
q11	501	296	267	267
q12	349	353	223	223
q13	17773	3663	3042	3042
q14	227	234	221	221
q15	563	470	471	470
q16	415	426	380	380
q17	586	859	353	353
q18	7580	7109	7173	7109
q19	1090	945	568	568
q20	331	322	212	212
q21	3966	3263	2358	2358
q22	1051	1042	980	980
Total cold run time: 106309 ms
Total hot run time: 34093 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5112	5064	5134	5064
q2	256	329	221	221
q3	2206	2668	2333	2333
q4	1341	1789	1313	1313
q5	4232	4544	4485	4485
q6	222	171	140	140
q7	2057	1963	1748	1748
q8	2620	2534	2579	2534
q9	7454	7286	7530	7286
q10	3084	3326	2889	2889
q11	599	513	507	507
q12	698	772	636	636
q13	3527	3875	3330	3330
q14	301	305	283	283
q15	543	467	494	467
q16	456	510	445	445
q17	1220	1625	1391	1391
q18	7969	7794	7244	7244
q19	818	802	898	802
q20	1912	1946	1820	1820
q21	4720	4400	4329	4329
q22	1078	1037	1025	1025
Total cold run time: 52425 ms
Total hot run time: 50292 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184488 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b91a7d40dd852da22786254f88a76595fdf1ef41, data reload: false

query1	982	397	419	397
query2	6511	1773	1758	1758
query3	6740	216	219	216
query4	26431	23640	23290	23290
query5	4349	604	505	505
query6	307	214	236	214
query7	4624	509	290	290
query8	279	224	231	224
query9	8551	2887	2856	2856
query10	471	328	300	300
query11	15609	14918	14718	14718
query12	161	114	111	111
query13	1645	531	423	423
query14	8472	5714	5698	5698
query15	204	183	175	175
query16	7133	649	484	484
query17	934	732	609	609
query18	1995	424	324	324
query19	193	187	162	162
query20	124	116	119	116
query21	219	125	113	113
query22	4136	4415	4140	4140
query23	33895	32840	32900	32840
query24	8152	2358	2346	2346
query25	588	549	394	394
query26	1239	266	160	160
query27	2755	505	332	332
query28	4418	2269	2245	2245
query29	764	550	448	448
query30	286	224	194	194
query31	892	799	749	749
query32	78	80	78	78
query33	605	365	334	334
query34	789	837	507	507
query35	803	851	729	729
query36	974	1024	914	914
query37	124	105	93	93
query38	4133	4000	3975	3975
query39	1462	1404	1426	1404
query40	221	121	112	112
query41	57	53	52	52
query42	117	105	109	105
query43	501	487	469	469
query44	1326	865	852	852
query45	174	170	161	161
query46	849	1000	642	642
query47	1740	1821	1730	1730
query48	400	419	306	306
query49	699	483	398	398
query50	639	685	402	402
query51	4204	4098	4074	4074
query52	110	109	95	95
query53	233	262	194	194
query54	584	594	514	514
query55	89	85	87	85
query56	333	297	301	297
query57	1188	1202	1119	1119
query58	281	267	271	267
query59	2594	2712	2603	2603
query60	331	341	338	338
query61	130	121	126	121
query62	809	714	662	662
query63	222	188	183	183
query64	4399	1014	683	683
query65	4332	4231	4194	4194
query66	1151	410	319	319
query67	15447	15362	15040	15040
query68	8389	927	577	577
query69	488	313	281	281
query70	1162	1157	1144	1144
query71	485	319	300	300
query72	5373	4656	4555	4555
query73	706	550	354	354
query74	8890	9032	8904	8904
query75	3808	3056	2615	2615
query76	3640	1129	744	744
query77	796	388	312	312
query78	9562	9670	8897	8897
query79	3025	815	593	593
query80	632	533	458	458
query81	491	246	215	215
query82	519	132	105	105
query83	274	244	240	240
query84	302	104	139	104
query85	792	373	334	334
query86	388	299	295	295
query87	4248	4183	4157	4157
query88	3384	2175	2180	2175
query89	405	310	279	279
query90	1817	221	213	213
query91	143	147	109	109
query92	83	71	71	71
query93	1905	983	636	636
query94	670	419	302	302
query95	400	313	311	311
query96	492	573	275	275
query97	2631	2655	2563	2563
query98	257	231	211	211
query99	1440	1387	1277	1277
Total cold run time: 272784 ms
Total hot run time: 184488 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.25 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b91a7d40dd852da22786254f88a76595fdf1ef41, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.05
query3	0.24	0.08	0.07
query4	1.62	0.11	0.10
query5	0.42	0.42	0.42
query6	1.17	0.64	0.65
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.62	0.52	0.51
query10	0.57	0.58	0.56
query11	0.15	0.10	0.11
query12	0.15	0.12	0.11
query13	0.62	0.60	0.61
query14	0.78	0.84	0.82
query15	0.86	0.84	0.86
query16	0.39	0.38	0.38
query17	1.05	1.06	1.10
query18	0.20	0.19	0.20
query19	1.91	1.80	1.84
query20	0.01	0.00	0.01
query21	15.41	0.99	0.59
query22	0.74	1.11	0.68
query23	15.01	1.33	0.64
query24	6.86	1.49	0.57
query25	0.51	0.30	0.06
query26	0.58	0.15	0.13
query27	0.06	0.05	0.06
query28	10.22	0.94	0.43
query29	12.58	3.82	3.23
query30	3.14	2.97	2.97
query31	2.82	0.58	0.38
query32	3.25	0.54	0.48
query33	3.05	3.15	3.11
query34	16.02	5.51	4.85
query35	4.93	4.91	4.94
query36	0.69	0.52	0.49
query37	0.10	0.07	0.07
query38	0.05	0.05	0.04
query39	0.04	0.02	0.03
query40	0.17	0.15	0.14
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.04
Total cold run time: 107.33 s
Total hot run time: 32.25 s

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 100% (0/0) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 83.02% (44/53) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 59.61% (16789/28166)
Line Coverage 48.56% (152788/314641)
Region Coverage 37.50% (116116/309620)
Branch Coverage 40.43% (51273/126823)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 86.79% (46/53) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 82.10% (22657/27598)
Line Coverage 74.77% (235147/314482)
Region Coverage 61.84% (194871/315115)
Branch Coverage 66.06% (84417/127790)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 86.79% (46/53) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 82.10% (22657/27598)
Line Coverage 74.78% (235170/314482)
Region Coverage 61.87% (194977/315115)
Branch Coverage 66.06% (84421/127790)

@csun5285 csun5285 force-pushed the enhance_compaction branch from b91a7d4 to a815efe Compare August 25, 2025 03:15
@csun5285
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34790 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a815efea6be8105ce0e5aed2f2419a4d23f63dea, data reload: false

------ Round 1 ----------------------------------
q1	17576	5440	5123	5123
q2	1921	299	180	180
q3	10298	1312	737	737
q4	10211	1025	536	536
q5	7512	2481	2338	2338
q6	180	160	130	130
q7	899	756	608	608
q8	9322	1342	1121	1121
q9	7066	5184	5062	5062
q10	6891	2409	1968	1968
q11	492	292	266	266
q12	353	361	217	217
q13	17767	3674	3039	3039
q14	239	242	207	207
q15	540	504	513	504
q16	444	433	387	387
q17	603	861	378	378
q18	7714	7137	7246	7137
q19	1233	968	570	570
q20	361	334	234	234
q21	4230	3261	3061	3061
q22	1063	1026	987	987
Total cold run time: 106915 ms
Total hot run time: 34790 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5307	5128	5156	5128
q2	247	325	225	225
q3	2270	2681	2295	2295
q4	1378	1759	1361	1361
q5	4466	4568	4508	4508
q6	251	169	127	127
q7	2021	2025	1810	1810
q8	2626	2695	2652	2652
q9	7400	7407	7233	7233
q10	3100	3279	2970	2970
q11	591	499	500	499
q12	695	807	661	661
q13	3470	4160	3254	3254
q14	300	322	269	269
q15	508	476	506	476
q16	470	512	460	460
q17	1193	1616	1371	1371
q18	7964	7719	7543	7543
q19	873	825	901	825
q20	1970	2061	1941	1941
q21	4970	4342	4376	4342
q22	1085	1026	1003	1003
Total cold run time: 53155 ms
Total hot run time: 50953 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184781 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a815efea6be8105ce0e5aed2f2419a4d23f63dea, data reload: false

query1	995	405	411	405
query2	6525	1784	1771	1771
query3	6751	230	217	217
query4	26279	24044	23339	23339
query5	5265	620	483	483
query6	312	236	209	209
query7	4634	501	289	289
query8	283	235	231	231
query9	8620	2871	2874	2871
query10	510	347	280	280
query11	15823	15013	14786	14786
query12	172	114	111	111
query13	1662	547	418	418
query14	9769	5840	5781	5781
query15	203	188	165	165
query16	7626	665	451	451
query17	1472	728	645	645
query18	2021	395	310	310
query19	189	185	154	154
query20	131	162	114	114
query21	213	119	109	109
query22	4056	4194	4097	4097
query23	33909	32811	32937	32811
query24	7971	2308	2403	2308
query25	524	469	412	412
query26	1229	275	165	165
query27	2688	530	341	341
query28	4346	2269	2226	2226
query29	731	576	440	440
query30	289	219	188	188
query31	885	807	730	730
query32	85	72	70	70
query33	562	387	362	362
query34	783	832	502	502
query35	792	824	741	741
query36	970	1018	911	911
query37	121	108	88	88
query38	4086	4041	3970	3970
query39	1510	1425	1382	1382
query40	215	128	112	112
query41	61	61	52	52
query42	121	114	112	112
query43	504	492	479	479
query44	1334	846	838	838
query45	184	171	181	171
query46	859	1002	635	635
query47	1756	1799	1688	1688
query48	384	414	307	307
query49	718	486	401	401
query50	633	680	402	402
query51	4069	4150	4124	4124
query52	118	110	101	101
query53	236	252	197	197
query54	610	605	525	525
query55	100	86	92	86
query56	340	307	321	307
query57	1193	1194	1111	1111
query58	273	266	275	266
query59	2738	2715	2564	2564
query60	340	343	319	319
query61	131	122	124	122
query62	794	723	668	668
query63	224	192	197	192
query64	4320	1005	702	702
query65	4261	4204	4222	4204
query66	1043	407	322	322
query67	15731	15477	15124	15124
query68	8252	975	573	573
query69	504	319	276	276
query70	1242	1139	1120	1120
query71	496	346	319	319
query72	5541	4736	4968	4736
query73	777	678	353	353
query74	9177	9051	8918	8918
query75	3897	3078	2599	2599
query76	3759	1132	733	733
query77	803	388	333	333
query78	9671	9643	8864	8864
query79	2218	791	580	580
query80	602	539	466	466
query81	455	250	211	211
query82	420	133	110	110
query83	291	252	280	252
query84	291	98	84	84
query85	758	424	335	335
query86	329	321	293	293
query87	4310	4236	4193	4193
query88	3005	2172	2153	2153
query89	383	316	288	288
query90	1985	214	214	214
query91	151	133	112	112
query92	82	72	65	65
query93	1123	982	629	629
query94	662	414	301	301
query95	385	310	314	310
query96	487	580	270	270
query97	2681	2699	2560	2560
query98	240	216	212	212
query99	1450	1403	1305	1305
Total cold run time: 274709 ms
Total hot run time: 184781 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.27 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a815efea6be8105ce0e5aed2f2419a4d23f63dea, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.25	0.08	0.07
query4	1.62	0.11	0.10
query5	0.41	0.44	0.41
query6	1.15	0.63	0.64
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.61	0.52	0.52
query10	0.58	0.58	0.58
query11	0.16	0.10	0.11
query12	0.15	0.11	0.12
query13	0.64	0.61	0.61
query14	0.78	0.84	0.84
query15	0.90	0.84	0.85
query16	0.38	0.39	0.39
query17	1.04	1.07	1.03
query18	0.20	0.20	0.19
query19	1.94	1.89	1.84
query20	0.01	0.01	0.01
query21	15.43	0.92	0.58
query22	0.77	1.29	0.74
query23	14.72	1.38	0.63
query24	6.31	0.93	0.47
query25	0.55	0.26	0.07
query26	0.54	0.15	0.13
query27	0.07	0.05	0.05
query28	9.76	1.02	0.43
query29	12.56	3.92	3.26
query30	3.09	3.02	2.99
query31	2.82	0.58	0.37
query32	3.23	0.56	0.48
query33	3.14	3.15	3.15
query34	15.88	5.49	4.81
query35	4.92	4.89	4.95
query36	0.71	0.50	0.49
query37	0.09	0.07	0.07
query38	0.06	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.15	0.13
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.03	0.05	0.03
Total cold run time: 106.01 s
Total hot run time: 32.27 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 83.02% (44/53) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 51.77% (17138/33107)
Line Coverage 37.24% (156155/419309)
Region Coverage 31.95% (119159/372999)
Branch Coverage 33.24% (52341/157480)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 86.79% (46/53) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 70.73% (22996/32513)
Line Coverage 56.99% (238873/419114)
Region Coverage 52.39% (198268/378462)
Branch Coverage 54.11% (85743/158457)

@csun5285 csun5285 force-pushed the enhance_compaction branch from a815efe to beda439 Compare August 26, 2025 08:00
@csun5285
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34035 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit beda4390405fa15ad85c09461b2c708dabd267a2, data reload: false

------ Round 1 ----------------------------------
q1	17737	5238	5182	5182
q2	1969	290	190	190
q3	10501	1304	711	711
q4	10919	1029	523	523
q5	7522	2497	2381	2381
q6	184	164	132	132
q7	919	769	639	639
q8	9324	1338	1099	1099
q9	7232	5126	5160	5126
q10	6928	2390	1950	1950
q11	468	291	265	265
q12	345	341	208	208
q13	17769	3645	3078	3078
q14	235	241	213	213
q15	564	472	489	472
q16	433	435	377	377
q17	598	850	347	347
q18	7394	7188	7039	7039
q19	1357	952	574	574
q20	365	328	212	212
q21	4142	3238	2331	2331
q22	1110	1007	986	986
Total cold run time: 108015 ms
Total hot run time: 34035 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5224	5126	5142	5126
q2	241	316	216	216
q3	2229	2700	2285	2285
q4	1365	1812	1352	1352
q5	4325	4540	4561	4540
q6	217	173	127	127
q7	1948	2012	1834	1834
q8	2718	2695	2603	2603
q9	7306	7290	7312	7290
q10	3164	3357	2909	2909
q11	560	505	486	486
q12	684	778	631	631
q13	3614	4145	3212	3212
q14	303	310	288	288
q15	521	485	485	485
q16	471	502	430	430
q17	1186	1470	1361	1361
q18	8072	7589	7661	7589
q19	848	885	891	885
q20	2109	2074	1981	1981
q21	4993	4382	4214	4214
q22	1087	1045	981	981
Total cold run time: 53185 ms
Total hot run time: 50825 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184716 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit beda4390405fa15ad85c09461b2c708dabd267a2, data reload: false

query1	986	375	437	375
query2	6516	1729	1736	1729
query3	6738	224	221	221
query4	26293	23319	23683	23319
query5	4851	635	473	473
query6	301	215	204	204
query7	4621	504	288	288
query8	293	232	220	220
query9	8628	2896	2883	2883
query10	522	337	286	286
query11	15813	15007	14755	14755
query12	165	116	116	116
query13	1660	548	431	431
query14	9113	5861	5763	5763
query15	204	190	174	174
query16	7417	666	490	490
query17	1176	732	602	602
query18	1993	435	331	331
query19	197	195	163	163
query20	128	118	117	117
query21	214	131	120	120
query22	4055	4133	3950	3950
query23	33610	32907	32793	32793
query24	8162	2322	2339	2322
query25	532	479	416	416
query26	1232	266	160	160
query27	2721	508	357	357
query28	4351	2315	2258	2258
query29	800	574	455	455
query30	285	225	198	198
query31	897	811	732	732
query32	83	76	76	76
query33	561	366	328	328
query34	783	869	501	501
query35	782	827	752	752
query36	985	1004	940	940
query37	128	106	85	85
query38	4127	4015	3973	3973
query39	1467	1424	1422	1422
query40	214	122	108	108
query41	61	57	53	53
query42	123	105	113	105
query43	519	496	473	473
query44	1337	860	854	854
query45	179	167	165	165
query46	869	1011	640	640
query47	1753	1805	1724	1724
query48	391	405	326	326
query49	746	493	407	407
query50	638	703	389	389
query51	4160	4175	4115	4115
query52	109	112	104	104
query53	234	259	198	198
query54	589	582	531	531
query55	87	85	87	85
query56	319	306	294	294
query57	1194	1208	1127	1127
query58	295	283	283	283
query59	2698	2709	2562	2562
query60	350	330	336	330
query61	126	154	124	124
query62	781	744	679	679
query63	225	190	192	190
query64	4343	1037	703	703
query65	4308	4231	4186	4186
query66	1152	407	330	330
query67	15671	15226	15136	15136
query68	8322	923	580	580
query69	469	325	294	294
query70	1219	1118	1086	1086
query71	475	346	320	320
query72	5324	4756	4682	4682
query73	717	578	349	349
query74	8900	8785	9119	8785
query75	3782	3100	2662	2662
query76	3704	1139	721	721
query77	817	404	335	335
query78	9679	9821	8902	8902
query79	2096	841	579	579
query80	621	548	480	480
query81	489	257	229	229
query82	441	133	106	106
query83	244	246	240	240
query84	248	111	80	80
query85	795	368	334	334
query86	342	297	338	297
query87	4238	4315	4150	4150
query88	3099	2241	2233	2233
query89	392	315	296	296
query90	1927	218	220	218
query91	139	138	112	112
query92	80	68	67	67
query93	1147	957	638	638
query94	697	413	312	312
query95	396	315	307	307
query96	502	583	277	277
query97	2619	2682	2545	2545
query98	263	225	219	219
query99	1339	1397	1282	1282
Total cold run time: 272383 ms
Total hot run time: 184716 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.9 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit beda4390405fa15ad85c09461b2c708dabd267a2, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.26	0.08	0.07
query4	1.62	0.11	0.11
query5	0.42	0.42	0.41
query6	1.17	0.64	0.66
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.60	0.53	0.52
query10	0.58	0.58	0.57
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.62	0.61	0.61
query14	0.80	0.84	0.84
query15	0.86	0.83	0.85
query16	0.39	0.40	0.38
query17	1.04	1.04	1.07
query18	0.21	0.19	0.20
query19	1.95	1.86	1.84
query20	0.01	0.01	0.01
query21	15.38	0.95	0.57
query22	0.79	1.15	0.77
query23	14.85	1.39	0.65
query24	6.18	1.40	1.10
query25	0.51	0.18	0.12
query26	0.63	0.15	0.14
query27	0.06	0.05	0.04
query28	9.75	0.98	0.42
query29	12.55	3.96	3.22
query30	3.10	3.05	2.95
query31	2.82	0.59	0.38
query32	3.25	0.55	0.47
query33	3.01	3.29	3.08
query34	16.04	5.47	4.85
query35	4.89	4.91	4.94
query36	0.67	0.51	0.48
query37	0.10	0.07	0.06
query38	0.04	0.04	0.04
query39	0.03	0.02	0.03
query40	0.18	0.14	0.14
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.01 s
Total hot run time: 32.9 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 83.02% (44/53) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 51.76% (17139/33113)
Line Coverage 37.24% (156164/419377)
Region Coverage 31.94% (119098/372933)
Branch Coverage 33.23% (52336/157495)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 86.79% (46/53) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 70.74% (23012/32531)
Line Coverage 56.98% (238896/419267)
Region Coverage 52.40% (198319/378479)
Branch Coverage 54.09% (85729/158493)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 86.79% (46/53) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 70.74% (23013/32531)
Line Coverage 56.98% (238880/419267)
Region Coverage 52.37% (198216/378479)
Branch Coverage 54.09% (85730/158493)

@csun5285 csun5285 force-pushed the enhance_compaction branch from beda439 to 38d730d Compare August 27, 2025 02:05
@csun5285
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34049 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 38d730d8df6d9cc09c43011c264f03e852b54543, data reload: false

------ Round 1 ----------------------------------
q1	17579	5260	5063	5063
q2	1927	287	187	187
q3	10313	1411	743	743
q4	10215	1029	527	527
q5	7505	2438	2334	2334
q6	180	158	132	132
q7	896	744	588	588
q8	9307	1318	1124	1124
q9	6956	5106	5101	5101
q10	6874	2387	1953	1953
q11	464	287	261	261
q12	336	342	231	231
q13	17778	3688	3015	3015
q14	227	240	212	212
q15	544	479	491	479
q16	413	429	369	369
q17	600	819	390	390
q18	7421	7206	7207	7206
q19	1087	954	567	567
q20	355	340	218	218
q21	3966	3221	2375	2375
q22	1075	1035	974	974
Total cold run time: 106018 ms
Total hot run time: 34049 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5469	5101	5101	5101
q2	243	318	224	224
q3	2140	2731	2291	2291
q4	1355	1802	1349	1349
q5	4261	4651	4506	4506
q6	211	198	130	130
q7	2015	1971	1788	1788
q8	2694	2832	2878	2832
q9	7179	7124	7297	7124
q10	3122	3343	2874	2874
q11	566	497	494	494
q12	695	1015	604	604
q13	3465	3757	3365	3365
q14	284	306	305	305
q15	513	477	478	477
q16	450	519	441	441
q17	1170	1601	1388	1388
q18	7999	7731	7655	7655
q19	853	877	881	877
q20	2025	2098	1984	1984
q21	5026	4619	4521	4521
q22	1085	1039	1023	1023
Total cold run time: 52820 ms
Total hot run time: 51353 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185490 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 38d730d8df6d9cc09c43011c264f03e852b54543, data reload: false

query1	993	407	412	407
query2	6518	1744	1707	1707
query3	6743	237	225	225
query4	26158	23274	23143	23143
query5	4314	601	521	521
query6	303	204	202	202
query7	4632	515	290	290
query8	278	237	213	213
query9	8568	2932	2872	2872
query10	467	324	280	280
query11	15663	15014	15142	15014
query12	166	116	113	113
query13	1651	560	430	430
query14	8700	5840	5781	5781
query15	206	194	173	173
query16	7138	668	465	465
query17	1183	712	577	577
query18	1971	447	306	306
query19	181	186	163	163
query20	117	114	114	114
query21	208	121	110	110
query22	4115	4106	4066	4066
query23	33892	32653	32819	32653
query24	8058	2375	2345	2345
query25	544	498	433	433
query26	1242	269	167	167
query27	2733	514	362	362
query28	4359	2248	2235	2235
query29	796	578	465	465
query30	299	219	198	198
query31	886	786	747	747
query32	83	78	74	74
query33	552	366	339	339
query34	792	853	522	522
query35	788	818	742	742
query36	956	1013	920	920
query37	124	107	86	86
query38	4197	4149	4034	4034
query39	1497	1427	1451	1427
query40	231	131	118	118
query41	63	55	54	54
query42	122	111	112	111
query43	514	509	462	462
query44	1318	863	857	857
query45	173	173	164	164
query46	870	1001	632	632
query47	1744	1789	1705	1705
query48	390	429	327	327
query49	727	488	395	395
query50	636	687	411	411
query51	4050	4079	4047	4047
query52	117	110	107	107
query53	239	262	196	196
query54	602	595	524	524
query55	88	87	87	87
query56	319	324	302	302
query57	1200	1205	1110	1110
query58	293	280	281	280
query59	2696	2783	2650	2650
query60	364	353	350	350
query61	157	173	150	150
query62	802	732	699	699
query63	228	199	193	193
query64	4537	1109	805	805
query65	4287	4176	4328	4176
query66	1167	424	324	324
query67	15845	15244	15208	15208
query68	9058	926	589	589
query69	493	322	291	291
query70	1265	1196	1103	1103
query71	480	355	322	322
query72	5732	4785	4757	4757
query73	736	609	361	361
query74	9141	9049	9080	9049
query75	4163	3098	2634	2634
query76	3639	1130	742	742
query77	817	403	322	322
query78	9493	9801	8813	8813
query79	2468	831	586	586
query80	658	534	467	467
query81	469	259	219	219
query82	456	129	108	108
query83	289	256	238	238
query84	290	114	82	82
query85	791	368	340	340
query86	358	318	306	306
query87	4382	4330	4224	4224
query88	2824	2246	2212	2212
query89	437	317	293	293
query90	1925	228	221	221
query91	153	202	120	120
query92	88	71	72	71
query93	1947	1017	641	641
query94	676	419	314	314
query95	402	319	295	295
query96	500	596	277	277
query97	2683	2725	2622	2622
query98	256	230	222	222
query99	1425	1375	1284	1284
Total cold run time: 274344 ms
Total hot run time: 185490 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.19 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 38d730d8df6d9cc09c43011c264f03e852b54543, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.05
query3	0.24	0.08	0.07
query4	1.63	0.11	0.10
query5	0.41	0.41	0.39
query6	1.16	0.65	0.64
query7	0.04	0.02	0.02
query8	0.05	0.04	0.04
query9	0.60	0.52	0.52
query10	0.59	0.57	0.59
query11	0.15	0.12	0.11
query12	0.15	0.11	0.11
query13	0.61	0.61	0.62
query14	0.79	0.83	0.82
query15	0.87	0.88	0.85
query16	0.38	0.39	0.41
query17	1.04	1.01	1.05
query18	0.21	0.19	0.20
query19	1.94	1.83	1.78
query20	0.01	0.01	0.01
query21	15.40	0.94	0.59
query22	0.80	1.25	0.75
query23	14.77	1.37	0.61
query24	6.64	0.88	0.55
query25	0.49	0.31	0.12
query26	0.64	0.15	0.12
query27	0.06	0.05	0.05
query28	9.19	0.95	0.42
query29	12.53	3.86	3.19
query30	3.04	2.97	2.97
query31	2.82	0.57	0.37
query32	3.23	0.56	0.46
query33	3.10	3.08	3.13
query34	16.02	5.43	4.85
query35	4.90	4.91	4.97
query36	0.71	0.51	0.49
query37	0.09	0.07	0.07
query38	0.04	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.14	0.14
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.82 s
Total hot run time: 32.19 s

@csun5285 csun5285 force-pushed the enhance_compaction branch from 38d730d to 67d658e Compare August 28, 2025 04:19
@csun5285
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34354 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 67d658e430c4e06f5a5f2acc8bc97b2488c830da, data reload: false

------ Round 1 ----------------------------------
q1	17663	5255	5021	5021
q2	2011	319	212	212
q3	10242	1317	732	732
q4	10230	1048	525	525
q5	7525	2455	2375	2375
q6	189	167	142	142
q7	962	779	631	631
q8	9362	1331	1213	1213
q9	6991	5137	5265	5137
q10	6930	2404	2003	2003
q11	507	306	286	286
q12	360	377	228	228
q13	17787	3702	3101	3101
q14	234	263	226	226
q15	560	491	498	491
q16	455	439	390	390
q17	602	881	362	362
q18	7472	7270	7124	7124
q19	1245	970	559	559
q20	356	352	233	233
q21	4033	3196	2366	2366
q22	1082	1065	997	997
Total cold run time: 106798 ms
Total hot run time: 34354 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5189	5129	5164	5129
q2	262	336	234	234
q3	2175	2681	2288	2288
q4	1334	1841	1365	1365
q5	4252	4537	4567	4537
q6	222	177	141	141
q7	2043	1997	1819	1819
q8	2653	2673	2664	2664
q9	7477	7432	7506	7432
q10	3196	3406	2849	2849
q11	592	525	519	519
q12	714	778	623	623
q13	3446	3922	3295	3295
q14	286	301	279	279
q15	525	556	511	511
q16	478	518	463	463
q17	1200	1535	1414	1414
q18	8024	7685	7664	7664
q19	814	823	975	823
q20	2014	2074	2037	2037
q21	5062	4495	4413	4413
q22	1096	1084	983	983
Total cold run time: 53054 ms
Total hot run time: 51482 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187387 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 67d658e430c4e06f5a5f2acc8bc97b2488c830da, data reload: false

query1	1054	478	428	428
query2	6560	1784	1796	1784
query3	6760	230	224	224
query4	26604	23745	23291	23291
query5	4379	695	507	507
query6	336	251	230	230
query7	4658	504	302	302
query8	311	273	254	254
query9	8645	2889	2881	2881
query10	508	361	291	291
query11	16086	15594	14873	14873
query12	174	131	124	124
query13	1683	576	448	448
query14	9395	5990	5876	5876
query15	222	249	176	176
query16	7291	655	513	513
query17	1239	742	613	613
query18	2010	442	344	344
query19	202	194	177	177
query20	138	133	127	127
query21	223	132	116	116
query22	4084	4158	3987	3987
query23	34005	33102	33041	33041
query24	8137	2400	2404	2400
query25	584	534	455	455
query26	1258	280	173	173
query27	2729	513	367	367
query28	4397	2272	2253	2253
query29	790	623	493	493
query30	308	230	202	202
query31	917	837	782	782
query32	92	126	83	83
query33	598	413	364	364
query34	800	875	523	523
query35	842	839	768	768
query36	991	1037	940	940
query37	131	131	91	91
query38	4124	4067	4038	4038
query39	1539	1455	1456	1455
query40	224	145	135	135
query41	73	70	66	66
query42	131	114	123	114
query43	531	520	493	493
query44	1365	868	867	867
query45	188	176	179	176
query46	878	1032	655	655
query47	1744	1859	1745	1745
query48	401	485	332	332
query49	773	564	434	434
query50	673	698	413	413
query51	4168	4242	4108	4108
query52	115	119	115	115
query53	254	292	212	212
query54	631	631	565	565
query55	100	94	92	92
query56	373	362	363	362
query57	1210	1220	1132	1132
query58	309	306	292	292
query59	2640	2714	2560	2560
query60	389	372	387	372
query61	195	187	196	187
query62	829	739	693	693
query63	279	196	197	196
query64	4469	1139	850	850
query65	4315	4213	4273	4213
query66	1189	453	364	364
query67	15573	15261	15078	15078
query68	8677	924	586	586
query69	483	346	307	307
query70	1224	1119	1130	1119
query71	469	357	325	325
query72	5670	5000	5016	5000
query73	729	619	364	364
query74	9234	8875	8672	8672
query75	4229	3127	2667	2667
query76	3679	1171	788	788
query77	830	425	343	343
query78	9638	9874	8878	8878
query79	1647	805	583	583
query80	675	622	524	524
query81	466	268	227	227
query82	212	144	123	123
query83	302	271	263	263
query84	301	114	89	89
query85	929	473	442	442
query86	358	333	314	314
query87	4300	4282	4226	4226
query88	2905	2230	2228	2228
query89	393	341	302	302
query90	2081	239	231	231
query91	167	176	136	136
query92	94	80	72	72
query93	1133	999	664	664
query94	693	410	328	328
query95	418	334	327	327
query96	492	604	281	281
query97	2635	2695	2604	2604
query98	250	225	223	223
query99	1414	1426	1336	1336
Total cold run time: 275550 ms
Total hot run time: 187387 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.61 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 67d658e430c4e06f5a5f2acc8bc97b2488c830da, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.06	0.06
query3	0.25	0.08	0.08
query4	1.61	0.11	0.12
query5	0.43	0.43	0.40
query6	1.17	0.64	0.65
query7	0.03	0.03	0.03
query8	0.06	0.05	0.05
query9	0.60	0.53	0.52
query10	0.60	0.58	0.57
query11	0.17	0.12	0.11
query12	0.15	0.12	0.12
query13	0.63	0.63	0.64
query14	0.80	0.83	0.83
query15	0.88	0.85	0.85
query16	0.39	0.46	0.40
query17	1.05	1.07	1.02
query18	0.21	0.20	0.20
query19	1.94	1.85	1.82
query20	0.01	0.02	0.01
query21	15.40	0.94	0.59
query22	0.78	1.22	0.77
query23	14.77	1.43	0.63
query24	7.01	1.09	0.48
query25	0.50	0.17	0.12
query26	0.72	0.15	0.14
query27	0.05	0.05	0.06
query28	9.69	0.90	0.43
query29	12.55	3.95	3.26
query30	3.03	3.05	3.00
query31	2.82	0.60	0.39
query32	3.26	0.55	0.47
query33	3.08	3.18	3.20
query34	16.15	5.46	4.83
query35	4.96	4.90	4.92
query36	0.70	0.52	0.49
query37	0.10	0.08	0.08
query38	0.05	0.04	0.05
query39	0.04	0.03	0.03
query40	0.19	0.15	0.14
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.05	0.04	0.04
Total cold run time: 107.15 s
Total hot run time: 32.61 s

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 100% (0/0) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 83.02% (44/53) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 51.79% (17150/33116)
Line Coverage 37.27% (156308/419419)
Region Coverage 31.93% (119072/372879)
Branch Coverage 33.25% (52375/157504)

Copy link
Member

@eldenmoon eldenmoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 1, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Sep 1, 2025

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Sep 1, 2025

PR approved by anyone and no changes requested.

fix

fix

fix

fix

remove code

remove code

modifyu test
@csun5285
Copy link
Contributor Author

csun5285 commented Sep 1, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34245 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5e7e538c6f72cf281d60f57f4399429b69a86d50, data reload: false

------ Round 1 ----------------------------------
q1	17637	5253	5083	5083
q2	2313	334	206	206
q3	10287	1305	747	747
q4	10269	1014	530	530
q5	7506	2421	2386	2386
q6	191	170	139	139
q7	945	766	646	646
q8	9367	1343	1178	1178
q9	7028	5162	5191	5162
q10	6961	2375	1983	1983
q11	510	313	282	282
q12	361	354	226	226
q13	17790	3730	3068	3068
q14	241	241	224	224
q15	593	517	492	492
q16	449	431	389	389
q17	603	878	378	378
q18	7544	7141	6970	6970
q19	1524	968	571	571
q20	353	347	231	231
q21	3803	2569	2388	2388
q22	1056	1049	966	966
Total cold run time: 107331 ms
Total hot run time: 34245 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5523	5420	5152	5152
q2	264	338	241	241
q3	2184	2717	2347	2347
q4	1355	1831	1353	1353
q5	4189	4521	4521	4521
q6	230	185	143	143
q7	2154	2025	1774	1774
q8	2846	2691	2722	2691
q9	7338	7384	7338	7338
q10	3176	3267	2888	2888
q11	563	523	507	507
q12	777	831	609	609
q13	3652	3948	3403	3403
q14	303	303	287	287
q15	524	473	486	473
q16	462	521	460	460
q17	1163	1522	1416	1416
q18	7826	7658	7637	7637
q19	826	854	988	854
q20	2052	2019	1858	1858
q21	4734	4407	4450	4407
q22	1085	1033	994	994
Total cold run time: 53226 ms
Total hot run time: 51353 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186334 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5e7e538c6f72cf281d60f57f4399429b69a86d50, data reload: false

query1	1078	461	402	402
query2	6591	1764	1758	1758
query3	6753	231	224	224
query4	26029	23712	22994	22994
query5	4436	632	552	552
query6	353	259	244	244
query7	4644	518	309	309
query8	309	271	252	252
query9	8679	2844	2892	2844
query10	515	364	299	299
query11	15800	15013	14888	14888
query12	176	120	120	120
query13	1673	554	424	424
query14	9530	5807	5811	5807
query15	216	193	172	172
query16	7604	668	489	489
query17	1212	732	655	655
query18	2053	424	337	337
query19	251	196	172	172
query20	139	123	120	120
query21	216	131	119	119
query22	4121	4103	4067	4067
query23	33925	32744	32964	32744
query24	8220	2368	2409	2368
query25	577	529	459	459
query26	1248	272	167	167
query27	2721	515	359	359
query28	4324	2272	2243	2243
query29	766	593	487	487
query30	296	233	198	198
query31	908	801	734	734
query32	85	82	80	80
query33	586	394	392	392
query34	792	874	509	509
query35	816	829	755	755
query36	987	1020	927	927
query37	134	115	89	89
query38	4096	4064	4029	4029
query39	1492	1467	1427	1427
query40	226	133	134	133
query41	67	60	61	60
query42	127	121	121	121
query43	530	494	454	454
query44	1355	859	862	859
query45	180	177	178	177
query46	866	1010	645	645
query47	1822	1811	1744	1744
query48	392	442	321	321
query49	752	526	405	405
query50	680	680	404	404
query51	4097	4148	4099	4099
query52	124	121	104	104
query53	233	275	194	194
query54	602	601	546	546
query55	96	88	89	88
query56	341	334	354	334
query57	1196	1206	1146	1146
query58	295	285	276	276
query59	2666	2792	2639	2639
query60	367	363	339	339
query61	163	159	151	151
query62	824	716	690	690
query63	229	195	203	195
query64	4488	1244	824	824
query65	4322	4178	4224	4178
query66	1106	440	346	346
query67	15596	15157	15089	15089
query68	7897	920	583	583
query69	510	334	293	293
query70	1200	1168	1122	1122
query71	419	349	323	323
query72	5819	4945	5034	4945
query73	669	621	351	351
query74	9209	9224	9047	9047
query75	3146	3112	2645	2645
query76	3248	1132	734	734
query77	503	401	348	348
query78	9502	9741	8880	8880
query79	1902	852	596	596
query80	666	625	550	550
query81	503	263	224	224
query82	206	148	117	117
query83	277	280	255	255
query84	273	118	97	97
query85	943	628	426	426
query86	381	326	294	294
query87	4279	4293	4096	4096
query88	2763	2209	2195	2195
query89	388	335	289	289
query90	1804	225	223	223
query91	165	158	133	133
query92	83	75	70	70
query93	1159	979	664	664
query94	669	449	324	324
query95	422	332	325	325
query96	487	594	283	283
query97	2627	2702	2592	2592
query98	243	215	214	214
query99	1322	1450	1320	1320
Total cold run time: 271777 ms
Total hot run time: 186334 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.35 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5e7e538c6f72cf281d60f57f4399429b69a86d50, data reload: false

query1	0.05	0.04	0.04
query2	0.09	0.04	0.06
query3	0.25	0.08	0.08
query4	1.61	0.11	0.12
query5	0.44	0.41	0.41
query6	1.19	0.63	0.66
query7	0.03	0.03	0.03
query8	0.05	0.05	0.04
query9	0.60	0.54	0.53
query10	0.59	0.58	0.59
query11	0.17	0.11	0.12
query12	0.15	0.12	0.12
query13	0.63	0.62	0.62
query14	0.82	0.84	0.84
query15	0.86	0.85	0.87
query16	0.38	0.40	0.39
query17	1.04	1.04	1.08
query18	0.22	0.20	0.20
query19	1.90	1.84	1.82
query20	0.02	0.01	0.01
query21	15.42	1.02	0.58
query22	0.76	1.23	0.74
query23	14.86	1.37	0.63
query24	6.59	1.37	0.41
query25	0.49	0.16	0.12
query26	0.67	0.16	0.15
query27	0.09	0.05	0.06
query28	9.89	0.93	0.43
query29	12.67	3.84	3.25
query30	3.08	3.03	3.00
query31	2.82	0.58	0.36
query32	3.26	0.55	0.47
query33	3.05	3.03	3.05
query34	15.89	5.51	4.85
query35	4.88	4.92	4.94
query36	0.67	0.50	0.52
query37	0.10	0.08	0.08
query38	0.06	0.04	0.05
query39	0.03	0.03	0.03
query40	0.17	0.16	0.14
query41	0.08	0.04	0.03
query42	0.04	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.7 s
Total hot run time: 32.35 s

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 100% (0/0) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 83.02% (44/53) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 51.66% (17130/33159)
Line Coverage 37.20% (156589/420888)
Region Coverage 31.84% (119462/375175)
Branch Coverage 33.23% (52516/158060)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 88.46% (46/52) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 70.53% (22968/32566)
Line Coverage 56.80% (238875/420587)
Region Coverage 52.18% (198384/380171)
Branch Coverage 53.90% (85668/158946)

@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 100% (0/0) 🎉
Increment coverage report
Complete coverage report

@eldenmoon
Copy link
Member

run p0 5

Copy link
Contributor

@amorynan amorynan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@eldenmoon eldenmoon merged commit e81879b into apache:master Sep 2, 2025
24 of 26 checks passed
uchenily pushed a commit to uchenily/doris that referenced this pull request Sep 5, 2025
…ns of variant. (apache#55127)

1. In the old version of variant, the path size of subcolumns was not
recorded, so the data type in the segment footer was used to calculate
the schema during compaction.
morrySnow pushed a commit that referenced this pull request Sep 11, 2025
… is empty (#55817)

### What problem does this PR solve?

In master #55127, the compaction process was made compatible with both
the new and old variants, while in 3.1 a defensive strategy was used to
prevent errors from occurring.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants