[opt](outfile) support compressed csv with names and types in outfile #58090

morningman · 2025-11-17T09:54:44Z

What problem does this PR solve?

Related PR: #55392

Problem Summary:
Support compression when outfile with csv_with_names and cvs_with_names_and_types

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

Thearas · 2025-11-17T09:54:49Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

morningman · 2025-11-17T14:32:43Z

run buildall

doris-robot · 2025-11-17T15:15:34Z

TPC-H: Total hot run time: 33814 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4ab437df18458ec284d9ef1ea0bddfae0a96271c, data reload: false

------ Round 1 ----------------------------------
q1	17658	5159	4987	4987
q2	2043	299	199	199
q3	10288	1280	693	693
q4	10242	1006	381	381
q5	7778	2553	2194	2194
q6	183	167	135	135
q7	947	777	634	634
q8	9350	1343	1088	1088
q9	6910	5018	5096	5018
q10	6853	2247	1836	1836
q11	500	299	283	283
q12	334	380	234	234
q13	17779	3621	3032	3032
q14	231	233	215	215
q15	577	505	505	505
q16	1018	1019	935	935
q17	594	858	349	349
q18	7438	7129	7062	7062
q19	1195	929	538	538
q20	355	350	233	233
q21	3637	2526	2272	2272
q22	1043	1029	991	991
Total cold run time: 106953 ms
Total hot run time: 33814 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5132	5064	5049	5049
q2	242	316	224	224
q3	2219	2606	2297	2297
q4	1354	1748	1338	1338
q5	4179	4292	4402	4292
q6	214	184	133	133
q7	2022	1955	1858	1858
q8	2674	2653	2480	2480
q9	7376	7309	7323	7309
q10	3021	3196	2829	2829
q11	581	529	509	509
q12	703	786	665	665
q13	3716	3859	3203	3203
q14	290	320	276	276
q15	546	507	512	507
q16	1064	1097	1054	1054
q17	1183	1594	1370	1370
q18	7948	7643	7485	7485
q19	795	801	857	801
q20	2004	2092	1924	1924
q21	4740	4329	4313	4313
q22	1088	1048	1018	1018
Total cold run time: 53091 ms
Total hot run time: 50934 ms

doris-robot · 2025-11-17T15:27:12Z

TPC-DS: Total hot run time: 188375 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4ab437df18458ec284d9ef1ea0bddfae0a96271c, data reload: false

query1	1021	412	389	389
query2	6602	1666	1688	1666
query3	6748	227	226	226
query4	27058	23533	23360	23360
query5	4357	643	519	519
query6	349	257	247	247
query7	4654	521	314	314
query8	313	283	242	242
query9	8635	2902	2896	2896
query10	481	350	296	296
query11	15425	15011	14764	14764
query12	172	125	119	119
query13	1681	577	450	450
query14	10236	9021	9075	9021
query15	196	182	172	172
query16	7301	649	497	497
query17	1240	745	621	621
query18	1993	436	340	340
query19	219	207	191	191
query20	135	124	122	122
query21	220	140	118	118
query22	3977	4084	3872	3872
query23	33822	32971	33068	32971
query24	8197	2394	2377	2377
query25	647	591	460	460
query26	1241	278	168	168
query27	2746	513	362	362
query28	4473	2265	2243	2243
query29	820	633	503	503
query30	298	228	195	195
query31	881	777	719	719
query32	95	80	78	78
query33	620	402	347	347
query34	781	849	527	527
query35	811	817	748	748
query36	954	1022	929	929
query37	133	115	96	96
query38	3467	3507	3397	3397
query39	1476	1425	1409	1409
query40	228	137	121	121
query41	62	60	61	60
query42	127	113	115	113
query43	475	463	457	457
query44	1274	800	797	797
query45	189	185	179	179
query46	891	989	655	655
query47	1789	1826	1744	1744
query48	404	423	329	329
query49	748	537	447	447
query50	668	677	403	403
query51	3892	3885	3911	3885
query52	123	115	107	107
query53	249	283	206	206
query54	326	312	312	312
query55	97	96	88	88
query56	363	347	326	326
query57	1225	1196	1134	1134
query58	299	293	291	291
query59	2532	2605	2492	2492
query60	362	362	348	348
query61	178	153	158	153
query62	801	746	662	662
query63	232	198	200	198
query64	4513	1191	898	898
query65	4035	3932	3953	3932
query66	1172	460	361	361
query67	15339	15217	14883	14883
query68	5675	965	634	634
query69	514	341	300	300
query70	1313	1298	1257	1257
query71	428	353	336	336
query72	5989	5205	5197	5197
query73	647	583	365	365
query74	8961	9070	8922	8922
query75	3306	3230	2753	2753
query76	3248	1146	724	724
query77	525	415	333	333
query78	9614	9775	8910	8910
query79	2194	864	614	614
query80	1549	597	522	522
query81	568	255	233	233
query82	438	173	135	135
query83	273	273	259	259
query84	255	118	90	90
query85	885	527	459	459
query86	408	315	289	289
query87	3694	3763	3597	3597
query88	2921	2230	2228	2228
query89	393	334	290	290
query90	1949	226	229	226
query91	173	164	135	135
query92	86	77	75	75
query93	2498	1032	674	674
query94	805	429	320	320
query95	421	340	325	325
query96	488	645	282	282
query97	2886	2976	2857	2857
query98	242	220	219	219
query99	1328	1383	1263	1263
Total cold run time: 271742 ms
Total hot run time: 188375 ms

doris-robot · 2025-11-17T15:32:18Z

ClickBench: Total hot run time: 27.46 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4ab437df18458ec284d9ef1ea0bddfae0a96271c, data reload: false

query1	0.06	0.05	0.05
query2	0.09	0.06	0.05
query3	0.26	0.08	0.09
query4	1.60	0.12	0.11
query5	0.28	0.25	0.25
query6	1.16	0.64	0.63
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.57	0.51	0.52
query10	0.58	0.57	0.57
query11	0.16	0.11	0.10
query12	0.15	0.12	0.11
query13	0.62	0.60	0.61
query14	1.00	1.01	0.99
query15	0.85	0.83	0.83
query16	0.39	0.39	0.40
query17	1.03	1.03	1.03
query18	0.21	0.21	0.20
query19	1.88	1.82	1.82
query20	0.02	0.01	0.02
query21	15.42	0.20	0.13
query22	4.98	0.06	0.04
query23	15.66	0.28	0.10
query24	2.31	0.46	0.86
query25	0.07	0.08	0.05
query26	0.15	0.14	0.14
query27	0.06	0.05	0.05
query28	5.55	1.13	0.97
query29	12.57	3.88	3.19
query30	0.28	0.15	0.13
query31	2.81	0.60	0.37
query32	3.23	0.55	0.47
query33	3.02	3.01	3.08
query34	15.86	5.15	4.56
query35	4.64	4.59	4.56
query36	0.68	0.51	0.48
query37	0.09	0.06	0.07
query38	0.07	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.14
query41	0.09	0.03	0.04
query42	0.04	0.03	0.03
query43	0.04	0.03	0.03
Total cold run time: 98.82 s
Total hot run time: 27.46 s

doris-robot · 2025-11-17T15:42:58Z

BE UT Coverage Report

Increment line coverage 0.00% (0/14) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.75% (18274/34643)
Line Coverage	38.12% (166105/435732)
Region Coverage	33.12% (129279/390393)
Branch Coverage	33.84% (55417/163769)

hello-stephen · 2025-11-17T16:49:13Z

BE Regression && UT Coverage Report

Increment line coverage 42.86% (6/14) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.42% (24314/34043)
Line Coverage	57.91% (252702/436406)
Region Coverage	53.11% (210279/395897)
Branch Coverage	54.50% (89838/164844)

morningman · 2025-11-18T02:45:09Z

run buildall

doris-robot · 2025-11-18T03:26:47Z

TPC-H: Total hot run time: 34788 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 69b42b6f7ee6844e9bbecf15d21f74b4def63b49, data reload: false

------ Round 1 ----------------------------------
q1	17839	5040	4957	4957
q2	2185	301	199	199
q3	10394	1273	712	712
q4	10329	933	377	377
q5	7507	2416	2348	2348
q6	189	171	138	138
q7	915	763	627	627
q8	9360	1324	1164	1164
q9	6789	5142	5009	5009
q10	7315	2215	1801	1801
q11	542	309	286	286
q12	440	371	236	236
q13	17929	3660	3027	3027
q14	231	240	211	211
q15	588	507	495	495
q16	1038	1002	918	918
q17	573	864	360	360
q18	7339	7616	7754	7616
q19	1792	984	556	556
q20	336	329	242	242
q21	4210	3347	2437	2437
q22	1112	1112	1072	1072
Total cold run time: 108952 ms
Total hot run time: 34788 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5184	5288	5211	5211
q2	257	324	223	223
q3	2361	2795	2469	2469
q4	1421	1822	1442	1442
q5	4414	4409	4492	4409
q6	202	166	122	122
q7	2006	1934	1793	1793
q8	2622	2655	2878	2655
q9	7252	7197	7444	7197
q10	2983	3150	2632	2632
q11	563	518	490	490
q12	662	774	581	581
q13	3276	3619	3023	3023
q14	282	285	266	266
q15	545	510	477	477
q16	1011	1047	1003	1003
q17	1097	1419	1346	1346
q18	7266	7153	6955	6955
q19	753	770	756	756
q20	1899	1956	1776	1776
q21	4683	4497	4266	4266
q22	1108	1044	995	995
Total cold run time: 51847 ms
Total hot run time: 50087 ms

doris-robot · 2025-11-18T03:38:37Z

TPC-DS: Total hot run time: 188133 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 69b42b6f7ee6844e9bbecf15d21f74b4def63b49, data reload: false

query1	1671	390	392	390
query2	6670	1658	1657	1657
query3	6882	230	229	229
query4	26432	22966	22890	22890
query5	4433	656	530	530
query6	376	253	237	237
query7	4664	520	320	320
query8	311	264	258	258
query9	8659	2916	2887	2887
query10	498	344	324	324
query11	15308	14995	15181	14995
query12	242	130	122	122
query13	1696	582	482	482
query14	11158	9310	9190	9190
query15	194	189	171	171
query16	7695	643	485	485
query17	1245	759	609	609
query18	2077	420	325	325
query19	251	199	175	175
query20	135	128	123	123
query21	560	134	113	113
query22	4260	4078	4028	4028
query23	33821	33103	32996	32996
query24	8137	2415	2420	2415
query25	672	522	480	480
query26	1278	276	164	164
query27	2706	508	371	371
query28	4389	2252	2235	2235
query29	783	624	542	542
query30	398	232	198	198
query31	929	801	719	719
query32	95	81	81	81
query33	604	406	347	347
query34	806	854	528	528
query35	805	854	749	749
query36	980	981	922	922
query37	175	115	95	95
query38	3519	3609	3398	3398
query39	1496	1417	1421	1417
query40	304	138	127	127
query41	62	58	63	58
query42	134	121	126	121
query43	494	493	445	445
query44	1262	819	791	791
query45	187	180	175	175
query46	880	1007	646	646
query47	1735	1789	1685	1685
query48	410	428	321	321
query49	900	503	414	414
query50	650	678	405	405
query51	3873	3999	3831	3831
query52	115	121	104	104
query53	243	287	209	209
query54	353	319	301	301
query55	96	91	91	91
query56	350	340	347	340
query57	1163	1184	1114	1114
query58	298	288	285	285
query59	2432	2629	2512	2512
query60	368	362	355	355
query61	168	161	163	161
query62	783	706	657	657
query63	229	195	197	195
query64	4473	1155	904	904
query65	4036	3981	3890	3890
query66	1160	458	332	332
query67	15191	14884	14896	14884
query68	5201	971	636	636
query69	635	343	302	302
query70	1335	1228	1192	1192
query71	433	355	323	323
query72	6023	5113	5030	5030
query73	658	567	362	362
query74	9101	9086	8803	8803
query75	3290	3282	2777	2777
query76	3321	1130	725	725
query77	558	425	344	344
query78	9959	9753	8942	8942
query79	2298	843	609	609
query80	1760	607	535	535
query81	596	259	229	229
query82	404	166	138	138
query83	349	268	245	245
query84	257	110	89	89
query85	934	503	446	446
query86	485	338	315	315
query87	3638	3732	3578	3578
query88	2850	2239	2209	2209
query89	382	331	288	288
query90	1860	229	231	229
query91	177	172	135	135
query92	87	77	75	75
query93	1434	1003	684	684
query94	706	429	344	344
query95	429	344	342	342
query96	478	604	284	284
query97	2873	2933	2886	2886
query98	255	216	211	211
query99	1339	1404	1276	1276
Total cold run time: 273464 ms
Total hot run time: 188133 ms

doris-robot · 2025-11-18T03:43:44Z

ClickBench: Total hot run time: 27.47 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 69b42b6f7ee6844e9bbecf15d21f74b4def63b49, data reload: false

query1	0.06	0.05	0.05
query2	0.16	0.05	0.05
query3	0.27	0.08	0.08
query4	1.77	0.12	0.11
query5	0.27	0.25	0.25
query6	1.18	0.64	0.65
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.58	0.53	0.52
query10	0.57	0.56	0.58
query11	0.17	0.11	0.11
query12	0.16	0.13	0.12
query13	0.63	0.61	0.60
query14	1.00	0.99	0.99
query15	0.85	0.83	0.81
query16	0.39	0.39	0.39
query17	1.02	1.03	0.99
query18	0.23	0.20	0.21
query19	1.91	1.82	1.82
query20	0.02	0.01	0.02
query21	15.46	0.19	0.13
query22	5.07	0.07	0.05
query23	16.11	0.26	0.10
query24	2.93	0.54	0.49
query25	0.07	0.07	0.06
query26	0.14	0.13	0.14
query27	0.07	0.05	0.06
query28	4.16	1.17	0.97
query29	12.59	3.92	3.24
query30	0.28	0.15	0.12
query31	2.82	0.60	0.38
query32	3.39	0.55	0.47
query33	3.04	3.00	3.13
query34	15.71	5.16	4.55
query35	4.58	4.58	4.53
query36	0.67	0.51	0.48
query37	0.14	0.07	0.07
query38	0.06	0.04	0.04
query39	0.05	0.03	0.03
query40	0.17	0.14	0.13
query41	0.09	0.04	0.03
query42	0.11	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 99.06 s
Total hot run time: 27.47 s

doris-robot · 2025-11-18T04:23:14Z

BE UT Coverage Report

Increment line coverage 0.00% (0/14) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.73% (18270/34648)
Line Coverage	38.10% (165977/435673)
Region Coverage	33.04% (129001/390442)
Branch Coverage	33.80% (55361/163789)

hello-stephen · 2025-11-18T05:13:27Z

BE Regression && UT Coverage Report

Increment line coverage 71.43% (10/14) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.45% (24326/34048)
Line Coverage	57.95% (252879/436346)
Region Coverage	53.30% (211020/395944)
Branch Coverage	54.60% (90008/164862)

morningman · 2025-11-18T08:49:33Z

run buildall

doris-robot · 2025-11-18T10:19:36Z

TPC-H: Total hot run time: 35040 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 740cba0ab417e5f33e23f4b774e52efa12826ea2, data reload: false

------ Round 1 ----------------------------------
q1	17618	5063	4950	4950
q2	1994	319	204	204
q3	10254	1301	731	731
q4	10245	907	361	361
q5	7507	2379	2393	2379
q6	183	169	136	136
q7	928	801	627	627
q8	9368	1384	1110	1110
q9	7072	5141	5159	5141
q10	6909	2252	1836	1836
q11	511	301	290	290
q12	379	361	239	239
q13	17812	3728	3025	3025
q14	229	242	213	213
q15	578	519	513	513
q16	1002	997	944	944
q17	599	893	371	371
q18	7544	7604	8049	7604
q19	1164	989	569	569
q20	394	361	244	244
q21	4546	3290	2489	2489
q22	1122	1117	1064	1064
Total cold run time: 107958 ms
Total hot run time: 35040 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5220	5178	5547	5178
q2	247	323	222	222
q3	2392	2909	2461	2461
q4	1495	1866	1518	1518
q5	4613	4557	4469	4469
q6	216	175	130	130
q7	2035	1998	1753	1753
q8	2697	2507	2589	2507
q9	7397	7180	7228	7180
q10	3004	3302	2803	2803
q11	627	524	491	491
q12	625	715	581	581
q13	3286	3701	3000	3000
q14	275	296	261	261
q15	522	486	485	485
q16	1001	1056	987	987
q17	1104	1462	1345	1345
q18	7232	7247	7072	7072
q19	767	745	806	745
q20	1924	1964	1822	1822
q21	4724	4441	4387	4387
q22	1080	1055	1001	1001
Total cold run time: 52483 ms
Total hot run time: 50398 ms

doris-robot · 2025-11-18T10:31:19Z

TPC-DS: Total hot run time: 188214 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 740cba0ab417e5f33e23f4b774e52efa12826ea2, data reload: false

query1	1027	425	419	419
query2	6547	1675	1661	1661
query3	6763	230	227	227
query4	25918	23209	22733	22733
query5	4409	661	511	511
query6	343	242	241	241
query7	4649	498	312	312
query8	299	280	249	249
query9	8697	2979	2955	2955
query10	476	346	307	307
query11	15860	15053	14986	14986
query12	199	123	122	122
query13	1700	581	451	451
query14	11239	9235	9155	9155
query15	198	187	173	173
query16	7699	691	527	527
query17	1266	810	657	657
query18	2054	441	355	355
query19	226	213	197	197
query20	138	131	131	131
query21	226	134	118	118
query22	4087	4214	3896	3896
query23	34016	33164	33004	33004
query24	8169	2438	2435	2435
query25	638	582	496	496
query26	1248	283	173	173
query27	2744	528	380	380
query28	4416	2267	2246	2246
query29	820	666	532	532
query30	301	228	202	202
query31	922	780	741	741
query32	95	89	86	86
query33	620	412	372	372
query34	850	848	517	517
query35	797	822	745	745
query36	938	996	933	933
query37	142	127	98	98
query38	3553	3457	3503	3457
query39	1520	1414	1422	1414
query40	235	142	131	131
query41	68	60	60	60
query42	133	122	119	119
query43	480	509	447	447
query44	1286	794	817	794
query45	184	177	176	176
query46	866	952	656	656
query47	1747	1789	1743	1743
query48	413	429	329	329
query49	760	490	417	417
query50	646	677	407	407
query51	3843	3912	3873	3873
query52	123	116	110	110
query53	247	282	196	196
query54	346	340	307	307
query55	96	95	90	90
query56	359	369	355	355
query57	1174	1188	1129	1129
query58	305	293	294	293
query59	2536	2564	2526	2526
query60	371	374	356	356
query61	177	164	164	164
query62	789	733	669	669
query63	235	201	204	201
query64	4433	1193	910	910
query65	4033	3921	3965	3921
query66	1133	448	356	356
query67	15158	14915	15144	14915
query68	8633	954	641	641
query69	511	333	303	303
query70	1349	1227	1296	1227
query71	507	365	329	329
query72	5864	4949	4892	4892
query73	685	568	365	365
query74	9031	9117	8743	8743
query75	3954	3260	2758	2758
query76	3769	1134	739	739
query77	828	410	332	332
query78	9560	9689	8854	8854
query79	2391	855	603	603
query80	661	600	530	530
query81	509	265	229	229
query82	339	176	139	139
query83	274	263	249	249
query84	256	110	93	93
query85	960	495	474	474
query86	400	316	300	300
query87	3664	3696	3584	3584
query88	3729	2235	2251	2235
query89	390	334	308	308
query90	1941	242	238	238
query91	184	164	135	135
query92	98	82	80	80
query93	1870	1025	691	691
query94	661	431	334	334
query95	429	351	341	341
query96	491	583	283	283
query97	2884	3022	2847	2847
query98	243	221	236	221
query99	1296	1359	1253	1253
Total cold run time: 276346 ms
Total hot run time: 188214 ms

doris-robot · 2025-11-18T10:36:19Z

ClickBench: Total hot run time: 27.31 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 740cba0ab417e5f33e23f4b774e52efa12826ea2, data reload: false

query1	0.05	0.05	0.05
query2	0.08	0.05	0.06
query3	0.26	0.08	0.08
query4	1.61	0.11	0.12
query5	0.27	0.25	0.25
query6	1.21	0.65	0.65
query7	0.04	0.03	0.03
query8	0.05	0.04	0.04
query9	0.57	0.54	0.52
query10	0.58	0.58	0.58
query11	0.16	0.11	0.12
query12	0.16	0.12	0.12
query13	0.62	0.60	0.60
query14	1.00	1.00	1.01
query15	0.87	0.83	0.84
query16	0.40	0.39	0.39
query17	1.01	1.01	1.04
query18	0.22	0.21	0.20
query19	1.92	1.78	1.77
query20	0.01	0.01	0.02
query21	15.44	0.20	0.14
query22	4.96	0.06	0.05
query23	15.69	0.24	0.10
query24	2.59	1.08	0.28
query25	0.07	0.06	0.06
query26	0.14	0.14	0.15
query27	0.06	0.06	0.05
query28	4.51	1.16	0.95
query29	12.56	3.86	3.23
query30	0.29	0.13	0.11
query31	2.82	0.58	0.38
query32	3.23	0.56	0.47
query33	3.04	3.04	3.03
query34	15.68	5.12	4.56
query35	4.57	4.57	4.54
query36	0.68	0.51	0.48
query37	0.10	0.07	0.06
query38	0.06	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.14	0.13
query41	0.09	0.04	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.04
Total cold run time: 97.95 s
Total hot run time: 27.31 s

hello-stephen · 2025-11-18T12:25:56Z

BE UT Coverage Report

Increment line coverage 0.00% (0/14) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.74% (18273/34650)
Line Coverage	38.10% (166026/435727)
Region Coverage	33.05% (129135/390732)
Branch Coverage	33.81% (55389/163823)

hello-stephen · 2025-11-18T12:52:33Z

BE Regression && UT Coverage Report

Increment line coverage 71.43% (10/14) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.47% (24337/34050)
Line Coverage	57.93% (252814/436396)
Region Coverage	53.22% (210922/396308)
Branch Coverage	54.55% (89961/164902)

morningman · 2025-11-20T01:58:20Z

run buildall

doris-robot · 2025-11-20T02:38:27Z

TPC-H: Total hot run time: 34479 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f3866e4fe626bccc13178281f5f4f81c13371fb9, data reload: false

------ Round 1 ----------------------------------
q1	17677	4974	5029	4974
q2	2133	311	198	198
q3	10268	1267	730	730
q4	10236	929	387	387
q5	7500	2383	2292	2292
q6	194	174	140	140
q7	926	789	618	618
q8	9344	1322	1111	1111
q9	7158	5513	5503	5503
q10	6963	2215	1795	1795
q11	502	300	289	289
q12	335	373	230	230
q13	17775	3696	3031	3031
q14	232	239	219	219
q15	578	512	516	512
q16	1022	986	937	937
q17	582	869	376	376
q18	7913	7090	7060	7060
q19	1099	965	550	550
q20	375	343	235	235
q21	3743	3239	2330	2330
q22	1072	1024	962	962
Total cold run time: 107627 ms
Total hot run time: 34479 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4943	4913	4875	4875
q2	323	391	306	306
q3	2155	2648	2268	2268
q4	1343	1773	1290	1290
q5	4183	4496	4446	4446
q6	218	170	130	130
q7	2005	2002	1827	1827
q8	2749	2675	2520	2520
q9	7498	7518	7564	7518
q10	3068	3237	2829	2829
q11	604	533	516	516
q12	670	998	652	652
q13	3485	3858	3359	3359
q14	299	323	273	273
q15	538	496	503	496
q16	1059	1100	1073	1073
q17	1203	1584	1393	1393
q18	7907	7726	7576	7576
q19	785	759	819	759
q20	1894	1974	1813	1813
q21	4794	4323	4238	4238
q22	1073	1024	977	977
Total cold run time: 52796 ms
Total hot run time: 51134 ms

doris-robot · 2025-11-20T02:50:18Z

TPC-DS: Total hot run time: 189584 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f3866e4fe626bccc13178281f5f4f81c13371fb9, data reload: false

query1	1144	422	406	406
query2	6562	1701	1678	1678
query3	6871	236	223	223
query4	26910	23376	23518	23376
query5	4401	665	512	512
query6	357	261	259	259
query7	4661	530	318	318
query8	305	275	266	266
query9	8682	2961	2964	2961
query10	507	371	323	323
query11	16072	15178	14992	14992
query12	200	131	128	128
query13	1729	580	456	456
query14	11014	9244	9231	9231
query15	201	187	166	166
query16	7321	665	515	515
query17	1242	780	628	628
query18	2007	438	347	347
query19	214	211	180	180
query20	139	135	129	129
query21	284	138	120	120
query22	3962	4163	4089	4089
query23	33959	32958	32955	32955
query24	8265	2369	2403	2369
query25	640	574	544	544
query26	1234	289	175	175
query27	2731	522	369	369
query28	4417	2255	2253	2253
query29	870	659	540	540
query30	338	236	210	210
query31	931	795	721	721
query32	102	86	89	86
query33	615	417	381	381
query34	792	882	528	528
query35	835	849	768	768
query36	938	1008	917	917
query37	189	125	100	100
query38	3580	3536	3532	3532
query39	1524	1455	1431	1431
query40	241	146	140	140
query41	70	110	62	62
query42	130	118	117	117
query43	480	488	458	458
query44	1293	802	802	802
query45	189	183	175	175
query46	894	987	656	656
query47	1768	1791	1739	1739
query48	403	444	341	341
query49	775	520	424	424
query50	653	673	406	406
query51	3991	3916	3867	3867
query52	116	117	115	115
query53	259	272	212	212
query54	331	327	303	303
query55	94	94	88	88
query56	361	340	342	340
query57	1184	1186	1117	1117
query58	311	290	291	290
query59	2496	2645	2526	2526
query60	378	380	356	356
query61	160	159	162	159
query62	811	724	641	641
query63	238	204	204	204
query64	4496	1206	892	892
query65	4144	3957	3970	3957
query66	1184	441	353	353
query67	15250	14989	14754	14754
query68	8173	966	631	631
query69	520	347	306	306
query70	1371	1267	1319	1267
query71	452	365	329	329
query72	5821	4951	4893	4893
query73	658	587	369	369
query74	8951	9120	8828	8828
query75	3423	3298	2850	2850
query76	3342	1178	757	757
query77	557	427	352	352
query78	9914	9925	9097	9097
query79	1669	849	610	610
query80	668	621	543	543
query81	525	276	255	255
query82	222	169	142	142
query83	280	278	261	261
query84	258	116	91	91
query85	912	491	456	456
query86	385	314	268	268
query87	3839	3863	3695	3695
query88	2863	2263	2204	2204
query89	386	331	291	291
query90	2030	250	231	231
query91	169	169	139	139
query92	94	80	73	73
query93	1820	1011	679	679
query94	717	454	311	311
query95	431	347	339	339
query96	475	596	285	285
query97	2980	3008	2868	2868
query98	252	228	218	218
query99	1307	1391	1270	1270
Total cold run time: 274909 ms
Total hot run time: 189584 ms

doris-robot · 2025-11-20T02:55:24Z

ClickBench: Total hot run time: 27.34 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f3866e4fe626bccc13178281f5f4f81c13371fb9, data reload: false

query1	0.05	0.04	0.05
query2	0.12	0.06	0.05
query3	0.27	0.08	0.08
query4	1.61	0.11	0.11
query5	0.26	0.26	0.26
query6	1.20	0.65	0.64
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.58	0.51	0.50
query10	0.58	0.57	0.57
query11	0.17	0.12	0.12
query12	0.16	0.15	0.12
query13	0.61	0.60	0.61
query14	1.00	1.00	0.98
query15	0.86	0.81	0.83
query16	0.39	0.39	0.39
query17	1.06	1.01	1.03
query18	0.22	0.20	0.20
query19	1.97	1.79	1.83
query20	0.05	0.01	0.02
query21	15.45	0.18	0.12
query22	5.11	0.07	0.05
query23	15.67	0.26	0.09
query24	2.85	0.79	0.46
query25	0.07	0.06	0.06
query26	0.14	0.13	0.13
query27	0.06	0.05	0.06
query28	4.53	1.17	0.95
query29	12.75	3.85	3.22
query30	0.28	0.14	0.11
query31	2.82	0.57	0.39
query32	3.23	0.56	0.47
query33	3.04	2.99	3.08
query34	15.68	5.17	4.50
query35	4.57	4.62	4.58
query36	0.67	0.50	0.49
query37	0.11	0.06	0.07
query38	0.07	0.04	0.04
query39	0.05	0.03	0.03
query40	0.18	0.15	0.14
query41	0.09	0.03	0.02
query42	0.05	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 98.75 s
Total hot run time: 27.34 s

doris-robot · 2025-11-20T06:28:06Z

BE UT Coverage Report

Increment line coverage 0.00% (0/14) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.67% (18280/34707)
Line Coverage	38.08% (166180/436399)
Region Coverage	33.04% (129226/391147)
Branch Coverage	33.82% (55441/163937)

hello-stephen · 2025-11-20T06:35:50Z

BE Regression && UT Coverage Report

Increment line coverage 100.00% (14/14) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.48% (24344/34058)
Line Coverage	57.96% (252982/436511)
Region Coverage	53.26% (211127/396429)
Branch Coverage	54.60% (90061/164932)

github-actions · 2025-11-20T08:25:17Z

PR approved by anyone and no changes requested.

github-actions · 2025-11-20T08:42:47Z

PR approved by at least one committer and no changes requested.

…apache#58090) ### What problem does this PR solve? Related PR: apache#55392 Problem Summary: Support compression when outfile with `csv_with_names` and `cvs_with_names_and_types`

…#58090) ### What problem does this PR solve? Related PR: #55392 Problem Summary: Support compression when outfile with `csv_with_names` and `cvs_with_names_and_types`

…s in outfile #58090 (#59988) Cherry-picked from #58090 Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>

morningman marked this pull request as ready for review November 17, 2025 14:32

morningman and others added 5 commits November 20, 2025 09:58

[opt](outfile) support compressed csv with names and types in outfile

9254a8c

add test

81dfc3d

fix case

9bd6170

3

ad02864

add bom case

f3866e4

morningman force-pushed the compress_csv_with_names branch from 740cba0 to f3866e4 Compare November 20, 2025 01:58

suxiaogang223 approved these changes Nov 20, 2025

View reviewed changes

github-actions bot added the reviewed label Nov 20, 2025

hubgeter approved these changes Nov 20, 2025

View reviewed changes

zy-kkk approved these changes Nov 20, 2025

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Nov 20, 2025

morningman merged commit 81aa5be into apache:master Nov 20, 2025
29 of 30 checks passed

morningman added dev/3.1.x dev/4.0.x labels Jan 17, 2026

github-actions bot mentioned this pull request Jan 17, 2026

branch-4.0: [opt](outfile) support compressed csv with names and types in outfile #58090 #59988

Merged

yiguolei pushed a commit that referenced this pull request Jan 17, 2026

branch-4.0: [opt](outfile) support compressed csv with names and type…

25d2bea

…s in outfile #58090 (#59988) Cherry-picked from #58090 Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>

yiguolei added dev/4.0.3-merged and removed dev/4.0.x labels Jan 17, 2026

[opt](outfile) support compressed csv with names and types in outfile #58090

[opt](outfile) support compressed csv with names and types in outfile #58090

Uh oh!

Conversation

morningman commented Nov 17, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

Thearas commented Nov 17, 2025

Uh oh!

morningman commented Nov 17, 2025

Uh oh!

doris-robot commented Nov 17, 2025

Uh oh!

doris-robot commented Nov 17, 2025

Uh oh!

doris-robot commented Nov 17, 2025

Uh oh!

doris-robot commented Nov 17, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Nov 17, 2025

BE Regression && UT Coverage Report

Uh oh!

morningman commented Nov 18, 2025

Uh oh!

doris-robot commented Nov 18, 2025

Uh oh!

doris-robot commented Nov 18, 2025

Uh oh!

doris-robot commented Nov 18, 2025

Uh oh!

doris-robot commented Nov 18, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Nov 18, 2025

BE Regression && UT Coverage Report

Uh oh!

morningman commented Nov 18, 2025

Uh oh!

doris-robot commented Nov 18, 2025

Uh oh!

doris-robot commented Nov 18, 2025

Uh oh!

doris-robot commented Nov 18, 2025

Uh oh!

hello-stephen commented Nov 18, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Nov 18, 2025

BE Regression && UT Coverage Report

Uh oh!

morningman commented Nov 20, 2025

Uh oh!

doris-robot commented Nov 20, 2025

Uh oh!

doris-robot commented Nov 20, 2025

Uh oh!

doris-robot commented Nov 20, 2025

Uh oh!

doris-robot commented Nov 20, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Nov 20, 2025

BE Regression && UT Coverage Report

Uh oh!

github-actions bot commented Nov 20, 2025

Uh oh!

github-actions bot commented Nov 20, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

morningman commented Nov 17, 2025 •

edited

Loading