Skip to content

branch-3.1: [opt](outfile) change suffix of compressed file #55803 #55908

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
morrySnow merged 1 commit into from
Sep 12, 2025
Merged

branch-3.1: [opt](outfile) change suffix of compressed file #55803 #55908

morrySnow merged 1 commit into from
Sep 12, 2025
+2 −2

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Sep 11, 2025

Cherry-picked from #55803

@morningman
[opt](outfile) change suffix of compressed file (#55803)
923f702 
Followup #55392
Change gzip to gz, bzip2 to bz2.
So that tools like `gunzip` can recognize it directly
@github-actions github-actions bot requested a review from morrySnow as a code owner September 11, 2025 06:30
@Thearas
Copy link
Contributor

Thearas commented Sep 11, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Sep 11, 2025
@Thearas
Copy link
Contributor

Thearas commented Sep 11, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Sep 11, 2025

TPC-H: Total hot run time: 32585 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 923f7029cc6b7d0f2f9841356359a6993c6e5272, data reload: false

------ Round 1 ----------------------------------
q1	17581	5430	5452	5430
q2	2022	403	287	287
q3	12158	1257	751	751
q4	10567	874	457	457
q5	9626	2389	2133	2133
q6	183	163	131	131
q7	868	741	607	607
q8	9338	1408	1169	1169
q9	5222	4946	4919	4919
q10	6775	2304	1804	1804
q11	481	276	279	276
q12	334	355	206	206
q13	17806	3586	3021	3021
q14	218	228	207	207
q15	533	455	457	455
q16	423	429	369	369
q17	594	853	354	354
q18	6822	6524	6332	6332
q19	1208	961	544	544
q20	325	337	206	206
q21	2813	2138	1921	1921
q22	1074	1036	1006	1006
Total cold run time: 106971 ms
Total hot run time: 32585 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5473	5445	5472	5445
q2	240	326	241	241
q3	2247	2583	2319	2319
q4	1384	1754	1365	1365
q5	4412	4936	5020	4936
q6	166	161	128	128
q7	2102	2021	1826	1826
q8	2599	2927	2777	2777
q9	7437	7469	7400	7400
q10	3125	3299	2748	2748
q11	579	517	558	517
q12	688	758	650	650
q13	3529	3950	3237	3237
q14	311	305	285	285
q15	538	475	468	468
q16	455	515	467	467
q17	1251	1764	1281	1281
q18	7849	7794	7477	7477
q19	796	1046	1079	1046
q20	2001	2084	1935	1935
q21	5210	4881	4449	4449
q22	1085	1079	1027	1027
Total cold run time: 53477 ms
Total hot run time: 52024 ms

@doris-robot
Copy link

doris-robot commented Sep 11, 2025

TPC-DS: Total hot run time: 192443 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 923f7029cc6b7d0f2f9841356359a6993c6e5272, data reload: false

query1	973	412	419	412
query2	6141	1943	1911	1911
query3	8692	217	204	204
query4	33344	24106	23560	23560
query5	3968	587	466	466
query6	298	209	180	180
query7	4211	490	326	326
query8	353	263	246	246
query9	9525	2630	2615	2615
query10	477	318	259	259
query11	17765	15414	15205	15205
query12	157	111	105	105
query13	1552	532	419	419
query14	10572	7636	6835	6835
query15	252	189	183	183
query16	8097	665	496	496
query17	1541	746	589	589
query18	2125	415	327	327
query19	229	192	172	172
query20	134	126	124	124
query21	204	135	110	110
query22	4564	4683	4420	4420
query23	35214	34342	34238	34238
query24	7274	2742	2804	2742
query25	555	503	428	428
query26	794	296	182	182
query27	2000	486	360	360
query28	5595	2191	2225	2191
query29	750	608	463	463
query30	251	189	188	188
query31	1040	966	849	849
query32	88	59	59	59
query33	488	372	319	319
query34	735	873	513	513
query35	781	811	780	780
query36	1014	1060	1001	1001
query37	111	100	67	67
query38	4107	4048	4000	4000
query39	1568	1484	1476	1476
query40	211	119	106	106
query41	53	50	47	47
query42	123	109	106	106
query43	513	524	505	505
query44	1367	849	835	835
query45	189	182	180	180
query46	895	1058	688	688
query47	1941	1946	1912	1912
query48	414	427	344	344
query49	750	487	423	423
query50	673	697	438	438
query51	7376	7340	7274	7274
query52	103	100	91	91
query53	238	254	205	205
query54	554	534	466	466
query55	86	87	87	87
query56	281	274	251	251
query57	1283	1269	1232	1232
query58	244	229	224	224
query59	3085	3063	2931	2931
query60	307	285	278	278
query61	109	116	113	113
query62	819	789	691	691
query63	229	194	199	194
query64	3929	1014	643	643
query65	3395	3369	3334	3334
query66	791	403	306	306
query67	16323	15702	15519	15519
query68	7791	836	543	543
query69	490	297	266	266
query70	1203	1147	1110	1110
query71	385	294	265	265
query72	5764	3722	3924	3722
query73	630	739	351	351
query74	10432	9098	8906	8906
query75	3265	3149	2663	2663
query76	3147	1198	805	805
query77	696	381	292	292
query78	10325	10382	9529	9529
query79	3881	882	591	591
query80	793	530	430	430
query81	503	257	224	224
query82	585	127	90	90
query83	168	159	150	150
query84	286	102	84	84
query85	778	366	297	297
query86	395	290	290	290
query87	4337	4331	4301	4301
query88	5026	2377	2383	2377
query89	410	330	293	293
query90	1759	189	192	189
query91	142	141	117	117
query92	61	55	52	52
query93	2693	888	536	536
query94	656	387	313	313
query95	342	287	273	273
query96	492	598	282	282
query97	3203	3283	3159	3159
query98	236	217	199	199
query99	1517	1449	1301	1301
Total cold run time: 296211 ms
Total hot run time: 192443 ms

@doris-robot
Copy link

doris-robot commented Sep 11, 2025

BE UT Coverage Report

Increment line coverage 0.00% (0/2) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 45.53% (12760/28023)
Line Coverage 36.36% (113754/312824)
Region Coverage 33.99% (65056/191376)
Branch Coverage 31.03% (34142/110046)

@doris-robot
Copy link

doris-robot commented Sep 11, 2025

ClickBench: Total hot run time: 28.86 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 923f7029cc6b7d0f2f9841356359a6993c6e5272, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.24	0.07	0.06
query4	1.61	0.10	0.10
query5	0.51	0.52	0.52
query6	1.13	0.73	0.72
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.57	0.50	0.52
query10	0.59	0.55	0.55
query11	0.14	0.10	0.11
query12	0.14	0.10	0.11
query13	0.62	0.60	0.59
query14	0.80	0.79	0.79
query15	0.84	0.84	0.83
query16	0.38	0.39	0.39
query17	0.96	1.05	1.01
query18	0.23	0.22	0.22
query19	1.90	1.84	1.89
query20	0.01	0.01	0.01
query21	15.39	0.92	0.61
query22	0.74	0.94	0.88
query23	14.78	1.43	0.53
query24	3.62	1.32	0.73
query25	0.13	0.06	0.11
query26	0.32	0.16	0.13
query27	0.06	0.04	0.05
query28	13.58	1.03	0.43
query29	12.57	3.98	3.29
query30	0.25	0.11	0.06
query31	2.81	0.61	0.39
query32	3.24	0.53	0.47
query33	3.03	3.00	3.08
query34	16.62	5.21	4.49
query35	4.62	4.58	4.55
query36	0.65	0.50	0.48
query37	0.09	0.06	0.05
query38	0.05	0.03	0.03
query39	0.03	0.02	0.02
query40	0.16	0.14	0.12
query41	0.07	0.02	0.03
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.7 s
Total hot run time: 28.86 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 11, 2025

BE Regression && UT Coverage Report

Increment line coverage 0.00% (0/2) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 66.02% (18197/27561)
Line Coverage 57.60% (179635/311853)
Region Coverage 55.35% (106366/192153)
Branch Coverage 49.71% (54956/110560)

@morrySnow morrySnow merged commit b209e00 into branch-3.1 Sep 12, 2025
21 of 23 checks passed
@github-actions github-actions bot deleted the auto-pick-55803-branch-3.1 branch September 12, 2025 02:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morrySnow morrySnow morrySnow approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@Thearas @doris-robot @hello-stephen @morrySnow @dataroaring @morningman