Skip to content

Conversation

@w41ter
Copy link
Contributor

@w41ter w41ter commented Sep 10, 2025

cherry-pick #55608

@w41ter w41ter requested a review from morrySnow as a code owner September 10, 2025 09:15
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@w41ter
Copy link
Contributor Author

w41ter commented Sep 10, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32861 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cb002cbed619abdb2e71fce6157429b7ffed1f04, data reload: false

------ Round 1 ----------------------------------
q1	17599	5590	5494	5494
q2	2028	424	296	296
q3	12230	1242	748	748
q4	10506	878	469	469
q5	9331	2454	2151	2151
q6	183	170	135	135
q7	895	781	617	617
q8	9338	1441	1150	1150
q9	5269	5071	4911	4911
q10	6792	2308	1815	1815
q11	480	291	265	265
q12	345	361	225	225
q13	17803	3603	3014	3014
q14	245	227	217	217
q15	523	464	470	464
q16	421	426	368	368
q17	597	863	369	369
q18	6580	6412	6427	6412
q19	1090	964	566	566
q20	331	337	205	205
q21	2941	2283	2016	2016
q22	1053	1024	954	954
Total cold run time: 106580 ms
Total hot run time: 32861 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5542	5468	5541	5468
q2	241	325	237	237
q3	2236	2665	2285	2285
q4	1360	1827	1408	1408
q5	4457	5016	4980	4980
q6	172	163	128	128
q7	2066	2014	1809	1809
q8	2684	2910	2716	2716
q9	7302	7297	7231	7231
q10	3032	3264	2748	2748
q11	580	545	501	501
q12	641	760	635	635
q13	3432	3804	3171	3171
q14	277	287	278	278
q15	529	477	474	474
q16	431	479	420	420
q17	1248	1743	1275	1275
q18	7661	7432	7330	7330
q19	816	963	1158	963
q20	2023	2069	1905	1905
q21	5486	4869	4572	4572
q22	1085	1079	1057	1057
Total cold run time: 53301 ms
Total hot run time: 51591 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193091 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cb002cbed619abdb2e71fce6157429b7ffed1f04, data reload: false

query1	955	396	400	396
query2	6227	1955	1889	1889
query3	8693	212	207	207
query4	33359	23968	23529	23529
query5	3659	621	481	481
query6	281	212	179	179
query7	4204	509	326	326
query8	307	238	259	238
query9	9428	2658	2673	2658
query10	478	333	273	273
query11	18169	15646	15307	15307
query12	166	106	105	105
query13	1550	539	428	428
query14	9016	6752	7966	6752
query15	284	196	186	186
query16	8164	685	522	522
query17	1560	785	600	600
query18	2198	435	341	341
query19	226	188	175	175
query20	130	137	120	120
query21	201	133	109	109
query22	4577	4719	4355	4355
query23	35063	34227	34277	34227
query24	7256	2735	2790	2735
query25	584	501	455	455
query26	808	291	178	178
query27	2170	507	368	368
query28	5305	2278	2238	2238
query29	738	604	465	465
query30	244	200	169	169
query31	973	944	838	838
query32	100	64	70	64
query33	549	385	330	330
query34	804	884	531	531
query35	804	806	729	729
query36	998	1090	972	972
query37	110	100	67	67
query38	3996	4068	3991	3991
query39	1534	1502	1529	1502
query40	212	121	110	110
query41	48	47	47	47
query42	126	110	106	106
query43	524	531	491	491
query44	1400	859	854	854
query45	189	186	181	181
query46	935	1084	698	698
query47	2009	2036	1934	1934
query48	442	463	345	345
query49	781	515	410	410
query50	709	720	442	442
query51	7402	7526	7229	7229
query52	109	105	94	94
query53	245	276	197	197
query54	566	555	494	494
query55	83	80	78	78
query56	273	317	275	275
query57	1288	1280	1235	1235
query58	232	224	226	224
query59	3096	3112	2967	2967
query60	293	299	288	288
query61	117	118	117	117
query62	811	753	700	700
query63	245	198	202	198
query64	3786	1014	654	654
query65	3410	3317	3300	3300
query66	802	411	311	311
query67	16425	15695	15955	15695
query68	7971	848	546	546
query69	503	321	277	277
query70	1220	1153	1071	1071
query71	423	306	281	281
query72	5182	3744	3808	3744
query73	668	762	369	369
query74	10180	9133	9124	9124
query75	3896	3139	2684	2684
query76	3523	1187	790	790
query77	764	385	282	282
query78	10315	10348	9631	9631
query79	3786	862	601	601
query80	736	539	434	434
query81	481	262	222	222
query82	610	124	92	92
query83	169	163	149	149
query84	278	106	84	84
query85	770	352	306	306
query86	342	296	290	290
query87	4370	4357	4225	4225
query88	5148	2624	2421	2421
query89	409	337	303	303
query90	1796	194	209	194
query91	134	145	109	109
query92	64	58	53	53
query93	1973	923	545	545
query94	648	406	314	314
query95	354	286	270	270
query96	500	644	296	296
query97	3198	3231	3178	3178
query98	240	215	199	199
query99	1536	1448	1298	1298
Total cold run time: 294613 ms
Total hot run time: 193091 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.52 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cb002cbed619abdb2e71fce6157429b7ffed1f04, data reload: false

query1	0.03	0.02	0.03
query2	0.07	0.03	0.02
query3	0.23	0.06	0.07
query4	1.62	0.10	0.10
query5	0.52	0.51	0.54
query6	1.14	0.72	0.72
query7	0.02	0.02	0.02
query8	0.05	0.03	0.03
query9	0.61	0.50	0.50
query10	0.56	0.54	0.55
query11	0.15	0.11	0.10
query12	0.14	0.11	0.11
query13	0.60	0.61	0.60
query14	0.78	0.81	0.80
query15	0.85	0.83	0.82
query16	0.40	0.37	0.39
query17	1.07	1.09	1.06
query18	0.24	0.22	0.22
query19	1.85	1.80	1.72
query20	0.01	0.01	0.01
query21	15.40	0.96	0.58
query22	0.75	0.81	0.58
query23	15.14	1.49	0.53
query24	3.11	0.78	0.84
query25	0.17	0.17	0.06
query26	0.29	0.17	0.13
query27	0.04	0.03	0.04
query28	13.59	1.11	0.45
query29	12.57	3.98	3.23
query30	0.26	0.09	0.07
query31	2.81	0.62	0.40
query32	3.23	0.55	0.47
query33	3.02	2.98	3.02
query34	16.70	5.13	4.55
query35	4.56	4.55	4.58
query36	0.64	0.50	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.17	0.14	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.72 s
Total hot run time: 28.52 s

@morrySnow morrySnow changed the title [fix](backup) Support backup meta/job info exceeds 2GB (#55608) branch-3.1: [fix](backup) Support backup meta/job info exceeds 2GB #55608 Sep 11, 2025
@morrySnow morrySnow merged commit 33de374 into apache:branch-3.1 Sep 11, 2025
24 checks passed
@w41ter w41ter deleted the pick_55608_to_origin_branch-3.1 branch September 11, 2025 09:46
@morrySnow morrySnow mentioned this pull request Sep 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants