Skip to content

Conversation

@github-actions
Copy link
Contributor

Cherry-picked from #54090

#54090)

…hen fe is abnormal



The previous operation and maintenance method force_skip_journal_ids can
only skip a specific logid. If there are many abnormal logids, it is
difficult to configure
@github-actions github-actions bot requested a review from dataroaring as a code owner August 22, 2025 13:56
@Thearas
Copy link
Contributor

Thearas commented Aug 22, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Aug 22, 2025
@Thearas
Copy link
Contributor

Thearas commented Aug 22, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39745 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fb046b93b3a05470547d038571e16085a98ff525, data reload: false

------ Round 1 ----------------------------------
q1	17933	7905	6692	6692
q2	2086	163	175	163
q3	10663	1139	1152	1139
q4	10426	755	799	755
q5	7767	2786	2776	2776
q6	212	129	129	129
q7	960	625	608	608
q8	9345	1942	1986	1942
q9	6681	6403	6420	6403
q10	7047	2258	2290	2258
q11	469	255	261	255
q12	398	216	226	216
q13	17794	2980	2982	2980
q14	232	202	215	202
q15	510	447	452	447
q16	484	373	379	373
q17	970	514	559	514
q18	7363	6669	6573	6573
q19	1389	1097	1061	1061
q20	483	201	210	201
q21	3816	3109	3085	3085
q22	1095	973	981	973
Total cold run time: 108123 ms
Total hot run time: 39745 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6619	6602	6552	6552
q2	327	237	230	230
q3	2914	2951	2937	2937
q4	2060	1823	1853	1823
q5	5723	5758	5712	5712
q6	207	125	123	123
q7	2201	1808	1842	1808
q8	3340	3622	3524	3524
q9	8742	8891	8877	8877
q10	3532	3547	3546	3546
q11	608	484	495	484
q12	814	623	624	623
q13	9691	3207	3163	3163
q14	302	266	285	266
q15	503	466	469	466
q16	488	450	432	432
q17	1836	1623	1601	1601
q18	8190	7731	7905	7731
q19	1661	1498	1435	1435
q20	2048	1840	1891	1840
q21	5271	5109	5162	5109
q22	1113	1039	1021	1021
Total cold run time: 68190 ms
Total hot run time: 59303 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191823 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fb046b93b3a05470547d038571e16085a98ff525, data reload: false

query1	960	397	399	397
query2	6248	1885	1894	1885
query3	8680	209	202	202
query4	33606	23445	23451	23445
query5	3575	469	447	447
query6	282	184	198	184
query7	4212	311	306	306
query8	282	215	220	215
query9	9455	2565	2558	2558
query10	486	260	264	260
query11	17785	15225	15211	15211
query12	159	107	104	104
query13	1551	446	419	419
query14	9191	6664	6569	6569
query15	255	171	173	171
query16	7993	455	495	455
query17	1621	626	593	593
query18	2123	343	338	338
query19	238	170	167	167
query20	128	119	121	119
query21	209	111	115	111
query22	4757	4380	4475	4380
query23	35233	33897	34359	33897
query24	11028	2971	2932	2932
query25	667	434	425	425
query26	1292	201	174	174
query27	2415	354	368	354
query28	7216	2180	2144	2144
query29	888	453	473	453
query30	291	169	160	160
query31	1055	839	814	814
query32	102	58	57	57
query33	800	317	339	317
query34	966	530	510	510
query35	856	742	742	742
query36	1136	951	957	951
query37	129	67	70	67
query38	4058	3915	3873	3873
query39	1533	1494	1494	1494
query40	210	100	102	100
query41	51	61	54	54
query42	121	109	112	109
query43	505	475	505	475
query44	1275	827	825	825
query45	196	174	173	173
query46	1202	751	752	751
query47	2011	1909	1928	1909
query48	495	389	374	374
query49	1042	397	396	396
query50	821	426	439	426
query51	7427	7367	7271	7271
query52	103	94	89	89
query53	267	186	180	180
query54	1319	469	466	466
query55	79	78	78	78
query56	258	255	268	255
query57	1363	1215	1211	1211
query58	223	204	235	204
query59	3156	2990	2939	2939
query60	280	263	250	250
query61	115	111	108	108
query62	880	724	699	699
query63	220	189	188	188
query64	4214	678	649	649
query65	3364	3343	3291	3291
query66	832	310	327	310
query67	16475	15705	15726	15705
query68	4416	589	567	567
query69	444	273	261	261
query70	1148	1120	1071	1071
query71	356	283	250	250
query72	6332	4042	3985	3985
query73	769	345	346	345
query74	10117	9208	9043	9043
query75	3400	2644	2641	2641
query76	2737	1043	989	989
query77	389	284	279	279
query78	10589	9672	9552	9552
query79	2622	605	623	605
query80	909	444	438	438
query81	544	219	221	219
query82	582	89	90	89
query83	246	144	138	138
query84	237	78	78	78
query85	1545	302	295	295
query86	460	304	306	304
query87	4305	4198	4186	4186
query88	4475	2370	2355	2355
query89	410	292	290	290
query90	1910	184	187	184
query91	189	149	154	149
query92	69	50	51	50
query93	2267	559	567	559
query94	765	310	297	297
query95	359	264	264	264
query96	620	289	289	289
query97	3239	3195	3173	3173
query98	228	204	209	204
query99	1565	1297	1289	1289
Total cold run time: 300208 ms
Total hot run time: 191823 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.93 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fb046b93b3a05470547d038571e16085a98ff525, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.05	0.05
query3	0.23	0.05	0.05
query4	1.65	0.07	0.09
query5	0.52	0.50	0.51
query6	1.14	0.74	0.74
query7	0.02	0.01	0.02
query8	0.05	0.04	0.05
query9	0.55	0.51	0.50
query10	0.56	0.55	0.56
query11	0.16	0.12	0.12
query12	0.15	0.13	0.13
query13	0.61	0.59	0.60
query14	0.78	0.79	0.82
query15	0.85	0.83	0.85
query16	0.38	0.38	0.38
query17	1.04	1.06	1.06
query18	0.19	0.18	0.18
query19	2.00	1.88	1.80
query20	0.02	0.01	0.02
query21	15.37	0.66	0.66
query22	4.18	7.28	1.89
query23	18.22	1.39	1.29
query24	2.25	0.23	0.21
query25	0.15	0.09	0.08
query26	0.28	0.18	0.18
query27	0.07	0.07	0.07
query28	13.24	0.58	0.57
query29	12.64	3.39	3.39
query30	0.25	0.06	0.06
query31	2.81	0.42	0.39
query32	3.23	0.49	0.48
query33	2.96	3.03	3.12
query34	16.85	4.53	4.52
query35	4.58	4.64	4.60
query36	0.67	0.48	0.47
query37	0.19	0.16	0.17
query38	0.17	0.16	0.15
query39	0.05	0.04	0.04
query40	0.16	0.14	0.13
query41	0.10	0.05	0.04
query42	0.06	0.05	0.06
query43	0.05	0.04	0.04
Total cold run time: 109.55 s
Total hot run time: 30.93 s

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 0.00% (0/10) 🎉
Increment coverage report
Complete coverage report

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit e8839ea into branch-3.0 Aug 24, 2025
25 of 26 checks passed
@github-actions github-actions bot deleted the auto-pick-54090-branch-3.0 branch August 24, 2025 07:39
@gavinchou gavinchou mentioned this pull request Sep 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants