Skip to content

Conversation

@airborne12
Copy link
Member

@airborne12 airborne12 commented May 30, 2025

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #50937

Problem Summary:
This PR fixes the error that occurs when attempting to open an empty inverted index file by adding a proper empty file check and error reporting.

Added a condition to verify if the file size is zero.
Sets an error message and returns false to prevent CLucene errors.

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@airborne12
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34007 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5f5041d9e708bfdfb4e44e96dbf00b262d77abdc, data reload: false

------ Round 1 ----------------------------------
q1	26265	5097	5083	5083
q2	1951	277	183	183
q3	10298	1225	693	693
q4	10740	998	538	538
q5	8797	2403	2304	2304
q6	185	161	129	129
q7	920	725	620	620
q8	9305	1282	1072	1072
q9	6920	5123	5087	5087
q10	6955	2379	1968	1968
q11	517	284	291	284
q12	347	358	224	224
q13	18555	3873	3167	3167
q14	229	234	221	221
q15	827	486	475	475
q16	661	429	380	380
q17	738	847	362	362
q18	8755	7396	7140	7140
q19	3015	949	529	529
q20	322	328	218	218
q21	3701	3162	2360	2360
q22	1026	1019	970	970
Total cold run time: 121029 ms
Total hot run time: 34007 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5221	5138	5094	5094
q2	244	319	231	231
q3	2160	2617	2342	2342
q4	1450	2027	1433	1433
q5	4526	4366	4347	4347
q6	207	179	126	126
q7	1980	1864	1747	1747
q8	2594	2562	2620	2562
q9	7179	6991	7092	6991
q10	2973	3201	2722	2722
q11	589	502	506	502
q12	665	764	614	614
q13	3454	3924	3286	3286
q14	288	300	276	276
q15	522	481	465	465
q16	447	480	431	431
q17	1134	1507	1390	1390
q18	7737	7500	7577	7500
q19	801	826	920	826
q20	1909	1988	1870	1870
q21	5412	4436	4504	4436
q22	1087	1006	1027	1006
Total cold run time: 52579 ms
Total hot run time: 50197 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192460 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5f5041d9e708bfdfb4e44e96dbf00b262d77abdc, data reload: false

query1	1397	1103	1035	1035
query2	6324	1821	1788	1788
query3	10999	4376	4469	4376
query4	52540	25517	23641	23641
query5	4978	613	453	453
query6	347	211	205	205
query7	4867	507	298	298
query8	280	224	213	213
query9	5345	2625	2631	2625
query10	402	341	278	278
query11	14978	14947	14784	14784
query12	160	109	105	105
query13	1026	526	401	401
query14	10037	6369	6290	6290
query15	203	216	186	186
query16	7111	618	476	476
query17	1088	744	576	576
query18	1639	421	313	313
query19	210	186	175	175
query20	137	136	122	122
query21	219	123	110	110
query22	4399	4561	4363	4363
query23	34103	33682	33741	33682
query24	6674	2417	2434	2417
query25	472	477	420	420
query26	689	282	162	162
query27	2189	520	337	337
query28	3264	2143	2129	2129
query29	578	559	428	428
query30	285	222	200	200
query31	884	877	774	774
query32	74	66	62	62
query33	447	367	309	309
query34	786	854	542	542
query35	800	826	806	806
query36	933	1009	923	923
query37	122	104	82	82
query38	4242	4239	4301	4239
query39	1496	1447	1469	1447
query40	217	123	123	123
query41	61	65	62	62
query42	133	113	107	107
query43	485	502	478	478
query44	1360	829	822	822
query45	181	182	169	169
query46	872	1043	651	651
query47	1881	1871	1776	1776
query48	390	424	307	307
query49	643	476	409	409
query50	676	712	411	411
query51	4252	4243	4188	4188
query52	111	111	96	96
query53	219	254	186	186
query54	592	579	526	526
query55	89	85	84	84
query56	317	317	310	310
query57	1172	1226	1108	1108
query58	270	272	256	256
query59	2605	2767	2668	2668
query60	336	320	324	320
query61	127	134	144	134
query62	761	745	683	683
query63	228	197	202	197
query64	1615	1120	795	795
query65	4222	4126	4203	4126
query66	698	401	298	298
query67	15969	15520	15288	15288
query68	6835	890	527	527
query69	530	350	271	271
query70	1212	1096	1095	1095
query71	509	329	294	294
query72	5861	4834	5006	4834
query73	1498	717	361	361
query74	9142	9159	8707	8707
query75	4251	3175	2697	2697
query76	4307	1181	804	804
query77	807	366	288	288
query78	10160	10081	9231	9231
query79	6613	805	551	551
query80	660	509	432	432
query81	482	266	224	224
query82	708	132	100	100
query83	274	249	231	231
query84	295	107	90	90
query85	762	353	306	306
query86	357	289	313	289
query87	4359	4440	4301	4301
query88	3996	2294	2309	2294
query89	450	307	287	287
query90	1943	205	212	205
query91	145	141	107	107
query92	76	58	59	58
query93	4096	913	564	564
query94	657	404	308	308
query95	366	294	276	276
query96	523	571	284	284
query97	2693	2760	2584	2584
query98	241	211	204	204
query99	1462	1421	1306	1306
Total cold run time: 303476 ms
Total hot run time: 192460 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.12 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5f5041d9e708bfdfb4e44e96dbf00b262d77abdc, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.10	0.11
query3	0.26	0.18	0.20
query4	1.59	0.19	0.18
query5	0.46	0.43	0.43
query6	1.48	0.65	0.66
query7	0.03	0.01	0.02
query8	0.04	0.04	0.04
query9	0.57	0.51	0.52
query10	0.56	0.57	0.56
query11	0.15	0.12	0.12
query12	0.15	0.11	0.11
query13	0.62	0.60	0.59
query14	0.79	0.82	0.81
query15	0.90	0.84	0.88
query16	0.38	0.41	0.40
query17	1.01	1.07	1.03
query18	0.22	0.22	0.21
query19	1.89	1.79	1.84
query20	0.01	0.01	0.01
query21	15.39	0.89	0.54
query22	0.75	1.16	0.66
query23	14.93	1.38	0.64
query24	6.91	1.51	0.79
query25	0.48	0.24	0.11
query26	0.65	0.16	0.14
query27	0.05	0.06	0.05
query28	9.27	0.90	0.46
query29	12.62	4.00	3.36
query30	0.25	0.09	0.06
query31	2.81	0.59	0.38
query32	3.22	0.55	0.48
query33	3.11	3.04	3.11
query34	15.76	5.08	4.51
query35	4.48	4.49	4.54
query36	0.66	0.49	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.18	0.14	0.14
query41	0.08	0.03	0.03
query42	0.03	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 103.11 s
Total hot run time: 29.12 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 0.00% (0/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 56.07% (15030/26808)
Line Coverage 44.95% (134161/298447)
Region Coverage 44.08% (67517/153175)
Branch Coverage 38.62% (34576/89522)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (3/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.55% (20996/26392)
Line Coverage 72.66% (216849/298436)
Region Coverage 70.90% (127682/180091)
Branch Coverage 64.58% (66095/102342)

1 similar comment
@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (3/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.55% (20996/26392)
Line Coverage 72.66% (216849/298436)
Region Coverage 70.90% (127682/180091)
Branch Coverage 64.58% (66095/102342)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (3/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.44% (20965/26392)
Line Coverage 72.57% (216573/298436)
Region Coverage 70.78% (127474/180091)
Branch Coverage 64.52% (66035/102342)

@dataroaring
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34030 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f79a685a5e3fc592ee783c9a925b62a1ca5aaa3a, data reload: false

------ Round 1 ----------------------------------
q1	25926	5119	5066	5066
q2	1947	273	176	176
q3	10292	1234	672	672
q4	10222	989	539	539
q5	7566	2269	2384	2269
q6	176	161	133	133
q7	903	766	619	619
q8	9320	1322	1171	1171
q9	6760	5094	5128	5094
q10	6821	2298	1897	1897
q11	483	287	276	276
q12	341	346	218	218
q13	18060	3690	3147	3147
q14	226	234	212	212
q15	570	490	496	490
q16	435	438	376	376
q17	603	896	373	373
q18	7915	7126	7229	7126
q19	1240	960	594	594
q20	346	345	226	226
q21	3812	3204	2380	2380
q22	1074	1030	976	976
Total cold run time: 115038 ms
Total hot run time: 34030 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5201	5190	5167	5167
q2	247	320	219	219
q3	2192	2689	2299	2299
q4	1355	1809	1377	1377
q5	4525	4438	4453	4438
q6	219	171	132	132
q7	2043	1938	1786	1786
q8	2646	2658	2577	2577
q9	7259	7225	7349	7225
q10	3085	3231	2837	2837
q11	596	505	512	505
q12	744	805	707	707
q13	3893	4240	3602	3602
q14	290	303	297	297
q15	542	499	524	499
q16	460	521	504	504
q17	1195	1576	1384	1384
q18	7740	7487	7357	7357
q19	1040	887	1072	887
q20	1999	2025	1966	1966
q21	4883	4490	4412	4412
q22	1108	1049	1011	1011
Total cold run time: 53262 ms
Total hot run time: 51188 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192980 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f79a685a5e3fc592ee783c9a925b62a1ca5aaa3a, data reload: false

query1	1396	1113	1051	1051
query2	6531	1899	1902	1899
query3	10964	4462	4460	4460
query4	55247	24763	23327	23327
query5	4944	567	465	465
query6	342	213	199	199
query7	4887	514	291	291
query8	264	240	203	203
query9	5287	2650	2676	2650
query10	430	330	259	259
query11	14924	14995	14843	14843
query12	156	108	105	105
query13	1032	556	430	430
query14	10158	6315	6611	6315
query15	205	200	181	181
query16	7130	671	506	506
query17	1113	778	603	603
query18	1783	431	321	321
query19	217	199	170	170
query20	133	133	120	120
query21	213	126	104	104
query22	4507	4362	4282	4282
query23	34299	33743	33372	33372
query24	6660	2435	2412	2412
query25	474	463	467	463
query26	710	291	160	160
query27	2206	576	344	344
query28	2939	2173	2161	2161
query29	596	557	451	451
query30	269	207	201	201
query31	874	877	777	777
query32	76	68	65	65
query33	451	370	317	317
query34	784	881	540	540
query35	816	848	789	789
query36	925	984	907	907
query37	117	106	80	80
query38	4261	4317	4278	4278
query39	1550	1455	1450	1450
query40	211	131	115	115
query41	65	64	59	59
query42	122	121	110	110
query43	514	551	495	495
query44	1408	866	847	847
query45	185	178	178	178
query46	907	1038	650	650
query47	1863	1876	1802	1802
query48	402	445	328	328
query49	645	509	401	401
query50	674	723	424	424
query51	4355	4231	4224	4224
query52	119	112	104	104
query53	235	269	190	190
query54	592	587	519	519
query55	87	87	92	87
query56	308	312	298	298
query57	1177	1229	1115	1115
query58	273	264	254	254
query59	2763	2799	2867	2799
query60	350	321	326	321
query61	131	139	127	127
query62	783	755	682	682
query63	229	186	189	186
query64	1747	1005	700	700
query65	4204	4166	4148	4148
query66	715	399	303	303
query67	16005	15597	15454	15454
query68	7236	853	523	523
query69	544	307	281	281
query70	1194	1140	1046	1046
query71	494	337	285	285
query72	5972	4892	4900	4892
query73	1510	669	359	359
query74	9012	9119	8944	8944
query75	3910	3172	2661	2661
query76	4263	1206	794	794
query77	651	383	310	310
query78	10191	10215	9321	9321
query79	2486	803	589	589
query80	680	515	456	456
query81	497	257	223	223
query82	445	125	102	102
query83	253	258	234	234
query84	292	116	86	86
query85	791	354	320	320
query86	373	284	280	280
query87	4542	4422	4261	4261
query88	3661	2289	2293	2289
query89	415	312	279	279
query90	1819	283	218	218
query91	148	143	115	115
query92	70	61	59	59
query93	1810	957	591	591
query94	649	410	306	306
query95	379	299	292	292
query96	495	572	286	286
query97	2759	2754	2642	2642
query98	232	219	197	197
query99	1699	1397	1268	1268
Total cold run time: 300411 ms
Total hot run time: 192980 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.2 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f79a685a5e3fc592ee783c9a925b62a1ca5aaa3a, data reload: false

query1	0.03	0.03	0.03
query2	0.13	0.10	0.12
query3	0.26	0.19	0.20
query4	1.59	0.19	0.20
query5	0.45	0.44	0.43
query6	1.15	0.66	0.66
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.59	0.51	0.53
query10	0.56	0.57	0.55
query11	0.15	0.11	0.11
query12	0.15	0.12	0.12
query13	0.62	0.59	0.60
query14	0.79	0.81	0.79
query15	0.87	0.85	0.88
query16	0.38	0.37	0.37
query17	1.07	1.04	1.05
query18	0.22	0.21	0.21
query19	1.97	1.86	1.81
query20	0.01	0.01	0.02
query21	15.40	0.88	0.53
query22	0.76	1.04	0.74
query23	14.89	1.38	0.59
query24	6.88	2.24	0.98
query25	0.52	0.14	0.12
query26	0.58	0.16	0.14
query27	0.04	0.05	0.05
query28	10.23	0.82	0.44
query29	12.54	4.03	3.29
query30	0.25	0.10	0.06
query31	2.81	0.61	0.39
query32	3.23	0.55	0.46
query33	3.07	3.04	3.17
query34	15.82	5.18	4.52
query35	4.59	4.49	4.45
query36	0.66	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.02	0.02
query40	0.17	0.14	0.13
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.81 s
Total hot run time: 29.2 s

@airborne12
Copy link
Member Author

run buildall

@airborne12 airborne12 requested a review from Copilot June 3, 2025 02:32
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR fixes the error that occurs when attempting to open an empty inverted index file by adding a proper empty file check and error reporting.

  • Added a condition to verify if the file size is zero.
  • Sets an error message and returns false to prevent CLucene errors.
Comments suppressed due to low confidence (1)

be/src/olap/rowset/segment_v2/inverted_index_fs_directory.cpp:116

  • Consider caching h->_reader->size() in a local variable to avoid multiple calls, ensuring consistency and potentially improving performance.
if (h->_reader->size() == 0) {

@doris-robot
Copy link

TPC-H: Total hot run time: 33757 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2596de16ae267ebbc3d2e6564903521b4602ce49, data reload: false

------ Round 1 ----------------------------------
q1	26313	5091	5170	5091
q2	1955	276	189	189
q3	10500	1269	698	698
q4	10269	1021	525	525
q5	8222	2374	2331	2331
q6	182	162	131	131
q7	899	747	604	604
q8	9311	1283	1047	1047
q9	6825	5086	5127	5086
q10	6866	2334	1891	1891
q11	483	279	275	275
q12	337	346	215	215
q13	17762	3676	3054	3054
q14	223	239	210	210
q15	576	487	483	483
q16	449	433	377	377
q17	597	852	353	353
q18	7663	7105	7117	7105
q19	1352	946	542	542
q20	330	343	226	226
q21	3979	2632	2353	2353
q22	1048	1015	971	971
Total cold run time: 116141 ms
Total hot run time: 33757 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5089	5085	5011	5011
q2	240	316	231	231
q3	2144	2672	2305	2305
q4	1352	1787	1311	1311
q5	4554	4447	4361	4361
q6	215	166	126	126
q7	1964	1888	1809	1809
q8	2587	2450	2483	2450
q9	7198	7100	7234	7100
q10	2985	3198	2766	2766
q11	581	509	499	499
q12	672	755	662	662
q13	3415	3899	3319	3319
q14	275	312	273	273
q15	527	485	464	464
q16	450	482	448	448
q17	1158	1495	1393	1393
q18	7749	7690	7497	7497
q19	786	817	831	817
q20	1973	1995	1875	1875
q21	4787	4429	4282	4282
q22	1093	1038	985	985
Total cold run time: 51794 ms
Total hot run time: 49984 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186117 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2596de16ae267ebbc3d2e6564903521b4602ce49, data reload: false

query1	1029	473	488	473
query2	6585	1817	1767	1767
query3	6741	239	223	223
query4	26503	23204	23057	23057
query5	4335	620	487	487
query6	296	199	194	194
query7	4621	481	282	282
query8	257	220	202	202
query9	8610	2647	2673	2647
query10	489	335	283	283
query11	15654	15041	15152	15041
query12	165	110	108	108
query13	1656	517	416	416
query14	8772	6152	6263	6152
query15	212	203	171	171
query16	7134	610	460	460
query17	1204	742	561	561
query18	1967	391	293	293
query19	184	176	163	163
query20	120	121	111	111
query21	221	133	109	109
query22	4302	4358	4277	4277
query23	34058	33212	33116	33116
query24	8397	2415	2397	2397
query25	554	441	399	399
query26	1240	265	149	149
query27	2745	507	338	338
query28	4338	2134	2136	2134
query29	780	548	425	425
query30	282	218	187	187
query31	920	853	772	772
query32	74	66	59	59
query33	553	371	312	312
query34	799	859	548	548
query35	777	811	722	722
query36	956	993	887	887
query37	106	101	77	77
query38	4133	4084	3996	3996
query39	1490	1413	1408	1408
query40	206	116	104	104
query41	64	68	58	58
query42	118	107	109	107
query43	494	490	488	488
query44	1292	820	822	820
query45	179	183	171	171
query46	849	1011	627	627
query47	1759	1794	1719	1719
query48	396	429	325	325
query49	741	487	391	391
query50	625	676	426	426
query51	4119	4222	4066	4066
query52	114	112	109	109
query53	223	249	192	192
query54	573	579	506	506
query55	93	88	88	88
query56	327	298	282	282
query57	1145	1171	1069	1069
query58	266	260	256	256
query59	2539	2591	2565	2565
query60	329	329	328	328
query61	157	149	151	149
query62	851	761	662	662
query63	218	193	185	185
query64	4423	1017	718	718
query65	4235	4165	4144	4144
query66	1156	404	315	315
query67	15925	15704	15466	15466
query68	7935	886	533	533
query69	473	301	266	266
query70	1197	1082	1107	1082
query71	469	316	288	288
query72	5531	4796	4664	4664
query73	670	586	351	351
query74	9098	8920	8823	8823
query75	3769	3190	2684	2684
query76	3595	1182	750	750
query77	793	402	296	296
query78	10006	10140	9429	9429
query79	2508	779	597	597
query80	660	522	427	427
query81	498	257	220	220
query82	512	122	97	97
query83	258	247	231	231
query84	253	103	91	91
query85	800	348	318	318
query86	383	287	278	278
query87	4440	4388	4336	4336
query88	3800	2286	2271	2271
query89	385	317	284	284
query90	1847	221	217	217
query91	164	150	127	127
query92	80	62	59	59
query93	2074	925	588	588
query94	660	411	310	310
query95	381	299	288	288
query96	497	568	287	287
query97	2763	2776	2686	2686
query98	235	219	209	209
query99	1447	1413	1291	1291
Total cold run time: 274856 ms
Total hot run time: 186117 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.51 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2596de16ae267ebbc3d2e6564903521b4602ce49, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.12	0.11
query3	0.26	0.20	0.20
query4	1.60	0.20	0.19
query5	0.46	0.42	0.46
query6	1.17	0.66	0.66
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.58	0.53	0.53
query10	0.57	0.58	0.56
query11	0.16	0.11	0.11
query12	0.16	0.12	0.12
query13	0.62	0.59	0.59
query14	0.81	0.81	0.80
query15	0.88	0.87	0.84
query16	0.37	0.38	0.37
query17	1.03	1.03	1.03
query18	0.23	0.22	0.21
query19	1.94	1.85	1.86
query20	0.02	0.01	0.01
query21	15.40	0.92	0.55
query22	0.75	1.16	0.63
query23	15.02	1.36	0.60
query24	7.65	0.98	0.41
query25	0.51	0.12	0.06
query26	0.60	0.17	0.13
query27	0.05	0.06	0.04
query28	9.36	0.89	0.43
query29	12.57	4.00	3.27
query30	0.25	0.09	0.06
query31	2.83	0.59	0.38
query32	3.24	0.55	0.47
query33	3.03	3.09	3.15
query34	15.78	5.02	4.46
query35	4.50	4.50	4.45
query36	0.68	0.49	0.47
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.18	0.15	0.13
query41	0.08	0.02	0.03
query42	0.03	0.02	0.03
query43	0.03	0.04	0.03
Total cold run time: 103.8 s
Total hot run time: 28.51 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 0.00% (0/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 56.05% (15021/26800)
Line Coverage 44.91% (134089/298551)
Region Coverage 44.03% (67464/153213)
Branch Coverage 38.58% (34552/89552)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (3/3) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.50% (20974/26383)
Line Coverage 72.58% (216666/298519)
Region Coverage 70.76% (127463/180128)
Branch Coverage 64.51% (66036/102372)

Copy link
Contributor

@csun5285 csun5285 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

github-actions bot commented Jun 3, 2025

PR approved by anyone and no changes requested.

@airborne12
Copy link
Member Author

run buildall

Copy link
Member

@eldenmoon eldenmoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

github-actions bot commented Jun 3, 2025

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 3, 2025
Copy link
Contributor

@zzzxl1993 zzzxl1993 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@doris-robot
Copy link

TPC-H: Total hot run time: 34034 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b69af6da72b4a2ec0b219b83c275b3223e465dbf, data reload: false

------ Round 1 ----------------------------------
q1	25984	5614	5099	5099
q2	1973	281	183	183
q3	10300	1220	704	704
q4	10230	999	553	553
q5	7552	2391	2373	2373
q6	182	164	130	130
q7	920	748	600	600
q8	9303	1270	1091	1091
q9	6902	5176	5198	5176
q10	6863	2308	1909	1909
q11	493	283	285	283
q12	347	362	219	219
q13	17768	3656	3071	3071
q14	237	224	207	207
q15	551	488	514	488
q16	431	442	372	372
q17	597	859	360	360
q18	7489	7174	7102	7102
q19	1520	965	563	563
q20	334	346	234	234
q21	3688	2548	2332	2332
q22	1064	993	985	985
Total cold run time: 114728 ms
Total hot run time: 34034 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5203	5082	5135	5082
q2	244	323	222	222
q3	2186	2693	2328	2328
q4	1340	1765	1360	1360
q5	4485	4439	4408	4408
q6	221	174	130	130
q7	1971	1871	1754	1754
q8	2596	2535	2550	2535
q9	7190	7000	7204	7000
q10	3092	3199	2811	2811
q11	611	530	491	491
q12	733	752	608	608
q13	3539	3799	3204	3204
q14	269	308	279	279
q15	556	494	492	492
q16	436	490	453	453
q17	1128	1470	1404	1404
q18	7727	7444	7352	7352
q19	785	858	922	858
q20	2040	2080	1954	1954
q21	4848	4398	4343	4343
q22	1069	1046	1018	1018
Total cold run time: 52269 ms
Total hot run time: 50086 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186501 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b69af6da72b4a2ec0b219b83c275b3223e465dbf, data reload: false

query1	1023	472	496	472
query2	6551	1865	1859	1859
query3	6755	230	226	226
query4	26208	23762	23595	23595
query5	4388	639	482	482
query6	301	209	198	198
query7	4618	505	284	284
query8	271	231	214	214
query9	8610	2639	2660	2639
query10	473	335	271	271
query11	15214	15038	14868	14868
query12	157	107	103	103
query13	1665	536	433	433
query14	8814	6264	6113	6113
query15	207	192	170	170
query16	7176	585	533	533
query17	1207	695	557	557
query18	1970	412	289	289
query19	186	185	162	162
query20	126	114	116	114
query21	211	124	106	106
query22	4063	4061	4024	4024
query23	33850	33235	32934	32934
query24	8466	2378	2363	2363
query25	559	450	385	385
query26	1244	267	148	148
query27	2763	500	336	336
query28	4344	2142	2123	2123
query29	770	576	423	423
query30	279	214	187	187
query31	927	831	740	740
query32	73	69	59	59
query33	568	363	301	301
query34	800	856	534	534
query35	785	801	723	723
query36	962	992	899	899
query37	120	102	77	77
query38	4132	4169	4125	4125
query39	1494	1421	1426	1421
query40	206	124	113	113
query41	62	62	58	58
query42	130	116	110	110
query43	526	502	470	470
query44	1288	815	817	815
query45	187	181	175	175
query46	836	1017	613	613
query47	1751	1794	1712	1712
query48	389	437	305	305
query49	760	501	411	411
query50	644	675	395	395
query51	4130	4108	4075	4075
query52	130	116	95	95
query53	219	246	186	186
query54	580	561	514	514
query55	88	84	82	82
query56	295	305	277	277
query57	1150	1153	1071	1071
query58	269	253	255	253
query59	2613	2815	2593	2593
query60	333	324	294	294
query61	133	129	126	126
query62	806	744	657	657
query63	225	199	185	185
query64	4383	1022	742	742
query65	4234	4128	4185	4128
query66	1161	411	334	334
query67	15734	15518	15522	15518
query68	6274	879	524	524
query69	485	293	271	271
query70	1210	1155	1080	1080
query71	397	327	315	315
query72	5695	4841	4711	4711
query73	669	598	354	354
query74	8907	9144	9049	9049
query75	3173	3197	2698	2698
query76	3192	1174	748	748
query77	511	378	282	282
query78	9924	10220	9396	9396
query79	1781	815	590	590
query80	665	509	447	447
query81	496	249	220	220
query82	178	132	100	100
query83	263	258	231	231
query84	251	113	92	92
query85	761	356	317	317
query86	367	326	320	320
query87	4381	4483	4416	4416
query88	2836	2278	2270	2270
query89	403	324	288	288
query90	1806	206	206	206
query91	151	141	114	114
query92	70	64	60	60
query93	1065	956	581	581
query94	640	421	309	309
query95	381	302	281	281
query96	488	568	283	283
query97	2733	2786	2663	2663
query98	228	225	203	203
query99	1336	1390	1285	1285
Total cold run time: 267309 ms
Total hot run time: 186501 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.25 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b69af6da72b4a2ec0b219b83c275b3223e465dbf, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.11	0.12
query3	0.26	0.20	0.19
query4	1.58	0.20	0.20
query5	0.46	0.43	0.44
query6	1.15	0.68	0.66
query7	0.02	0.02	0.01
query8	0.04	0.04	0.04
query9	0.59	0.52	0.54
query10	0.57	0.58	0.57
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.62	0.60	0.60
query14	0.81	0.81	0.81
query15	0.88	0.86	0.85
query16	0.39	0.38	0.37
query17	1.02	1.06	1.05
query18	0.23	0.22	0.20
query19	1.87	1.82	1.79
query20	0.01	0.01	0.01
query21	15.49	0.92	0.54
query22	0.75	1.29	0.67
query23	14.82	1.38	0.63
query24	6.93	1.04	0.81
query25	0.54	0.32	0.06
query26	0.47	0.16	0.13
query27	0.06	0.06	0.05
query28	9.73	0.91	0.45
query29	12.54	4.01	3.40
query30	0.27	0.10	0.07
query31	2.81	0.60	0.41
query32	3.23	0.55	0.46
query33	3.13	3.00	3.10
query34	15.82	5.14	4.55
query35	4.56	4.58	4.55
query36	0.66	0.50	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.16	0.14	0.13
query41	0.09	0.03	0.03
query42	0.04	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.27 s
Total hot run time: 29.25 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 16.67% (1/6) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 56.15% (15048/26800)
Line Coverage 44.97% (134265/298554)
Region Coverage 44.08% (67542/153216)
Branch Coverage 38.64% (34603/89554)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (6/6) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.38% (20942/26383)
Line Coverage 72.47% (216352/298522)
Region Coverage 70.69% (127338/180132)
Branch Coverage 64.41% (65935/102374)

@airborne12 airborne12 merged commit 0d364bd into apache:master Jun 3, 2025
28 of 30 checks passed
@airborne12 airborne12 deleted the fix-empty-index branch June 3, 2025 09:05
github-actions bot pushed a commit that referenced this pull request Jun 3, 2025
Related PR: #50937 

Problem Summary:
This PR fixes the error that occurs when attempting to open an empty
inverted index file by adding a proper empty file check and error
reporting.

Added a condition to verify if the file size is zero.
Sets an error message and returns false to prevent CLucene errors.
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
)

Related PR: apache#50937 

Problem Summary:
This PR fixes the error that occurs when attempting to open an empty
inverted index file by adding a proper empty file check and error
reporting.

Added a condition to verify if the file size is zero.
Sets an error message and returns false to prevent CLucene errors.
dataroaring pushed a commit that referenced this pull request Jun 11, 2025
…#51393 (#51438)

Cherry-picked from #51393

Co-authored-by: airborne12 <jiangkai@selectdb.com>
airborne12 added a commit that referenced this pull request Jun 20, 2025
Related PR: #51393

Problem Summary:
This PR ensures that copying an empty inverted index segment no longer
throws an exception.
zhiqiang-hhhh pushed a commit to zhiqiang-hhhh/doris that referenced this pull request Jul 2, 2025
…#51984)

Related PR: apache#51393

Problem Summary:
This PR ensures that copying an empty inverted index segment no longer
throws an exception.
zhiqiang-hhhh pushed a commit to zhiqiang-hhhh/doris that referenced this pull request Jul 2, 2025
…#51984)

Related PR: apache#51393

Problem Summary:
This PR ensures that copying an empty inverted index segment no longer
throws an exception.
airborne12 added a commit to airborne12/apache-doris that referenced this pull request Jul 7, 2025
…#51984)

Related PR: apache#51393

Problem Summary:
This PR ensures that copying an empty inverted index segment no longer
throws an exception.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/3.0.7-merged dev/3.1.0-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants