Skip to content

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Jul 1, 2025

Cherry-picked from #52548

### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #51152

Problem Summary:
Fix hudi p2 cases caused by NullPointerException
@github-actions github-actions bot requested a review from morrySnow as a code owner July 1, 2025 15:58
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring closed this Jul 1, 2025
@dataroaring dataroaring reopened this Jul 1, 2025
@hello-stephen
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40364 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5d2f66a8d1264f553e9cdf1256a257adb7c828b7, data reload: false

------ Round 1 ----------------------------------
q1	17588	7080	6999	6999
q2	2104	176	174	174
q3	10596	1160	1261	1160
q4	10319	755	701	701
q5	7790	2966	2854	2854
q6	224	133	136	133
q7	1019	627	609	609
q8	9594	2009	2076	2009
q9	7844	6430	6444	6430
q10	7017	2316	2347	2316
q11	461	255	262	255
q12	418	214	215	214
q13	17823	2967	2980	2967
q14	240	208	208	208
q15	526	469	450	450
q16	467	387	373	373
q17	1017	574	619	574
q18	7346	6568	6633	6568
q19	1333	1061	976	976
q20	494	205	203	203
q21	4096	3230	3232	3230
q22	1094	967	961	961
Total cold run time: 109410 ms
Total hot run time: 40364 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6801	6724	6759	6724
q2	338	234	234	234
q3	3118	2951	2954	2951
q4	2114	1799	1788	1788
q5	5780	5790	5787	5787
q6	225	134	136	134
q7	2265	1813	1786	1786
q8	3437	3727	3470	3470
q9	8996	8968	8886	8886
q10	3618	3534	3545	3534
q11	606	507	484	484
q12	826	619	633	619
q13	7896	3146	3161	3146
q14	311	276	270	270
q15	517	463	460	460
q16	501	443	447	443
q17	1888	1651	1682	1651
q18	8472	7835	7673	7673
q19	1777	1700	1579	1579
q20	2085	1862	1842	1842
q21	5209	5179	5060	5060
q22	1148	1032	987	987
Total cold run time: 67928 ms
Total hot run time: 59508 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196896 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5d2f66a8d1264f553e9cdf1256a257adb7c828b7, data reload: false

query1	1294	898	900	898
query2	6304	1934	1846	1846
query3	10833	4379	4258	4258
query4	33236	23349	23774	23349
query5	3661	487	457	457
query6	263	180	175	175
query7	3975	316	349	316
query8	298	222	226	222
query9	9542	2575	2561	2561
query10	494	273	259	259
query11	17748	15224	15189	15189
query12	161	106	105	105
query13	1566	444	430	430
query14	10003	6805	6961	6805
query15	235	180	194	180
query16	7993	483	491	483
query17	1557	595	578	578
query18	2088	322	295	295
query19	203	169	159	159
query20	126	117	123	117
query21	208	107	107	107
query22	4658	4450	4481	4450
query23	35321	34588	34185	34185
query24	11516	2937	2958	2937
query25	671	424	449	424
query26	1567	176	179	176
query27	2796	356	358	356
query28	7968	2194	2180	2180
query29	1054	480	460	460
query30	288	165	157	157
query31	1048	841	803	803
query32	104	58	63	58
query33	787	324	314	314
query34	950	521	542	521
query35	892	753	743	743
query36	1094	970	970	970
query37	123	69	67	67
query38	4109	3896	3921	3896
query39	1499	1477	1478	1477
query40	267	105	106	105
query41	48	47	49	47
query42	120	106	103	103
query43	524	488	492	488
query44	1334	830	824	824
query45	185	174	174	174
query46	1178	744	733	733
query47	1975	1878	1922	1878
query48	444	369	354	354
query49	1096	404	393	393
query50	851	428	437	428
query51	7497	7391	7311	7311
query52	103	91	94	91
query53	270	188	187	187
query54	1190	475	472	472
query55	93	80	82	80
query56	287	248	244	244
query57	1301	1246	1202	1202
query58	227	214	218	214
query59	3124	2905	3054	2905
query60	295	271	267	267
query61	118	126	113	113
query62	857	705	721	705
query63	230	197	191	191
query64	5134	807	704	704
query65	3400	3339	3261	3261
query66	1398	308	309	308
query67	15890	15392	15363	15363
query68	4769	589	582	582
query69	425	272	262	262
query70	1147	1126	1107	1107
query71	347	266	261	261
query72	6243	4182	3998	3998
query73	768	340	350	340
query74	10376	9153	9336	9153
query75	3391	2649	2661	2649
query76	2618	1096	1086	1086
query77	382	280	275	275
query78	10484	9544	9610	9544
query79	1123	608	606	606
query80	805	450	434	434
query81	518	223	222	222
query82	1271	93	90	90
query83	237	147	141	141
query84	228	84	83	83
query85	1090	323	338	323
query86	332	292	303	292
query87	4342	4252	4233	4233
query88	3624	2411	2370	2370
query89	424	299	305	299
query90	2090	194	209	194
query91	157	124	121	121
query92	64	56	55	55
query93	1102	568	568	568
query94	777	307	311	307
query95	379	269	279	269
query96	609	282	287	282
query97	3255	3111	3184	3111
query98	221	205	201	201
query99	1514	1354	1330	1330
Total cold run time: 302781 ms
Total hot run time: 196896 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.4 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5d2f66a8d1264f553e9cdf1256a257adb7c828b7, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.04	0.03
query3	0.25	0.06	0.07
query4	1.64	0.11	0.11
query5	0.53	0.50	0.51
query6	1.13	0.74	0.73
query7	0.01	0.01	0.02
query8	0.04	0.04	0.03
query9	0.55	0.51	0.50
query10	0.56	0.54	0.56
query11	0.14	0.10	0.11
query12	0.15	0.12	0.12
query13	0.61	0.60	0.60
query14	0.78	0.78	0.80
query15	0.85	0.84	0.84
query16	0.38	0.37	0.37
query17	0.98	1.02	1.06
query18	0.23	0.22	0.22
query19	1.85	1.87	1.84
query20	0.01	0.02	0.01
query21	15.40	0.62	0.61
query22	2.33	2.14	1.53
query23	16.75	1.09	0.86
query24	3.30	1.37	1.28
query25	0.23	0.18	0.14
query26	0.39	0.13	0.14
query27	0.05	0.05	0.04
query28	9.67	0.53	0.52
query29	12.60	3.21	3.21
query30	0.24	0.06	0.05
query31	2.87	0.39	0.38
query32	3.25	0.46	0.45
query33	3.01	3.02	3.06
query34	16.98	4.46	4.47
query35	4.47	4.55	4.50
query36	0.66	0.49	0.48
query37	0.08	0.05	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 103.47 s
Total hot run time: 30.4 s

@morrySnow morrySnow merged commit 8af21fc into branch-3.1 Jul 2, 2025
22 checks passed
@github-actions github-actions bot deleted the auto-pick-52548-branch-3.1 branch July 2, 2025 02:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants