Skip to content

Conversation

@sollhui
Copy link
Contributor

@sollhui sollhui commented Nov 13, 2025

What problem does this PR solve?

Create a rollup:

ALTER TABLE mow_table ADD ROLLUP rollup1(event_date, event_time, user_id, country, update_time)

update table after create rollup with column(city) do not exist in rollup:

UPDATE mow_table SET city = "beijing" WHERE user_id = 2000

BE node will core dump(#57934 avoid core dump, but still always fail)

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Nov 13, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@sollhui
Copy link
Contributor Author

sollhui commented Nov 13, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 36065 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b498314da29eb32ce5a2f13b553f2433252e1122, data reload: false

------ Round 1 ----------------------------------
q1	17599	5180	5077	5077
q2	2060	310	210	210
q3	10207	1282	727	727
q4	10240	884	384	384
q5	7517	2479	2301	2301
q6	185	171	139	139
q7	927	787	635	635
q8	9362	1334	1195	1195
q9	6882	5193	5242	5193
q10	6826	2253	1827	1827
q11	491	306	282	282
q12	341	376	236	236
q13	17799	3655	3085	3085
q14	232	226	218	218
q15	569	519	512	512
q16	1019	1002	946	946
q17	590	852	390	390
q18	7482	7583	8061	7583
q19	1271	969	589	589
q20	378	374	238	238
q21	4455	3464	3253	3253
q22	1113	1099	1045	1045
Total cold run time: 107545 ms
Total hot run time: 36065 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5421	5343	5650	5343
q2	240	325	230	230
q3	2397	2749	2591	2591
q4	1546	1903	1454	1454
q5	4574	4410	4758	4410
q6	210	173	124	124
q7	1985	1962	1808	1808
q8	2711	2668	2556	2556
q9	7342	7284	7302	7284
q10	3051	3306	2839	2839
q11	589	543	528	528
q12	718	833	602	602
q13	3467	3910	3235	3235
q14	268	281	265	265
q15	520	483	486	483
q16	1015	1046	1023	1023
q17	1125	1530	1314	1314
q18	7426	7084	7104	7084
q19	774	785	787	785
q20	1925	1967	1796	1796
q21	4765	4424	4305	4305
q22	1110	1042	1023	1023
Total cold run time: 53179 ms
Total hot run time: 51082 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188865 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b498314da29eb32ce5a2f13b553f2433252e1122, data reload: false

query1	1017	399	389	389
query2	6563	1709	1714	1709
query3	6762	234	224	224
query4	26428	23922	23538	23538
query5	4556	649	516	516
query6	344	242	239	239
query7	4660	496	307	307
query8	343	258	249	249
query9	8719	2614	2606	2606
query10	495	344	286	286
query11	15381	15136	14870	14870
query12	178	118	114	114
query13	1673	581	430	430
query14	10911	9493	9346	9346
query15	195	195	176	176
query16	7697	659	542	542
query17	1232	800	658	658
query18	2056	434	340	340
query19	216	216	189	189
query20	128	126	125	125
query21	224	136	114	114
query22	4004	4116	3989	3989
query23	34322	32879	32944	32879
query24	8479	2466	2483	2466
query25	638	563	484	484
query26	1241	283	168	168
query27	2735	511	369	369
query28	4362	2226	2229	2226
query29	818	644	523	523
query30	305	227	201	201
query31	909	807	731	731
query32	86	78	73	73
query33	643	394	348	348
query34	805	868	534	534
query35	801	848	771	771
query36	944	991	903	903
query37	122	116	93	93
query38	3621	3495	3497	3495
query39	1484	1433	1409	1409
query40	233	138	127	127
query41	68	67	68	67
query42	131	120	117	117
query43	497	512	462	462
query44	1232	754	749	749
query45	191	184	175	175
query46	875	996	659	659
query47	1747	1780	1697	1697
query48	415	430	323	323
query49	776	552	455	455
query50	654	693	423	423
query51	3934	3912	3959	3912
query52	108	107	104	104
query53	247	282	200	200
query54	301	305	269	269
query55	91	84	84	84
query56	326	341	326	326
query57	1170	1205	1098	1098
query58	284	295	275	275
query59	2484	2711	2431	2431
query60	342	363	339	339
query61	166	167	160	160
query62	789	735	684	684
query63	233	197	197	197
query64	4495	1176	938	938
query65	4018	3969	4017	3969
query66	1126	435	339	339
query67	15418	15131	15065	15065
query68	8400	978	603	603
query69	496	329	292	292
query70	1373	1296	1325	1296
query71	508	354	324	324
query72	5834	4986	4936	4936
query73	690	590	360	360
query74	8852	9270	8678	8678
query75	4039	3357	2842	2842
query76	3801	1166	748	748
query77	833	417	327	327
query78	9508	9679	8912	8912
query79	2340	811	614	614
query80	679	588	524	524
query81	492	257	233	233
query82	433	161	133	133
query83	323	276	256	256
query84	302	116	98	98
query85	922	487	445	445
query86	338	330	287	287
query87	3792	3736	3712	3712
query88	3506	2290	2285	2285
query89	398	343	304	304
query90	2014	236	229	229
query91	182	182	137	137
query92	88	68	68	68
query93	1582	996	646	646
query94	705	448	353	353
query95	400	334	320	320
query96	495	578	286	286
query97	2945	2987	2866	2866
query98	270	223	218	218
query99	1453	1427	1260	1260
Total cold run time: 276441 ms
Total hot run time: 188865 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 27.77 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b498314da29eb32ce5a2f13b553f2433252e1122, data reload: false

query1	0.05	0.05	0.05
query2	0.09	0.05	0.05
query3	0.26	0.09	0.08
query4	1.61	0.11	0.10
query5	0.28	0.24	0.26
query6	1.20	0.66	0.64
query7	0.04	0.03	0.03
query8	0.05	0.04	0.05
query9	0.59	0.53	0.51
query10	0.58	0.57	0.58
query11	0.16	0.11	0.12
query12	0.15	0.12	0.12
query13	0.63	0.61	0.61
query14	1.02	1.00	1.01
query15	0.86	0.84	0.84
query16	0.39	0.40	0.39
query17	1.03	1.06	1.01
query18	0.22	0.20	0.20
query19	1.90	1.81	1.84
query20	0.02	0.01	0.01
query21	15.44	0.20	0.12
query22	5.20	0.07	0.05
query23	15.67	0.25	0.10
query24	2.50	0.54	0.83
query25	0.07	0.07	0.06
query26	0.14	0.13	0.13
query27	0.21	0.07	0.05
query28	5.24	1.15	0.94
query29	12.60	3.91	3.27
query30	0.28	0.13	0.11
query31	2.83	0.58	0.39
query32	3.23	0.56	0.47
query33	3.02	3.07	3.07
query34	15.85	5.17	4.62
query35	4.61	4.59	4.60
query36	0.67	0.51	0.50
query37	0.10	0.07	0.06
query38	0.06	0.05	0.04
query39	0.03	0.03	0.03
query40	0.17	0.14	0.13
query41	0.09	0.03	0.02
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 99.22 s
Total hot run time: 27.77 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 100.00% (2/2) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.81% (18283/34621)
Line Coverage 38.18% (166231/435431)
Region Coverage 33.17% (129209/389573)
Branch Coverage 33.90% (55445/163566)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (2/2) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.54% (24337/34021)
Line Coverage 58.02% (253011/436107)
Region Coverage 53.45% (211165/395084)
Branch Coverage 54.67% (90009/164641)

@sollhui
Copy link
Contributor Author

sollhui commented Nov 14, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34501 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a06434a6b6fd7af05ef630b5ba01ecff11904d5d, data reload: false

------ Round 1 ----------------------------------
q1	17638	5136	5184	5136
q2	2067	308	205	205
q3	10276	1308	700	700
q4	10217	878	365	365
q5	7511	2508	2333	2333
q6	190	173	136	136
q7	959	773	639	639
q8	9355	1335	1158	1158
q9	7028	5228	5180	5180
q10	6918	2229	1815	1815
q11	487	301	283	283
q12	384	378	234	234
q13	17776	3646	3086	3086
q14	226	241	214	214
q15	575	515	505	505
q16	1038	1009	921	921
q17	595	864	385	385
q18	7604	7220	7127	7127
q19	1097	943	563	563
q20	353	346	225	225
q21	3839	2526	2300	2300
q22	1085	1058	991	991
Total cold run time: 107218 ms
Total hot run time: 34501 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5120	5121	5095	5095
q2	254	326	233	233
q3	2221	2703	2317	2317
q4	1376	1760	1399	1399
q5	4186	4458	4428	4428
q6	214	177	133	133
q7	2046	1993	1850	1850
q8	2651	2622	2637	2622
q9	7380	7370	7357	7357
q10	3017	3290	2817	2817
q11	591	522	511	511
q12	698	749	591	591
q13	3528	3910	3433	3433
q14	295	300	276	276
q15	561	510	506	506
q16	1316	1086	1057	1057
q17	1243	1487	1403	1403
q18	8250	7630	7669	7630
q19	784	789	891	789
q20	2069	2095	2065	2065
q21	4882	4370	4322	4322
q22	1095	1065	1005	1005
Total cold run time: 53777 ms
Total hot run time: 51839 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188429 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a06434a6b6fd7af05ef630b5ba01ecff11904d5d, data reload: false

query1	1026	425	389	389
query2	6595	1707	1700	1700
query3	6755	228	226	226
query4	26540	23753	23395	23395
query5	4394	639	468	468
query6	337	240	218	218
query7	4642	493	293	293
query8	298	243	246	243
query9	8692	2612	2596	2596
query10	510	334	289	289
query11	15810	15248	14870	14870
query12	197	122	109	109
query13	1675	562	454	454
query14	10996	9203	9218	9203
query15	205	189	171	171
query16	7399	684	500	500
query17	1225	751	610	610
query18	1994	415	321	321
query19	209	213	174	174
query20	129	125	126	125
query21	215	133	113	113
query22	3990	4092	3911	3911
query23	34019	33169	32878	32878
query24	8559	2475	2416	2416
query25	581	550	464	464
query26	1239	269	159	159
query27	2774	495	358	358
query28	4375	2219	2190	2190
query29	824	651	488	488
query30	309	226	198	198
query31	910	826	701	701
query32	81	77	74	74
query33	601	380	323	323
query34	800	851	532	532
query35	812	835	733	733
query36	959	982	905	905
query37	124	113	88	88
query38	3542	3500	3493	3493
query39	1455	1438	1401	1401
query40	226	131	119	119
query41	64	60	62	60
query42	127	117	110	110
query43	497	508	487	487
query44	1226	751	746	746
query45	187	178	207	178
query46	877	1004	638	638
query47	1772	1780	1720	1720
query48	387	432	313	313
query49	782	494	397	397
query50	662	693	412	412
query51	3898	3938	3939	3938
query52	110	108	100	100
query53	241	262	194	194
query54	339	295	294	294
query55	88	94	88	88
query56	329	329	320	320
query57	1178	1184	1116	1116
query58	284	274	279	274
query59	2531	2660	2582	2582
query60	344	355	322	322
query61	165	152	153	152
query62	794	728	670	670
query63	239	194	197	194
query64	4473	1207	985	985
query65	4037	3922	3960	3922
query66	1180	456	359	359
query67	15291	15050	15204	15050
query68	4646	946	603	603
query69	504	363	285	285
query70	1330	1314	1288	1288
query71	415	323	318	318
query72	6036	4895	5111	4895
query73	623	570	362	362
query74	9065	9036	9017	9017
query75	3317	3358	2910	2910
query76	3316	1153	723	723
query77	542	423	324	324
query78	9535	9887	8908	8908
query79	965	860	609	609
query80	1172	594	498	498
query81	554	260	224	224
query82	388	166	130	130
query83	328	271	262	262
query84	250	112	98	98
query85	970	482	440	440
query86	383	324	293	293
query87	3708	3741	3641	3641
query88	2911	2318	2288	2288
query89	393	323	298	298
query90	1728	231	227	227
query91	177	189	154	154
query92	73	74	67	67
query93	1068	982	652	652
query94	708	464	369	369
query95	429	342	346	342
query96	493	569	288	288
query97	2924	2972	2861	2861
query98	238	222	215	215
query99	1296	1405	1321	1321
Total cold run time: 268610 ms
Total hot run time: 188429 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 27.68 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a06434a6b6fd7af05ef630b5ba01ecff11904d5d, data reload: false

query1	0.06	0.05	0.06
query2	0.09	0.04	0.05
query3	0.26	0.08	0.09
query4	1.60	0.12	0.11
query5	0.28	0.25	0.25
query6	1.15	0.66	0.65
query7	0.03	0.03	0.02
query8	0.05	0.05	0.05
query9	0.58	0.54	0.52
query10	0.57	0.59	0.58
query11	0.16	0.11	0.12
query12	0.15	0.12	0.12
query13	0.63	0.61	0.59
query14	1.01	0.99	1.00
query15	0.85	0.83	0.83
query16	0.40	0.40	0.39
query17	1.02	1.01	1.08
query18	0.22	0.20	0.20
query19	1.90	1.78	1.78
query20	0.01	0.02	0.01
query21	15.45	0.19	0.13
query22	5.03	0.06	0.04
query23	15.64	0.27	0.10
query24	2.53	0.56	0.83
query25	0.08	0.07	0.06
query26	0.14	0.13	0.14
query27	0.07	0.05	0.05
query28	4.41	1.14	0.93
query29	12.59	3.92	3.22
query30	0.28	0.13	0.14
query31	2.81	0.58	0.37
query32	3.23	0.57	0.47
query33	3.07	3.14	3.14
query34	15.71	5.23	4.55
query35	4.62	4.64	4.59
query36	0.67	0.50	0.49
query37	0.09	0.06	0.07
query38	0.06	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.16	0.13
query41	0.09	0.04	0.03
query42	0.04	0.03	0.02
query43	0.04	0.03	0.04
Total cold run time: 97.88 s
Total hot run time: 27.68 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 50.00% (2/4) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.81% (18285/34621)
Line Coverage 38.18% (166264/435440)
Region Coverage 33.18% (129251/389590)
Branch Coverage 33.90% (55462/163584)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (4/4) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.54% (24337/34021)
Line Coverage 58.03% (253059/436114)
Region Coverage 53.47% (211263/395101)
Branch Coverage 54.75% (90157/164659)

@sollhui sollhui force-pushed the partial_update_after_rollup branch from a06434a to 61f2e78 Compare November 14, 2025 08:26
@sollhui
Copy link
Contributor Author

sollhui commented Nov 14, 2025

run buildall

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 100.00% (1/1) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.81% (18285/34621)
Line Coverage 38.18% (166267/435439)
Region Coverage 33.21% (129372/389586)
Branch Coverage 33.92% (55479/163578)

@doris-robot
Copy link

TPC-H: Total hot run time: 34843 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 61f2e787873ac6744efde3291845fbc8d49ce000, data reload: false

------ Round 1 ----------------------------------
q1	17862	5181	5051	5051
q2	2017	300	204	204
q3	10276	1288	714	714
q4	10223	882	368	368
q5	7486	2321	2398	2321
q6	190	174	138	138
q7	913	809	620	620
q8	9347	1335	1125	1125
q9	6841	5230	5120	5120
q10	6885	2227	1805	1805
q11	527	302	285	285
q12	336	370	246	246
q13	17780	3624	3041	3041
q14	241	239	211	211
q15	578	514	508	508
q16	1038	1028	947	947
q17	579	877	375	375
q18	7329	7264	7678	7264
q19	1358	1051	588	588
q20	368	336	244	244
q21	4448	3667	2627	2627
q22	1169	1041	1078	1041
Total cold run time: 107791 ms
Total hot run time: 34843 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5464	5297	5362	5297
q2	239	330	221	221
q3	2323	2907	2503	2503
q4	1443	1891	1400	1400
q5	4650	4492	4408	4408
q6	205	170	123	123
q7	1998	1846	1814	1814
q8	2622	2946	2514	2514
q9	7154	7368	7154	7154
q10	2905	3137	2656	2656
q11	584	510	495	495
q12	647	721	577	577
q13	3267	3698	3065	3065
q14	261	282	266	266
q15	533	501	496	496
q16	1007	1036	992	992
q17	1121	1424	1310	1310
q18	7312	7163	6959	6959
q19	758	800	931	800
q20	1936	1970	1828	1828
q21	4722	4354	4238	4238
q22	1090	1047	992	992
Total cold run time: 52241 ms
Total hot run time: 50108 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187259 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 61f2e787873ac6744efde3291845fbc8d49ce000, data reload: false

query1	1004	394	421	394
query2	6538	1724	1702	1702
query3	6751	230	224	224
query4	26606	23723	23087	23087
query5	4444	628	461	461
query6	326	234	217	217
query7	4647	489	303	303
query8	294	250	251	250
query9	8702	2599	2593	2593
query10	486	336	282	282
query11	15477	15111	14886	14886
query12	173	120	114	114
query13	1691	577	444	444
query14	10413	9204	9145	9145
query15	203	192	177	177
query16	7460	660	513	513
query17	1247	751	609	609
query18	1977	420	320	320
query19	208	201	171	171
query20	135	128	122	122
query21	213	127	111	111
query22	3908	4111	3926	3926
query23	33907	32911	33038	32911
query24	8481	2430	2388	2388
query25	609	518	448	448
query26	1233	275	159	159
query27	2746	498	352	352
query28	4352	2183	2186	2183
query29	821	601	477	477
query30	295	226	197	197
query31	883	817	713	713
query32	82	74	76	74
query33	590	379	330	330
query34	791	843	529	529
query35	802	849	755	755
query36	935	1008	898	898
query37	119	108	85	85
query38	3581	3616	3480	3480
query39	1494	1453	1578	1453
query40	219	128	115	115
query41	64	59	58	58
query42	124	111	114	111
query43	493	482	457	457
query44	1215	748	734	734
query45	178	183	173	173
query46	938	983	673	673
query47	1715	1808	1703	1703
query48	384	415	321	321
query49	782	482	413	413
query50	661	688	407	407
query51	3873	3932	3905	3905
query52	105	108	105	105
query53	236	273	208	208
query54	303	296	281	281
query55	91	85	81	81
query56	323	319	303	303
query57	1195	1186	1095	1095
query58	282	278	264	264
query59	2513	2713	2508	2508
query60	351	343	361	343
query61	175	171	160	160
query62	783	723	705	705
query63	221	190	191	190
query64	4533	1152	912	912
query65	3991	3968	3934	3934
query66	1199	461	352	352
query67	15282	15052	14868	14868
query68	4605	947	610	610
query69	507	324	300	300
query70	1353	1269	1234	1234
query71	423	362	319	319
query72	6326	5092	5020	5020
query73	646	586	359	359
query74	8902	8938	8690	8690
query75	3276	3305	2804	2804
query76	3318	1126	715	715
query77	505	396	323	323
query78	9577	9795	8884	8884
query79	2391	853	600	600
query80	1668	591	511	511
query81	586	265	233	233
query82	404	159	129	129
query83	364	275	251	251
query84	262	127	99	99
query85	941	492	436	436
query86	471	315	288	288
query87	3780	3692	3624	3624
query88	2919	2279	2251	2251
query89	383	343	313	313
query90	1836	232	226	226
query91	169	167	135	135
query92	79	72	77	72
query93	1328	1018	653	653
query94	734	452	342	342
query95	415	325	315	315
query96	497	563	279	279
query97	2922	2937	2885	2885
query98	249	219	218	218
query99	1307	1385	1279	1279
Total cold run time: 269996 ms
Total hot run time: 187259 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 27.53 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 61f2e787873ac6744efde3291845fbc8d49ce000, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.06	0.04
query3	0.26	0.09	0.08
query4	1.61	0.11	0.11
query5	0.28	0.25	0.25
query6	1.18	0.65	0.65
query7	0.03	0.03	0.02
query8	0.05	0.04	0.04
query9	0.59	0.52	0.51
query10	0.57	0.58	0.56
query11	0.16	0.12	0.11
query12	0.15	0.12	0.12
query13	0.63	0.62	0.61
query14	1.01	1.00	1.01
query15	0.86	0.83	0.83
query16	0.39	0.40	0.40
query17	1.01	1.05	1.03
query18	0.22	0.20	0.20
query19	1.89	1.83	1.82
query20	0.02	0.01	0.01
query21	15.43	0.18	0.13
query22	5.04	0.07	0.05
query23	15.66	0.26	0.10
query24	3.46	0.74	0.27
query25	0.08	0.06	0.06
query26	0.15	0.13	0.14
query27	0.06	0.05	0.05
query28	4.14	1.13	0.95
query29	12.62	3.91	3.33
query30	0.28	0.14	0.12
query31	2.82	0.60	0.38
query32	3.24	0.57	0.48
query33	3.03	3.07	3.20
query34	15.76	5.14	4.59
query35	4.57	4.56	4.54
query36	0.68	0.50	0.49
query37	0.09	0.07	0.07
query38	0.06	0.04	0.04
query39	0.04	0.03	0.02
query40	0.17	0.15	0.13
query41	0.08	0.04	0.03
query42	0.04	0.04	0.02
query43	0.04	0.04	0.04
Total cold run time: 98.6 s
Total hot run time: 27.53 s

@sollhui sollhui force-pushed the partial_update_after_rollup branch from 61f2e78 to ef516f6 Compare November 20, 2025 08:48
@sollhui
Copy link
Contributor Author

sollhui commented Nov 20, 2025

run buildall

@sollhui sollhui force-pushed the partial_update_after_rollup branch 2 times, most recently from af4d894 to 37f4d5b Compare November 20, 2025 08:51
@sollhui sollhui force-pushed the partial_update_after_rollup branch from 37f4d5b to d286182 Compare November 20, 2025 08:52
@sollhui
Copy link
Contributor Author

sollhui commented Nov 20, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 35451 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d286182da1f0dae4bfdcb5b749ee3ddec1dbb8fa, data reload: false

------ Round 1 ----------------------------------
q1	17617	5132	4988	4988
q2	2040	323	223	223
q3	10190	1279	745	745
q4	10236	953	370	370
q5	7539	2337	2450	2337
q6	188	169	136	136
q7	909	810	632	632
q8	9361	1348	1109	1109
q9	7240	5408	5357	5357
q10	6912	2234	1854	1854
q11	498	315	285	285
q12	363	369	231	231
q13	17822	3737	3052	3052
q14	230	241	219	219
q15	587	512	511	511
q16	1039	1001	943	943
q17	591	880	374	374
q18	7638	7671	8063	7671
q19	1095	953	544	544
q20	391	355	231	231
q21	4455	3495	2584	2584
q22	1126	1055	1090	1055
Total cold run time: 108067 ms
Total hot run time: 35451 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5257	5173	5310	5173
q2	332	404	317	317
q3	2386	2951	2549	2549
q4	1553	1848	1469	1469
q5	4554	4437	4458	4437
q6	217	172	137	137
q7	2058	1966	1758	1758
q8	2621	2688	2625	2625
q9	7678	7801	7636	7636
q10	3045	3235	2839	2839
q11	584	514	488	488
q12	647	697	576	576
q13	3245	3705	3037	3037
q14	285	274	250	250
q15	538	486	490	486
q16	1010	1057	1020	1020
q17	1099	1440	1340	1340
q18	7366	7235	6965	6965
q19	763	816	908	816
q20	1918	1984	1805	1805
q21	4718	4413	4279	4279
q22	1118	1039	998	998
Total cold run time: 52992 ms
Total hot run time: 51000 ms

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (1/1) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.47% (24361/34087)
Line Coverage 57.91% (253077/437011)
Region Coverage 53.20% (211172/396937)
Branch Coverage 54.55% (90078/165126)

@sollhui
Copy link
Contributor Author

sollhui commented Nov 23, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34086 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d286182da1f0dae4bfdcb5b749ee3ddec1dbb8fa, data reload: false

------ Round 1 ----------------------------------
q1	17597	5013	4898	4898
q2	2029	303	210	210
q3	10248	1266	708	708
q4	10214	890	358	358
q5	7527	2437	2326	2326
q6	184	173	137	137
q7	908	755	617	617
q8	9354	1328	1060	1060
q9	7040	5357	5322	5322
q10	6866	2220	1778	1778
q11	483	294	277	277
q12	344	363	226	226
q13	17796	3636	3028	3028
q14	231	238	219	219
q15	595	510	502	502
q16	963	990	939	939
q17	577	856	372	372
q18	7700	7082	7039	7039
q19	1079	937	551	551
q20	356	346	229	229
q21	3687	2519	2331	2331
q22	1057	1033	959	959
Total cold run time: 106835 ms
Total hot run time: 34086 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4981	4954	4978	4954
q2	317	380	307	307
q3	2164	2655	2248	2248
q4	1335	1745	1306	1306
q5	4229	4237	4531	4237
q6	223	179	132	132
q7	1958	1973	1798	1798
q8	2669	2646	2602	2602
q9	7577	7472	7562	7472
q10	3092	3256	2789	2789
q11	588	518	513	513
q12	668	754	626	626
q13	3506	4084	3178	3178
q14	321	334	280	280
q15	550	519	503	503
q16	1094	1091	1071	1071
q17	1168	1583	1374	1374
q18	7848	7595	7719	7595
q19	831	864	829	829
q20	1996	1987	1830	1830
q21	4684	4277	4290	4277
q22	1078	1049	973	973
Total cold run time: 52877 ms
Total hot run time: 50894 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186435 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d286182da1f0dae4bfdcb5b749ee3ddec1dbb8fa, data reload: false

query1	1038	421	383	383
query2	6565	1659	1655	1655
query3	6757	232	220	220
query4	24954	23337	22939	22939
query5	4396	661	484	484
query6	336	246	234	234
query7	4652	510	319	319
query8	312	269	265	265
query9	8713	2574	2622	2574
query10	510	344	285	285
query11	15566	15238	14828	14828
query12	186	120	116	116
query13	1695	592	462	462
query14	11050	9147	9069	9069
query15	207	194	176	176
query16	7435	665	507	507
query17	1217	738	623	623
query18	1991	423	307	307
query19	215	197	166	166
query20	126	122	120	120
query21	217	130	114	114
query22	3956	4163	3905	3905
query23	33874	32924	32985	32924
query24	8492	2337	2420	2337
query25	613	497	438	438
query26	1239	277	160	160
query27	2762	508	357	357
query28	4357	2173	2160	2160
query29	829	592	477	477
query30	304	225	197	197
query31	913	822	723	723
query32	90	71	77	71
query33	618	383	327	327
query34	782	846	517	517
query35	802	824	721	721
query36	948	986	889	889
query37	114	108	89	89
query38	3500	3533	3397	3397
query39	1444	1408	1420	1408
query40	218	124	118	118
query41	67	62	62	62
query42	122	108	117	108
query43	487	472	470	470
query44	1251	771	757	757
query45	186	177	173	173
query46	886	986	638	638
query47	1724	1763	1762	1762
query48	398	431	320	320
query49	779	504	421	421
query50	660	683	421	421
query51	3866	3897	3797	3797
query52	115	110	105	105
query53	261	266	192	192
query54	297	285	271	271
query55	88	87	90	87
query56	324	304	297	297
query57	1183	1185	1099	1099
query58	286	278	263	263
query59	2433	2622	2446	2446
query60	340	339	323	323
query61	181	159	155	155
query62	809	755	649	649
query63	230	197	199	197
query64	4535	1154	849	849
query65	4003	3916	3938	3916
query66	1142	429	329	329
query67	15273	15085	14771	14771
query68	3835	979	639	639
query69	496	327	274	274
query70	1418	1316	1324	1316
query71	438	331	331	331
query72	5749	4967	5078	4967
query73	664	590	375	375
query74	8785	9052	8675	8675
query75	3318	3334	2823	2823
query76	3359	1137	732	732
query77	530	417	336	336
query78	9649	9784	9018	9018
query79	1435	865	596	596
query80	1678	631	501	501
query81	536	257	224	224
query82	433	165	128	128
query83	318	261	243	243
query84	251	114	104	104
query85	896	476	443	443
query86	390	294	287	287
query87	3681	3797	3615	3615
query88	2769	2213	2189	2189
query89	388	321	296	296
query90	1744	223	212	212
query91	162	158	132	132
query92	71	70	65	65
query93	1139	1018	682	682
query94	686	448	339	339
query95	406	326	321	321
query96	491	570	281	281
query97	2892	2975	2842	2842
query98	245	219	207	207
query99	1249	1404	1303	1303
Total cold run time: 266020 ms
Total hot run time: 186435 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 27.56 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d286182da1f0dae4bfdcb5b749ee3ddec1dbb8fa, data reload: false

query1	0.05	0.04	0.05
query2	0.09	0.05	0.05
query3	0.26	0.08	0.08
query4	1.61	0.11	0.12
query5	0.26	0.24	0.25
query6	1.17	0.64	0.64
query7	0.03	0.02	0.03
query8	0.05	0.04	0.04
query9	0.57	0.51	0.50
query10	0.57	0.58	0.56
query11	0.16	0.11	0.11
query12	0.14	0.12	0.11
query13	0.62	0.60	0.61
query14	0.99	1.01	0.98
query15	0.85	0.82	0.82
query16	0.38	0.40	0.40
query17	1.09	1.01	1.04
query18	0.22	0.19	0.20
query19	1.86	1.82	1.78
query20	0.02	0.01	0.01
query21	15.44	0.17	0.12
query22	5.07	0.07	0.05
query23	15.65	0.26	0.10
query24	2.69	1.10	0.79
query25	0.07	0.07	0.07
query26	0.14	0.14	0.13
query27	0.08	0.05	0.05
query28	5.22	1.14	0.91
query29	12.64	3.88	3.21
query30	0.28	0.13	0.12
query31	2.82	0.58	0.38
query32	3.23	0.54	0.47
query33	3.03	3.04	3.07
query34	15.82	5.14	4.48
query35	4.56	4.57	4.54
query36	0.65	0.51	0.49
query37	0.10	0.06	0.06
query38	0.07	0.03	0.03
query39	0.04	0.03	0.02
query40	0.17	0.14	0.14
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 98.91 s
Total hot run time: 27.56 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 100.00% (1/1) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.64% (18281/34731)
Line Coverage 38.08% (166362/436849)
Region Coverage 33.06% (129453/391594)
Branch Coverage 33.83% (55511/164091)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (1/1) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.48% (24368/34092)
Line Coverage 57.92% (253121/437015)
Region Coverage 53.20% (211152/396902)
Branch Coverage 54.54% (90051/165102)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (1/1) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.48% (24368/34092)
Line Coverage 57.92% (253117/437015)
Region Coverage 53.16% (210997/396902)
Branch Coverage 54.53% (90029/165102)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100.00% (1/1) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.48% (24368/34092)
Line Coverage 57.91% (253096/437015)
Region Coverage 53.18% (211054/396902)
Branch Coverage 54.54% (90051/165102)

Copy link
Contributor

@liaoxin01 liaoxin01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Nov 24, 2025
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@liaoxin01 liaoxin01 merged commit 6122098 into apache:master Nov 26, 2025
26 of 28 checks passed
github-actions bot pushed a commit that referenced this pull request Nov 26, 2025
…ollup/MV (#58003)

### What problem does this PR solve?

Create a rollup:
```
ALTER TABLE mow_table ADD ROLLUP rollup1(event_date, event_time, user_id, country, update_time)
```

update table after create rollup with column(city) do not exist in
rollup:
```
UPDATE mow_table SET city = "beijing" WHERE user_id = 2000
```

BE node will core dump(#57934 avoid
core dump, but still always fail)
yiguolei pushed a commit that referenced this pull request Nov 27, 2025
…ter create rollup/MV #58003 (#58393)

Cherry-picked from #58003

Co-authored-by: hui lai <laihui@selectdb.com>
sollhui added a commit to sollhui/doris that referenced this pull request Dec 1, 2025
…ollup/MV (apache#58003)

Create a rollup:
```
ALTER TABLE mow_table ADD ROLLUP rollup1(event_date, event_time, user_id, country, update_time)
```

update table after create rollup with column(city) do not exist in
rollup:
```
UPDATE mow_table SET city = "beijing" WHERE user_id = 2000
```

BE node will core dump(apache#57934 avoid
core dump, but still always fail)
sollhui added a commit to sollhui/doris that referenced this pull request Dec 1, 2025
…ollup/MV (apache#58003)

Create a rollup:
```
ALTER TABLE mow_table ADD ROLLUP rollup1(event_date, event_time, user_id, country, update_time)
```

update table after create rollup with column(city) do not exist in
rollup:
```
UPDATE mow_table SET city = "beijing" WHERE user_id = 2000
```

BE node will core dump(apache#57934 avoid
core dump, but still always fail)
morrySnow pushed a commit that referenced this pull request Dec 2, 2025
nagisa-kunhah pushed a commit to nagisa-kunhah/doris that referenced this pull request Dec 14, 2025
…ollup/MV (apache#58003)

### What problem does this PR solve?

Create a rollup:
```
ALTER TABLE mow_table ADD ROLLUP rollup1(event_date, event_time, user_id, country, update_time)
```

update table after create rollup with column(city) do not exist in
rollup:
```
UPDATE mow_table SET city = "beijing" WHERE user_id = 2000
```

BE node will core dump(apache#57934 avoid
core dump, but still always fail)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/3.1.4-merged dev/4.0.2-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants