Skip to content

branch-3.1: [fix](mtmv)fix mtmv can not refresh when a partition table not have partition #55468 #56085

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
morrySnow merged 1 commit into from
Sep 17, 2025
Merged

branch-3.1: [fix](mtmv)fix mtmv can not refresh when a partition table not have partition #55468 #56085

morrySnow merged 1 commit into from
Sep 17, 2025
+82 −1

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Sep 16, 2025

Cherry-picked from #55468

@zddr
[fix](mtmv)fix mtmv can not refresh when a partition table not have p…
1b3c469 
…artition (#55468)

```
CREATE TABLE partition_table (
  `col1` BOOLEAN COMMENT 'col1',
  `pt1` VARCHAR COMMENT 'pt1'
)  ENGINE=hive
PARTITION BY LIST (pt1) ()
PROPERTIES (
  'file_format'='orc',
  'compression'='zlib'
);

CREATE MATERIALIZED VIEW mv1
REFRESH auto ON manual
DISTRIBUTED BY random BUCKETS 2
PROPERTIES (
        'replication_num' = '1'
        )
AS
select * from partition_table;
```
error msg: partitionList is empty, table name: partition_table
@github-actions github-actions bot requested a review from morrySnow as a code owner September 16, 2025 02:38
@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 16, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Sep 16, 2025
@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 16, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Sep 16, 2025

TPC-H: Total hot run time: 32835 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1b3c469b1d7b1091f88037273e812e19400e0fda, data reload: false

------ Round 1 ----------------------------------
q1	17584	5472	5466	5466
q2	2027	426	277	277
q3	12334	1236	750	750
q4	10321	879	451	451
q5	9433	2376	2101	2101
q6	190	165	133	133
q7	918	762	623	623
q8	9362	1439	1239	1239
q9	5182	4947	4877	4877
q10	6764	2262	1836	1836
q11	473	282	265	265
q12	336	371	211	211
q13	17767	3573	3031	3031
q14	236	222	204	204
q15	535	466	468	466
q16	422	430	382	382
q17	618	859	367	367
q18	6815	6372	6452	6372
q19	1207	957	552	552
q20	319	341	206	206
q21	3044	2226	2044	2044
q22	1049	1031	982	982
Total cold run time: 106936 ms
Total hot run time: 32835 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5535	5493	5543	5493
q2	241	327	242	242
q3	2236	2626	2287	2287
q4	1397	1758	1366	1366
q5	4390	5033	4971	4971
q6	177	157	125	125
q7	2055	1946	1835	1835
q8	2636	2803	2707	2707
q9	7308	7481	7314	7314
q10	3102	3291	2821	2821
q11	581	534	502	502
q12	660	766	658	658
q13	3526	3853	3252	3252
q14	293	316	292	292
q15	524	479	472	472
q16	455	495	444	444
q17	1262	1750	1267	1267
q18	7783	7963	7710	7710
q19	855	1172	1078	1078
q20	2030	2035	1911	1911
q21	5342	4717	4473	4473
q22	1132	1082	1042	1042
Total cold run time: 53520 ms
Total hot run time: 52262 ms

@doris-robot
Copy link

doris-robot commented Sep 16, 2025

TPC-DS: Total hot run time: 192493 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1b3c469b1d7b1091f88037273e812e19400e0fda, data reload: false

query1	944	386	381	381
query2	6192	1954	1849	1849
query3	8677	199	192	192
query4	33320	23591	23500	23500
query5	3692	593	447	447
query6	280	212	182	182
query7	4197	494	319	319
query8	298	236	235	235
query9	9428	2600	2606	2600
query10	475	320	263	263
query11	17905	15729	15250	15250
query12	161	108	108	108
query13	1560	539	409	409
query14	11103	6696	6846	6696
query15	225	188	179	179
query16	7973	699	505	505
query17	1530	763	609	609
query18	2159	443	328	328
query19	219	185	179	179
query20	126	121	127	121
query21	208	128	105	105
query22	4621	4568	4436	4436
query23	35311	34362	34566	34362
query24	7420	2693	2734	2693
query25	553	510	439	439
query26	1238	289	170	170
query27	2198	482	363	363
query28	5030	2230	2182	2182
query29	773	600	483	483
query30	241	199	165	165
query31	1024	939	845	845
query32	88	61	61	61
query33	494	410	310	310
query34	751	876	513	513
query35	790	829	720	720
query36	1025	1076	943	943
query37	105	93	69	69
query38	4023	4003	4006	4003
query39	1510	1468	1492	1468
query40	215	118	117	117
query41	59	48	50	48
query42	125	104	104	104
query43	509	526	479	479
query44	1300	819	820	819
query45	196	180	171	171
query46	909	1083	683	683
query47	2002	1985	1919	1919
query48	408	451	359	359
query49	790	496	414	414
query50	718	724	439	439
query51	7396	7352	7303	7303
query52	104	99	91	91
query53	231	266	190	190
query54	538	542	478	478
query55	80	76	78	76
query56	266	286	256	256
query57	1265	1273	1220	1220
query58	247	211	221	211
query59	3118	3088	2928	2928
query60	301	281	274	274
query61	118	116	106	106
query62	798	764	717	717
query63	238	189	193	189
query64	4469	982	624	624
query65	3382	3344	3334	3334
query66	1041	409	303	303
query67	16452	15898	15654	15654
query68	7685	833	526	526
query69	481	303	264	264
query70	1210	1184	1068	1068
query71	423	287	264	264
query72	5122	3786	3880	3786
query73	641	754	350	350
query74	10380	9483	8984	8984
query75	3729	3172	2776	2776
query76	3565	1140	767	767
query77	770	382	278	278
query78	10377	10469	9692	9692
query79	3151	901	587	587
query80	617	524	419	419
query81	494	256	231	231
query82	571	118	86	86
query83	165	163	141	141
query84	247	96	83	83
query85	763	351	293	293
query86	353	324	283	283
query87	4303	4306	4211	4211
query88	4682	2396	2492	2396
query89	405	339	301	301
query90	1841	195	198	195
query91	141	143	106	106
query92	61	57	52	52
query93	1215	897	541	541
query94	641	432	294	294
query95	348	282	268	268
query96	484	627	287	287
query97	3231	3291	3351	3291
query98	233	213	203	203
query99	1608	1402	1282	1282
Total cold run time: 295079 ms
Total hot run time: 192493 ms

@doris-robot
Copy link

doris-robot commented Sep 16, 2025

ClickBench: Total hot run time: 29.64 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1b3c469b1d7b1091f88037273e812e19400e0fda, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.63	0.11	0.10
query5	0.53	0.51	0.51
query6	1.12	0.73	0.76
query7	0.03	0.02	0.01
query8	0.04	0.02	0.04
query9	0.59	0.49	0.50
query10	0.56	0.55	0.54
query11	0.13	0.10	0.10
query12	0.14	0.10	0.11
query13	0.63	0.60	0.63
query14	0.77	0.79	0.80
query15	0.84	0.83	0.82
query16	0.38	0.38	0.38
query17	1.00	0.97	1.06
query18	0.25	0.21	0.22
query19	1.98	1.87	1.87
query20	0.01	0.01	0.00
query21	15.37	0.92	0.59
query22	0.74	1.01	0.78
query23	14.81	1.39	0.54
query24	3.07	1.60	2.05
query25	0.15	0.07	0.14
query26	0.26	0.14	0.12
query27	0.04	0.05	0.04
query28	14.47	0.96	0.44
query29	12.54	3.85	3.26
query30	0.26	0.11	0.06
query31	2.82	0.60	0.36
query32	3.23	0.53	0.47
query33	3.03	3.00	3.04
query34	16.54	5.23	4.58
query35	4.58	4.61	4.59
query36	0.62	0.50	0.47
query37	0.08	0.06	0.06
query38	0.04	0.04	0.03
query39	0.04	0.02	0.02
query40	0.15	0.13	0.13
query41	0.07	0.02	0.03
query42	0.03	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 103.95 s
Total hot run time: 29.64 s

@morrySnow morrySnow merged commit 15e3850 into branch-3.1 Sep 17, 2025
23 checks passed
@github-actions github-actions bot deleted the auto-pick-55468-branch-3.1 branch September 17, 2025 08:56
@morrySnow morrySnow mentioned this pull request Sep 22, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morrySnow morrySnow morrySnow approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@hello-stephen @doris-robot @morrySnow @dataroaring @zddr