Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[enhance](mtmv)refresh hms table before run mtmv task #38212

Merged
merged 3 commits into from
Aug 16, 2024
Merged

[enhance](mtmv)refresh hms table before run mtmv task #38212

merged 3 commits into from
Aug 16, 2024

Conversation

zddr
Copy link
Contributor

@zddr zddr commented Jul 22, 2024

There are some caches in the HMS catalog, which can result in the inability to maintain consistency with Hive side data even after a successful refresh of the materialized view.
In this PR, the cache of relevant HMS tables will be cleared before refreshing the materialized view to solve this problem

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zddr
Copy link
Contributor Author

zddr commented Jul 22, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40068 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 247b60d9fe2686e9c8776de9a343289292951ddd, data reload: false

------ Round 1 ----------------------------------
q1	18739	4555	4412	4412
q2	2719	212	192	192
q3	11480	1195	1054	1054
q4	10695	869	831	831
q5	7808	2724	2726	2724
q6	229	141	139	139
q7	966	618	623	618
q8	9556	2074	2107	2074
q9	8821	6636	6591	6591
q10	8777	3831	3759	3759
q11	473	239	245	239
q12	398	224	222	222
q13	17789	2975	2996	2975
q14	277	233	228	228
q15	516	476	475	475
q16	485	408	389	389
q17	980	613	626	613
q18	8098	7477	7399	7399
q19	5214	1495	1342	1342
q20	661	329	335	329
q21	4876	3177	3281	3177
q22	352	290	286	286
Total cold run time: 119909 ms
Total hot run time: 40068 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4449	4275	4217	4217
q2	393	275	278	275
q3	2978	2796	2786	2786
q4	1906	1615	1604	1604
q5	5303	5332	5309	5309
q6	218	132	129	129
q7	2145	1769	1730	1730
q8	3233	3330	3335	3330
q9	8436	8395	8416	8395
q10	3902	3646	3670	3646
q11	605	486	506	486
q12	778	631	594	594
q13	16719	2946	2972	2946
q14	307	282	275	275
q15	517	470	485	470
q16	492	427	421	421
q17	1774	1500	1478	1478
q18	7671	7554	7401	7401
q19	1666	1535	1660	1535
q20	1998	1788	1776	1776
q21	4941	4750	4660	4660
q22	605	471	500	471
Total cold run time: 71036 ms
Total hot run time: 53934 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 173119 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 247b60d9fe2686e9c8776de9a343289292951ddd, data reload: false

query1	923	378	371	371
query2	6447	2005	1894	1894
query3	6665	203	218	203
query4	27018	17684	17354	17354
query5	4201	474	479	474
query6	274	163	155	155
query7	4583	286	286	286
query8	239	195	198	195
query9	8826	2458	2436	2436
query10	426	291	281	281
query11	11885	10258	10280	10258
query12	127	82	86	82
query13	1647	357	370	357
query14	10218	7325	7606	7325
query15	215	172	164	164
query16	7814	468	458	458
query17	1415	571	540	540
query18	1937	282	285	282
query19	199	153	156	153
query20	96	84	84	84
query21	210	129	129	129
query22	4598	4223	4325	4223
query23	33689	32946	33327	32946
query24	12124	2962	2863	2863
query25	691	383	390	383
query26	1832	153	149	149
query27	2959	271	276	271
query28	7508	2001	1986	1986
query29	1192	639	621	621
query30	284	151	153	151
query31	948	715	747	715
query32	98	56	57	56
query33	789	341	335	335
query34	897	481	495	481
query35	864	765	740	740
query36	1108	935	932	932
query37	287	79	78	78
query38	2890	2755	2771	2755
query39	871	814	812	812
query40	278	129	119	119
query41	48	46	47	46
query42	120	98	101	98
query43	529	479	474	474
query44	1221	709	724	709
query45	199	163	163	163
query46	1099	734	732	732
query47	1867	1820	1788	1788
query48	380	303	302	302
query49	1209	419	419	419
query50	803	398	397	397
query51	6726	6712	6696	6696
query52	109	92	99	92
query53	365	294	282	282
query54	1040	457	461	457
query55	76	75	78	75
query56	299	280	285	280
query57	1196	1062	1080	1062
query58	267	267	255	255
query59	3251	2685	2699	2685
query60	329	269	281	269
query61	96	96	94	94
query62	836	650	654	650
query63	319	294	314	294
query64	10416	2204	1655	1655
query65	3164	3104	3098	3098
query66	1351	335	326	326
query67	15787	15099	14956	14956
query68	8766	552	542	542
query69	790	490	372	372
query70	1172	1084	1129	1084
query71	557	286	279	279
query72	8843	5740	4966	4966
query73	1804	328	327	327
query74	6150	5763	5772	5763
query75	5241	2696	2700	2696
query76	5166	920	896	896
query77	753	315	338	315
query78	9903	9134	10294	9134
query79	11199	523	517	517
query80	894	462	478	462
query81	576	221	220	220
query82	751	134	128	128
query83	336	166	163	163
query84	278	85	87	85
query85	1363	311	299	299
query86	404	331	325	325
query87	3313	3165	3042	3042
query88	4428	2455	2481	2455
query89	531	387	368	368
query90	2024	193	194	193
query91	133	99	99	99
query92	66	47	52	47
query93	6635	500	510	500
query94	1265	276	305	276
query95	411	319	317	317
query96	614	277	271	271
query97	3201	3069	3052	3052
query98	217	197	189	189
query99	1552	1286	1286	1286
Total cold run time: 311710 ms
Total hot run time: 173119 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.05 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 247b60d9fe2686e9c8776de9a343289292951ddd, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.03
query3	0.22	0.04	0.04
query4	1.69	0.07	0.07
query5	0.50	0.49	0.49
query6	1.12	0.72	0.72
query7	0.02	0.02	0.01
query8	0.04	0.04	0.04
query9	0.54	0.50	0.48
query10	0.55	0.56	0.54
query11	0.15	0.11	0.11
query12	0.15	0.12	0.12
query13	0.61	0.59	0.58
query14	0.74	0.78	0.78
query15	0.86	0.83	0.80
query16	0.35	0.37	0.34
query17	0.96	0.96	0.96
query18	0.22	0.22	0.22
query19	1.78	1.78	1.80
query20	0.02	0.01	0.01
query21	15.39	0.77	0.66
query22	4.21	7.19	2.32
query23	18.34	1.35	1.29
query24	2.12	0.23	0.22
query25	0.15	0.08	0.09
query26	0.30	0.21	0.20
query27	0.46	0.23	0.24
query28	13.23	1.03	1.00
query29	12.66	3.34	3.35
query30	0.24	0.06	0.05
query31	2.86	0.39	0.38
query32	3.29	0.48	0.47
query33	2.86	2.88	2.89
query34	17.22	4.32	4.32
query35	4.41	4.45	4.40
query36	0.65	0.47	0.46
query37	0.19	0.16	0.16
query38	0.15	0.15	0.15
query39	0.04	0.04	0.04
query40	0.14	0.14	0.12
query41	0.10	0.05	0.05
query42	0.06	0.05	0.04
query43	0.05	0.04	0.03
Total cold run time: 109.76 s
Total hot run time: 31.05 s

@zddr
Copy link
Contributor Author

zddr commented Jul 23, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40036 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 89de2fe899600a9d27e7276846bc313f6124ecca, data reload: false

------ Round 1 ----------------------------------
q1	17979	4574	4414	4414
q2	2016	195	187	187
q3	10455	1178	1066	1066
q4	10182	769	782	769
q5	7543	2705	2690	2690
q6	221	135	134	134
q7	958	595	588	588
q8	9237	2077	2100	2077
q9	8691	6575	6507	6507
q10	8701	3822	3783	3783
q11	458	223	230	223
q12	393	222	220	220
q13	17759	2983	2985	2983
q14	290	242	236	236
q15	524	484	487	484
q16	495	374	376	374
q17	974	704	700	700
q18	8105	7506	7431	7431
q19	7914	1465	1366	1366
q20	716	326	326	326
q21	4990	3207	3240	3207
q22	338	271	289	271
Total cold run time: 118939 ms
Total hot run time: 40036 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4384	4277	4232	4232
q2	370	263	275	263
q3	3011	2809	2808	2808
q4	1860	1599	1633	1599
q5	5278	5335	5336	5335
q6	223	131	130	130
q7	2135	1687	1702	1687
q8	3232	3341	3327	3327
q9	8400	8376	8413	8376
q10	3880	3677	3718	3677
q11	567	504	483	483
q12	782	613	598	598
q13	16271	3019	3004	3004
q14	292	271	271	271
q15	527	464	480	464
q16	465	424	418	418
q17	1798	1482	1456	1456
q18	7697	7514	7394	7394
q19	1648	1644	1596	1596
q20	1981	1804	1784	1784
q21	4854	4630	4585	4585
q22	576	496	478	478
Total cold run time: 70231 ms
Total hot run time: 53965 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 172791 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 89de2fe899600a9d27e7276846bc313f6124ecca, data reload: false

query1	919	373	374	373
query2	6467	1927	1842	1842
query3	6646	210	214	210
query4	28567	17523	17280	17280
query5	4174	471	492	471
query6	302	207	161	161
query7	4605	283	288	283
query8	244	199	201	199
query9	8419	2386	2360	2360
query10	441	310	269	269
query11	10509	10061	10032	10032
query12	136	82	85	82
query13	1643	378	359	359
query14	10175	7626	7625	7625
query15	236	160	168	160
query16	8036	467	458	458
query17	1578	565	523	523
query18	2068	270	277	270
query19	189	152	152	152
query20	85	79	80	79
query21	203	143	127	127
query22	4422	4033	3996	3996
query23	33641	34074	33148	33148
query24	11717	2813	2877	2813
query25	625	364	387	364
query26	1579	144	147	144
query27	2926	267	268	267
query28	7596	1951	1956	1951
query29	937	614	602	602
query30	283	144	154	144
query31	968	730	743	730
query32	96	55	54	54
query33	759	325	334	325
query34	905	474	487	474
query35	858	780	727	727
query36	1159	930	920	920
query37	152	80	77	77
query38	2844	2768	2808	2768
query39	852	816	803	803
query40	272	119	116	116
query41	46	44	46	44
query42	119	101	99	99
query43	502	474	481	474
query44	1220	709	714	709
query45	201	164	160	160
query46	1089	719	729	719
query47	1902	1792	1797	1792
query48	363	290	283	283
query49	1115	412	423	412
query50	801	398	392	392
query51	6680	6674	6792	6674
query52	105	92	94	92
query53	365	291	286	286
query54	880	440	437	437
query55	74	73	74	73
query56	289	266	274	266
query57	1123	1054	1102	1054
query58	266	277	248	248
query59	3174	2734	2683	2683
query60	293	274	268	268
query61	96	93	95	93
query62	795	651	641	641
query63	323	287	285	285
query64	10489	2186	1691	1691
query65	3149	3082	3122	3082
query66	1213	345	323	323
query67	15800	14935	15237	14935
query68	4608	536	534	534
query69	463	334	351	334
query70	1140	1158	1141	1141
query71	382	276	274	274
query72	7023	5619	5671	5619
query73	741	338	321	321
query74	6168	5709	5590	5590
query75	3435	2711	2704	2704
query76	2824	894	933	894
query77	471	309	300	300
query78	9752	8939	9362	8939
query79	2367	515	522	515
query80	2004	470	465	465
query81	606	224	216	216
query82	777	134	133	133
query83	311	169	166	166
query84	272	89	88	88
query85	1567	407	309	309
query86	472	304	320	304
query87	3314	3073	3089	3073
query88	3809	2371	2359	2359
query89	489	389	383	383
query90	1953	200	190	190
query91	127	99	99	99
query92	60	52	48	48
query93	1510	494	490	490
query94	1291	291	293	291
query95	413	315	311	311
query96	596	274	265	265
query97	3192	3044	3019	3019
query98	229	198	199	198
query99	1537	1269	1266	1266
Total cold run time: 284608 ms
Total hot run time: 172791 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.3 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 89de2fe899600a9d27e7276846bc313f6124ecca, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.04
query3	0.23	0.05	0.05
query4	1.68	0.07	0.08
query5	0.53	0.49	0.49
query6	1.14	0.74	0.73
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.56	0.50	0.49
query10	0.54	0.54	0.55
query11	0.16	0.11	0.10
query12	0.15	0.12	0.13
query13	0.60	0.59	0.58
query14	0.77	0.77	0.77
query15	0.85	0.81	0.80
query16	0.36	0.35	0.36
query17	1.02	1.00	0.98
query18	0.23	0.21	0.21
query19	1.79	1.70	1.78
query20	0.01	0.01	0.00
query21	15.40	0.76	0.67
query22	4.83	7.50	1.63
query23	18.34	1.36	1.28
query24	2.11	0.22	0.22
query25	0.14	0.09	0.09
query26	0.29	0.21	0.22
query27	0.46	0.23	0.23
query28	13.34	1.02	0.99
query29	12.64	3.30	3.32
query30	0.25	0.08	0.06
query31	2.85	0.38	0.40
query32	3.27	0.48	0.46
query33	2.92	2.86	2.86
query34	17.05	4.38	4.38
query35	4.39	4.38	4.46
query36	0.65	0.49	0.50
query37	0.21	0.16	0.15
query38	0.15	0.15	0.14
query39	0.04	0.03	0.04
query40	0.15	0.13	0.11
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.05
Total cold run time: 110.48 s
Total hot run time: 30.3 s

@zddr
Copy link
Contributor Author

zddr commented Jul 31, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 42115 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0efb3b88230355e1a1b92bf152703527d4bd6579, data reload: false

------ Round 1 ----------------------------------
q1	18313	4238	4215	4215
q2	2358	216	228	216
q3	11243	1401	1402	1401
q4	10709	877	1033	877
q5	7716	2995	3047	2995
q6	229	141	158	141
q7	1054	639	627	627
q8	9604	1883	1969	1883
q9	8501	6603	7020	6603
q10	8707	3873	3864	3864
q11	425	250	263	250
q12	421	232	229	229
q13	17760	2934	2948	2934
q14	274	245	238	238
q15	522	485	489	485
q16	492	388	395	388
q17	967	935	928	928
q18	8094	7286	7262	7262
q19	1496	1230	1234	1230
q20	559	319	352	319
q21	5337	4754	4838	4754
q22	350	283	276	276
Total cold run time: 115131 ms
Total hot run time: 42115 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4076	4093	4049	4049
q2	331	227	221	221
q3	3016	3013	2982	2982
q4	1904	1894	1878	1878
q5	5319	5270	5273	5270
q6	218	129	131	129
q7	2083	1696	1689	1689
q8	3257	3327	3307	3307
q9	8336	8349	8365	8349
q10	3759	3899	3870	3870
q11	571	439	447	439
q12	755	559	539	539
q13	14405	2954	2960	2954
q14	282	252	256	252
q15	520	476	473	473
q16	452	411	398	398
q17	1736	1720	1740	1720
q18	7873	7238	7220	7220
q19	1672	1676	1698	1676
q20	1969	1773	1774	1773
q21	5443	5171	5122	5122
q22	529	463	462	462
Total cold run time: 68506 ms
Total hot run time: 54772 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 169386 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0efb3b88230355e1a1b92bf152703527d4bd6579, data reload: false

query1	904	371	370	370
query2	6461	1703	1668	1668
query3	6667	222	222	222
query4	20127	17572	17297	17297
query5	4336	528	524	524
query6	277	171	164	164
query7	4620	316	299	299
query8	258	206	200	200
query9	8529	2376	2369	2369
query10	438	276	298	276
query11	10413	9999	10032	9999
query12	135	93	88	88
query13	1624	372	363	363
query14	9736	8410	7706	7706
query15	202	162	169	162
query16	7098	465	471	465
query17	935	562	531	531
query18	1914	278	278	278
query19	198	144	142	142
query20	92	84	86	84
query21	234	97	99	97
query22	4073	4102	4122	4102
query23	33656	32984	33021	32984
query24	10310	3055	3068	3055
query25	685	405	376	376
query26	1753	149	144	144
query27	2960	284	272	272
query28	6908	1968	1964	1964
query29	1335	445	403	403
query30	284	151	149	149
query31	923	757	737	737
query32	104	54	56	54
query33	700	327	314	314
query34	907	467	477	467
query35	877	760	704	704
query36	985	877	830	830
query37	299	81	76	76
query38	2867	2806	2782	2782
query39	863	814	800	800
query40	282	118	110	110
query41	47	44	44	44
query42	125	101	105	101
query43	455	420	415	415
query44	1164	724	731	724
query45	208	176	181	176
query46	1077	811	780	780
query47	1799	1690	1721	1690
query48	361	287	289	287
query49	1195	430	422	422
query50	916	442	462	442
query51	6936	6696	6687	6687
query52	102	90	93	90
query53	252	178	177	177
query54	651	448	447	447
query55	77	74	75	74
query56	281	261	256	256
query57	1129	1034	1027	1027
query58	274	270	261	261
query59	2499	2251	2440	2251
query60	280	269	281	269
query61	101	93	90	90
query62	911	665	641	641
query63	218	183	189	183
query64	5867	1898	1919	1898
query65	3176	3095	3110	3095
query66	1450	342	329	329
query67	15323	14618	14965	14618
query68	4343	568	572	568
query69	438	299	313	299
query70	1111	1058	1067	1058
query71	407	264	279	264
query72	7152	2668	2483	2483
query73	774	329	324	324
query74	6042	5640	5719	5640
query75	3393	2828	2714	2714
query76	2285	1356	1427	1356
query77	431	313	315	313
query78	9428	8927	8850	8850
query79	1308	543	542	542
query80	1005	512	512	512
query81	576	221	220	220
query82	1098	133	126	126
query83	242	166	170	166
query84	274	78	81	78
query85	1253	305	304	304
query86	393	307	288	288
query87	3303	3131	3131	3131
query88	2905	2395	2388	2388
query89	379	296	302	296
query90	1797	198	198	198
query91	190	101	101	101
query92	60	52	51	51
query93	1406	623	614	614
query94	858	308	298	298
query95	390	265	269	265
query96	603	274	281	274
query97	3288	3100	3081	3081
query98	216	200	195	195
query99	1731	1290	1288	1288
Total cold run time: 261922 ms
Total hot run time: 169386 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.44 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0efb3b88230355e1a1b92bf152703527d4bd6579, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.04
query3	0.24	0.05	0.05
query4	1.66	0.07	0.08
query5	0.49	0.47	0.48
query6	1.13	0.71	0.71
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.57	0.52	0.50
query10	0.56	0.55	0.58
query11	0.15	0.12	0.11
query12	0.16	0.13	0.13
query13	0.60	0.60	0.60
query14	0.78	0.78	0.79
query15	0.90	0.86	0.85
query16	0.36	0.36	0.36
query17	1.03	1.00	0.99
query18	0.22	0.21	0.22
query19	1.90	1.72	1.73
query20	0.01	0.02	0.01
query21	15.40	0.79	0.66
query22	4.32	7.74	1.61
query23	17.81	1.57	1.34
query24	2.35	0.24	0.24
query25	0.19	0.10	0.10
query26	0.33	0.21	0.21
query27	0.47	0.25	0.25
query28	13.16	1.00	0.96
query29	12.55	3.31	3.31
query30	0.25	0.05	0.07
query31	2.86	0.41	0.40
query32	3.23	0.49	0.49
query33	2.92	2.95	2.95
query34	15.45	4.27	4.25
query35	4.28	4.29	4.29
query36	0.68	0.48	0.49
query37	0.20	0.17	0.17
query38	0.17	0.15	0.15
query39	0.04	0.03	0.04
query40	0.17	0.13	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 107.98 s
Total hot run time: 30.44 s

seawinde
seawinde reviewed Aug 6, 2024
View reviewed changes
regression-test/suites/mtmv_p0/test_hive_refresh_mtmv.groovy
@@ -157,9 +148,6 @@ suite("test_hive_refresh_mtmv", "p0,external,hive,external_docker,external_docke
"""
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

after refresh materialized view, maybe we should add order_qt to check the mv result is right or not

@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Aug 16, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@morrySnow morrySnow merged commit e4056df into apache:master Aug 16, 2024
28 of 32 checks passed
zddr added a commit to zddr/incubator-doris that referenced this pull request Aug 16, 2024
@zddr
[enhance](mtmv)refresh hms table before run mtmv task (apache#38212)
46cb39c 
There are some caches in the HMS catalog, which can result in the
inability to maintain consistency with Hive side data even after a
successful refresh of the materialized view.
In this PR, the cache of relevant HMS tables will be cleared before
refreshing the materialized view to solve this problem
@zddr zddr mentioned this pull request Aug 16, 2024
Merged
morrySnow pushed a commit that referenced this pull request Aug 16, 2024
@zddr
[enhance](mtmv) refresh hms table before run mtmv task (#38212) (#39490)
472565c 
pick from master #38212​
dataroaring pushed a commit that referenced this pull request Aug 17, 2024
@zddr @dataroaring
[enhance](mtmv)refresh hms table before run mtmv task (#38212)
d281487 
There are some caches in the HMS catalog, which can result in the
inability to maintain consistency with Hive side data even after a
successful refresh of the materialized view.
In this PR, the cache of relevant HMS tables will be cleared before
refreshing the materialized view to solve this problem
@yiguolei yiguolei mentioned this pull request Sep 5, 2024
Open
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@morrySnow morrySnow morrySnow approved these changes

@seawinde seawinde seawinde approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.2-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@zddr @doris-robot @morrySnow @seawinde @dataroaring