Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[enhance](mtmv)change mysql table type of mtmv to table #38797

Merged
merged 3 commits into from
Aug 9, 2024
Merged

[enhance](mtmv)change mysql table type of mtmv to table #38797

merged 3 commits into from
Aug 9, 2024

Conversation

zddr
Copy link
Contributor

@zddr zddr commented Aug 2, 2024

mv1 is MTMV

mysql> SHOW FULL TABLES WHERE Table_type =  'BASE TABLE';
+--------------+------------+
| Tables_in_zd | Table_type |
+--------------+------------+
| mv1          | BASE TABLE |
| com3         | BASE TABLE |
+--------------+------------+

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zddr
Copy link
Contributor Author

zddr commented Aug 2, 2024

run buildall

@github-actions github-actions bot added the doing label Aug 2, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 41681 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 402f4a713a62640ea515104f3ef63f3356bf9916, data reload: false

------ Round 1 ----------------------------------
q1	17652	4082	4111	4082
q2	2040	198	227	198
q3	10583	1309	1368	1309
q4	10280	876	904	876
q5	7650	2936	2968	2936
q6	221	143	142	142
q7	1057	616	611	611
q8	9451	1837	1949	1837
q9	8493	6553	6607	6553
q10	8733	3844	3848	3844
q11	418	248	251	248
q12	423	222	226	222
q13	17752	2950	2915	2915
q14	282	242	246	242
q15	523	490	484	484
q16	511	408	391	391
q17	962	896	893	893
q18	7981	7408	7312	7312
q19	1395	1213	1210	1210
q20	563	328	344	328
q21	5310	4789	4766	4766
q22	361	285	282	282
Total cold run time: 112641 ms
Total hot run time: 41681 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4018	3986	3998	3986
q2	329	228	222	222
q3	2998	3025	3143	3025
q4	1999	2023	1997	1997
q5	5619	5478	5475	5475
q6	218	141	131	131
q7	2083	1801	1842	1801
q8	3315	3388	3352	3352
q9	8700	8698	8859	8698
q10	3948	4051	3941	3941
q11	570	460	468	460
q12	797	597	600	597
q13	16257	3099	3116	3099
q14	317	273	286	273
q15	540	474	487	474
q16	450	440	410	410
q17	1757	1760	1709	1709
q18	8183	7651	7736	7651
q19	1705	1717	1707	1707
q20	2106	1833	1844	1833
q21	5719	5484	5364	5364
q22	526	460	485	460
Total cold run time: 72154 ms
Total hot run time: 56665 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 169300 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 402f4a713a62640ea515104f3ef63f3356bf9916, data reload: false

query1	912	369	363	363
query2	6286	1672	1639	1639
query3	6665	209	218	209
query4	20482	17427	17468	17427
query5	3668	508	526	508
query6	291	183	166	166
query7	4587	309	295	295
query8	274	194	188	188
query9	8505	2358	2369	2358
query10	441	281	273	273
query11	10628	10158	10052	10052
query12	124	92	88	88
query13	1643	382	382	382
query14	9264	6592	6869	6592
query15	206	163	162	162
query16	6630	476	434	434
query17	930	566	539	539
query18	1796	280	279	279
query19	193	162	147	147
query20	104	87	86	86
query21	201	100	97	97
query22	4464	4090	3905	3905
query23	33764	33715	33750	33715
query24	10158	3097	3057	3057
query25	681	410	421	410
query26	1839	151	154	151
query27	3017	293	291	291
query28	7704	2023	1996	1996
query29	1263	435	442	435
query30	240	159	156	156
query31	984	786	761	761
query32	107	55	61	55
query33	706	355	333	333
query34	958	507	520	507
query35	889	785	758	758
query36	1070	888	887	887
query37	290	85	78	78
query38	2951	2797	2737	2737
query39	880	804	790	790
query40	258	115	115	115
query41	46	44	44	44
query42	120	102	99	99
query43	452	402	408	402
query44	1195	737	734	734
query45	218	184	181	181
query46	1083	837	786	786
query47	1802	1720	1724	1720
query48	363	302	307	302
query49	960	422	425	422
query50	897	443	437	437
query51	6844	6661	6756	6661
query52	98	90	91	90
query53	258	194	187	187
query54	619	471	452	452
query55	77	74	79	74
query56	283	252	257	252
query57	1170	1046	1015	1015
query58	274	273	275	273
query59	2490	2280	2354	2280
query60	312	269	288	269
query61	103	96	99	96
query62	902	654	671	654
query63	216	189	185	185
query64	5758	1931	1877	1877
query65	3169	3121	3118	3118
query66	1312	329	328	328
query67	15512	14985	14750	14750
query68	4300	563	574	563
query69	485	302	305	302
query70	1132	1047	1032	1032
query71	430	282	283	282
query72	7198	2670	2463	2463
query73	773	334	333	333
query74	6088	5707	5663	5663
query75	3372	2742	2726	2726
query76	2377	1215	1281	1215
query77	441	309	366	309
query78	9475	9069	8830	8830
query79	1338	545	539	539
query80	979	527	514	514
query81	554	225	228	225
query82	1097	133	130	130
query83	237	170	170	170
query84	268	83	80	80
query85	1197	342	295	295
query86	408	297	312	297
query87	3287	3118	3092	3092
query88	3024	2534	2508	2508
query89	394	294	289	289
query90	1738	196	197	196
query91	129	100	104	100
query92	115	50	50	50
query93	1364	609	612	609
query94	816	305	306	305
query95	390	269	270	269
query96	594	284	281	281
query97	3245	3067	3056	3056
query98	215	202	200	200
query99	1646	1268	1290	1268
Total cold run time: 261692 ms
Total hot run time: 169300 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.24 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 402f4a713a62640ea515104f3ef63f3356bf9916, data reload: false

query1	0.05	0.04	0.04
query2	0.07	0.04	0.04
query3	0.23	0.05	0.06
query4	1.68	0.06	0.06
query5	0.48	0.48	0.48
query6	1.13	0.72	0.71
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.57	0.50	0.51
query10	0.57	0.55	0.56
query11	0.15	0.12	0.11
query12	0.14	0.12	0.13
query13	0.62	0.60	0.60
query14	0.77	0.79	0.80
query15	0.90	0.87	0.86
query16	0.36	0.35	0.35
query17	0.96	1.02	1.02
query18	0.23	0.22	0.21
query19	1.82	1.83	1.75
query20	0.01	0.00	0.00
query21	15.39	0.75	0.64
query22	3.69	7.69	1.51
query23	17.94	1.35	1.30
query24	2.27	0.22	0.22
query25	0.18	0.08	0.08
query26	0.31	0.21	0.21
query27	0.47	0.22	0.22
query28	13.23	1.00	0.97
query29	12.56	3.35	3.36
query30	0.26	0.05	0.05
query31	2.86	0.39	0.41
query32	3.24	0.50	0.48
query33	2.96	2.94	2.94
query34	15.46	4.24	4.26
query35	4.28	4.29	4.29
query36	0.67	0.47	0.48
query37	0.20	0.17	0.16
query38	0.17	0.15	0.15
query39	0.04	0.03	0.04
query40	0.15	0.13	0.13
query41	0.10	0.05	0.04
query42	0.06	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 107.34 s
Total hot run time: 30.24 s

@zddr
Copy link
Contributor Author

zddr commented Aug 5, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41799 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fc7133c2c20b4bf6fd3af058e7f6c4cf597d2ff1, data reload: false

------ Round 1 ----------------------------------
q1	20668	4197	4183	4183
q2	2365	204	204	204
q3	11028	1321	1380	1321
q4	10481	817	950	817
q5	7975	3060	2981	2981
q6	218	139	135	135
q7	1059	610	604	604
q8	9441	1845	1961	1845
q9	8430	6604	6615	6604
q10	8713	3833	3847	3833
q11	424	247	252	247
q12	414	223	224	223
q13	17762	2934	2919	2919
q14	275	242	238	238
q15	522	481	492	481
q16	488	403	389	389
q17	967	923	932	923
q18	8019	7317	7293	7293
q19	1428	1217	1209	1209
q20	567	335	348	335
q21	5281	4810	4737	4737
q22	357	281	278	278
Total cold run time: 116882 ms
Total hot run time: 41799 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4061	4033	4042	4033
q2	326	236	227	227
q3	2999	3013	2986	2986
q4	1885	1857	1887	1857
q5	5289	5228	5215	5215
q6	216	132	129	129
q7	2076	1706	1729	1706
q8	3205	3264	3268	3264
q9	8279	8271	8275	8271
q10	3779	3838	3831	3831
q11	543	444	439	439
q12	743	549	599	549
q13	16719	2957	2953	2953
q14	287	270	261	261
q15	520	478	478	478
q16	445	384	392	384
q17	1752	1692	1706	1692
q18	7797	7247	7229	7229
q19	1672	1684	1688	1684
q20	1979	1765	1772	1765
q21	5431	5168	5292	5168
q22	516	460	469	460
Total cold run time: 70519 ms
Total hot run time: 54581 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 169409 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fc7133c2c20b4bf6fd3af058e7f6c4cf597d2ff1, data reload: false

query1	919	373	371	371
query2	6497	1644	1647	1644
query3	6664	212	221	212
query4	19845	17478	17437	17437
query5	4312	522	559	522
query6	304	197	171	171
query7	4601	307	297	297
query8	275	205	199	199
query9	8538	2383	2397	2383
query10	452	282	273	273
query11	10618	10010	9943	9943
query12	139	97	88	88
query13	1624	378	385	378
query14	9322	7771	7354	7354
query15	211	159	162	159
query16	7097	445	477	445
query17	925	558	561	558
query18	1903	297	277	277
query19	189	142	144	142
query20	91	89	86	86
query21	201	98	108	98
query22	4065	4119	4003	4003
query23	33704	32926	32975	32926
query24	10460	3069	3069	3069
query25	677	381	386	381
query26	1778	152	150	150
query27	2916	280	286	280
query28	6915	1983	1968	1968
query29	1311	414	406	406
query30	285	151	153	151
query31	941	755	740	740
query32	99	53	57	53
query33	707	327	325	325
query34	909	485	506	485
query35	848	717	732	717
query36	1009	875	869	869
query37	288	78	78	78
query38	2894	2754	2784	2754
query39	860	827	807	807
query40	291	113	117	113
query41	49	45	44	44
query42	125	100	104	100
query43	479	425	429	425
query44	1207	740	736	736
query45	209	178	178	178
query46	1091	812	786	786
query47	1781	1714	1716	1714
query48	367	292	315	292
query49	1206	428	423	423
query50	925	438	433	433
query51	6776	6572	6742	6572
query52	105	93	89	89
query53	272	190	185	185
query54	655	459	461	459
query55	109	75	74	74
query56	281	270	266	266
query57	1136	1025	1069	1025
query58	277	275	277	275
query59	2504	2410	2342	2342
query60	299	278	279	278
query61	97	92	93	92
query62	919	657	668	657
query63	217	192	184	184
query64	5839	1934	1890	1890
query65	3161	3130	3174	3130
query66	1446	338	338	338
query67	15361	14735	14751	14735
query68	4316	556	577	556
query69	441	305	297	297
query70	1121	1070	1058	1058
query71	411	285	282	282
query72	7122	2672	2460	2460
query73	766	328	327	327
query74	6021	5692	5673	5673
query75	3418	2748	2741	2741
query76	2431	1180	1263	1180
query77	447	331	327	327
query78	9367	9009	8980	8980
query79	1492	539	543	539
query80	1197	519	529	519
query81	571	228	227	227
query82	1038	133	134	133
query83	242	181	175	175
query84	280	85	91	85
query85	1378	355	302	302
query86	395	284	317	284
query87	3259	3149	3118	3118
query88	2930	2411	2420	2411
query89	375	289	296	289
query90	1793	194	192	192
query91	124	103	101	101
query92	61	54	52	52
query93	1413	618	618	618
query94	881	282	305	282
query95	377	268	272	268
query96	611	279	279	279
query97	3269	3121	3123	3121
query98	221	199	198	198
query99	1694	1309	1301	1301
Total cold run time: 262039 ms
Total hot run time: 169409 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.99 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fc7133c2c20b4bf6fd3af058e7f6c4cf597d2ff1, data reload: false

query1	0.05	0.04	0.03
query2	0.07	0.03	0.04
query3	0.22	0.04	0.04
query4	1.69	0.06	0.06
query5	0.48	0.48	0.49
query6	1.14	0.72	0.71
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.57	0.50	0.52
query10	0.56	0.56	0.56
query11	0.16	0.12	0.11
query12	0.14	0.11	0.12
query13	0.60	0.61	0.60
query14	0.78	0.78	0.80
query15	0.92	0.87	0.86
query16	0.35	0.36	0.35
query17	1.00	1.01	1.00
query18	0.22	0.22	0.21
query19	1.81	1.71	1.73
query20	0.01	0.01	0.01
query21	15.40	0.76	0.66
query22	3.84	6.79	1.37
query23	17.79	1.36	1.27
query24	2.51	0.22	0.21
query25	0.18	0.07	0.08
query26	0.31	0.22	0.22
query27	0.46	0.22	0.22
query28	13.19	0.99	1.01
query29	12.51	3.32	3.28
query30	0.26	0.06	0.05
query31	2.87	0.41	0.40
query32	3.25	0.49	0.48
query33	2.93	2.97	2.97
query34	15.45	4.22	4.27
query35	4.29	4.30	4.30
query36	0.67	0.48	0.48
query37	0.20	0.16	0.16
query38	0.17	0.15	0.15
query39	0.04	0.04	0.04
query40	0.15	0.12	0.13
query41	0.10	0.06	0.04
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 107.51 s
Total hot run time: 29.99 s

@zddr
Copy link
Contributor Author

zddr commented Aug 7, 2024

run feut

@zddr
Copy link
Contributor Author

zddr commented Aug 7, 2024

run cloud_p1

@wm1581066 wm1581066 added the usercase Important user case type label label Aug 8, 2024
@morrySnow morrySnow added dev/2.1.x and removed doing labels Aug 8, 2024
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Aug 8, 2024

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 8, 2024
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Aug 8, 2024

PR approved by anyone and no changes requested.

@morrySnow morrySnow merged commit a9800b4 into apache:master Aug 9, 2024
29 of 30 checks passed
zddr added a commit to zddr/incubator-doris that referenced this pull request Aug 9, 2024
@zddr
[enhance](mtmv) change mysql table type of mtmv to table (apache#38797)
ec253ec 
mv1 is MTMV

mysql> SHOW FULL TABLES WHERE Table_type =  'BASE TABLE';
+--------------+------------+
| Tables_in_zd | Table_type |
+--------------+------------+
| mv1          | BASE TABLE |
| com3         | BASE TABLE |
+--------------+------------+
@zddr zddr mentioned this pull request Aug 9, 2024
Merged
yiguolei pushed a commit that referenced this pull request Aug 10, 2024
@zddr
[enhance](mtmv) change mysql table type of mtmv to table (#38797) (#3…
4dd9d4e 
…9166)

pick: #38797
dataroaring pushed a commit that referenced this pull request Aug 11, 2024
@zddr @dataroaring
[enhance](mtmv) change mysql table type of mtmv to table (#38797)
bbd7e12 
mv1 is MTMV

mysql> SHOW FULL TABLES WHERE Table_type =  'BASE TABLE';
+--------------+------------+
| Tables_in_zd | Table_type |
+--------------+------------+
| mv1          | BASE TABLE |
| com3         | BASE TABLE |
+--------------+------------+
wyxxxcat pushed a commit to wyxxxcat/doris that referenced this pull request Aug 14, 2024
@zddr @wyxxxcat
[enhance](mtmv) change mysql table type of mtmv to table (apache#38797)
2172916 
mv1 is MTMV

mysql> SHOW FULL TABLES WHERE Table_type =  'BASE TABLE';
+--------------+------------+
| Tables_in_zd | Table_type |
+--------------+------------+
| mv1          | BASE TABLE |
| com3         | BASE TABLE |
+--------------+------------+
dataroaring pushed a commit that referenced this pull request Aug 16, 2024
@zddr @dataroaring
[enhance](mtmv) change mysql table type of mtmv to table (#38797)
43fed24 
mv1 is MTMV

mysql> SHOW FULL TABLES WHERE Table_type =  'BASE TABLE';
+--------------+------------+
| Tables_in_zd | Table_type |
+--------------+------------+
| mv1          | BASE TABLE |
| com3         | BASE TABLE |
+--------------+------------+
@yiguolei yiguolei mentioned this pull request Sep 5, 2024
Open
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@morrySnow morrySnow morrySnow approved these changes

@seawinde seawinde seawinde approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.2-merged reviewed usercase Important user case type label
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
7 participants
@zddr @doris-robot @morrySnow @seawinde @yiguolei @wm1581066 @dataroaring