Skip to content

[feature](branch20) support statement to show views from database #33505

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
xy720 merged 4 commits into from
Apr 11, 2024
Merged

[feature](branch20) support statement to show views from database #33505

xy720 merged 4 commits into from
Apr 11, 2024

Conversation

@xy720
Copy link
Member

@xy720 xy720 commented Apr 10, 2024

Proposed changes

Issue Number: close #xxx

cherry-pick: #32358

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

xy720 and others added 2 commits April 10, 2024 15:38
@xy720
[chore](show) support statement to show views from table (apache#32358)
0a28efd 
MySQL [test]> show views;
+----------------+
| Tables_in_test |
+----------------+
| t1_view        |
| t2_view        |
+----------------+
2 rows in set (0.00 sec)

MySQL [test]> show views like '%t1%';
+----------------+
| Tables_in_test |
+----------------+
| t1_view        |
+----------------+
1 row in set (0.01 sec)

MySQL [test]> show views where create_time > '2024-03-18';
+----------------+
| Tables_in_test |
+----------------+
| t2_view        |
+----------------+
1 row in set (0.02 sec)
@xy720
save
b70c0e3
@doris-robot
Copy link

doris-robot commented Apr 10, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions github-actions bot added area/planner Issues or PRs related to the query planner kind/docs Categorizes issue or PR as related to documentation. labels Apr 10, 2024
@xy720
Copy link
Member Author

xy720 commented Apr 10, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Apr 10, 2024

TPC-H: Total hot run time: 49878 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b70c0e3c9d0cf1cee6e6d196b050416ef840bd79, data reload: false

------ Round 1 ----------------------------------
q1	18087	4360	4342	4342
q2	2019	148	144	144
q3	10459	1885	1919	1885
q4	10286	1249	1307	1249
q5	8618	3936	3924	3924
q6	228	123	123	123
q7	2015	1588	1560	1560
q8	9243	2687	2700	2687
q9	10786	10607	10510	10510
q10	8653	3506	3494	3494
q11	415	235	241	235
q12	470	302	306	302
q13	18339	3967	4066	3967
q14	344	334	320	320
q15	521	455	448	448
q16	699	595	603	595
q17	1111	947	975	947
q18	7288	6871	6907	6871
q19	1676	1539	1512	1512
q20	513	288	310	288
q21	4459	4146	4060	4060
q22	515	415	422	415
Total cold run time: 116744 ms
Total hot run time: 49878 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4293	4325	4311	4311
q2	318	221	220	220
q3	4118	4138	4146	4138
q4	2770	2755	2765	2755
q5	7241	7164	7162	7162
q6	236	118	117	117
q7	3250	2812	2785	2785
q8	4320	4437	4465	4437
q9	17051	16937	16938	16937
q10	4219	4281	4295	4281
q11	771	657	684	657
q12	1008	849	855	849
q13	6849	3724	3758	3724
q14	441	412	413	412
q15	487	465	463	463
q16	753	706	712	706
q17	3983	3810	3838	3810
q18	8803	8714	8781	8714
q19	1700	1734	1597	1597
q20	2412	2171	2123	2123
q21	8558	8514	8470	8470
q22	1040	937	899	899
Total cold run time: 84621 ms
Total hot run time: 79567 ms

@xy720
Copy link
Member Author

xy720 commented Apr 10, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Apr 10, 2024

TPC-H: Total hot run time: 50125 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 321ea22a3b8f4cdb018a031a2a8c54df2a92b884, data reload: false

------ Round 1 ----------------------------------
q1	17544	4383	4407	4383
q2	1977	154	141	141
q3	10251	1930	1920	1920
q4	10076	1321	1326	1321
q5	8475	3963	4004	3963
q6	237	124	125	124
q7	2042	1592	1582	1582
q8	9343	2724	2737	2724
q9	10800	10590	10441	10441
q10	8659	3534	3539	3534
q11	419	232	239	232
q12	475	293	299	293
q13	18327	3951	4046	3951
q14	365	327	327	327
q15	505	458	455	455
q16	680	589	592	589
q17	1129	989	985	985
q18	7283	6924	6851	6851
q19	1702	1510	1529	1510
q20	544	331	307	307
q21	4517	4140	4088	4088
q22	505	425	404	404
Total cold run time: 115855 ms
Total hot run time: 50125 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4344	4300	4332	4300
q2	322	217	223	217
q3	4158	4165	4142	4142
q4	2745	2752	2740	2740
q5	7275	7213	7215	7213
q6	237	119	118	118
q7	3244	2878	2843	2843
q8	4379	4502	4451	4451
q9	17215	17020	16873	16873
q10	4216	4262	4274	4262
q11	784	680	666	666
q12	1022	836	862	836
q13	5646	3769	3755	3755
q14	448	435	421	421
q15	501	457	459	457
q16	753	708	704	704
q17	3837	3807	3833	3807
q18	8769	8791	8711	8711
q19	1732	1686	1635	1635
q20	2400	2215	2099	2099
q21	8580	8527	8505	8505
q22	1083	953	940	940
Total cold run time: 83690 ms
Total hot run time: 79695 ms

@xy720
Copy link
Member Author

xy720 commented Apr 10, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Apr 10, 2024

TPC-H: Total hot run time: 50034 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bdcd1b8ec8c25d92bcd1e043337d17b1c1da4e9d, data reload: false

------ Round 1 ----------------------------------
q1	17747	4378	4509	4378
q2	2112	152	144	144
q3	10415	1957	1913	1913
q4	10405	1239	1325	1239
q5	8541	3933	3975	3933
q6	229	121	124	121
q7	2027	1566	1596	1566
q8	9299	2710	2701	2701
q9	11139	10526	10545	10526
q10	8610	3535	3511	3511
q11	414	244	246	244
q12	467	299	300	299
q13	18390	3974	4024	3974
q14	366	335	322	322
q15	513	452	476	452
q16	704	580	594	580
q17	1134	960	963	960
q18	7221	6867	6957	6867
q19	1661	1536	1532	1532
q20	533	290	311	290
q21	4479	4118	4082	4082
q22	512	400	419	400
Total cold run time: 116918 ms
Total hot run time: 50034 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4300	4323	4379	4323
q2	319	219	221	219
q3	4199	4140	4148	4140
q4	2744	2735	2757	2735
q5	7331	7215	7282	7215
q6	237	118	126	118
q7	3261	2831	2845	2831
q8	4395	4446	4470	4446
q9	17575	17160	17003	17003
q10	4214	4279	4246	4246
q11	766	677	685	677
q12	1017	854	837	837
q13	7661	3739	3730	3730
q14	449	434	416	416
q15	500	462	467	462
q16	777	695	713	695
q17	3821	3872	3831	3831
q18	8782	8701	8753	8701
q19	1725	1702	1641	1641
q20	2401	2188	2121	2121
q21	8589	8427	8440	8427
q22	1040	963	997	963
Total cold run time: 86103 ms
Total hot run time: 79777 ms

@doris-robot
Copy link

doris-robot commented Apr 10, 2024

TPC-DS: Total hot run time: 202901 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bdcd1b8ec8c25d92bcd1e043337d17b1c1da4e9d, data reload: false

query1	926	397	396	396
query2	6730	2274	2241	2241
query3	6944	200	195	195
query4	19915	18071	17994	17994
query5	20913	6583	6604	6583
query6	329	221	241	221
query7	4531	297	307	297
query8	246	229	252	229
query9	3141	2733	2681	2681
query10	421	298	303	298
query11	11342	10861	10901	10861
query12	118	83	71	71
query13	5572	638	657	638
query14	18167	13539	13591	13539
query15	364	226	234	226
query16	6440	286	262	262
query17	1454	1520	868	868
query18	2274	408	395	395
query19	212	150	149	149
query20	87	76	71	71
query21	192	90	94	90
query22	5171	5126	4967	4967
query23	32424	31936	32093	31936
query24	6798	6668	6579	6579
query25	527	436	432	432
query26	521	164	158	158
query27	1880	307	298	298
query28	6066	2310	2245	2245
query29	3055	2692	2822	2692
query30	242	162	165	162
query31	934	738	725	725
query32	67	59	61	59
query33	397	249	259	249
query34	859	467	508	467
query35	1127	906	913	906
query36	1257	1223	1121	1121
query37	90	65	59	59
query38	3088	2993	2979	2979
query39	1370	1324	1334	1324
query40	198	95	94	94
query41	35	32	33	32
query42	91	81	86	81
query43	691	708	625	625
query44	1153	718	709	709
query45	238	227	228	227
query46	1238	980	975	975
query47	1821	1670	1719	1670
query48	966	703	668	668
query49	615	363	380	363
query50	851	587	591	587
query51	4730	4709	4643	4643
query52	83	82	85	82
query53	443	323	316	316
query54	2653	2492	2487	2487
query55	86	77	79	77
query56	196	179	210	179
query57	1279	1150	1078	1078
query58	221	197	189	189
query59	3629	3112	3357	3112
query60	208	186	199	186
query61	86	80	81	80
query62	884	470	561	470
query63	467	343	331	331
query64	2383	1488	1458	1458
query65	3612	3584	3603	3584
query66	804	379	359	359
query67	16399	15548	15409	15409
query68	8273	674	683	674
query69	584	360	342	342
query70	1621	1531	1293	1293
query71	405	307	312	307
query72	6437	3394	3442	3394
query73	742	334	324	324
query74	6294	5911	5890	5890
query75	4535	3698	3751	3698
query76	4552	1161	1191	1161
query77	557	244	264	244
query78	12523	11883	11896	11883
query79	8031	641	648	641
query80	1103	403	407	403
query81	509	237	235	235
query82	1568	106	96	96
query83	170	138	128	128
query84	253	70	71	70
query85	871	293	276	276
query86	337	338	309	309
query87	3263	3036	3026	3026
query88	5165	2395	2391	2391
query89	378	282	288	282
query90	1923	212	209	209
query91	167	125	117	117
query92	54	50	53	50
query93	4828	589	610	589
query94	761	204	207	204
query95	1103	1071	1069	1069
query96	654	332	332	332
query97	6599	6439	6476	6439
query98	180	174	165	165
query99	2903	944	926	926
Total cold run time: 309594 ms
Total hot run time: 202901 ms

@doris-robot
Copy link

doris-robot commented Apr 10, 2024

ClickBench: Total hot run time: 30.67 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bdcd1b8ec8c25d92bcd1e043337d17b1c1da4e9d, data reload: false

query1	0.03	0.02	0.03
query2	0.07	0.03	0.03
query3	0.24	0.05	0.04
query4	1.81	0.06	0.07
query5	0.52	0.52	0.52
query6	1.24	0.61	0.61
query7	0.01	0.01	0.00
query8	0.04	0.02	0.02
query9	0.53	0.50	0.48
query10	0.53	0.54	0.54
query11	0.12	0.09	0.09
query12	0.10	0.08	0.10
query13	0.61	0.62	0.61
query14	0.79	0.79	0.79
query15	0.78	0.76	0.78
query16	0.37	0.37	0.37
query17	1.00	1.03	0.98
query18	0.22	0.26	0.23
query19	1.88	1.89	1.83
query20	0.02	0.01	0.00
query21	15.46	0.56	0.54
query22	1.95	1.93	1.61
query23	17.44	1.08	0.85
query24	6.30	1.05	1.42
query25	0.39	0.12	0.06
query26	0.67	0.16	0.16
query27	0.05	0.04	0.04
query28	6.39	0.73	0.81
query29	12.61	2.29	2.20
query30	0.56	0.55	0.53
query31	2.79	0.40	0.40
query32	3.36	0.50	0.49
query33	3.06	3.14	3.08
query34	15.25	4.80	4.83
query35	4.88	4.85	4.83
query36	1.08	1.02	1.01
query37	0.06	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.13
query41	0.07	0.01	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.01
Total cold run time: 103.53 s
Total hot run time: 30.67 s

@doris-robot
Copy link

doris-robot commented Apr 10, 2024

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit bdcd1b8ec8c25d92bcd1e043337d17b1c1da4e9d with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       20.5 seconds inserted 10000000 Rows, about 487K ops/s

cambyzju
cambyzju approved these changes Apr 11, 2024
View reviewed changes
Copy link
Contributor

@cambyzju cambyzju left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 11, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Apr 11, 2024

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Apr 11, 2024

PR approved by anyone and no changes requested.

lide-reed
lide-reed approved these changes Apr 11, 2024
View reviewed changes
Copy link
Contributor

@lide-reed lide-reed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@xy720 xy720 merged commit 9a049d9 into apache:branch-2.0 Apr 11, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
@xy720
[feature](branch20) support statement to show views from database (ap…
776c72b 
…ache#33505)

MySQL [test]> show views;
+----------------+
| Tables_in_test |
+----------------+
| t1_view        |
| t2_view        |
+----------------+
2 rows in set (0.00 sec)

MySQL [test]> show views like '%t1%';
+----------------+
| Tables_in_test |
+----------------+
| t1_view        |
+----------------+
1 row in set (0.01 sec)

MySQL [test]> show views where create_time > '2024-03-18';
+----------------+
| Tables_in_test |
+----------------+
| t2_view        |
+----------------+
1 row in set (0.02 sec)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@lide-reed lide-reed lide-reed approved these changes

@cambyzju cambyzju cambyzju approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. area/planner Issues or PRs related to the query planner kind/docs Categorizes issue or PR as related to documentation. reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@xy720 @doris-robot @lide-reed @cambyzju