Skip to content

Commit 8d6e49d

Browse files
jaceklaskowskijaceklaskowski
committed
CreateView Logical Operator (non-temporary views using CREATE VIEW AS)
1 parent 51c1296 commit 8d6e49d

File tree

3 files changed

+65
-20
lines changed

3 files changed

+65
-20
lines changed

‎docs/logical-operators/CreateView.md

+23-1
Original file line numberDiff line numberDiff line change
@@ -4,4 +4,26 @@ title: CreateView
44

55
# CreateView Logical Operator
66

7-
`CreateView` is...FIXME
7+
`CreateView` is a `BinaryCommand` logical operator that represents [CREATE VIEW AS](../sql/SparkSqlAstBuilder.md#visitCreateView) SQL statement to create a persisted (non-temporary) view.
8+
9+
??? note "CreateViewCommand"
10+
[CreateViewCommand](CreateViewCommand.md) logical operator is used to represent [CREATE TEMPORARY VIEW AS](../sql/SparkSqlAstBuilder.md#visitCreateView) SQL statements.
11+
12+
`CreateView` is resolved into [CreateViewCommand](CreateViewCommand.md) logical operator by [ResolveSessionCatalog](../logical-analysis-rules/ResolveSessionCatalog.md) logical analysis rule.
13+
14+
## Creating Instance
15+
16+
`CreateView` takes the following to be created:
17+
18+
* <span id="child"> Child [LogicalPlan](LogicalPlan.md)
19+
* <span id="userSpecifiedColumns"> User-specified columns (`Seq[(String, Option[String])]`)
20+
* <span id="comment"> Optional Comment
21+
* <span id="properties"> Properties (`Map[String, String]`)
22+
* <span id="originalText"> Optional "Original Text"
23+
* <span id="query"> [Logical Query Plan](LogicalPlan.md)
24+
* <span id="allowExisting"> `allowExisting` flag
25+
* <span id="replace"> `replace` flag
26+
27+
`CreateView` is created when:
28+
29+
* `SparkSqlAstBuilder` is requested to [parse a CREATE VIEW AS statement](../sql/SparkSqlAstBuilder.md#visitCreateView)

‎docs/logical-operators/CreateViewCommand.md

+23-8
Original file line numberDiff line numberDiff line change
@@ -30,7 +30,7 @@ title: CreateViewCommand
3030
* [Dataset.createTempViewCommand](../Dataset.md#createTempViewCommand) operator is used
3131
* [ResolveSessionCatalog](../logical-analysis-rules/ResolveSessionCatalog.md) logical analysis rule is executed (to resolve [CreateView](CreateView.md) logical operator)
3232
* `SparkConnectPlanner` is requested to [handleCreateViewCommand](../connect/SparkConnectPlanner.md#handleCreateViewCommand)
33-
* `SparkSqlAstBuilder` is requested to [parse a CREATE VIEW statement](../sql/SparkSqlAstBuilder.md#visitCreateView)
33+
* `SparkSqlAstBuilder` is requested to [parse a CREATE VIEW AS statement](../sql/SparkSqlAstBuilder.md#visitCreateView)
3434

3535
## Executing Command { #run }
3636

@@ -103,37 +103,52 @@ Property Name | Property Value
103103
val tableName = "demo_source_table"
104104

105105
// Demo table for "AS query" part
106-
sql(s"CREATE TABLE ${tableName} AS SELECT * FROM VALUES 1,2,3")
106+
sql(s"CREATE TABLE ${tableName} AS SELECT * FROM VALUES 1,2,3 t(id)")
107107

108108
// The "AS" query
109109
val asQuery = s"SELECT * FROM ${tableName}"
110110

111111
val viewName = "demo_view"
112112

113-
sql(s"CREATE VIEW ${viewName} AS ${asQuery}")
113+
sql(s"CREATE OR REPLACE VIEW ${viewName} AS ${asQuery}")
114+
```
115+
116+
```scala
117+
sql("SHOW VIEWS").show(truncate = false)
118+
```
119+
120+
```text
121+
+---------+---------+-----------+
122+
|namespace|viewName |isTemporary|
123+
+---------+---------+-----------+
124+
|default |demo_view|false |
125+
+---------+---------+-----------+
126+
```
127+
128+
```scala
129+
sql(s"DESC EXTENDED ${viewName}").show(truncate = false)
114130
```
115131

116132
```text
117-
scala> sql(s"DESC EXTENDED ${viewName}").show(truncate = false)
118133
+----------------------------+---------------------------------------------------------+-------+
119134
|col_name |data_type |comment|
120135
+----------------------------+---------------------------------------------------------+-------+
121-
|col1 |int |NULL |
136+
|id |int |NULL |
122137
| | | |
123138
|# Detailed Table Information| | |
124139
|Catalog |spark_catalog | |
125140
|Database |default | |
126141
|Table |demo_view | |
127142
|Owner |jacek | |
128-
|Created Time |Sun Apr 21 14:02:23 CEST 2024 | |
143+
|Created Time |Sun Apr 21 18:22:16 CEST 2024 | |
129144
|Last Access |UNKNOWN | |
130145
|Created By |Spark 3.5.1 | |
131146
|Type |VIEW | |
132147
|View Text |SELECT * FROM demo_source_table | |
133148
|View Original Text |SELECT * FROM demo_source_table | |
134149
|View Catalog and Namespace |spark_catalog.default | |
135-
|View Query Output Columns |[col1] | |
136-
|Table Properties |[transient_lastDdlTime=1713700943] | |
150+
|View Query Output Columns |[id] | |
151+
|Table Properties |[transient_lastDdlTime=1713716536] | |
137152
|Serde Library |org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe | |
138153
|InputFormat |org.apache.hadoop.mapred.SequenceFileInputFormat | |
139154
|OutputFormat |org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat| |

‎docs/sql/SparkSqlAstBuilder.md

+19-11
Original file line numberDiff line numberDiff line change
@@ -113,9 +113,9 @@ Creates a [CatalogStorageFormat](../CatalogStorageFormat.md) with the Hive SerDe
113113
* `textfile`
114114
* `avro`
115115

116-
### visitCacheTable
116+
### CACHE TABLE { #visitCacheTable }
117117

118-
Creates a [CacheTableCommand](../logical-operators/RunnableCommand.md#CacheTableCommand) logical command for `CACHE LAZY? TABLE [table] (AS? [query])?`
118+
Creates a [CacheTableCommand](../logical-operators/RunnableCommand.md#CacheTableCommand) logical command for `CACHE [LAZY] TABLE [table] (AS? [query])?`
119119

120120
ANTLR labeled alternative: `#cacheTable`
121121

@@ -125,19 +125,27 @@ Creates a [CreateTable](../logical-operators/CreateTable.md)
125125

126126
ANTLR labeled alternative: `#createHiveTable`
127127

128-
### visitCreateTable { #visitCreateTable }
128+
### CREATE TABLE { #visitCreateTable }
129129

130-
Creates [CreateTempViewUsing](../logical-operators/CreateTempViewUsing.md) logical operator for `CREATE TEMPORARY VIEW &hellip; USING &hellip;` or falls back to [AstBuilder](AstBuilder.md#visitCreateTable)
130+
Creates a [CreateTempViewUsing](../logical-operators/CreateTempViewUsing.md) logical operator for `CREATE TEMPORARY VIEW USING` or falls back to [AstBuilder](AstBuilder.md#visitCreateTable) (to create either a [CreateTableAsSelect](../logical-operators/CreateTableAsSelect.md) or a [CreateTable](../logical-operators/CreateTable.md))
131+
132+
```sql
133+
CREATE [TEMPORARY] [EXTERNAL] TABLE [IF NOT EXISTS] identifierReference
134+
[(createOrReplaceTableColTypeList)]
135+
[USING multipartIdentifier]
136+
createTableClauses
137+
[[AS] query]
138+
```
131139

132140
ANTLR labeled alternative: `#createTable`
133141

134-
### visitCreateView { #visitCreateView }
142+
### CREATE VIEW AS { #visitCreateView }
135143

136144
Creates either a [CreateViewCommand](../logical-operators/CreateViewCommand.md) or a [CreateView](../logical-operators/CreateView.md) logical operator for `CREATE VIEW AS` SQL statement.
137145

138146
```sql
139147
CREATE [OR REPLACE] [[GLOBAL] TEMPORARY] VIEW [IF NOT EXISTS] name
140-
[(identifierComment (, identifierComment)*)]
148+
[identifierComment (, identifierComment)*]
141149
[COMMENT STRING]
142150
[PARTITIONED ON identifierList]
143151
[TBLPROPERTIES propertyList]
@@ -146,9 +154,9 @@ AS query
146154

147155
ANTLR labeled alternative: `#createView`
148156

149-
### visitCreateTempViewUsing
157+
### CREATE TEMPORARY VIEW USING { #visitCreateTempViewUsing }
150158

151-
Creates a [CreateTempViewUsing](../logical-operators/CreateTempViewUsing.md) for `CREATE TEMPORARY VIEW &hellip; USING`
159+
Creates a [CreateTempViewUsing](../logical-operators/CreateTempViewUsing.md) for `CREATE TEMPORARY VIEW USING` SQL statement
152160

153161
ANTLR labeled alternative: `#createTempViewUsing`
154162

@@ -186,7 +194,7 @@ scala> println(cmd)
186194
DescribeTableCommand `t1`, false
187195
```
188196

189-
### visitExplain { #visitExplain }
197+
### EXPLAIN { #visitExplain }
190198

191199
Creates an [ExplainCommand](../logical-operators/ExplainCommand.md) logical command for the following:
192200

@@ -200,7 +208,7 @@ EXPLAIN (LOGICAL | FORMATTED | EXTENDED | CODEGEN | COST)?
200208

201209
ANTLR labeled alternative: `#explain`
202210

203-
### visitShowCreateTable { #visitShowCreateTable }
211+
### SHOW CREATE TABLE { #visitShowCreateTable }
204212

205213
Creates [ShowCreateTableCommand](../logical-operators/ShowCreateTableCommand.md) logical command for `SHOW CREATE TABLE` SQL statement.
206214

@@ -210,7 +218,7 @@ SHOW CREATE TABLE tableIdentifier
210218

211219
ANTLR labeled alternative: `#showCreateTable`
212220

213-
### visitTruncateTable { #visitTruncateTable }
221+
### TRUNCATE TABLE { #visitTruncateTable }
214222

215223
Creates [TruncateTableCommand](../logical-operators/TruncateTableCommand.md) logical command for `TRUNCATE TABLE` SQL statement.
216224

0 commit comments

Comments
 (0)