Skip to content

Commit 638dc4b

Browse files
committed
address feedback
1 parent ecf6653 commit 638dc4b

File tree

1 file changed

+10
-7
lines changed

1 file changed

+10
-7
lines changed

plugins/spark/README.md

Lines changed: 10 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -83,10 +83,13 @@ bin/spark-shell \
8383
```
8484

8585
# Limitations
86-
The Spark client does have limitations as follows:
87-
1) Create table as select (CTAS) is not supported for Delta tables.
88-
2) Dataframe saveAsTable is not supported for Delta tables, which requires CTAS support.
89-
3) Create non-iceberg table without explicit location is not supported.
90-
4) Rename table for non-iceberg table is not supported.
91-
5) ALTER TABLE ... SET LOCATION/SET FILEFORMAT/ADD PARTITION is not supported for DELTA table.
92-
6) No specific guarantee is provided for table types that are neither ICEBERG or DELTA at this moment.
86+
The Polaris Spark client supports catalog management for both Iceberg and None-Iceberg tables, it routes all Iceberg
87+
table requests to the Iceberg REST endpoints, and routes none-iceberg table requests to the Generic Table REST endpoints.
88+
89+
Following describes the current limitations of the Polaris Spark client:
90+
1) Create table as select (CTAS) is not supported for Delta tables. As a result, the `saveAsTable` method of `Dataframe`
91+
is also not supported, since it relies on the CTAS support.
92+
2) Create a non-iceberg table without explicit location is not supported.
93+
3) Rename a table for non-iceberg table is not supported.
94+
4) ALTER TABLE ... SET LOCATION/SET FILEFORMAT/ADD PARTITION is not supported for DELTA table.
95+
5) No guarantee is provided for table types that are neither ICEBERG or DELTA at this moment, like csv.

0 commit comments

Comments
 (0)