Commit 78f7c30
[SPARK-42328][SQL] Remove _LEGACY_ERROR_TEMP_1175 from error classes
### What changes were proposed in this pull request?
Only occurrence of `_LEGACY_ERROR_TEMP_1175` appears under conversion from Spark data types to Parquet. All supported documented [Spark data types](https://spark.apache.org/docs/latest/sql-ref-datatypes.html) are covered in the [conversion function](https://github.com/apache/spark/blob/3e0808c33f185c13808ce2d547ce9ba0057d31a6/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaConverter.scala#L517-L745) (`VarcharType` and `CharType` are not present but they are passed down as string before reaching the conversion function), so under normal circumstances user can't force this error.
Convert the error class to `INTERNAL_ERROR`.
### Why are the changes needed?
Remove legacy error classes as part of activity in [SPARK-37935](https://issues.apache.org/jira/browse/SPARK-37935).
### Does this PR introduce _any_ user-facing change?
If the Spark works correctly, user shouldn't be able to run into `INTERNAL_ERROR` by using the public API.
### How was this patch tested?
Added test to `QueryCompilationErrorsSuite` and tested with sbt:
```
project sql
testOnly *QueryCompilationErrorsSuite
```
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #45183 from nikolamand-db/nikolamand-db/SPARK-42328.
Authored-by: Nikola Mandic <nikola.mandic@databricks.com>
Signed-off-by: Max Gekk <max.gekk@gmail.com>1 parent df4d489 commit 78f7c30
File tree
3 files changed
+22
-7
lines changed- common/utils/src/main/resources/error
- sql
- catalyst/src/main/scala/org/apache/spark/sql/errors
- core/src/test/scala/org/apache/spark/sql/errors
3 files changed
+22
-7
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
5118 | 5118 | | |
5119 | 5119 | | |
5120 | 5120 | | |
5121 | | - | |
5122 | | - | |
5123 | | - | |
5124 | | - | |
5125 | | - | |
5126 | 5121 | | |
5127 | 5122 | | |
5128 | 5123 | | |
| |||
Lines changed: 3 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1908 | 1908 | | |
1909 | 1909 | | |
1910 | 1910 | | |
1911 | | - | |
1912 | | - | |
| 1911 | + | |
| 1912 | + | |
| 1913 | + | |
1913 | 1914 | | |
1914 | 1915 | | |
1915 | 1916 | | |
| |||
Lines changed: 19 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
24 | 24 | | |
25 | 25 | | |
26 | 26 | | |
| 27 | + | |
27 | 28 | | |
28 | 29 | | |
29 | 30 | | |
| |||
962 | 963 | | |
963 | 964 | | |
964 | 965 | | |
| 966 | + | |
| 967 | + | |
| 968 | + | |
| 969 | + | |
| 970 | + | |
| 971 | + | |
| 972 | + | |
| 973 | + | |
| 974 | + | |
| 975 | + | |
| 976 | + | |
| 977 | + | |
| 978 | + | |
| 979 | + | |
| 980 | + | |
| 981 | + | |
| 982 | + | |
| 983 | + | |
965 | 984 | | |
966 | 985 | | |
967 | 986 | | |
| |||
0 commit comments