-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-42318][SPARK-42319][SQL] Assign name to _LEGACY_ERROR_TEMP_(2123|2125) #39891
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
cc @srielau @MaxGekk @cloud-fan Could you review this error class ticket when you find some time 🙏 |
srielau
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you explain when this error is being raised?
It seems to be related to a data source?
MERGE is a SQL Statement, so the term is very confusing.
Also there is no action associated or any other context.
I agree with that.
The Btw, on my second thought, it seems to be a private function so can't be used in user space ?? scala> StructType.merge(left, right)
<console>:29: error: method merge in object StructType cannot be accessed in object org.apache.spark.sql.types.StructType
StructType.merge(left, right)cc @MaxGekk @cloud-fan Would you confirm if we should switched this error into internal error ?? |
|
If it's an internal error we want to issue an XXK sqlstate. For Analysis I have created XXKD0. Would this be considered analysis? |
Don't think so. The function invokes itself recursively to merge struct fields too. Try to reproduce the error from user space using |
|
I see. |
I agree with that.
@itholic Sure. Please, rebase on the recent master. |
|
Rebased, thanks! |
…23|2125) ### What changes were proposed in this pull request? This PR proposes to assign name to _LEGACY_ERROR_TEMP_2123 and _LEGACY_ERROR_TEMP_2125, "CANNOT_MERGE_INCOMPATIBLE_DATA_TYPE". ### Why are the changes needed? We should assign proper name to _LEGACY_ERROR_TEMP_* ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? `./build/sbt "sql/testOnly org.apache.spark.sql.SQLQueryTestSuite*` Closes #39891 from itholic/LEGACY_2125. Authored-by: itholic <haejoon.lee@databricks.com> Signed-off-by: Max Gekk <max.gekk@gmail.com> (cherry picked from commit b11fba0) Signed-off-by: Max Gekk <max.gekk@gmail.com>
…23|2125) ### What changes were proposed in this pull request? This PR proposes to assign name to _LEGACY_ERROR_TEMP_2123 and _LEGACY_ERROR_TEMP_2125, "CANNOT_MERGE_INCOMPATIBLE_DATA_TYPE". ### Why are the changes needed? We should assign proper name to _LEGACY_ERROR_TEMP_* ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? `./build/sbt "sql/testOnly org.apache.spark.sql.SQLQueryTestSuite*` Closes apache#39891 from itholic/LEGACY_2125. Authored-by: itholic <haejoon.lee@databricks.com> Signed-off-by: Max Gekk <max.gekk@gmail.com> (cherry picked from commit b11fba0) Signed-off-by: Max Gekk <max.gekk@gmail.com>
What changes were proposed in this pull request?
This PR proposes to assign name to _LEGACY_ERROR_TEMP_2123 and _LEGACY_ERROR_TEMP_2125, "CANNOT_MERGE_INCOMPATIBLE_DATA_TYPE".
Why are the changes needed?
We should assign proper name to LEGACY_ERROR_TEMP*
Does this PR introduce any user-facing change?
No
How was this patch tested?
./build/sbt "sql/testOnly org.apache.spark.sql.SQLQueryTestSuite*