Skip to content

[SPARK-43009][SQL] Parameterized sql() with Any constants #40623

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 15 commits into from
+293 −233
Closed

[SPARK-43009][SQL] Parameterized sql() with Any constants #40623

Changes from 1 commit
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
5844cbb
Parameterized sql with literal args
MaxGekk Mar 31, 2023
9cdf053
Fix SparkSession.scala
MaxGekk Mar 31, 2023
7bc0bec
Fix coding style
MaxGekk Mar 31, 2023
302f801
Fix python/pyspark/sql/session.py
MaxGekk Mar 31, 2023
9ff50d0
Update proto
MaxGekk Apr 1, 2023
5c0c455
Fix python coding style
MaxGekk Apr 1, 2023
b07ccf2
Fix plan.py
MaxGekk Apr 1, 2023
0a7da2b
Reformat plan.py
MaxGekk Apr 1, 2023
5b7d90b
Fix coding style
MaxGekk Apr 1, 2023
4543764
Add a test
MaxGekk Apr 1, 2023
c482018
Update comments
MaxGekk Apr 2, 2023
ae11139
Fix coding style
MaxGekk Apr 2, 2023
ba54339
Re-gen proto files
MaxGekk Apr 2, 2023
f6b9ee4
Merge remote-tracking branch 'origin/master' into parameterized-sql-any
MaxGekk Apr 3, 2023
67f34e9
Address Wenchen's review comments
MaxGekk Apr 3, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Re-gen proto files
  • Loading branch information
@MaxGekk
MaxGekk committed Apr 2, 2023

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode
commit ba54339cae057a0c89cf4e83a6181eaa406d112a
6 changes: 1 addition & 5 deletions python/pyspark/sql/connect/proto/commands_pb2.pyi
View file
Original file line number Diff line number Diff line change
@@ -186,11 +186,7 @@ class SqlCommand(google.protobuf.message.Message):
) -> google.protobuf.internal.containers.MessageMap[
builtins.str, pyspark.sql.connect.proto.expressions_pb2.Expression.Literal
]:
"""(Optional) A map of parameter names to string values that are parsed as
SQL literal expressions. For example, map keys: "rank", "name", "birthdate";
map values: "1", "'Steven'", "DATE'2023-03-21'". The fragments of string values
belonged to SQL comments are skipped while parsing.
"""
"""(Optional) A map of parameter names to literal expressions."""
def __init__(
self,
*,
6 changes: 1 addition & 5 deletions python/pyspark/sql/connect/proto/relations_pb2.pyi
View file
Original file line number Diff line number Diff line change
@@ -585,11 +585,7 @@ class SQL(google.protobuf.message.Message):
) -> google.protobuf.internal.containers.MessageMap[
builtins.str, pyspark.sql.connect.proto.expressions_pb2.Expression.Literal
]:
"""(Optional) A map of parameter names to string values that are parsed as
SQL literal expressions. For example, map keys: "rank", "name", "birthdate";
map values: "1", "'Steven'", "DATE'2023-03-21'". The fragments of string values
belonged to SQL comments are skipped while parsing.
"""
"""(Optional) A map of parameter names to literal expressions."""
def __init__(
self,
*,