Skip to content

[SPARK-11593][SQL] Replace catalyst converter with RowEncoder in ScalaUDF #9565

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
viirya wants to merge 35 commits into from
+105 −971
Closed

[SPARK-11593][SQL] Replace catalyst converter with RowEncoder in ScalaUDF #9565

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
942dad7
Replace catalyst converter with RowEncoder.
viirya Nov 9, 2015
39f6c26
Add UserDefinedType to RowEncoder.
viirya Nov 9, 2015
75ffaeb
Fix scala style.
viirya Nov 9, 2015
1e13ff9
Call serialize on udt instead of user class.
viirya Nov 9, 2015
07ff97a
Add getField for UserDefinedType.
viirya Nov 10, 2015
ecf01bf
Move outputEncoder outside of eval and add calling copy().
viirya Nov 10, 2015
5186777
Merge remote-tracking branch 'upstream/master' into rowencoder-scalaudf
viirya Nov 11, 2015
39c0b7a
Replace catalyst converter with RowEncoder for the generated ScalaUDF.
viirya Nov 11, 2015
c910e6e
Fix scala style.
viirya Nov 11, 2015
1234515
Fix scala style.
viirya Nov 11, 2015
5c18c0c
Merge remote-tracking branch 'upstream/master' into rowencoder-scalaudf
viirya Nov 15, 2015
934f2cc
Merge remote-tracking branch 'upstream/master' into rowencoder-scalaudf
viirya Nov 25, 2015
fc882ca
Merge remote-tracking branch 'upstream/master' into rowencoder-scalaudf
viirya Dec 7, 2015
2c85714
Use reflection to call function for interpreted version. Add more com…
viirya Dec 7, 2015
f806755
Move reflection code outside eval function.
viirya Dec 7, 2015
26b4d85
Process exception thrown in UDF.
viirya Dec 7, 2015
693a6fe
Try to solve failed tests.
viirya Dec 8, 2015
1ca2efc
Try again.
viirya Dec 8, 2015
b8f3cce
Merge remote-tracking branch 'upstream/master' into rowencoder-scalaudf
viirya Apr 1, 2016
2fcbe69
Fix scala style.
viirya Apr 1, 2016
5da1c13
Try it.
viirya Apr 2, 2016
60f4ca0
Try to fix test.
viirya Apr 7, 2016
7a046fa
Make createTransformFunc as val.
viirya Apr 7, 2016
898acfa
Merge remote-tracking branch 'upstream/master' into rowencoder-scalaudf
viirya Apr 7, 2016
dd43918
Make createTransformFunc as lazy val.
viirya Apr 7, 2016
8dbc551
Pass Transformer into UDF to get the updated param values.
viirya Apr 7, 2016
5f987c0
Merge remote-tracking branch 'upstream/master' into rowencoder-scalaudf
viirya Apr 7, 2016
597c971
Fix MiMa problem.
viirya Apr 7, 2016
405e8b0
Fix passing null into ScalaUDF.
viirya Apr 7, 2016
648c7b2
Check PrimitiveType.
viirya Apr 7, 2016
10a9f91
Merge remote-tracking branch 'upstream/master' into rowencoder-scalaudf
viirya Apr 8, 2016
2a0c319
Merge remote-tracking branch 'upstream/master' into rowencoder-scalaudf
viirya Apr 8, 2016
21a2af2
Merge remote-tracking branch 'upstream/master' into rowencoder-scalaudf
viirya Apr 11, 2016
884a176
Remove ScalaUDF non code-generated evaluation support.
viirya Apr 11, 2016
30a867e
Remove unnecessary import.
viirya Apr 11, 2016
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading