Add an array_sum function to sum all the numbers in an array

[MrPowers]

No description provided.

[manuzhang]

@MrPowers From the JIRA, it seems the higher order functions are only available in SQL

[nvander1]

If you want scala syntax support for the higher order functions: transform, exists, aggregate, etc. We could merge this into daria as it doesn't seem to be gaining traction on the main spark tree: apache/spark#24232 @manuzhang @MrPowers This will be more performant than a UDF or UDAF

[manuzhang]

@nvander1 does it work for older versions of Spark ?

[nvander1]

@manuzhang It will only work for spark 2.4 onward.

[nvander1]

Although I did some experiements today with custom native spark functions, so I think we could do the same to backport the higher order functions.

[manuzhang]

Sounds great ! Do you have examples I could try ?

[nvander1]

@manuzhang I'll work up an example this week for you to test out and link it here! Kind of a busy week, but if I don't have an update by sunday evening, ping me!

[MrPowers]

We can continue this conversation on the higher order functions issue: #85

Closing this one cause it's not needed anymore.