[SPARK-23645][MINOR][DOCS][PYTHON] Add docs RE `pandas_udf` with keyword args#20798

Closed

mstewart141 wants to merge 30 commits intoapache:masterfrom

mstewart141:udfkw

Commits on Mar 24, 2018

[SPARK-23462][SQL] improve missing field error message in `StructType`

xysun
authored and
mstewart141
committed
[SPARK-23618][K8S][BUILD] Initialize BUILD_ARGS in docker-image-tool.sh

Jooseong Kim
authored and
mstewart141
committed
[SPARK-23412][ML] Add cosine distance to BisectingKMeans

mgaido91
authored and
mstewart141
committed
[SPARK-23656][TEST] Perform assertions in XXH64Suite.testKnownByteArrayInputs() on big endian platform, too

kiszk
authored and
mstewart141
committed
[MINOR][SQL][TEST] Create table using `dataSourceName` in `HadoopFsRelationTest`

jiangxb1987
authored and
mstewart141
committed
[SPARK-23547][SQL] Cleanup the .pipeout file when the Hive Session closed

zuotingbing
authored and
mstewart141
committed
[SPARK-23598][SQL] Make methods in BufferedRowIterator public to avoid runtime error for a large query

kiszk
authored and
mstewart141
committed
[SPARK-22915][MLLIB] Streaming tests for spark.ml.feature, from N to Z

attilapiros
authored and
mstewart141
committed
[SPARK-23642][DOCS] AccumulatorV2 subclass isZero scaladoc fix

smallory
authored and
mstewart141
committed
[SPARK-23533][SS] Add support for changing ContinuousDataReader's startOffset

xuanyuanking
authored and
mstewart141
committed
[SPARK-23695][PYTHON] Fix the error message for Kinesis streaming tests

HyukjinKwon
authored and
mstewart141
committed
[HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 262144 bytes of memory, got 224631

wangyum
authored and
mstewart141
committed
[SPARK-23658][LAUNCHER] InProcessAppHandle uses the wrong class in getLogger

Sahil Takiar
authored and
mstewart141
committed
[SPARK-23671][CORE] Fix condition to enable the SHS thread pool.

Marcelo Vanzin
authored and
mstewart141
committed
[SPARK-23608][CORE][WEBUI] Add synchronization in SHS between attachSparkUI and detachSparkUI functions to avoid concurrent modification issue to Jetty Handlers

zhouyejoe
authored and
mstewart141
committed
[SPARK-23670][SQL] Fix memory leak on SparkPlanGraphWrapper

myroslavlisniak
authored and
mstewart141
committed
[SPARK-23644][CORE][UI] Use absolute path for REST call in SHS

mgaido91
authored and
mstewart141
committed
[SPARK-23635][YARN] AM env variable should not overwrite same name env variable set through spark.executorEnv.

jerryshao
authored and
mstewart141
committed
[SPARK-23553][TESTS] Tests should not assume the default value of `spark.sql.sources.default`

dongjoon-hyun
authored and
mstewart141
committed
[SPARK-18371][STREAMING] Spark Streaming backpressure generates batch with large number of records

Sebastian Arzt
authored and
mstewart141
committed
[SPARK-23581][SQL] Add interpreted unsafe projection

hvanhovell
authored and
mstewart141
committed
[SPARK-23680] Fix entrypoint.sh to properly support Arbitrary UIDs

Ricardo Martinelli de Oliveira
authored and
mstewart141
committed
[SPARK-23623][SS] Avoid concurrent use of cached consumers in CachedKafkaConsumer

tdas
authored and
mstewart141
committed
[SPARK-15009][PYTHON][ML] Construct a CountVectorizerModel from a vocabulary list

BryanCutler
authored and
mstewart141
committed
[SPARK-23683][SQL] FileCommitProtocol.instantiate() hardening

steveloughran
authored and
mstewart141
committed
[SPARK-23706][PYTHON] spark.conf.get(value, default=None) should produce None in PySpark

HyukjinKwon
authored and
mstewart141
committed
[SPARK-23645][PYTHON] Allow python udfs to be called with keyword arguments
mstewart141
committed
Incomplete / Show issue with partial fn in pandas_udf
mstewart141
committed
Add note RE no keyword args in python UDFs
mstewart141
committed
Address comments
mstewart141
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[SPARK-23645][MINOR][DOCS][PYTHON] Add docs RE `pandas_udf` with keyword args#20798

[SPARK-23645][MINOR][DOCS][PYTHON] Add docs RE `pandas_udf` with keyword args#20798
mstewart141 wants to merge 30 commits intoapache:masterfrom
mstewart141:udfkw

Commits on Mar 24, 2018

[SPARK-23462][SQL] improve missing field error message in `StructType`

[SPARK-23618][K8S][BUILD] Initialize BUILD_ARGS in docker-image-tool.sh

[SPARK-23412][ML] Add cosine distance to BisectingKMeans

[SPARK-23656][TEST] Perform assertions in XXH64Suite.testKnownByteArrayInputs() on big endian platform, too

[MINOR][SQL][TEST] Create table using `dataSourceName` in `HadoopFsRelationTest`

[SPARK-23547][SQL] Cleanup the .pipeout file when the Hive Session closed

[SPARK-23598][SQL] Make methods in BufferedRowIterator public to avoid runtime error for a large query

[SPARK-22915][MLLIB] Streaming tests for spark.ml.feature, from N to Z

[SPARK-23642][DOCS] AccumulatorV2 subclass isZero scaladoc fix

[SPARK-23533][SS] Add support for changing ContinuousDataReader's startOffset

[SPARK-23695][PYTHON] Fix the error message for Kinesis streaming tests

[HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 262144 bytes of memory, got 224631

[SPARK-23658][LAUNCHER] InProcessAppHandle uses the wrong class in getLogger

[SPARK-23671][CORE] Fix condition to enable the SHS thread pool.

[SPARK-23608][CORE][WEBUI] Add synchronization in SHS between attachSparkUI and detachSparkUI functions to avoid concurrent modification issue to Jetty Handlers

[SPARK-23670][SQL] Fix memory leak on SparkPlanGraphWrapper

[SPARK-23644][CORE][UI] Use absolute path for REST call in SHS

[SPARK-23635][YARN] AM env variable should not overwrite same name env variable set through spark.executorEnv.

[SPARK-23553][TESTS] Tests should not assume the default value of `spark.sql.sources.default`

[SPARK-18371][STREAMING] Spark Streaming backpressure generates batch with large number of records

[SPARK-23581][SQL] Add interpreted unsafe projection

[SPARK-23680] Fix entrypoint.sh to properly support Arbitrary UIDs

[SPARK-23623][SS] Avoid concurrent use of cached consumers in CachedKafkaConsumer

[SPARK-15009][PYTHON][ML] Construct a CountVectorizerModel from a vocabulary list

[SPARK-23683][SQL] FileCommitProtocol.instantiate() hardening

[SPARK-23706][PYTHON] spark.conf.get(value, default=None) should produce None in PySpark

[SPARK-23645][PYTHON] Allow python udfs to be called with keyword arguments

Incomplete / Show issue with partial fn in pandas_udf

Add note RE no keyword args in python UDFs

Address comments

[SPARK-23645][MINOR][DOCS][PYTHON] Add docs RE `pandas_udf` with keyword args#20798mstewart141 wants to merge 30 commits intoapache:masterapache/spark:masterfrom mstewart141:udfkwmstewart141/spark:udfkwCopy head branch name to clipboard

Commits

Commits on Mar 24, 2018

[SPARK-23645][MINOR][DOCS][PYTHON] Add docs RE `pandas_udf` with keyword args#20798
mstewart141 wants to merge 30 commits intoapache:masterfrom
mstewart141:udfkw