[SPARK-15194] [ML] Add Python ML API for MultivariateGaussian#13248

Closed

praveendareddy21 wants to merge 108 commits intoapache:branch-2.0from

praveendareddy21:local_branch

Commits on May 22, 2016

Commits on Jun 28, 2016

[SPARK-16114][SQL] structured streaming network word count examples

jjthomas
authored and
tdas
committed

Commits on Jun 29, 2016

[MINOR][DOCS][STRUCTURED STREAMING] Minor doc fixes around `DataFrameWriter` and `DataStreamWriter`

brkyvz
authored and
zsxwing
committed
[SPARKR] add csv tests

felixcheung
authored and
shivaram
committed
[SPARK-16268][PYSPARK] SQLContext should import DataStreamReader

zsxwing
authored and
tdas
committed
[SPARK-16248][SQL] Whitelist the list of Hive fallback functions
rxin
committed
[SPARK-16245][ML] model loading backward compatibility for ml.feature.PCA

yanboliang
authored and
mengxr
committed
[SPARK-16259][PYSPARK] cleanup options in DataFrame read/write API

Davies Liu
authored and
zsxwing
committed
[SPARK-16266][SQL][STREAING] Moved DataStreamReader/Writer from pyspark.sql to pyspark.sql.streaming

tdas
authored and
zsxwing
committed
[TRIVIAL][DOCS][STREAMING][SQL] The return type mentioned in the Javadoc is incorrect for toJavaRDD, …

holdenk
authored and
tdas
committed
[SPARK-16291][SQL] CheckAnalysis should capture nested aggregate functions that reference no input attributes

liancheng
authored and
cloud-fan
committed
[SPARK-16261][EXAMPLES][ML] Fixed incorrect appNames in ML Examples

BryanCutler
authored and
Nick Pentreath
committed
[MINOR][SPARKR] Fix arguments of survreg in SparkR

yanboliang
authored and
mengxr
committed
[SPARK-16140][MLLIB][SPARKR][DOCS] Group k-means method in generated R doc

keypointt
authored and
mengxr
committed
[SPARK-16236][SQL][FOLLOWUP] Add Path Option back to Load API in DataFrameReader

gatorsmile
authored and
zsxwing
committed
[SPARK-16256][SQL][STREAMING] Added Structured Streaming Programming Guide
tdas
committed
[TRIVIAL] [PYSPARK] Clean up orc compression option as well

HyukjinKwon
authored and
davies
committed
[SPARK-16301] [SQL] The analyzer rule for resolving using joins should respect the case sensitivity setting.

yhuai
authored and
davies
committed
[SPARK-16006][SQL] Attemping to write empty DataFrame with no fields throws non-intuitive exception

dongjoon-hyun
authored and
rxin
committed
[SPARK-16238] Metrics for generated method and class bytecode size

ericl
authored and
rxin
committed
[SPARK-16228][SQL] HiveSessionCatalog should return `double`-param functions for decimal param lookups

dongjoon-hyun
authored and
rxin
committed

Commits on Jun 30, 2016

[SPARK-16134][SQL] optimizer rules for typed filter

cloud-fan
authored and
liancheng
committed
Revert "[SPARK-16134][SQL] optimizer rules for typed filter"
liancheng
committed
[SPARK-16267][TEST] Replace deprecated `CREATE TEMPORARY TABLE ... USING` from testsuites.

dongjoon-hyun
authored and
rxin
committed
[SPARK-16294][SQL] Labelling support for the include_example Jekyll plugin

liancheng
authored and
mengxr
committed
[SPARK-12177][STREAMING][KAFKA] Update KafkaDStreams to new Kafka 0.10 Consumer API

koeninger
authored and
tdas
committed
[SPARK-16256][DOCS] Minor fixes on the Structured Streaming Programming Guide
tdas
committed
[SPARK-16241][ML] model loading backward compatibility for ml NaiveBayes

zlpmichelle
authored and
yanboliang
committed
[SPARK-12177][TEST] Removed test to avoid compilation issue in scala 2.10

tdas
authored and
liancheng
committed
[SPARK-16071][SQL] Checks size limit when doubling the array size in BufferHolder

clockfly
authored and
cloud-fan
committed
[BUILD] Fix version in poms related to kafka-0-10

tdas
authored and
liancheng
committed
[SPARK-13850] Force the sorter to Spill when number of elements in th…

Sital Kedia
authored and
davies
committed
[SPARK-16256][DOCS] Fix window operation diagram
tdas
committed
[SPARK-16336][SQL] Suggest doing table refresh upon FileNotFoundException

petermaxlee
authored and
rxin
committed
[SPARK-16313][SQL] Spark should not silently drop exceptions in file listing
rxin
committed

Commits on Jul 1, 2016

[SPARK-16328][ML][MLLIB][PYSPARK] Add 'asML' and 'fromML' conversion methods to PySpark linalg

Nick Pentreath
authored and
jkbradley
committed
[SPARK-15643][DOC][ML] Add breaking changes to ML migration guide

Nick Pentreath
authored and
jkbradley
committed
[SPARK-15954][SQL] Disable loading test tables in Python tests
rxin
committed
[SPARK-15820][PYSPARK][SQL] Add Catalog.refreshTable into python API

WeichenXu123
authored and
liancheng
committed
[SPARK-14608][ML] transformSchema needs better documentation

hhbyyh
authored and
jkbradley
committed
[SPARK-12177][STREAMING][KAFKA] limit api surface area

koeninger
authored and
tdas
committed
[SPARK-16182][CORE] Utils.scala -- terminateProcess() should call Process.destroyForcibly() if and only if Process.destroy() fails
srowen
committed
[SPARK-15761][MLLIB][PYSPARK] Load ipython when default python is Python3

MechCoder
authored and
srowen
committed
[SPARK-16222][SQL] JDBC Sources - Handling illegal input values for `fetchsize` and `batchsize`

gatorsmile
authored and
srowen
committed
[SPARK-16012][SPARKR] Implement gapplyCollect which will apply a R function on each group similar to gapply and collect the result back to R data.frame

Narine Kokhlikyan
authored and
shivaram
committed
[SPARK-16299][SPARKR] Capture errors from R workers in daemon.R to avoid deletion of R session temporary directory.

sun-rui
authored and
shivaram
committed
[SPARK-16335][SQL] Structured streaming should fail if source directory does not exist
rxin
committed
[SPARK-16233][R][TEST] ORC test should be enabled only when HiveContext is available.

dongjoon-hyun
authored and
shivaram
committed
[SPARK-16095][YARN] Yarn cluster mode should report correct state to SparkLauncher

renozhang
authored and
Marcelo Vanzin
committed

Commits on Jul 2, 2016

[GRAPHX][EXAMPLES] move graphx test data directory and update graphx document

WeichenXu123
authored and
srowen
committed
[SPARK-16345][DOCUMENTATION][EXAMPLES][GRAPHX] Extract graphx programming guide example snippets from source files instead of hard code them

WeichenXu123
authored and
srowen
committed
[MINOR][BUILD] Fix Java linter errors

dongjoon-hyun
authored and
srowen
committed

Commits on Jul 4, 2016

[SPARK-16260][ML][EXAMPLE] PySpark ML Example Improvements and Cleanup

wangmiao1981
authored and
yanboliang
committed
[MINOR][DOCS] Remove unused images; crush PNGs that could use it for good measure
srowen
committed
[SPARK-16329][SQL][BACKPORT-2.0] Star Expansion over Table Containing No Column

gatorsmile
authored and
cloud-fan
committed
[SPARK-16353][BUILD][DOC] Missing javadoc options for java unidoc

Michael Allman
authored and
srowen
committed

Commits on Jul 5, 2016

Commits on Jul 6, 2016

[SPARK-16348][ML][MLLIB][PYTHON] Use full classpaths for pyspark ML JVM calls
jkbradley
committed
Preparing Spark release v2.0.0-rc2
pwendell
committed
Preparing development version 2.0.1-SNAPSHOT
pwendell
committed
[SPARK-16339][CORE] ScriptTransform does not print stderr when outstream is lost

tejasapatil
authored and
srowen
committed
[SPARK-16249][ML] Change visibility of Object ml.clustering.LDA to public for loading

YY-OnCall
authored and
yanboliang
committed
[SPARK-15968][SQL] Nonempty partitioned metastore tables are not cached

rxin
authored and
cloud-fan
committed
[SPARK-16229][SQL] Drop Empty Table After CREATE TABLE AS SELECT fails

gatorsmile
authored and
cloud-fan
committed
[DOC][SQL] update out-of-date code snippets using SQLContext in all documents.

WeichenXu123
authored and
rxin
committed
[MINOR][PYSPARK][DOC] Fix wrongly formatted examples in PySpark documentation

HyukjinKwon
authored and
rxin
committed
[SPARK-16371][SQL] Do not push down filters incorrectly when inner name and outer name are the same in Parquet

HyukjinKwon
authored and
rxin
committed
[SPARK-15740][MLLIB] Word2VecSuite "big model load / save" caused OOM in maven jenkins builds

tmnd1991
authored and
jkbradley
committed
[SPARK-16379][CORE][MESOS] Spark on mesos is broken due to race condition in Logging

srowen
authored and
rxin
committed
[MESOS] expand coarse-grained mode docs

Michael Gummelt
authored and
rxin
committed
[SPARK-16371][SQL] Two follow-up tasks
rxin
committed
[SPARK-16212][STREAMING][KAFKA] apply test tweaks from 0-10 to 0-8 as well

koeninger
authored and
tdas
committed

Commits on Jul 7, 2016

Commits on Jul 8, 2016

[SPARK-16425][R] `describe()` should not fail with non-numeric columns

dongjoon-hyun
authored and
shivaram
committed
[SPARK-16276][SQL] Implement elt SQL function

petermaxlee
authored and
rxin
committed
[SPARK-16278][SPARK-16279][SQL] Implement map_keys/map_values SQL functions

dongjoon-hyun
authored and
rxin
committed
[SPARK-16289][SQL] Implement posexplode table generating function

dongjoon-hyun
authored and
rxin
committed
[SPARK-16271][SQL] Implement Hive's UDFXPathUtil

petermaxlee
authored and
rxin
committed
[SPARK-16274][SQL] Implement xpath_boolean

petermaxlee
authored and
rxin
committed
[SPARK-16288][SQL] Implement inline table generating function

dongjoon-hyun
authored and
rxin
committed
[SPARK-16286][SQL] Implement stack table generating function

dongjoon-hyun
authored and
rxin
committed
[SPARK-16430][SQL][STREAMING] Add option maxFilesPerTrigger
tdas
committed
[SPARK-16285][SQL] Implement sentences SQL functions

dongjoon-hyun
authored and
cloud-fan
committed
[SPARK-16369][MLLIB] tallSkinnyQR of RowMatrix should aware of empty partition

yinxusen
authored and
srowen
committed
[SPARK-13638][SQL] Add quoteAll option to CSV DataFrameWriter

jurriaan
authored and
rxin
committed
[SPARK-16420] Ensure compression streams are closed.

rdblue
authored and
rxin
committed
[SPARK-16281][SQL] Implement parse_url SQL function

janplus
authored and
rxin
committed
[SPARK-16453][BUILD] release-build.sh is missing hive-thriftserver for scala 2.10
yhuai
committed
[SPARK-16387][SQL] JDBC Writer should use dialect to quote field names.

dongjoon-hyun
authored and
rxin
committed

Commits on Jul 9, 2016

[SPARK-13569][STREAMING][KAFKA] pattern based topic subscription

koeninger
authored and
tdas
committed
[SPARK-16376][WEBUI][SPARK WEB UI][APP-ID] HTTP ERROR 500 when using rest api "/applications//jobs" if array "stageIds" is empty

srowen
authored and
rxin
committed
[SPARK-16432] Empty blocks fail to serialize due to assert in ChunkedByteBuffer

ericl
authored and
rxin
committed
[SPARK-11857][MESOS] Deprecate fine grained

Michael Gummelt
authored and
rxin
committed
[SPARK-16401][SQL] Data Source API: Enable Extending RelationProvider and CreatableRelationProvider without Extending SchemaRelationProvider

gatorsmile
authored and
cloud-fan
committed

Commits on Jul 10, 2016

Commits on Jul 11, 2016