[SPARK-10618] [Mesos] Refactoring scheduling condition and adding test for same#8771

Closed

SleepyThread wants to merge 1144 commits intoapache:masterfrom

SleepyThread:upstream-local

This pull request is big! We're only showing the most recent 250 commits

Commits on Nov 24, 2015

[SPARK-11818][REPL] Fix ExecutorClassLoader to lookup resources from …

HeartSaVioR
authored and
Marcelo Vanzin
committed
[SPARK-11942][SQL] fix encoder life cycle for CoGroup

cloud-fan
authored and
marmbrus
committed
[SPARK-11952][ML] Remove duplicate ml examples

yanboliang
authored and
mengxr
committed
[SPARK-11521][ML][DOC] Document that Logistic, Linear Regression summaries ignore weight col

jkbradley
authored and
mengxr
committed
[SPARK-11847][ML] Model export/import for spark.ml: LDA

hhbyyh
authored and
mengxr
committed
[SPARK-11926][SQL] unify GetStructField and GetInternalRowField

cloud-fan
authored and
marmbrus
committed
[SPARK-11872] Prevent the call to SparkContext#stop() in the listener bus's thread

tedyu
authored and
zsxwing
committed
[SPARK-11946][SQL] Audit pivot API for 1.6.
rxin
committed
[SPARK-11929][CORE] Make the repl log4j configuration override the root logger.

Marcelo Vanzin
authored and
squito
committed
[SPARK-11805] free the array in UnsafeExternalSorter during spilling

Davies Liu
authored and
JoshRosen
committed
Added a line of comment to explain why the extra sort exists in pivot.
rxin
committed
[SPARK-11783][SQL] Fixes execution Hive client when using remote Hive metastore

liancheng
authored and
yhuai
committed
[SPARK-11914][SQL] Support coalesce and repartition in Dataset APIs

gatorsmile
authored and
rxin
committed

Commits on Nov 25, 2015

[SPARK-11967][SQL] Consistent use of varargs for multiple paths in DataFrameReader
rxin
committed
[SPARK-11947][SQL] Mark deprecated methods with "This will be removed in Spark 2.0."
rxin
committed
[STREAMING][FLAKY-TEST] Catch execution context race condition in `FileBasedWriteAheadLog.close()`

brkyvz
authored and
zsxwing
committed
[SPARK-10621][SQL] Consistent naming for functions in SQL, Python, Scala
rxin
committed
[SPARK-11979][STREAMING] Empty TrackStateRDD cannot be checkpointed and recovered from checkpoint file

tdas
authored and
zsxwing
committed
[SPARK-11970][SQL] Adding JoinType into JoinWith and support Sample in Dataset API

gatorsmile
authored and
rxin
committed
[SPARK-11981][SQL] Move implementations of methods back to DataFrame from Queryable
rxin
committed
[SPARK-11686][CORE] Issue WARN when dynamic allocation is disabled due to spark.dynamicAllocation.enabled and spark.executor.instances both set

Ashwin Swaroop
authored and
srowen
committed
[SPARK-11860][PYSAPRK][DOCUMENTATION] Invalid argument specification …

zjffdu
authored and
srowen
committed
[SPARK-10666][SPARK-6880][CORE] Use properties from ActiveJob associated with a Stage

markhamstra
authored and
squito
committed
[SPARK-11956][CORE] Fix a few bugs in network lib-based file transfer.
Marcelo Vanzin
committed
[SPARK-11984][SQL][PYTHON] Fix typos in doc for pivot for scala and python

felixcheung
authored and
rxin
committed
[SPARK-11974][CORE] Not all the temp dirs had been deleted when the JVM exits

pzzs
authored and
rxin
committed
[SPARK-11969] [SQL] [PYSPARK] visualization of SQL query for pyspark

Davies Liu
authored and
davies
committed
[MINOR] Remove unnecessary spaces in `include_example.rb`

yu-iskw
authored and
Andrew Or
committed
[DOCUMENTATION] Fix minor doc error

zjffdu
authored and
Andrew Or
committed
[SPARK-10864][WEB UI] app name is hidden if window is resized

ajbozarth
authored and
Andrew Or
committed
[SPARK-11880][WINDOWS][SPARK SUBMIT] bin/load-spark-env.cmd loads spark-env.cmd from wrong directory

wangt
authored and
Andrew Or
committed
[SPARK-10558][CORE] Fix wrong executor state in Master

jerryshao
authored and
Andrew Or
committed
[SPARK-11935][PYSPARK] Send the Python exceptions in TransformFunction and TransformFunctionSerializer to Java

zsxwing
authored and
tdas
committed
[SPARK-11866][NETWORK][CORE] Make sure timed out RPCs are cleaned up.
Marcelo Vanzin
committed
Fix Aggregator documentation (rename present to finish).
rxin
committed
[SPARK-11983][SQL] remove all unused codegen fallback trait

adrian-wang
authored and
rxin
committed
[SPARK-11206] Support SQL UI on the history server

carsonwang
authored and
Marcelo Vanzin
committed

Commits on Nov 26, 2015

[SPARK-12003] [SQL] remove the prefix for name after expanded star

Davies Liu
authored and
davies
committed
[SPARK-11980][SPARK-10621][SQL] Fix json_tuple and add test cases for

gatorsmile
authored and
rxin
committed
[SPARK-11999][CORE] Fix the issue that ThreadUtils.newDaemonCachedThreadPool doesn't cache any task
zsxwing
committed
[SPARK-11973] [SQL] push filter through aggregation with alias and literals

Davies Liu
authored and
davies
committed
[SPARK-12005][SQL] Work around VerifyError in HyperLogLogPlusPlus.

Marcelo Vanzin
authored and
rxin
committed
[SPARK-11863][SQL] Unable to resolve order by if it contains mixture of aliases and real columns

dilipbiswal
authored and
marmbrus
committed

Commits on Nov 27, 2015

[SPARK-11998][SQL][TEST-HADOOP2.0] When downloading Hadoop artifacts from maven, we need to try to download the version that is used by Spark
yhuai
committed
[SPARK-11973][SQL] Improve optimizer code readability.
rxin
committed
doc typo: "classificaion" -> "classification"

muxator
authored and
rxin
committed
[SPARK-11996][CORE] Make the executor thread dump work again

zsxwing
authored and
rxin
committed
[SPARK-12011][SQL] Stddev/Variance etc should support columnName as arguments

yanboliang
authored and
rxin
committed
[SPARK-11881][SQL] Fix for postgresql fetchsize > 0

mariusvniekerk
authored and
rxin
committed
[SPARK-11917][PYSPARK] Add SQLContext#dropTempTable to PySpark

zjffdu
authored and
rxin
committed
[SPARK-11778][SQL] add regression test

Huaxin Gao
authored and
rxin
committed
[SPARK-11991] fixes

Jeremy Derr
authored and
rxin
committed
Fix style violation for b63938a8b04
rxin
committed
[SPARK-11997] [SQL] NPE when save a DataFrame as parquet and partitioned by long column

dilipbiswal
authored and
davies
committed
[SPARK-12025][SPARKR] Rename some window rank function names for SparkR

yanboliang
authored and
shivaram
committed
[SPARK-12021][STREAMING][TESTS] Fix the potential dead-lock in StreamingListenerSuite
zsxwing
committed
[SPARK-12020][TESTS][TEST-HADOOP2.0] PR builder cannot trigger hadoop 2.0 test
yhuai
committed

Commits on Nov 28, 2015

[SPARK-12028] [SQL] get_json_object returns an incorrect result when the value is null literals

gatorsmile
authored and
davies
committed

Commits on Nov 29, 2015

[SPARK-12029][SPARKR] Improve column functions signature, param check, tests, fix doc and add examples

felixcheung
authored and
shivaram
committed
[SPARK-9319][SPARKR] Add support for setting column names, types

felixcheung
authored and
shivaram
committed
[SPARK-11781][SPARKR] SparkR has problem in inferring type of raw type.

Sun Rui
authored and
shivaram
committed
[SPARK-12024][SQL] More efficient multi-column counting.

hvanhovell
authored and
yhuai
committed

Commits on Nov 30, 2015

[SPARK-12039] [SQL] Ignore HiveSparkSubmitSuite's "SPARK-9757 Persist Parquet relation with decimal column".
yhuai
committed
[SPARK-11859][MESOS] SparkContext accepts invalid Master URLs in the form zk://host:port for a multi-master Mesos cluster using ZooKeeper

toddwan
authored and
srowen
committed
[MINOR][BUILD] Changed the comment to reflect the plugin project is there to support SBT pom reader only.

ScrapCodes
authored and
srowen
committed
[DOC] Explicitly state that top maintains the order of elements

mineo
authored and
srowen
committed
[SPARK-12023][BUILD] Fix warnings while packaging spark with maven.

ScrapCodes
authored and
srowen
committed
[SPARK-11989][SQL] Only use commit in JDBC data source if the underlying database supports transactions

CK50
authored and
rxin
committed
[SPARK-11700] [SQL] Remove thread local SQLContext in SparkPlan

Davies Liu
authored and
davies
committed
[SPARK-11982] [SQL] improve performance of cartesian product

Davies Liu
authored and
davies
committed
[MINOR][DOCS] fixed list display in ml-ensembles

BenFradet
authored and
mengxr
committed
Revert "[SPARK-11206] Support SQL UI on the history server"
JoshRosen
committed
[SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters

chutium
authored and
sarutak
committed
[SPARK-11689][ML] Add user guide and example code for LDA under spark.ml

hhbyyh
authored and
mengxr
committed
[SPARK-11975][ML] Remove duplicate mllib example (DT/RF/GBT in Java/Python)

yanboliang
authored and
mengxr
committed
[SPARK-11960][MLLIB][DOC] User guide for streaming tests

feynmanliang
authored and
mengxr
committed
fix Maven build
davies
committed

Commits on Dec 1, 2015

[SPARK-12058][HOTFIX] Disable KinesisStreamTests
zsxwing
committed
[SPARK-12000] Fix API doc generation issues
JoshRosen
committed
[SPARK-12035] Add more debug information in include_example tag of Jekyll

yinxusen
authored and
Andrew Or
committed
[SPARK-12037][CORE] initialize heartbeatReceiverRef before calling startDriverHeartbeat

CodingCat
authored and
Andrew Or
committed
[SPARK-12007][NETWORK] Avoid copies in the network lib's RPC layer.

Marcelo Vanzin
authored and
Andrew Or
committed
[SPARK-12049][CORE] User JVM shutdown hook can cause deadlock at shutdown

srowen
authored and
Marcelo Vanzin
committed
[HOTFIX][SPARK-12000] Add missing quotes in Jekyll API docs plugin.
JoshRosen
committed
[SPARK-12018][SQL] Refactor common subexpression elimination code

viirya
authored and
marmbrus
committed
[SPARK-11898][MLLIB] Use broadcast for the global tables in Word2Vec

hhbyyh
authored and
srowen
committed
[SPARK-11949][SQL] Set field nullable property for GroupingSets to get correct results for null values

viirya
authored and
yhuai
committed
[SPARK-12060][CORE] Avoid memory copy in JavaSerializerInstance.serialize
zsxwing
committed
[SPARK-12046][DOC] Fixes various ScalaDoc/JavaDoc issues

liancheng
authored and
marmbrus
committed
[SPARK-12068][SQL] use a single column in Dataset.groupBy and count will fail

cloud-fan
authored and
marmbrus
committed
[SPARK-11856][SQL] add type cast if the real type is different but compatible with encoder schema

cloud-fan
authored and
marmbrus
committed
[SPARK-11954][SQL] Encoder for JavaBeans

cloud-fan
authored and
marmbrus
committed
[SPARK-11905][SQL] Support Persist/Cache and Unpersist in Dataset APIs

gatorsmile
authored and
marmbrus
committed
[SPARK-11821] Propagate Kerberos keytab for all environments

woj-i
authored and
Marcelo Vanzin
committed
[SPARK-12065] Upgrade Tachyon from 0.8.1 to 0.8.2
JoshRosen
committed
[SPARK-12030] Fix Platform.copyMemory to handle overlapping regions.

nongli
authored and
yhuai
committed
[SPARK-12004] Preserve the RDD partitioner through RDD checkpointing

tdas
authored and
Andrew Or
committed
Revert "[SPARK-12060][CORE] Avoid memory copy in JavaSerializerInstance.serialize"
zsxwing
committed
[SPARK-11961][DOC] Add docs of ChiSqSelector

yinxusen
authored and
jkbradley
committed
[SPARK-12002][STREAMING][PYSPARK] Fix python direct stream checkpoint recovery issue

jerryshao
authored and
zsxwing
committed
[SPARK-12075][SQL] Speed up HiveComparisionTest by avoiding / speeding up TestHive.reset()

JoshRosen
authored and
rxin
committed
[SPARK-11328][SQL] Improve error message when hitting this issue

nongli
authored and
yhuai
committed
[SPARK-11788][SQL] surround timestamp/date value with quotes in JDBC data source

Huaxin Gao
authored and
yhuai
committed

Commits on Dec 2, 2015

[SPARK-11352][SQL] Escape */ in the generated comments.
yhuai
committed
[SPARK-11596][SQL] In TreeNode's argString, if a TreeNode is not a child of the current TreeNode, we should only return the simpleString.

yhuai
authored and
marmbrus
committed
[SPARK-8414] Ensure context cleaner periodic cleanups

Andrew Or
authored and
JoshRosen
committed
[SPARK-12081] Make unified memory manager work with small heaps
Andrew Or
committed
[SPARK-12077][SQL] change the default plan for single distinct

Davies Liu
authored and
yhuai
committed
[SPARK-12087][STREAMING] Create new JobConf for every batch in saveAsHadoopFiles

tdas
authored and
zsxwing
committed
[SPARK-11949][SQL] Check bitmasks to set nullable property

viirya
authored and
yhuai
committed
[SPARK-12090] [PYSPARK] consider shuffle in coalesce()

Davies Liu
authored and
davies
committed
[SPARK-3580][CORE] Add Consistent Method To Get Number of RDD Partitions Across Different Languages

Jeroen Schot
authored and
srowen
committed
[SPARK-12094][SQL] Prettier tree string for TreeNode

liancheng
authored and
yhuai
committed
[SPARK-12001] Allow partially-stopped StreamingContext to be completely stopped
JoshRosen
committed
[SPARK-10266][DOCUMENTATION, ML] Fixed @Since annotation for ml.tunning

yu-iskw
authored and
mengxr
committed

Commits on Dec 3, 2015

[SPARK-12093][SQL] Fix the error of comment in DDLParser

watermen
authored and
rxin
committed
[SPARK-12000] do not specify arg types when reference a method in ScalaDoc
mengxr
committed
[SPARK-12082][FLAKY-TEST] Increase timeouts in NettyBlockTransferSecuritySuite

JoshRosen
authored and
rxin
committed
[SPARK-12109][SQL] Expressions's simpleString should delegate to its toString.

yhuai
authored and
rxin
committed
[SPARK-12088][SQL] check connection.isClosed before calling connection…

Huaxin Gao
authored and
srowen
committed
[DOCUMENTATION][MLLIB] typo in mllib doc

zjffdu
authored and
srowen
committed
[DOCUMENTATION][KAFKA] fix typo in kafka/OffsetRange.scala

microwishing
authored and
srowen
committed
[SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts with dplyr

felixcheung
authored and
shivaram
committed
[SPARK-11314][YARN] add service API and test service for Yarn Cluster schedulers

steveloughran
authored and
Marcelo Vanzin
committed
[SPARK-12059][CORE] Avoid assertion error when unexpected state transition met in Master

jerryshao
authored and
Andrew Or
committed
[SPARK-12101][CORE] Fix thread pools that cannot cache tasks in Worker and AppClient
zsxwing
committed
[SPARK-12108] Make event logs smaller
Andrew Or
committed
[MINOR][ML] Use coefficients replace weights

yanboliang
authored and
mengxr
committed
[SPARK-12107][EC2] Update spark-ec2 versions

nchammas
authored and
shivaram
committed
[FLAKY-TEST-FIX][STREAMING][TEST] Make sure StreamingContexts are shutdown after test
tdas
committed
[SPARK-12019][SPARKR] Support character vector for sparkR.init(), check param and fix doc

felixcheung
authored and
shivaram
committed

Commits on Dec 4, 2015

[SPARK-12056][CORE] Create a TaskAttemptContext only after calling setConf.

Anderson de Andrade
authored and
Marcelo Vanzin
committed
[SPARK-11206] Support SQL UI on the history server (resubmit)

carsonwang
authored and
Marcelo Vanzin
committed
[SPARK-12104][SPARKR] collect() does not handle multiple columns with same name.

Sun Rui
authored and
shivaram
committed
[SPARK-12122][STREAMING] Prevent batches from being submitted twice after recovering StreamingContext from checkpoint
tdas
committed
Add links howto to setup IDEs for developing spark

kaklakariada
authored and
srowen
committed
[SPARK-12089] [SQL] Fix memory corrupt due to freeing a page being referenced

Nong
authored and
davies
committed
[SPARK-6990][BUILD] Add Java linting script; fix minor warnings

dskrvk
authored and
JoshRosen
committed
[SPARK-12058][STREAMING][KINESIS][TESTS] fix Kinesis python tests

brkyvz
authored and
tdas
committed
[SPARK-11314][BUILD][HOTFIX] Add exclusion for moved YARN classes.

Marcelo Vanzin
authored and
JoshRosen
committed

Commits on Dec 5, 2015

[SPARK-12112][BUILD] Upgrade to SBT 0.13.9

JoshRosen
authored and
rxin
committed
[SPARK-12142][CORE]Reply false when container allocator is not ready and reset target

XuTingjun
authored and
Marcelo Vanzin
committed
[SPARK-12080][CORE] Kryo - Support multiple user registrators

rotems
authored and
Marcelo Vanzin
committed
[SPARK-12084][CORE] Fix codes that uses ByteBuffer.array incorrectly

zsxwing
authored and
Marcelo Vanzin
committed
[SPARK-12096][MLLIB] remove the old constraint in word2vec

hhbyyh
authored and
srowen
committed
[SPARK-11994][MLLIB] Word2VecModel load and save cause SparkException when model is bigger than spark.kryoserializer.buffer.max

tmnd1991
authored and
srowen
committed
[SPARK-11988][ML][MLLIB] Update JPMML to 1.2.7
srowen
committed
[SPARK-11774][SPARKR] Implement struct(), encode(), decode() functions in SparkR.

Sun Rui
authored and
shivaram
committed

Commits on Dec 6, 2015

Commits on Dec 7, 2015

[SPARK-12152][PROJECT-INFRA] Speed up Scalastyle checks by only invoking SBT once
JoshRosen
committed
[SPARK-12106][STREAMING][FLAKY-TEST] BatchedWAL test transiently flaky when Jenkins load is high

brkyvz
authored and
tdas
committed
[SPARK-12032] [SQL] Re-order inner joins to do join with conditions first

Davies Liu
authored and
davies
committed
[SPARK-12034][SPARKR] Eliminate warnings in SparkR test cases.

Sun Rui
authored and
shivaram
committed
[SPARK-12132] [PYSPARK] raise KeyboardInterrupt inside SIGINT handler

Davies Liu
authored and
davies
committed
[SPARK-11932][STREAMING] Partition previous TrackStateRDD if partitioner not present
tdas
committed
[SPARK-12060][CORE] Avoid memory copy in JavaSerializerInstance.serialize
zsxwing
committed
[SPARK-11963][DOC] Add docs for QuantileDiscretizer

yinxusen
authored and
jkbradley
committed
[SPARK-11884] Drop multiple columns in the DataFrame API

tedyu
authored and
marmbrus
committed
[SPARK-12184][PYTHON] Make python api doc for pivot consistant with scala doc

aray
authored and
yhuai
committed

Commits on Dec 8, 2015

[SPARK-12160][MLLIB] Use SQLContext.getOrCreate in MLlib

jkbradley
authored and
mengxr
committed
[SPARK-11551][DOC][EXAMPLE] Replace example code in ml-features.md using include_example

somideshmukh
authored and
mengxr
committed
Closes #10098
mengxr
committed
[SPARK-10259][ML] Add @since annotation to ml.classification

Takahashi Hiroshi
authored and
mengxr
committed
[SPARK-11958][SPARK-11957][ML][DOC] SQLTransformer user guide and example code

yanboliang
authored and
mengxr
committed
[SPARK-12103][STREAMING][KAFKA][DOC] document that K means Key and V …

koeninger
authored and
srowen
committed
[SPARK-12166][TEST] Unset hadoop related environment in testing

zjffdu
authored and
srowen
committed
[SPARK-11439][ML] Optimization of creating sparse feature without dense one

Nakul Jindal
authored and
srowen
committed
[SPARK-11551][DOC][EXAMPLE] Revert PR #10002
liancheng
committed
[SPARK-11652][CORE] Remote code execution with InvokerTransformer
srowen
committed
[SPARK-11155][WEB UI] Stage summary json should include stage duration

keypointt
authored and
squito
committed
[SPARK-12074] Avoid memory copy involving ByteBuffer.wrap(ByteArrayOutputStream.toByteArray)

tedyu
authored and
zsxwing
committed
[SPARK-12201][SQL] add type coercion rule for greatest/least

cloud-fan
authored and
marmbrus
committed
[SPARK-12195][SQL] Adding BigDecimal, Date and Timestamp into Encoder

gatorsmile
authored and
marmbrus
committed
[SPARK-12188][SQL] Code refactoring and comment correction in Dataset APIs

gatorsmile
authored and
marmbrus
committed
[SPARK-10393] use ML pipeline in LDA example

hhbyyh
authored and
jkbradley
committed
[SPARK-12205][SQL] Pivot fails Analysis when aggregate is UnresolvedFunction

aray
authored and
yhuai
committed
[SPARK-11605][MLLIB] ML 1.6 QA: API: Java compatibility, docs

hhbyyh
authored and
jkbradley
committed
[SPARK-12159][ML] Add user guide section for IndexToString transformer

BenFradet
authored and
jkbradley
committed
[SPARK-3873][BUILD] Add style checker to enforce import ordering.
Marcelo Vanzin
committed
[SPARK-12187] *MemoryPool classes should not be fully public

Andrew Or
authored and
JoshRosen
committed
[SPARK-12069][SQL] Update documentation with Datasets
marmbrus
committed

Commits on Dec 9, 2015

[SPARK-8517][ML][DOC] Reorganizes the spark.ml user guide

thunterdb
authored and
jkbradley
committed
[SPARK-11343][ML] Documentation of float and double prediction/label columns in RegressionEvaluator

dahlem
authored and
jkbradley
committed
[SPARK-12222] [CORE] Deserialize RoaringBitmap using Kryo serializer throw Buffer underflow exception

scwf
authored and
davies
committed
[SPARK-11676][SQL] Parquet filter tests all pass if filters are not really pushed down

HyukjinKwon
authored and
liancheng
committed
[SPARK-12031][CORE][BUG] Integer overflow when do sampling

uncleGen
authored and
srowen
committed
[SPARK-12012][SQL] Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan

liancheng
authored and
rxin
committed
[SPARK-10299][ML] word2vec should allow users to specify the window size

holdenk
authored and
srowen
committed
[SPARK-10582][YARN][CORE] Fix AM failure situation for dynamic allocation

jerryshao
authored and
Marcelo Vanzin
committed
[SPARK-12241][YARN] Improve failure reporting in Yarn client obtainTokenForHBase()

steveloughran
authored and
Marcelo Vanzin
committed
[SPARK-12165][SPARK-12189] Fix bugs in eviction of storage memory by execution

JoshRosen
authored and
Andrew Or
committed
[SPARK-11824][WEBUI] WebUI does not render descriptions with 'bad' HTML, throws console error
srowen
committed
[SPARK-11551][DOC] Replace example code in ml-features.md using include_example

yinxusen
authored and
mengxr
committed

Commits on Dec 10, 2015

[SPARK-12211][DOC][GRAPHX] Fix version number in graphx doc for migration from 1.1

aray
authored and
jkbradley
committed
[SPARK-12165][ADDENDUM] Fix outdated comments on unroll test

Andrew Or
authored and
JoshRosen
committed
[SPARK-11678][SQL][DOCS] Document basePath in the programming guide.
yhuai
committed
[SPARK-11796] Fix httpclient and httpcore depedency issues related to docker-client

Mark Grover
authored and
JoshRosen
committed
[SPARK-12244][SPARK-12245][STREAMING] Rename trackStateByKey to mapWithState and change tracking function signature

tdas
authored and
zsxwing
committed
[SPARK-12252][SPARK-12131][SQL] refactor MapObjects to make it less hacky

cloud-fan
authored and
liancheng
committed
[SPARK-12136][STREAMING] rddToFileName does not properly handle prefix and suffix parameters

bomeng
authored and
srowen
committed
[SPARK-11530][MLLIB] Return eigenvalues with PCA model
srowen
committed
[SPARK-12242][SQL] Add DataFrame.transform method
rxin
committed
[SPARK-11832][CORE] Process arguments in spark-shell for Scala 2.11

jodersky
authored and
Marcelo Vanzin
committed
[SPARK-12198][SPARKR] SparkR support read.parquet and deprecate parquetFile

yanboliang
authored and
shivaram
committed
[SPARK-11602][MLLIB] Refine visibility for 1.6 scala API audit

hhbyyh
authored and
jkbradley
committed
[SPARK-12234][SPARKR] Fix ```subset``` function error when only set ```select``` argument

yanboliang
authored and
shivaram
committed
[SPARK-12250][SQL] Allow users to define a UDAF without providing details of its inputSchema
yhuai
committed
[SPARK-12228][SQL] Try to run execution hive's derby in memory.
yhuai
committed
[SPARK-12212][ML][DOC] Clarifies the difference between spark.ml, spark.mllib and mllib in the documentation.

thunterdb
authored and
jkbradley
committed
[SPARK-11563][CORE][REPL] Use RpcEnv to transfer REPL-generated classes.
Marcelo Vanzin
committed
[SPARK-11713] [PYSPARK] [STREAMING] Initial RDD updateStateByKey for PySpark

BryanCutler
authored and
davies
committed
[SPARK-12251] Document and improve off-heap memory configurations

JoshRosen
authored and
Andrew Or
committed
[SPARK-12155][SPARK-12253] Fix executor OOM in unified memory management
Andrew Or
committed
[STREAMING][DOC][MINOR] Update the description of direct Kafka stream doc

jerryshao
authored and
zsxwing
committed

Commits on Dec 11, 2015

[SPARK-12258][SQL] passing null into ScalaUDF

Davies Liu
authored and
yhuai
committed
[SPARK-10991][ML] logistic regression training summary handle empty prediction col

holdenk
authored and
DB Tsai
committed
[SPARK-12258] [SQL] passing null into ScalaUDF (follow-up)

Davies Liu
authored and
davies
committed
[SPARK-12146][SPARKR] SparkR jsonFile should support multiple input files

yanboliang
authored and
shivaram
committed
[SPARK-11964][DOCS][ML] Add in Pipeline Import/Export Documentation

bllchmbrs
authored and
jkbradley
committed
[SPARK-12273][STREAMING] Make Spark Streaming web UI list Receivers in order

lw-lin
authored and
zsxwing
committed
[SPARK-11497][MLLIB][PYTHON] PySpark RowMatrix Constructor Has Type Erasure Issue

dusenberrymw
authored and
jkbradley
committed
[SPARK-12217][ML] Document invalid handling for StringIndexer

BenFradet
authored and
jkbradley
committed

Commits on Dec 12, 2015

Commits on Dec 13, 2015

Commits on Dec 14, 2015

Commits on Dec 15, 2015

[SPARK-12327] Disable commented code lintr temporarily
shivaram
committed
[SPARK-12274][SQL] WrapOption should not have type constraint for child

cloud-fan
authored and
marmbrus
committed
[SPARK-12188][SQL][FOLLOW-UP] Code refactoring and comment correction in Dataset APIs

gatorsmile
authored and
marmbrus
committed
[SPARK-12288] [SQL] Support UnsafeRow in Coalesce/Except/Intersect.

gatorsmile
authored and
davies
committed
[SPARK-12332][TRIVIAL][TEST] Fix minor typo in ResetSystemProperties

holdenk
authored and
srowen
committed
[STREAMING][MINOR] Fix typo in function name of StateImpl

jerryshao
authored and
zsxwing
committed
[SPARK-10618] [Mesos] Adressing comments on PR.
SleepyThread
committed