[SPARK-10618] [Mesos] Refactoring scheduling condition and adding test for same#10326

Closed

SleepyThread wants to merge 1172 commits intoapache:masterfrom

SleepyThread:scheduling-refactor

This pull request is big! We're only showing the most recent 250 commits

Commits on Feb 23, 2016

[SPARK-11860][PYSAPRK][DOCUMENTATION] Invalid argument specification …

zjffdu
authored and
SleepyThread
committed
[SPARK-10666][SPARK-6880][CORE] Use properties from ActiveJob associated with a Stage

markhamstra
authored and
SleepyThread
committed
[SPARK-11956][CORE] Fix a few bugs in network lib-based file transfer.

Marcelo Vanzin
authored and
SleepyThread
committed
[SPARK-11984][SQL][PYTHON] Fix typos in doc for pivot for scala and python

felixcheung
authored and
SleepyThread
committed
[SPARK-11974][CORE] Not all the temp dirs had been deleted when the JVM exits

pzzs
authored and
SleepyThread
committed
[SPARK-11969] [SQL] [PYSPARK] visualization of SQL query for pyspark

Davies Liu
authored and
SleepyThread
committed
[MINOR] Remove unnecessary spaces in `include_example.rb`

yu-iskw
authored and
SleepyThread
committed
[DOCUMENTATION] Fix minor doc error

zjffdu
authored and
SleepyThread
committed
[SPARK-10864][WEB UI] app name is hidden if window is resized

ajbozarth
authored and
SleepyThread
committed
[SPARK-11880][WINDOWS][SPARK SUBMIT] bin/load-spark-env.cmd loads spark-env.cmd from wrong directory

wangt
authored and
SleepyThread
committed
[SPARK-10558][CORE] Fix wrong executor state in Master

jerryshao
authored and
SleepyThread
committed
[SPARK-11935][PYSPARK] Send the Python exceptions in TransformFunction and TransformFunctionSerializer to Java

zsxwing
authored and
SleepyThread
committed
[SPARK-11866][NETWORK][CORE] Make sure timed out RPCs are cleaned up.

Marcelo Vanzin
authored and
SleepyThread
committed
Fix Aggregator documentation (rename present to finish).

rxin
authored and
SleepyThread
committed
[SPARK-11983][SQL] remove all unused codegen fallback trait

adrian-wang
authored and
SleepyThread
committed
[SPARK-11206] Support SQL UI on the history server

carsonwang
authored and
SleepyThread
committed
[SPARK-12003] [SQL] remove the prefix for name after expanded star

Davies Liu
authored and
SleepyThread
committed
[SPARK-11980][SPARK-10621][SQL] Fix json_tuple and add test cases for

gatorsmile
authored and
SleepyThread
committed
[SPARK-11999][CORE] Fix the issue that ThreadUtils.newDaemonCachedThreadPool doesn't cache any task

zsxwing
authored and
SleepyThread
committed
[SPARK-11973] [SQL] push filter through aggregation with alias and literals

Davies Liu
authored and
SleepyThread
committed
[SPARK-12005][SQL] Work around VerifyError in HyperLogLogPlusPlus.

Marcelo Vanzin
authored and
SleepyThread
committed
[SPARK-11863][SQL] Unable to resolve order by if it contains mixture of aliases and real columns

dilipbiswal
authored and
SleepyThread
committed
[SPARK-11998][SQL][TEST-HADOOP2.0] When downloading Hadoop artifacts from maven, we need to try to download the version that is used by Spark

yhuai
authored and
SleepyThread
committed
[SPARK-11973][SQL] Improve optimizer code readability.

rxin
authored and
SleepyThread
committed
doc typo: "classificaion" -> "classification"

muxator
authored and
SleepyThread
committed
[SPARK-11996][CORE] Make the executor thread dump work again

zsxwing
authored and
SleepyThread
committed
[SPARK-12011][SQL] Stddev/Variance etc should support columnName as arguments

yanboliang
authored and
SleepyThread
committed
[SPARK-11881][SQL] Fix for postgresql fetchsize > 0

mariusvniekerk
authored and
SleepyThread
committed
[SPARK-11917][PYSPARK] Add SQLContext#dropTempTable to PySpark

zjffdu
authored and
SleepyThread
committed
[SPARK-11778][SQL] add regression test

Huaxin Gao
authored and
SleepyThread
committed
[SPARK-11991] fixes

Jeremy Derr
authored and
SleepyThread
committed
Fix style violation for b63938a8b04

rxin
authored and
SleepyThread
committed
[SPARK-11997] [SQL] NPE when save a DataFrame as parquet and partitioned by long column

dilipbiswal
authored and
SleepyThread
committed
[SPARK-12025][SPARKR] Rename some window rank function names for SparkR

yanboliang
authored and
SleepyThread
committed
[SPARK-12021][STREAMING][TESTS] Fix the potential dead-lock in StreamingListenerSuite

zsxwing
authored and
SleepyThread
committed
[SPARK-12020][TESTS][TEST-HADOOP2.0] PR builder cannot trigger hadoop 2.0 test

yhuai
authored and
SleepyThread
committed
[SPARK-12028] [SQL] get_json_object returns an incorrect result when the value is null literals

gatorsmile
authored and
SleepyThread
committed
[SPARK-12029][SPARKR] Improve column functions signature, param check, tests, fix doc and add examples

felixcheung
authored and
SleepyThread
committed
[SPARK-9319][SPARKR] Add support for setting column names, types

felixcheung
authored and
SleepyThread
committed
[SPARK-11781][SPARKR] SparkR has problem in inferring type of raw type.

Sun Rui
authored and
SleepyThread
committed
[SPARK-12024][SQL] More efficient multi-column counting.

hvanhovell
authored and
SleepyThread
committed
[SPARK-12039] [SQL] Ignore HiveSparkSubmitSuite's "SPARK-9757 Persist Parquet relation with decimal column".

yhuai
authored and
SleepyThread
committed
[SPARK-11859][MESOS] SparkContext accepts invalid Master URLs in the form zk://host:port for a multi-master Mesos cluster using ZooKeeper

toddwan
authored and
SleepyThread
committed
[MINOR][BUILD] Changed the comment to reflect the plugin project is there to support SBT pom reader only.

ScrapCodes
authored and
SleepyThread
committed
[DOC] Explicitly state that top maintains the order of elements

mineo
authored and
SleepyThread
committed
[SPARK-12023][BUILD] Fix warnings while packaging spark with maven.

ScrapCodes
authored and
SleepyThread
committed
[SPARK-11989][SQL] Only use commit in JDBC data source if the underlying database supports transactions

CK50
authored and
SleepyThread
committed
[SPARK-11700] [SQL] Remove thread local SQLContext in SparkPlan

Davies Liu
authored and
SleepyThread
committed
[SPARK-11982] [SQL] improve performance of cartesian product

Davies Liu
authored and
SleepyThread
committed
[MINOR][DOCS] fixed list display in ml-ensembles

BenFradet
authored and
SleepyThread
committed
Revert "[SPARK-11206] Support SQL UI on the history server"

JoshRosen
authored and
SleepyThread
committed
[SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters

chutium
authored and
SleepyThread
committed
[SPARK-11689][ML] Add user guide and example code for LDA under spark.ml

hhbyyh
authored and
SleepyThread
committed
[SPARK-11975][ML] Remove duplicate mllib example (DT/RF/GBT in Java/Python)

yanboliang
authored and
SleepyThread
committed
[SPARK-11960][MLLIB][DOC] User guide for streaming tests

feynmanliang
authored and
SleepyThread
committed
fix Maven build

davies
authored and
SleepyThread
committed
[SPARK-12058][HOTFIX] Disable KinesisStreamTests

zsxwing
authored and
SleepyThread
committed
[SPARK-12000] Fix API doc generation issues

JoshRosen
authored and
SleepyThread
committed
[SPARK-12035] Add more debug information in include_example tag of Jekyll

yinxusen
authored and
SleepyThread
committed
[SPARK-12037][CORE] initialize heartbeatReceiverRef before calling startDriverHeartbeat

CodingCat
authored and
SleepyThread
committed
[SPARK-12007][NETWORK] Avoid copies in the network lib's RPC layer.

Marcelo Vanzin
authored and
SleepyThread
committed
[SPARK-12049][CORE] User JVM shutdown hook can cause deadlock at shutdown

srowen
authored and
SleepyThread
committed
[HOTFIX][SPARK-12000] Add missing quotes in Jekyll API docs plugin.

JoshRosen
authored and
SleepyThread
committed
[SPARK-12018][SQL] Refactor common subexpression elimination code

viirya
authored and
SleepyThread
committed
[SPARK-11898][MLLIB] Use broadcast for the global tables in Word2Vec

hhbyyh
authored and
SleepyThread
committed
[SPARK-11949][SQL] Set field nullable property for GroupingSets to get correct results for null values

viirya
authored and
SleepyThread
committed
[SPARK-12060][CORE] Avoid memory copy in JavaSerializerInstance.serialize

zsxwing
authored and
SleepyThread
committed
[SPARK-12046][DOC] Fixes various ScalaDoc/JavaDoc issues

liancheng
authored and
SleepyThread
committed
[SPARK-12068][SQL] use a single column in Dataset.groupBy and count will fail

cloud-fan
authored and
SleepyThread
committed
[SPARK-11856][SQL] add type cast if the real type is different but compatible with encoder schema

cloud-fan
authored and
SleepyThread
committed
[SPARK-11954][SQL] Encoder for JavaBeans

cloud-fan
authored and
SleepyThread
committed
[SPARK-11905][SQL] Support Persist/Cache and Unpersist in Dataset APIs

gatorsmile
authored and
SleepyThread
committed
[SPARK-11821] Propagate Kerberos keytab for all environments

woj-i
authored and
SleepyThread
committed
[SPARK-12065] Upgrade Tachyon from 0.8.1 to 0.8.2

JoshRosen
authored and
SleepyThread
committed
[SPARK-12030] Fix Platform.copyMemory to handle overlapping regions.

nongli
authored and
SleepyThread
committed
[SPARK-12004] Preserve the RDD partitioner through RDD checkpointing

tdas
authored and
SleepyThread
committed
Revert "[SPARK-12060][CORE] Avoid memory copy in JavaSerializerInstance.serialize"

zsxwing
authored and
SleepyThread
committed
[SPARK-11961][DOC] Add docs of ChiSqSelector

yinxusen
authored and
SleepyThread
committed
[SPARK-12002][STREAMING][PYSPARK] Fix python direct stream checkpoint recovery issue

jerryshao
authored and
SleepyThread
committed
[SPARK-12075][SQL] Speed up HiveComparisionTest by avoiding / speeding up TestHive.reset()

JoshRosen
authored and
SleepyThread
committed
[SPARK-11328][SQL] Improve error message when hitting this issue

nongli
authored and
SleepyThread
committed
[SPARK-11788][SQL] surround timestamp/date value with quotes in JDBC data source

Huaxin Gao
authored and
SleepyThread
committed
[SPARK-11352][SQL] Escape */ in the generated comments.

yhuai
authored and
SleepyThread
committed
[SPARK-11596][SQL] In TreeNode's argString, if a TreeNode is not a child of the current TreeNode, we should only return the simpleString.

yhuai
authored and
SleepyThread
committed
[SPARK-8414] Ensure context cleaner periodic cleanups

Andrew Or
authored and
SleepyThread
committed
[SPARK-12081] Make unified memory manager work with small heaps

Andrew Or
authored and
SleepyThread
committed
[SPARK-12077][SQL] change the default plan for single distinct

Davies Liu
authored and
SleepyThread
committed
[SPARK-12087][STREAMING] Create new JobConf for every batch in saveAsHadoopFiles

tdas
authored and
SleepyThread
committed
[SPARK-11949][SQL] Check bitmasks to set nullable property

viirya
authored and
SleepyThread
committed
[SPARK-12090] [PYSPARK] consider shuffle in coalesce()

Davies Liu
authored and
SleepyThread
committed
[SPARK-3580][CORE] Add Consistent Method To Get Number of RDD Partitions Across Different Languages

Jeroen Schot
authored and
SleepyThread
committed
[SPARK-12094][SQL] Prettier tree string for TreeNode

liancheng
authored and
SleepyThread
committed
[SPARK-12001] Allow partially-stopped StreamingContext to be completely stopped

JoshRosen
authored and
SleepyThread
committed
[SPARK-10266][DOCUMENTATION, ML] Fixed @Since annotation for ml.tunning

yu-iskw
authored and
SleepyThread
committed
[SPARK-12093][SQL] Fix the error of comment in DDLParser

watermen
authored and
SleepyThread
committed
[SPARK-12000] do not specify arg types when reference a method in ScalaDoc

mengxr
authored and
SleepyThread
committed
[SPARK-12082][FLAKY-TEST] Increase timeouts in NettyBlockTransferSecuritySuite

JoshRosen
authored and
SleepyThread
committed
[SPARK-12109][SQL] Expressions's simpleString should delegate to its toString.

yhuai
authored and
SleepyThread
committed
[SPARK-12088][SQL] check connection.isClosed before calling connection…

Huaxin Gao
authored and
SleepyThread
committed
[DOCUMENTATION][MLLIB] typo in mllib doc

zjffdu
authored and
SleepyThread
committed
[DOCUMENTATION][KAFKA] fix typo in kafka/OffsetRange.scala

microwishing
authored and
SleepyThread
committed
[SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts with dplyr

felixcheung
authored and
SleepyThread
committed
[SPARK-11314][YARN] add service API and test service for Yarn Cluster schedulers

steveloughran
authored and
SleepyThread
committed
[SPARK-12059][CORE] Avoid assertion error when unexpected state transition met in Master

jerryshao
authored and
SleepyThread
committed
[SPARK-12101][CORE] Fix thread pools that cannot cache tasks in Worker and AppClient

zsxwing
authored and
SleepyThread
committed
[SPARK-12108] Make event logs smaller

Andrew Or
authored and
SleepyThread
committed
[MINOR][ML] Use coefficients replace weights

yanboliang
authored and
SleepyThread
committed
[SPARK-12107][EC2] Update spark-ec2 versions

nchammas
authored and
SleepyThread
committed
[FLAKY-TEST-FIX][STREAMING][TEST] Make sure StreamingContexts are shutdown after test

tdas
authored and
SleepyThread
committed
[SPARK-12019][SPARKR] Support character vector for sparkR.init(), check param and fix doc

felixcheung
authored and
SleepyThread
committed
[SPARK-12056][CORE] Create a TaskAttemptContext only after calling setConf.

Anderson de Andrade
authored and
SleepyThread
committed
[SPARK-11206] Support SQL UI on the history server (resubmit)

carsonwang
authored and
SleepyThread
committed
[SPARK-12104][SPARKR] collect() does not handle multiple columns with same name.

Sun Rui
authored and
SleepyThread
committed
[SPARK-12122][STREAMING] Prevent batches from being submitted twice after recovering StreamingContext from checkpoint

tdas
authored and
SleepyThread
committed
Add links howto to setup IDEs for developing spark

kaklakariada
authored and
SleepyThread
committed
[SPARK-12089] [SQL] Fix memory corrupt due to freeing a page being referenced

Nong
authored and
SleepyThread
committed
[SPARK-6990][BUILD] Add Java linting script; fix minor warnings

dskrvk
authored and
SleepyThread
committed
[SPARK-12058][STREAMING][KINESIS][TESTS] fix Kinesis python tests

brkyvz
authored and
SleepyThread
committed
[SPARK-11314][BUILD][HOTFIX] Add exclusion for moved YARN classes.

Marcelo Vanzin
authored and
SleepyThread
committed
[SPARK-12112][BUILD] Upgrade to SBT 0.13.9

JoshRosen
authored and
SleepyThread
committed
[SPARK-12142][CORE]Reply false when container allocator is not ready and reset target

XuTingjun
authored and
SleepyThread
committed
[SPARK-12080][CORE] Kryo - Support multiple user registrators

rotems
authored and
SleepyThread
committed
[SPARK-12084][CORE] Fix codes that uses ByteBuffer.array incorrectly

zsxwing
authored and
SleepyThread
committed
[SPARK-12096][MLLIB] remove the old constraint in word2vec

hhbyyh
authored and
SleepyThread
committed
[SPARK-11994][MLLIB] Word2VecModel load and save cause SparkException when model is bigger than spark.kryoserializer.buffer.max

tmnd1991
authored and
SleepyThread
committed
[SPARK-11988][ML][MLLIB] Update JPMML to 1.2.7

srowen
authored and
SleepyThread
committed
[SPARK-11774][SPARKR] Implement struct(), encode(), decode() functions in SparkR.

Sun Rui
authored and
SleepyThread
committed
[SPARK-11715][SPARKR] Add R support corr for Column Aggregration

felixcheung
authored and
SleepyThread
committed
[SPARK-12115][SPARKR] Change numPartitions() to getNumPartitions() to be consistent with Scala/Python

yanboliang
authored and
SleepyThread
committed
[SPARK-12044][SPARKR] Fix usage of isnan, isNaN

yanboliang
authored and
SleepyThread
committed
[SPARK-12048][SQL] Prevent to close JDBC resources twice

gcc
authored and
SleepyThread
committed
[SPARK-12138][SQL] Escape \u in the generated comments of codegen

gatorsmile
authored and
SleepyThread
committed
[SPARK-12152][PROJECT-INFRA] Speed up Scalastyle checks by only invoking SBT once

JoshRosen
authored and
SleepyThread
committed
[SPARK-12106][STREAMING][FLAKY-TEST] BatchedWAL test transiently flaky when Jenkins load is high

brkyvz
authored and
SleepyThread
committed
[SPARK-12032] [SQL] Re-order inner joins to do join with conditions first

Davies Liu
authored and
SleepyThread
committed
[SPARK-12034][SPARKR] Eliminate warnings in SparkR test cases.

Sun Rui
authored and
SleepyThread
committed
[SPARK-12132] [PYSPARK] raise KeyboardInterrupt inside SIGINT handler

Davies Liu
authored and
SleepyThread
committed
[SPARK-11932][STREAMING] Partition previous TrackStateRDD if partitioner not present

tdas
authored and
SleepyThread
committed
[SPARK-12060][CORE] Avoid memory copy in JavaSerializerInstance.serialize

zsxwing
authored and
SleepyThread
committed
[SPARK-11963][DOC] Add docs for QuantileDiscretizer

yinxusen
authored and
SleepyThread
committed
[SPARK-11884] Drop multiple columns in the DataFrame API

tedyu
authored and
SleepyThread
committed
[SPARK-12184][PYTHON] Make python api doc for pivot consistant with scala doc

aray
authored and
SleepyThread
committed
[SPARK-12160][MLLIB] Use SQLContext.getOrCreate in MLlib

jkbradley
authored and
SleepyThread
committed
[SPARK-11551][DOC][EXAMPLE] Replace example code in ml-features.md using include_example

somideshmukh
authored and
SleepyThread
committed
[SPARK-10259][ML] Add @since annotation to ml.classification

Takahashi Hiroshi
authored and
SleepyThread
committed
[SPARK-11958][SPARK-11957][ML][DOC] SQLTransformer user guide and example code

yanboliang
authored and
SleepyThread
committed
[SPARK-12103][STREAMING][KAFKA][DOC] document that K means Key and V …

koeninger
authored and
SleepyThread
committed
[SPARK-12166][TEST] Unset hadoop related environment in testing

zjffdu
authored and
SleepyThread
committed
[SPARK-11439][ML] Optimization of creating sparse feature without dense one

Nakul Jindal
authored and
SleepyThread
committed
[SPARK-11551][DOC][EXAMPLE] Revert PR #10002

liancheng
authored and
SleepyThread
committed
[SPARK-11652][CORE] Remote code execution with InvokerTransformer

srowen
authored and
SleepyThread
committed
[SPARK-11155][WEB UI] Stage summary json should include stage duration

keypointt
authored and
SleepyThread
committed
[SPARK-12074] Avoid memory copy involving ByteBuffer.wrap(ByteArrayOutputStream.toByteArray)

tedyu
authored and
SleepyThread
committed
[SPARK-12201][SQL] add type coercion rule for greatest/least

cloud-fan
authored and
SleepyThread
committed
[SPARK-12195][SQL] Adding BigDecimal, Date and Timestamp into Encoder

gatorsmile
authored and
SleepyThread
committed
[SPARK-12188][SQL] Code refactoring and comment correction in Dataset APIs

gatorsmile
authored and
SleepyThread
committed
[SPARK-10393] use ML pipeline in LDA example

hhbyyh
authored and
SleepyThread
committed
[SPARK-12205][SQL] Pivot fails Analysis when aggregate is UnresolvedFunction

aray
authored and
SleepyThread
committed
[SPARK-11605][MLLIB] ML 1.6 QA: API: Java compatibility, docs

hhbyyh
authored and
SleepyThread
committed
[SPARK-12159][ML] Add user guide section for IndexToString transformer

BenFradet
authored and
SleepyThread
committed
[SPARK-3873][BUILD] Add style checker to enforce import ordering.

Marcelo Vanzin
authored and
SleepyThread
committed
[SPARK-12187] *MemoryPool classes should not be fully public

Andrew Or
authored and
SleepyThread
committed
[SPARK-12069][SQL] Update documentation with Datasets

marmbrus
authored and
SleepyThread
committed
[SPARK-8517][ML][DOC] Reorganizes the spark.ml user guide

thunterdb
authored and
SleepyThread
committed
[SPARK-11343][ML] Documentation of float and double prediction/label columns in RegressionEvaluator

dahlem
authored and
SleepyThread
committed
[SPARK-12222] [CORE] Deserialize RoaringBitmap using Kryo serializer throw Buffer underflow exception

scwf
authored and
SleepyThread
committed
[SPARK-11676][SQL] Parquet filter tests all pass if filters are not really pushed down

HyukjinKwon
authored and
SleepyThread
committed
[SPARK-12031][CORE][BUG] Integer overflow when do sampling

uncleGen
authored and
SleepyThread
committed
[SPARK-12012][SQL] Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan

liancheng
authored and
SleepyThread
committed
[SPARK-10299][ML] word2vec should allow users to specify the window size

holdenk
authored and
SleepyThread
committed
[SPARK-10582][YARN][CORE] Fix AM failure situation for dynamic allocation

jerryshao
authored and
SleepyThread
committed
[SPARK-12241][YARN] Improve failure reporting in Yarn client obtainTokenForHBase()

steveloughran
authored and
SleepyThread
committed
[SPARK-12165][SPARK-12189] Fix bugs in eviction of storage memory by execution

JoshRosen
authored and
SleepyThread
committed
[SPARK-11824][WEBUI] WebUI does not render descriptions with 'bad' HTML, throws console error

srowen
authored and
SleepyThread
committed
[SPARK-11551][DOC] Replace example code in ml-features.md using include_example

yinxusen
authored and
SleepyThread
committed
[SPARK-12211][DOC][GRAPHX] Fix version number in graphx doc for migration from 1.1

aray
authored and
SleepyThread
committed
[SPARK-12165][ADDENDUM] Fix outdated comments on unroll test

Andrew Or
authored and
SleepyThread
committed
[SPARK-11678][SQL][DOCS] Document basePath in the programming guide.

yhuai
authored and
SleepyThread
committed
[SPARK-11796] Fix httpclient and httpcore depedency issues related to docker-client

Mark Grover
authored and
SleepyThread
committed
[SPARK-12244][SPARK-12245][STREAMING] Rename trackStateByKey to mapWithState and change tracking function signature

tdas
authored and
SleepyThread
committed
[SPARK-12252][SPARK-12131][SQL] refactor MapObjects to make it less hacky

cloud-fan
authored and
SleepyThread
committed
[SPARK-12136][STREAMING] rddToFileName does not properly handle prefix and suffix parameters

bomeng
authored and
SleepyThread
committed
[SPARK-11530][MLLIB] Return eigenvalues with PCA model

srowen
authored and
SleepyThread
committed
[SPARK-12242][SQL] Add DataFrame.transform method

rxin
authored and
SleepyThread
committed
[SPARK-11832][CORE] Process arguments in spark-shell for Scala 2.11

jodersky
authored and
SleepyThread
committed
[SPARK-12198][SPARKR] SparkR support read.parquet and deprecate parquetFile

yanboliang
authored and
SleepyThread
committed
[SPARK-11602][MLLIB] Refine visibility for 1.6 scala API audit

hhbyyh
authored and
SleepyThread
committed
[SPARK-12234][SPARKR] Fix ```subset``` function error when only set ```select``` argument

yanboliang
authored and
SleepyThread
committed
[SPARK-12250][SQL] Allow users to define a UDAF without providing details of its inputSchema

yhuai
authored and
SleepyThread
committed
[SPARK-12228][SQL] Try to run execution hive's derby in memory.

yhuai
authored and
SleepyThread
committed
[SPARK-12212][ML][DOC] Clarifies the difference between spark.ml, spark.mllib and mllib in the documentation.

thunterdb
authored and
SleepyThread
committed
[SPARK-11563][CORE][REPL] Use RpcEnv to transfer REPL-generated classes.

Marcelo Vanzin
authored and
SleepyThread
committed
[SPARK-11713] [PYSPARK] [STREAMING] Initial RDD updateStateByKey for PySpark

BryanCutler
authored and
SleepyThread
committed
[SPARK-12251] Document and improve off-heap memory configurations

JoshRosen
authored and
SleepyThread
committed
[SPARK-12155][SPARK-12253] Fix executor OOM in unified memory management

Andrew Or
authored and
SleepyThread
committed
[STREAMING][DOC][MINOR] Update the description of direct Kafka stream doc

jerryshao
authored and
SleepyThread
committed
[SPARK-12258][SQL] passing null into ScalaUDF

Davies Liu
authored and
SleepyThread
committed
[SPARK-10991][ML] logistic regression training summary handle empty prediction col

holdenk
authored and
SleepyThread
committed
[SPARK-12258] [SQL] passing null into ScalaUDF (follow-up)

Davies Liu
authored and
SleepyThread
committed
[SPARK-12146][SPARKR] SparkR jsonFile should support multiple input files

yanboliang
authored and
SleepyThread
committed
[SPARK-11964][DOCS][ML] Add in Pipeline Import/Export Documentation

bllchmbrs
authored and
SleepyThread
committed
[SPARK-12273][STREAMING] Make Spark Streaming web UI list Receivers in order

lw-lin
authored and
SleepyThread
committed
[SPARK-11497][MLLIB][PYTHON] PySpark RowMatrix Constructor Has Type Erasure Issue

dusenberrymw
authored and
SleepyThread
committed
[SPARK-12217][ML] Document invalid handling for StringIndexer

BenFradet
authored and
SleepyThread
committed
[SPARK-11978][ML] Move dataset_example.py to examples/ml and rename to dataframe_example.py

yanboliang
authored and
SleepyThread
committed
[SPARK-12298][SQL] Fix infinite loop in DataFrame.sortWithinPartitions

ankurdave
authored and
SleepyThread
committed
[SPARK-12158][SPARKR][SQL] Fix 'sample' functions that break R unit test cases

gatorsmile
authored and
SleepyThread
committed
[SPARK-11193] Use Java ConcurrentHashMap instead of SynchronizedMap trait in order to avoid ClassCastException due to KryoSerializer in KinesisReceiver

jbonofre
authored and
SleepyThread
committed
[SPARK-12199][DOC] Follow-up: Refine example code in ml-features.md

yinxusen
authored and
SleepyThread
committed
[SPARK-12267][CORE] Store the remote RpcEnv address to send the correct disconnetion message

zsxwing
authored and
SleepyThread
committed
[SPARK-12281][CORE] Fix a race condition when reporting ExecutorState in the shutdown hook

zsxwing
authored and
SleepyThread
committed
[SPARK-12213][SQL] use multiple partitions for single distinct query

Davies Liu
authored and
SleepyThread
committed
[SPARK-12275][SQL] No plan for BroadcastHint in some condition

yucai
authored and
SleepyThread
committed
[MINOR][DOC] Fix broken word2vec link

BenFradet
authored and
SleepyThread
committed
[SPARK-12016] [MLLIB] [PYSPARK] Wrap Word2VecModel when loading it in pyspark

viirya
authored and
SleepyThread
committed
[SPARK-12327] Disable commented code lintr temporarily

shivaram
authored and
SleepyThread
committed
[SPARK-12274][SQL] WrapOption should not have type constraint for child

cloud-fan
authored and
SleepyThread
committed
[SPARK-12188][SQL][FOLLOW-UP] Code refactoring and comment correction in Dataset APIs

gatorsmile
authored and
SleepyThread
committed
[SPARK-12288] [SQL] Support UnsafeRow in Coalesce/Except/Intersect.

gatorsmile
authored and
SleepyThread
committed
[SPARK-12332][TRIVIAL][TEST] Fix minor typo in ResetSystemProperties

holdenk
authored and
SleepyThread
committed
[STREAMING][MINOR] Fix typo in function name of StateImpl

jerryshao
authored and
SleepyThread
committed
[MINOR][ML] Rename weights to coefficients for examples/DeveloperApiExample

yanboliang
authored and
SleepyThread
committed
[SPARK-12271][SQL] Improve error message when Dataset.as[ ] has incompatible schemas.

nongli
authored and
SleepyThread
committed
[SPARK-12236][SQL] JDBC filter tests all pass if filters are not really pushed down

HyukjinKwon
authored and
SleepyThread
committed
[SPARK-12105] [SQL] add convenient show functions

jbonofre
authored and
SleepyThread
committed
[HOTFIX] Compile error from commit 31b3910

Andrew Or
authored and
SleepyThread
committed
[SPARK-12056][CORE] Part 2 Create a TaskAttemptContext only after calling setConf

tedyu
authored and
SleepyThread
committed
[SPARK-12130] Replace shuffleManagerClass with shortShuffleMgrNames in ExternalShuffleBlockResolver

lianhuiwang
authored and
SleepyThread
committed
[SPARK-12351][MESOS] Add documentation about submitting Spark with mesos cluster mode.

tnachen
authored and
SleepyThread
committed
[SPARK-9516][UI] Improvement of Thread Dump Page

CodingCat
authored and
SleepyThread
committed
[SPARK-9026][SPARK-4514] Modifications to JobWaiter, FutureAction, and AsyncRDDActions to support non-blocking operation

reggert
authored and
SleepyThread
committed
[SPARK-10123][DEPLOY] Support specifying deploy mode from configuration

jerryshao
authored and
SleepyThread
committed
[SPARK-9886][CORE] Fix to use ShutdownHookManager in

naveenminchu
authored and
SleepyThread
committed
[SPARK-12062][CORE] Change Master to asyc rebuild UI when application completes

BryanCutler
authored and
SleepyThread
committed
[SPARK-10477][SQL] using DSL in ColumnPruningSuite to improve readability

cloud-fan
authored and
SleepyThread
committed
[SPARK-4117][YARN] Spark on Yarn handle AM being told command from RM

Devaraj K
authored and
SleepyThread
committed
[SPARK-12304][STREAMING] Make Spark Streaming web UI display more fri…

lw-lin
authored and
SleepyThread
committed
[SPARK-12249][SQL] JDBC non-equality comparison operator not pushed down.

HyukjinKwon
authored and
SleepyThread
committed
[SPARK-12314][SQL] isnull operator not pushed down for JDBC datasource.

HyukjinKwon
authored and
SleepyThread
committed
[SPARK-12315][SQL] isnotnull operator not pushed down for JDBC datasource.

HyukjinKwon
authored and
SleepyThread
committed
Style fix for the previous 3 JDBC filter push down commits.

rxin
authored and
SleepyThread
committed
Revert "[HOTFIX] Compile error from commit 31b3910"

rxin
authored and
SleepyThread
committed
Revert "[SPARK-12105] [SQL] add convenient show functions"

rxin
authored and
SleepyThread
committed
[SPARK-10618] [Mesos] Refactoring coarsed-grained scheduling condition and adding test for same
SleepyThread
committed
[SPARK-10618] [Mesos] Killing space and removing duplication, also having one test for each case
SleepyThread
committed
[SPARK-10514] [CORE] [Mesos] Refactoring fine-grained scheduling condition and adding test for it.
SleepyThread
committed
[SPARK-10618] [Mesos] Adressing comments on PR.
SleepyThread
committed
[SPARK-10618] [Mesos] removing meetconstraints check as it is already done
SleepyThread
committed
[SPARK-10618] [Mesos] checking in missed Style check fix
SleepyThread
committed
Merge branch 'scheduling-refactor' of github.com:SleepyThread/spark into scheduling-refactor
SleepyThread
committed