[BRANCH-1.1][SPARK-4626] Kill a task only if the executorId is (still) registered with the scheduler#3502

Closed

roxchkplusony wants to merge 527 commits intoapache:masterfrom

Paxata:bugfix/4626-1.1

This pull request is big! We're only showing the most recent 250 commits

Commits on Aug 27, 2014

[SPARK-3138][SQL] sqlContext.parquetFile should be able to take a single file as parameter

chutium
authored and
marmbrus
committed
Spark-3213 Fixes issue with spark-ec2 not detecting slaves created with "Launch More like this"

vidaha
authored and
JoshRosen
committed
[SPARK-3243] Don't use stale spark-driver.* system properties

andrewor14
authored and
pwendell
committed
[SPARK-3252][SQL] Add missing condition for test

viirya
authored and
marmbrus
committed
[SQL] [SPARK-3236] Reading Parquet tables from Metastore mangles location

aarondav
authored and
marmbrus
committed
[SPARK-3065][SQL] Add locale setting to fix results do not match for udf_unix_timestamp format "yyyy MMM dd h:mm:ss a" run with not "America/Los_Angeles" TimeZone in HiveCompatibilitySuite

luogankun
authored and
marmbrus
committed
[SPARK-3235][SQL] Ensure in-memory tables don't always broadcast.
marmbrus
committed
Revert "[maven-release-plugin] prepare for next development iteration"
pwendell
committed
Revert "[maven-release-plugin] prepare release v1.1.0-snapshot2"
pwendell
committed
Add line continuation for script to work w/ py2.7.5

Matthew Farrellee
authored and
pwendell
committed
BUILD: Updating CHANGES.txt for Spark 1.1
pwendell
committed
[maven-release-plugin] prepare release v1.1.0-rc1
pwendell
committed
[maven-release-plugin] prepare for next development iteration
pwendell
committed

Commits on Aug 28, 2014

Commits on Aug 29, 2014

Commits on Aug 30, 2014

Commits on Sep 2, 2014

Commits on Sep 3, 2014

Commits on Sep 5, 2014

[Docs] fix minor MLlib case typo

nchammas
authored and
mengxr
committed

Commits on Sep 6, 2014

Commits on Sep 8, 2014

[SPARK-3394] [SQL] Fix crash in TakeOrdered when limit is 0

Eric Liang
authored and
mateiz
committed
[SQL] Update SQL Programming Guide
marmbrus
committed
[SPARK-3408] Fixed Limit operator so it works with sort-based shuffle.
rxin
committed
Fixed typos in make-distribution.sh

liancheng
authored and
pwendell
committed
[SPARK-938][doc] Add OpenStack Swift support

rxin
authored and
pwendell
committed
[SQL] Minor edits to sql programming guide.

hcook
authored and
marmbrus
committed

Commits on Sep 9, 2014

Commits on Sep 11, 2014

HOTFIX: Changing color on doc menu
pwendell
committed
[SPARK-2140] Updating heap memory calculation for YARN stable and alpha.

Chris Cope
authored and
tgravescs
committed

Commits on Sep 13, 2014

[SPARK-3500] [SQL] use JavaSchemaRDD as SchemaRDD._jschema_rdd

davies
authored and
JoshRosen
committed
[SPARK-3515][SQL] Moves test suite setup code to beforeAll rather than in constructor

liancheng
authored and
marmbrus
committed
[SQL] [Docs] typo fixes

nchammas
authored and
marmbrus
committed

Commits on Sep 15, 2014

SPARK-3039: Allow spark to be built using avro-mapred for hadoop2

bbossy
authored and
pwendell
committed
[SPARK-3518] Remove wasted statement in JsonProtocol

sarutak
authored and
pwendell
committed

Commits on Sep 16, 2014

Commits on Sep 17, 2014

Commits on Sep 18, 2014

[SPARK-3565]Fix configuration item not consistent with document

WangTaoTheTonic
authored and
pwendell
committed
[SPARK-3589][Minor]remove redundant code

WangTaoTheTonic
authored and
pwendell
committed
[SPARK-3560] Fixed setting spark.jars system property in yarn-cluster mode

Victsm
authored and
andrewor14
committed

Commits on Sep 19, 2014

Commits on Sep 21, 2014

Commits on Sep 22, 2014

[MLLib] Fix example code variable name misspelling in MLLib Feature Extraction guide

rnowling
authored and
mengxr
committed
Update docs to use jsonRDD instead of wrong jsonRdd.

gregakespret
authored and
marmbrus
committed

Commits on Sep 23, 2014

Commits on Sep 26, 2014

SPARK-3639 | Removed settings master in examples

aniketbhatnagar
authored and
andrewor14
committed

Commits on Sep 27, 2014

Docs : use "--total-executor-cores" rather than "--cores" after spark-shell

CrazyJvm
authored and
andrewor14
committed

Commits on Sep 29, 2014

[SPARK-3715][Docs]minor typo

WangTaoTheTonic
authored and
marmbrus
committed
[CORE] Bugfix: LogErr format in DAGScheduler.scala

liyezhang556520
authored and
rxin
committed
[SPARK-3032][Shuffle] Fix key comparison integer overflow introduced sorting exception

jerryshao
authored and
mateiz
committed

Commits on Sep 30, 2014

Commits on Oct 2, 2014

SPARK-3638 | Forced a compatible version of http client in kinesis-asl profile

aniketbhatnagar
authored and
JoshRosen
committed
[SQL][Docs] Update the output of printSchema and fix a typo in SQL programming guide.

yhuai
authored and
marmbrus
committed

Commits on Oct 3, 2014

[SPARK-3755][Core] avoid trying privileged port when request a non-privileged port

scwf
authored and
andrewor14
committed
[DEPLOY] SPARK-3759: Return the exit code of the driver process

Eric Eijkelenboom
authored and
andrewor14
committed
SPARK-2058: Overriding SPARK_HOME/conf with SPARK_CONF_DIR

EugenCepoi
authored and
andrewor14
committed
[SPARK-3696]Do not override the user-difined conf_dir

WangTaoTheTonic
authored and
andrewor14
committed
[SPARK-3535][Mesos] Fix resource handling.

brndnmtthws
authored and
andrewor14
committed
[SPARK-3775] Not suitable error message in spark-shell.cmd

tsudukim
authored and
andrewor14
committed
[SPARK-3774] typo comment in bin/utils.sh

tsudukim
authored and
andrewor14
committed

Commits on Oct 5, 2014

[SPARK-3597][Mesos] Implement `killTask`.

brndnmtthws
authored and
andrewor14
committed
SPARK-1656: Fix potential resource leaks

zsxwing
authored and
andrewor14
committed

Commits on Oct 6, 2014

[SPARK-3792][SQL] Enable JavaHiveQLSuite

scwf
authored and
marmbrus
committed

Commits on Oct 7, 2014

[SPARK-3827] Very long RDD names are not rendered properly in web UI

falaki
authored and
JoshRosen
committed
[SPARK-3808] PySpark fails to start in Windows

tsudukim
authored and
andrewor14
committed
[SPARK-3825] Log more detail when unrolling a block fails
andrewor14
committed
[SPARK-3731] [PySpark] fix memory leak in PythonRDD

davies
authored and
JoshRosen
committed
[SPARK-3777] Display "Executor ID" for Tasks in Stage page

zsxwing
authored and
andrewor14
committed
[SPARK-3829] Make Spark logo image on the header of HistoryPage as a link to HistoryPage's page #1

sarutak
authored and
andrewor14
committed

Commits on Oct 8, 2014

[SPARK-3788] [yarn] Fix compareFs to do the right thing for HDFS namespaces (1.1 version).

Marcelo Vanzin
authored and
tgravescs
committed

Commits on Oct 9, 2014

[SPARK-3844][UI] Truncate appName in WebUI if it is too long

mengxr
authored and
andrewor14
committed
[SPARK-3711][SQL] Optimize where in clause filter queries

Yash Datta
authored and
marmbrus
committed

Commits on Oct 12, 2014

SPARK-3716 [GraphX] Update Analytics.scala for partitionStrategy assignment

NamelessAnalyst
authored and
ankurdave
committed

Commits on Oct 13, 2014

[SPARK-3121] Wrong implementation of implicit bytesWritableConverter

Jakub Dubovský
authored and
JoshRosen
committed
[SPARK-3905][Web UI]The keys for sorting the columns of Executor page ,Stage page Storage page are incorrect

witgo
authored and
JoshRosen
committed
[SPARK-3899][Doc]fix wrong links in streaming doc

scwf
authored and
JoshRosen
committed
SPARK-3807: SparkSql does not work for tables created using custom serde

chiragaggarwal
authored and
marmbrus
committed

Commits on Oct 17, 2014

[SQL]typo in HiveFromSpark

Kun Li
authored and
andrewor14
committed
[SPARK-3890][Docs]remove redundant spark.executor.memory in doc

WangTaoTheTonic
authored and
andrewor14
committed
[SPARK-3067] JobProgressPage could not show Fair Scheduler Pools section sometimes

YanTangZhai
authored and
andrewor14
committed
[SPARK-3606] [yarn] Correctly configure AmIpFilter for Yarn HA (1.1 vers...

Marcelo Vanzin
authored and
andrewor14
committed

Commits on Oct 18, 2014

SPARK-3926 [CORE] Result of JavaRDD.collectAsMap() is not Serializable

srowen
authored and
JoshRosen
committed

Commits on Oct 19, 2014

[SPARK-2546] Clone JobConf for each task (branch-1.0 / 1.1 backport)
JoshRosen
committed

Commits on Oct 20, 2014

[SPARK-3948][Shuffle]Fix stream corruption bug in sort-based shuffle

jerryshao
authored and
JoshRosen
committed
[SPARK-4010][Web UI]Spark UI returns 500 in yarn-client mode

witgo
authored and
andrewor14
committed

Commits on Oct 22, 2014

Commits on Oct 24, 2014

[SPARK-2652] [PySpark] donot use KyroSerializer as default serializer

Davies Liu
authored and
mengxr
committed
[SPARK-4076] Parameter expansion in spark-config is wrong

sarutak
authored and
Andrew Or
committed
[SPARK-4075] [Deploy] Jar url validation is not enough for Jar file

sarutak
authored and
Andrew Or
committed
[SPARK-4006] In long running contexts, we encountered the situation of d...

tsliwowicz
authored and
Andrew Or
committed
[SPARK-4080] Only throw IOException from [write|read][Object|External]
JoshRosen
committed

Commits on Oct 25, 2014

[SPARK-4056] Upgrade snappy-java to 1.1.1.5
JoshRosen
committed

Commits on Oct 26, 2014

Commits on Oct 28, 2014

[MLlib] SPARK-3987: add test case on objective value for NNLS

coderxiang
authored and
mengxr
committed
[SPARK-4110] Wrong comments about default settings in spark-daemon.sh

sarutak
authored and
Andrew Or
committed
[SPARK-4107] Fix incorrect handling of read() and skip() return values (branch-1.1 backport)

JoshRosen
authored and
rxin
committed
[SPARK-4065] Add check for IPython on Windows

msjgriffiths
authored and
Andrew Or
committed

Commits on Oct 29, 2014

[SPARK-4097] Fix the race condition of 'thread'

zsxwing
authored and
rxin
committed

Commits on Nov 1, 2014

[SPARK-4115][GraphX] Add overrided count for edge counting of EdgeRDD.

luluorta
authored and
rxin
committed

Commits on Nov 5, 2014

Commits on Nov 6, 2014

[SPARK-4158] Fix for missing resources.

brndnmtthws
authored and
Andrew Or
committed
[SPARK-4249][GraphX]fix a problem of EdgePartitionBuilder in Graphx

lianhuiwang
authored and
ankurdave
committed

Commits on Nov 7, 2014

Update JavaCustomReceiver.java

xiao321
authored and
tdas
committed

Commits on Nov 8, 2014

[SPARK-4304] [PySpark] Fix sort on empty RDD

Davies Liu
authored and
JoshRosen
committed

Commits on Nov 9, 2014

[SPARK-4301] StreamingContext should not allow start() to be called after calling stop()

JoshRosen
authored and
tdas
committed

Commits on Nov 10, 2014

[SPARK-4169] [Core] Accommodate non-English Locales in unit tests

Niklas Wilcke
authored and
Andrew Or
committed
SPARK-2548 [STREAMING] JavaRecoverableWordCount is missing

srowen
authored and
tdas
committed
Update RecoverableNetworkWordCount.scala

comcmipi
authored and
tdas
committed
[SPARK-2548][HOTFIX][Streaming] Removed use of o.a.s.streaming.Durations in branch 1.1
tdas
committed

Commits on Nov 11, 2014

[SPARK-4308][SQL] Follow up of #3175 for branch 1.1

liancheng
authored and
marmbrus
committed
[SPARK-3971][SQL] Backport #2843 to branch-1.1

liancheng
authored and
marmbrus
committed
[SPARK-3954][Streaming] Optimization to FileInputDStream

surongquan
authored and
tdas
committed
[SPARK-3495][SPARK-3496] Backporting block replication fixes made in master to branch 1.1
tdas
committed
Update versions for 1.1.1 release
Andrew Or
committed
[SQL] Backport backtick and smallint JDBC fixes to 1.1

ravipesala
authored and
marmbrus
committed
[SPARK-4330][Doc] Link to proper URL for YARN overview

sarutak
authored and
mateiz
committed
[BRANCH-1.1][SPARK-2652] change the default spark.serializer in pyspark back to Kryo
mengxr
committed
[branch-1.1][SPARK-3990] add a note on ALS usage
mengxr
committed
[SPARK-4295][External]Fix exception in SparkSinkSuite

maji2014
authored and
tdas
committed
Update CHANGES.txt
andrewor14
committed
[maven-release-plugin] prepare release v1.1.1-rc1
andrewor14
committed
[maven-release-plugin] prepare for next development iteration
andrewor14
committed

Commits on Nov 12, 2014

Commits on Nov 13, 2014

Commits on Nov 17, 2014

Revert "[SPARK-4075] [Deploy] Jar url validation is not enough for Jar file"
Andrew Or
committed
Revert "[maven-release-plugin] prepare for next development iteration"
Andrew Or
committed
Revert "[maven-release-plugin] prepare release v1.1.1-rc1"
Andrew Or
committed

Commits on Nov 18, 2014

Commits on Nov 19, 2014

Commits on Nov 24, 2014

Update versions to 1.1.2-SNAPSHOT
Andrew Or
committed

Commits on Nov 25, 2014

Commits on Nov 27, 2014

[Release] Automate generation of contributors list
Andrew Or
committed

Commits on Nov 28, 2014

[SPARK-4626] Kill a task only if the executorId is (still) registered with the scheduler
roxchkplusony
committed