init commit for hiding Mapoutputtracker behind shuffle manager#2

Closed

CodingCat wants to merge 74 commits intomasterfrom

Commits on Jun 20, 2014

Commits on Jun 21, 2014

Clean up CacheManager et al.

andrewor14
authored and
rxin
committed
Move ScriptTransformation into the appropriate place.
rxin
committed
[SQL] Use hive.SessionState, not the thread local SessionState

aarondav
authored and
rxin
committed
SPARK-1902 Silence stacktrace from logs when doing port failover to port n+1

ash211
authored and
pwendell
committed
[SPARK-1970] Update unit test in XORShiftRandomSuite to use ChiSquareTest from commons-math3

dorx
authored and
pwendell
committed
HOTFIX: Fixing style error introduced by 08d0ac
pwendell
committed
[SPARK-2061] Made splits deprecated in JavaRDDLike

AtlasPilotPuppy
authored and
pwendell
committed
Fix some tests.

Marcelo Vanzin
authored and
pwendell
committed
[SQL] Pass SQLContext instead of SparkContext into physical operators.
rxin
committed
[SQL] Break hiveOperators.scala into multiple files.

rxin
authored and
marmbrus
committed
HOTFIX: Fix missing MIMA ignore
pwendell
committed
HOTFIX: Add excludes for new MIMA files
pwendell
committed

Commits on Jun 22, 2014

Commits on Jun 23, 2014

SPARK-2229: FileAppender throw an llegalArgumentException in jdk6

witgo
authored and
rxin
committed
SPARK-2241: quote command line args in ec2 script

orikremer
authored and
pwendell
committed
SPARK-2166 - Listing of instances to be terminated before the prompt

Jean-Martin Archer
authored and
pwendell
committed
[SPARK-1395] Fix "local:" URI support in Yarn mode (again).

Marcelo Vanzin
authored and
tgravescs
committed
Fixed small running on YARN docs typo

frol
authored and
tgravescs
committed
Fix mvn detection

Matthew Farrellee
authored and
pwendell
committed
[SPARK-1669][SQL] Made cacheTable idempotent

liancheng
authored and
marmbrus
committed
[SPARK-2118] spark class should complain if tools jar is missing.

ScrapCodes
authored and
pwendell
committed
[SPARK-1768] History server enhancements.

Marcelo Vanzin
authored and
pwendell
committed

Commits on Jun 24, 2014

Cleanup on Connection, ConnectionManagerId, ConnectionManager classes part 2

hsaputra
authored and
rxin
committed
[SPARK-2227] Support dfs command in SQL.
rxin
committed
[SPARK-2124] Move aggregation into shuffle implementations

jerryshao
authored and
mateiz
committed
[SPARK-2252] Fix MathJax for HTTPs.
rxin
committed
SPARK-1937: fix issue with task locality

Rui Li
authored and
mateiz
committed
HOTFIX: Disabling tests per SPARK-2264
pwendell
committed
Fix broken Json tests.
kayousterhout
committed

Commits on Jun 25, 2014

[SPARK-2264][SQL] Fix failing CachedTableSuite

marmbrus
authored and
pwendell
committed
[SPARK-1112, 2156] Bootstrap to fetch the driver's Spark properties.

mengxr
authored and
pwendell
committed
[SQL]Add base row updating methods for JoinedRow

chenghao-intel
authored and
marmbrus
committed
Autodetect JAVA_HOME on RPM-based systems

Matthew Farrellee
authored and
pwendell
committed
Fix possible null pointer in acumulator toString

marmbrus
authored and
rxin
committed
SPARK-2248: spark.default.parallelism does not apply in local mode

witgo
authored and
pwendell
committed
[SPARK-2263][SQL] Support inserting MAP<K, V> to Hive tables

liancheng
authored and
rxin
committed
[BUGFIX][SQL] Should match java.math.BigDecimal when wnrapping Hive output

liancheng
authored and
rxin
committed
SPARK-2038: rename "conf" parameters in the saveAsHadoop functions with source-compatibility

CodingCat
authored and
rxin
committed
Replace doc reference to Shark with Spark SQL.
rxin
committed
[SPARK-2242] HOTFIX: pyspark shell hangs on simple job

andrewor14
authored and
mengxr
committed
[SPARK-2258 / 2266] Fix a few worker UI bugs

andrewor14
authored and
pwendell
committed
[SPARK-2270] Kryo cannot serialize results returned by asJavaIterable

rxin
authored and
pwendell
committed
[SPARK-2204] Launch tasks on the proper executors in mesos fine-grained mode

sebastienrainville
authored and
pwendell
committed

Commits on Jun 26, 2014

[SQL] SPARK-1800 Add broadcast hash join operator & associated hints.

concretevitamin
authored and
marmbrus
committed
[SPARK-2283][SQL] Reset test environment before running PruningSuite

liancheng
authored and
marmbrus
committed
[SPARK-1749] Job cancellation when SchedulerBackend does not implement killTask

markhamstra
authored and
pwendell
committed
[SPARK-2284][UI] Mark all failed tasks as failures.
rxin
committed
[SPARK-2172] PySpark cannot import mllib modules in YARN-client mode

piotrszul
authored and
rxin
committed
[SPARK-2254] [SQL] ScalaRefection should mark primitive types as non-nullable.

ueshin
authored and
rxin
committed
Remove use of spark.worker.instances

kayousterhout
authored and
tgravescs
committed
[SPARK-2295] [SQL] Make JavaBeans nullability stricter.

ueshin
authored and
marmbrus
committed
[SPARK-2286][UI] Report exception/errors for failed tasks that are not ExceptionFailure

rxin
authored and
pwendell
committed
Fixing AWS instance type information based upon current EC2 data

Zichuan Ye
authored and
pwendell
committed

Commits on Jun 27, 2014