Branch 2.2#17853

Closed

crjk21 wants to merge 107 commits intomasterfrom

Commits on Apr 18, 2017

[SPARK-20354][CORE][REST-API] When I request access to the 'http: //ip:port/api/v1/applications' link, return 'sparkUser' is empty in REST API.

郭小龙 10207633
authored and
Marcelo Vanzin
committed
[SPARK-20360][PYTHON] reprs for interpreters

rgbkrk
authored and
holdenk
committed
[SPARK-20377][SS] Fix JavaStructuredSessionization example
tdas
committed

Commits on Apr 19, 2017

[SPARK-20254][SQL] Remove unnecessary data conversion for Dataset with primitive array

kiszk
authored and
cloud-fan
committed
[SPARK-20208][R][DOCS] Document R fpGrowth support

zero323
authored and
Felix Cheung
committed
[SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE

koertkuipers
authored and
cloud-fan
committed
[SPARK-20356][SQL] Pruned InMemoryTableScanExec should have correct output partitioning and ordering

viirya
authored and
cloud-fan
committed
[SPARK-20343][BUILD] Avoid Unidoc build only if Hadoop 2.6 is explicitly set in SBT build

HyukjinKwon
authored and
srowen
committed
[SPARK-20036][DOC] Note incompatible dependencies on org.apache.kafka artifacts

koeninger
authored and
srowen
committed
[SPARK-20397][SPARKR][SS] Fix flaky test: test_streaming.R.Terminated by error
zsxwing
committed

Commits on Apr 20, 2017

[SPARK-20350] Add optimization rules to apply Complementation Laws.

ptkool
authored and
cloud-fan
committed
[MINOR][SS] Fix a missing space in UnsupportedOperationChecker error message
zsxwing
committed
[SPARK-20398][SQL] range() operator should include cancellation reason when killed

ericl
authored and
rxin
committed
Fixed typos in docs

ymahajan
authored and
rxin
committed
[SPARK-20156][SQL][FOLLOW-UP] Java String toLowerCase "Turkish locale bug" in Database and Table DDLs

gatorsmile
authored and
srowen
committed
[SPARK-20405][SQL] Dataset.withNewExecutionId should be private

rxin
authored and
hvanhovell
committed
[SPARK-20409][SQL] fail early if aggregate function in GROUP BY

cloud-fan
authored and
hvanhovell
committed
[SPARK-20407][TESTS] ParquetQuerySuite 'Enabling/disabling ignoreCorruptFiles' flaky test

bogdanrdc
authored and
hvanhovell
committed
[SPARK-20358][CORE] Executors failing stage on interrupted exception thrown by cancelled tasks

ericl
authored and
yhuai
committed
[SPARK-20410][SQL] Make sparkConf a def in SharedSQLContext
hvanhovell
committed
[SPARK-20172][CORE] Add file permission check when listing files in FsHistoryProvider

jerryshao
authored and
Marcelo Vanzin
committed

Commits on Apr 21, 2017

[SPARK-20367] Properly unescape column names of partitioning columns parsed from paths.

juliuszsompolski
authored and
cloud-fan
committed
[SPARK-20329][SQL] Make timezone aware expression without timezone unresolved

hvanhovell
authored and
cloud-fan
committed
[SPARK-20281][SQL] Print the identical Range parameters of SparkContext APIs and SQL in explain

maropu
authored and
gatorsmile
committed
[SPARK-20420][SQL] Add events to the external catalog

hvanhovell
authored and
rxin
committed
Small rewording about history server use case

dud225
authored and
srowen
committed
[SPARK-20412] Throw ParseException from visitNonOptionalPartitionSpec instead of returning null values.

juliuszsompolski
authored and
cloud-fan
committed
[SPARK-20341][SQL] Support BigInt's value that does not fit in long value range

kiszk
authored and
cloud-fan
committed
[SPARK-20423][ML] fix MLOR coeffs centering when reg == 0

WeichenXu123
authored and
dbtsai
committed
[SPARK-20401][DOC] In the spark official configuration document, the 'spark.driver.supervise' configuration parameter specification and default values are necessary.

郭小龙 10207633
authored and
srowen
committed

Commits on Apr 22, 2017

[SPARK-20386][SPARK CORE] modify the log info if the block exists on the slave already

eatoncys
authored and
srowen
committed
[SPARK-20430][SQL] Initialise RangeExec parameters in a driver side

maropu
authored and
gatorsmile
committed

Commits on Apr 23, 2017

[SPARK-20385][WEB-UI] Submitted Time' field, the date format needs to be formatted, in running Drivers table or Completed Drivers table in master web ui.

郭小龙 10207633
authored and
srowen
committed

Commits on Apr 24, 2017

[SPARK-20439][SQL] Fix Catalog API listTables and getTable when failed to fetch table metadata

gatorsmile
authored and
cloud-fan
committed
[SPARK-18901][ML] Require in LR LogisticAggregator is redundant

wangmiao1981
authored and
yanboliang
committed

Commits on Apr 25, 2017

[SPARK-20239][CORE] Improve HistoryServer's ACL mechanism

jerryshao
authored and
Marcelo Vanzin
committed
[SPARK-20451] Filter out nested mapType datatypes from sort order in randomSplit

sameeragarwal
authored and
cloud-fan
committed
[SPARK-20455][DOCS] Fix Broken Docker IT Docs

original-brownbear
authored and
srowen
committed
[SPARK-20404][CORE] Using Option(name) instead of Some(name)

szhem
authored and
srowen
committed
[SPARK-18901][FOLLOWUP][ML] Require in LR LogisticAggregator is redundant

wangmiao1981
authored and
yanboliang
committed
[SPARK-20449][ML] Upgrade breeze version to 0.13.1

yanboliang
authored and
dbtsai
committed
[SPARK-5484][GRAPHX] Periodically do checkpoint in Pregel

ding
authored and
Felix Cheung
committed

Commits on Apr 26, 2017

[SPARK-18127] Add hooks and extension points to Spark

sameeragarwal
authored and
gatorsmile
committed
[SPARK-16548][SQL] Inconsistent error handling in JSON parsing SQL functions

Eric Wasserman
authored and
cloud-fan
committed
[SPARK-20400][DOCS] Remove References to 3rd Party Vendor Tools

anabranch
authored and
srowen
committed
[SPARK-19812] YARN shuffle service fails to relocate recovery DB acro…

tgravescs
authored and
Tom Graves
committed
[MINOR][ML] Fix some PySpark & SparkR flaky tests
yanboliang
committed
[SPARK-20391][CORE] Rename memory related fields in ExecutorSummay

jerryshao
authored and
squito
committed
[SPARK-20473] Enabling missing types in ColumnVector.Array

michal-databricks
authored and
rxin
committed
[SPARK-20474] Fixing OnHeapColumnVector reallocation

michal-databricks
authored and
rxin
committed
[SPARK-12868][SQL] Allow adding jars from hdfs

weiqingy
authored and
Marcelo Vanzin
committed

Commits on Apr 27, 2017

[SPARK-20435][CORE] More thorough redaction of sensitive information

markgrover
authored and
Marcelo Vanzin
committed
Preparing Spark release v2.2.0-rc1
pwendell
committed
Preparing development version 2.2.0-SNAPSHOT
pwendell
committed
[SPARK-20483] Mesos Coarse mode may starve other Mesos frameworks

dgshep
authored and
dbtsai
committed
[SPARK-20421][CORE] Mark internal listeners as deprecated.
Marcelo Vanzin
committed
[SPARK-20482][SQL] Resolving Casts is too strict on having time zone set

rednaxelafx
authored and
gatorsmile
committed
[SPARK-20487][SQL] `HiveTableScan` node is quite verbose in explained plan

tejasapatil
authored and
gatorsmile
committed
[SPARK-20426] Lazy initialization of FileSegmentManagedBuffer for shuffle service.

jinxing
authored and
Tom Graves
committed
[SPARK-20483][MINOR] Test for Mesos Coarse mode may starve other Mesos frameworks

dgshep
authored and
dbtsai
committed
[SPARK-20047][ML] Constrained Logistic Regression

yanboliang
authored and
dbtsai
committed
[SPARK-20461][CORE][SS] Use UninterruptibleThread for Executor and fix the potential hang in CachedKafkaConsumer

zsxwing
authored and
tdas
committed
[SPARK-20452][SS][KAFKA] Fix a potential ConcurrentModificationException for batch Kafka DataFrame

zsxwing
authored and
tdas
committed

Commits on Apr 28, 2017

[SPARK-12837][CORE] Do not send the name of internal accumulator to executor side

cloud-fan
authored and
hvanhovell
committed
[SPARKR][DOC] Document LinearSVC in R programming guide

wangmiao1981
authored and
Felix Cheung
committed
[SPARK-20476][SQL] Block users to create a table that use commas in the column names

gatorsmile
authored and
cloud-fan
committed
[SPARK-14471][SQL] Aliases in SELECT could be used in GROUP BY

maropu
authored and
cloud-fan
committed
[SPARK-20465][CORE] Throws a proper exception when any temp directory could not be got

HyukjinKwon
authored and
srowen
committed
[SPARK-20496][SS] Bug in KafkaWriter Looks at Unanalyzed Plans

Bill Chambers
authored and
brkyvz
committed
[SPARK-20514][CORE] Upgrade Jetty to 9.3.11.v20160721

markgrover
authored and
Marcelo Vanzin
committed
[SPARK-20471] Remove AggregateBenchmark testsuite warning: Two level hashmap is disabled but vectorized hashmap is enabled

heary-cao
authored and
gatorsmile
committed
[SPARK-19525][CORE] Add RDD checkpoint compression support

Aaditya Ramesh
authored and
zsxwing
committed

Commits on Apr 29, 2017

[SPARK-20487][SQL] Display `serde` for `HiveTableScan` node in explained plan

tejasapatil
authored and
gatorsmile
committed
[SPARK-20477][SPARKR][DOC] Document R bisecting k-means in R programming guide

wangmiao1981
authored and
Felix Cheung
committed
[SPARK-19791][ML] Add doc and example for fpgrowth

YY-OnCall
authored and
Felix Cheung
committed

Commits on Apr 30, 2017

[SPARK-20521][DOC][CORE] The default of 'spark.worker.cleanup.appDataTtl' should be 604800 in spark-standalone.md

郭小龙 10207633
authored and
srowen
committed
[SPARK-20492][SQL] Do not print empty parentheses for invalid primitive types in parser

HyukjinKwon
authored and
hvanhovell
committed

Commits on May 1, 2017

[MINOR][DOCS][PYTHON] Adding missing boolean type for replacement value in fillna

Srinivasa Reddy Vundela
authored and
Felix Cheung
committed
[SPARK-20541][SPARKR][SS] support awaitTermination without timeout

felixcheung
authored and
Felix Cheung
committed
[SPARK-20534][SQL] Make outer generate exec return empty rows

hvanhovell
authored and
gatorsmile
committed
[SPARK-20517][UI] Fix broken history UI download link

jerryshao
authored and
Marcelo Vanzin
committed
[SPARK-20464][SS] Add a job group and description for streaming queries and fix cancellation of running jobs using the job group

kunalkhamar
authored and
zsxwing
committed
[SPARK-20540][CORE] Fix unstable executor requests.

rdblue
authored and
Marcelo Vanzin
committed

Commits on May 2, 2017

[SPARK-20459][SQL] JdbcUtils throws IllegalStateException: Cause already initialized after getting SQLException

srowen
authored and
gatorsmile
committed
[SPARK-20192][SPARKR][DOC] SparkR migration guide to 2.2.0

felixcheung
authored and
Felix Cheung
committed
[SPARK-20537][CORE] Fixing OffHeapColumnVector reallocation

kiszk
authored and
cloud-fan
committed
[SPARK-20549] java.io.CharConversionException: Invalid UTF-32' in JsonToStructs

brkyvz
authored and
cloud-fan
committed
[SPARK-20300][ML][PYSPARK] Python API for ALSModel.recommendForAllUsers,Items
Nick Pentreath
committed
[SPARK-19235][SQL][TEST][FOLLOW-UP] Enable Test Cases in DDLSuite with Hive Metastore

gatorsmile
authored and
cloud-fan
committed
[SPARK-20421][CORE] Add a missing deprecation tag.
Marcelo Vanzin
committed

Commits on May 3, 2017

Commits on May 4, 2017

[SPARK-20584][PYSPARK][SQL] Python generic hint support

zero323
authored and
rxin
committed
[SPARK-20544][SPARKR] skip tests when running on CRAN

felixcheung
authored and
Felix Cheung
committed
[SPARK-20015][SPARKR][SS][DOC][EXAMPLE] Document R Structured Streaming (experimental) in R vignettes and R & SS programming guide, R example

felixcheung
authored and
Felix Cheung
committed
[SPARK-20585][SPARKR] R generic hint support

zero323
authored and
Felix Cheung
committed
[SPARK-20571][SPARKR][SS] Flaky Structured Streaming tests

felixcheung
authored and
Felix Cheung
committed
[SPARK-20047][FOLLOWUP][ML] Constrained Logistic Regression follow up
yanboliang
committed

Commits on May 5, 2017

[SPARK-20574][ML] Allow Bucketizer to handle non-Double numeric column

Wayne Zhang
authored and
yanboliang
committed