[SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGenerator#14174

Closed

ooq wants to merge 154 commits intoapache:masterfrom

ooq:rowbasedfastaggmap-pr1

Commits on Jul 13, 2016

add RowBatch and RowBasedHashMapGenerator
ooq
committed
[SPARK-16303][DOCS][EXAMPLES] Updated SQL programming guide and examples

aokolnychyi
authored and
liancheng
committed
fix scale codestyle
ooq
committed
[SPARK-15889][STREAMING] Follow-up fix to erroneous condition in StreamTest
srowen
committed
[SPARK-16375][WEB UI] Fixed misassigned var: numCompletedTasks was assigned to numSkippedTasks

ajbozarth
authored and
srowen
committed
[MINOR] Fix Java style errors and remove unused imports

keypointt
authored and
srowen
committed
[SPARK-16439] Fix number formatting in SQL UI

Maciej Brynski
authored and
srowen
committed
[SPARK-16438] Add Asynchronous Actions documentation

phalodi
authored and
srowen
committed
[MINOR][YARN] Fix code error in yarn-cluster unit test

sharkdtu
authored and
srowen
committed
[SPARK-16440][MLLIB] Undeleted broadcast variables in Word2Vec causing OoM for long runs
srowen
committed
[SPARK-16469] enhanced simulate multiply

uzadude
authored and
srowen
committed
[SPARK-16343][SQL] Improve the PushDownPredicate rule to pushdown predicates correctly in non-deterministic condition.

jiangxb1987
authored and
liancheng
committed
[SPARK-16435][YARN][MINOR] Add warning log if initialExecutors is less than minExecutors

jerryshao
authored and
Tom Graves
committed
[SPARK-14812][ML][MLLIB][PYTHON] Experimental, DeveloperApi annotation audit for ML
jkbradley
committed
[SPARK-16531][SQL][TEST] Remove timezone setting from DataFrameTimeWindowingSuite

brkyvz
authored and
marmbrus
committed
[SPARK-16114][SQL] updated structured streaming guide

jjthomas
authored and
tdas
committed
[SPARKR][MINOR] R examples and test updates

felixcheung
authored and
shivaram
committed
[SPARKR][DOCS][MINOR] R programming guide to include csv data source example

felixcheung
authored and
shivaram
committed
[SPARK-16482][SQL] Describe Table Command for Tables Requiring Runtime Inferred Schema

gatorsmile
authored and
yhuai
committed
[SPARK-16485][ML][DOC] Fix privacy of GLM members, rename sqlDataTypes for ML, doc fixes
jkbradley
committed

Commits on Jul 14, 2016

[SPARK-16536][SQL][PYSPARK][MINOR] Expose `sql` in PySpark Shell

dongjoon-hyun
authored and
rxin
committed
[SPARK-16503] SparkSession should provide Spark version

lw-lin
authored and
rxin
committed
[SPARK-16448] RemoveAliasOnlyProject should not remove alias with metadata

cloud-fan
authored and
liancheng
committed
[SPARK-16500][ML][MLLIB][OPTIMIZER] add LBFGS convergence warning for all used place in MLLib

WeichenXu123
authored and
srowen
committed
[SPARK-16403][EXAMPLES] Cleanup to remove unused imports, consistent style, minor fixes

BryanCutler
authored and
srowen
committed
[SPARK-14963][MINOR][YARN] Fix typo in YarnShuffleService recovery file name

jerryshao
authored and
Tom Graves
committed
[SPARK-16505][YARN] Optionally propagate error during shuffle service startup.

Marcelo Vanzin
authored and
Tom Graves
committed
[SPARK-16530][SQL][TRIVIAL] Wrong Parser Keyword in ALTER TABLE CHANGE COLUMN

gatorsmile
authored and
hvanhovell
committed
[SPARK-16543][SQL] Rename the columns of `SHOW PARTITION/COLUMNS` commands

dongjoon-hyun
authored and
hvanhovell
committed
[SPARK-16509][SPARKR] Rename window.partitionBy and window.orderBy to windowPartitionBy and windowOrderBy.

sun-rui
authored and
shivaram
committed
[SPARK-16538][SPARKR] fix R call with namespace operator on SparkSession functions

felixcheung
authored and
shivaram
committed
[SPARK-16529][SQL][TEST] `withTempDatabase` should set `default` database before dropping

dongjoon-hyun
authored and
liancheng
committed
[SPARK-16528][SQL] Fix NPE problem in HiveClientImpl

jacek-lewandowski
authored and
rxin
committed
[SPARK-16540][YARN][CORE] Avoid adding jars twice for Spark running on yarn

jerryshao
authored and
Marcelo Vanzin
committed
[SPARK-16553][DOCS] Fix SQL example file name in docs

shivaram
authored and
rxin
committed
[SPARK-16555] Work around Jekyll error-handling bug which led to silent failures

JoshRosen
authored and
rxin
committed

Commits on Jul 15, 2016

Commits on Jul 16, 2016

[SPARK-16582][SQL] Explicitly define isNull = false for non-nullable expressions

sameeragarwal
authored and
rxin
committed
[SPARK-3359][DOCS] More changes to resolve javadoc 8 errors that will help unidoc/genjavadoc compatibility

srowen
authored and
rxin
committed
[SPARK-16112][SPARKR] Programming guide for gapply/gapplyCollect

Narine Kokhlikyan
authored and
shivaram
committed

Commits on Jul 17, 2016

Commits on Jul 18, 2016

Commits on Jul 19, 2016

[SPARK-16590][SQL] Improve LogicalPlanToSQLSuite to check generated SQL directly

dongjoon-hyun
authored and
rxin
committed
[HOTFIX] Fix Scala 2.10 compilation
rxin
committed
[SPARK-16615][SQL] Expose sqlContext in SparkSession
rxin
committed
[MINOR] Remove unused arg in als.py

zhengruifeng
authored and
rxin
committed
[SPARK-16303][DOCS][EXAMPLES] Minor Scala/Java example update

liancheng
authored and
yhuai
committed
[DOC] improve python doc for rdd.histogram and dataframe.join

mortada
authored and
rxin
committed
[MINOR][BUILD] Fix Java Linter `LineLength` errors

dongjoon-hyun
authored and
srowen
committed
[SPARK-16535][BUILD] In pom.xml, remove groupId which is redundant definition and inherited from the parent

keypointt
authored and
srowen
committed
[MINOR][SQL][STREAMING][DOCS] Fix minor typos, punctuations and grammar

ahmed-mahran
authored and
srowen
committed
[SPARK-16600][MLLIB] fix some latex formula syntax error

WeichenXu123
authored and
srowen
committed
[SPARK-16395][STREAMING] Fail if too many CheckpointWriteHandlers are queued up in the fixed thread pool
srowen
committed
[SPARK-16478] graphX (added graph caching in strongly connected components)

Michał Wesołowski
authored and
srowen
committed
[SPARK-16494][ML] Upgrade breeze version to 0.12

yanboliang
authored and
srowen
committed
[SPARK-16620][CORE] Add back the tokenization process in `RDD.pipe(command: String)`

lw-lin
authored and
rxin
committed
[SPARK-16602][SQL] `Nvl` function should support numeric-string cases

dongjoon-hyun
authored and
rxin
committed
Fixs all comments except re-structuring
ooq
committed
[SPARK-15705][SQL] Change the default value of spark.sql.hive.convertMetastoreOrc to false.

yhuai
authored and
rxin
committed
Refactoring RowBasedKeyValueBatch
ooq
committed
Checking in refactored code, refactoring done
ooq
committed
Refactoring HashMapGenerator
ooq
committed
minor fix
ooq
committed

Commits on Jul 20, 2016

[SPARK-14702] Make environment of SparkLauncher launched process more configurable

Andrew Duffy
authored and
Marcelo Vanzin
committed
[SPARK-16568][SQL][DOCUMENTATION] update sql programming guide refreshTable API in python code

WeichenXu123
authored and
rxin
committed
[SPARK-10683][SPARK-16510][SPARKR] Move SparkR include jar test to SparkSubmitSuite
shivaram
committed
[SPARK-16632][SQL] Respect Hive schema when merging parquet schema.

Marcelo Vanzin
authored and
liancheng
committed
[SPARK-16440][MLLIB] Destroy broadcasted variables even on driver

Anthony Truchet
authored and
srowen
committed
[SPARK-15923][YARN] Spark Application rest api returns 'no such app: …

weiqingy
authored and
srowen
committed
[SPARK-16613][CORE] RDD.pipe returns values for empty partitions

srowen
authored and
rxin
committed
[SPARK-15951] Change Executors Page to use datatables to support sorting columns and searching

kishorvpatil
authored and
Tom Graves
committed
[SPARK-16634][SQL] Workaround JVM bug by moving some code out of ctor.
Marcelo Vanzin
committed
[SPARK-16344][SQL] Decoding Parquet array of struct with a single field named "element"

liancheng
authored and
yhuai
committed

Commits on Jul 21, 2016

Commits on Jul 22, 2016

[SPARK-16287][SQL] Implement str_to_map SQL function

techaddict
authored and
cloud-fan
committed
[SPARK-16556][SPARK-16559][SQL] Fix Two Bugs in Bucket Specification

gatorsmile
authored and
cloud-fan
committed
[SPARK-16287][HOTFIX][BUILD][SQL] Fix annotation argument needs to be a constant

jaceklaskowski
authored and
srowen
committed
[SPARK-16487][STREAMING] Fix some batches might not get marked as fully processed in JobGenerator

ahmed-mahran
authored and
srowen
committed
[GIT] add pydev & Rstudio project file to gitignore list

WeichenXu123
authored and
srowen
committed
[SPARK-16650] Improve documentation of spark.task.maxFailures

Tom Graves
authored and
srowen
committed
[SPARK-16651][PYSPARK][DOC] Make `withColumnRenamed/drop` description more consistent with Scala API

dongjoon-hyun
authored and
srowen
committed

Commits on Jul 23, 2016

[SPARK-16622][SQL] Fix NullPointerException when the returned value of the called method in Invoke is null

viirya
authored and
cloud-fan
committed
Fix hash perf on strings.
ooq
committed
Typo in comment and make two default values private to the base class.
ooq
committed
[SPARK-16561][MLLIB] fix multivarOnlineSummary min/max bug

WeichenXu123
authored and
srowen
committed
[SPARK-16662][PYSPARK][SQL] fix HiveContext warning bug

WeichenXu123
authored and
srowen
committed
[SPARK-16690][TEST] rename SQLTestUtils.withTempTable to withTempView

cloud-fan
authored and
rxin
committed
[SPARK-16380][EXAMPLES] Update SQL examples and programming guide for Python language binding

liancheng
authored and
rxin
committed

Commits on Jul 24, 2016

Commits on Jul 25, 2016