[SPARK-14346] [SQL] Show create table #12406

Closed

xwu0226 wants to merge 114 commits intoapache:masterfrom

xwu0226:show_create_table_2

Commits on Apr 13, 2016

merge the code committed by CREATE TABLE native support
xwu0226
committed

Commits on Apr 14, 2016

rework show create ddl based on new native supported create table DDL work
xwu0226
committed
Merge branch 'show_create_table_1' into show_create_table_2
xwu0226
committed

Commits on Apr 15, 2016

[SPARK-14601][DOC] Minor doc/usage changes related to removal of Spark assembly

markgrover
authored and
rxin
committed
remove spaces
xwu0226
committed
[SPARK-14447][SQL] Speed up TungstenAggregate w/ keys using VectorizedHashMap

sameeragarwal
authored and
yhuai
committed
[SPARK-14275][SQL] Reimplement TypedAggregateExpression to DeclarativeAggregate
cloud-fan
committed
[SPARK-14374][ML][PYSPARK] PySpark ml GBTClassifier, Regressor support export/import

yanboliang
authored and
mengxr
committed
Closes #12407
rxin
committed
[SPARK-14549][ML] Copy the Vector and Matrix classes from mllib to ml in mllib-local

DB Tsai
authored and
mengxr
committed
[SPARK-14370][MLLIB] removed duplicate generation of ids in OnlineLDAOptimizer

Pravin Gadakh
authored and
srowen
committed
[SPARK-14633] Use more readable format to show memory bytes in Error Message

peterableda
authored and
srowen
committed
[SPARK-13925][ML][SPARKR] Expose R-like summary statistics in SparkR::glm for more family and link functions

yanboliang
authored and
mengxr
committed
update upon review - use visitTableIdentifier
xwu0226
committed
[SPARK-14665][ML][PYTHON] Fixed bug with StopWordsRemover default stopwords
jkbradley
committed
[SPARK-14104][PYSPARK][ML] All Python param setters should use the `_set` method

sethah
authored and
jkbradley
committed
[SPARK-7861][ML] PySpark OneVsRest

yinxusen
authored and
jkbradley
committed
[SPARK-14628][CORE] Simplify task metrics by always tracking read/write metrics
rxin
committed
[SPARK-14620][SQL] Use/benchmark a better hash in VectorizedHashMap

sameeragarwal
authored and
yhuai
committed

Commits on Apr 16, 2016

[SPARK-14668][SQL] Move CurrentDatabase to Catalyst

yhuai
authored and
rxin
committed
[SPARK-14677][SQL] Make the max number of iterations configurable for Catalyst

rxin
authored and
yhuai
committed
[SPARK-13363][SQL] support Aggregator in RelationalGroupedDataset

cloud-fan
authored and
rxin
committed
Revert "[SPARK-13363][SQL] support Aggregator in RelationalGroupedDataset"
rxin
committed
[MINOR] Remove inappropriate type notation and extra anonymous closure within functional transformations

HyukjinKwon
authored and
srowen
committed
[SPARK-14605][ML][PYTHON] Changed Python to use unicode UIDs for spark.ml Identifiable
jkbradley
committed
[SPARK-14677][SQL] follow up: make max iter num config internal

rxin
authored and
yhuai
committed
[SPARK-14683][DOCUMENTATION] Configure external links in ScalaDoc

Atry
authored and
rxin
committed
[SPARK-14647][SQL] Group SQLContext/HiveContext state into SharedState

Andrew Or
authored and
yhuai
committed
[SPARK-14672][SQL] Move HiveContext analyze logic to AnalyzeTable

Andrew Or
authored and
yhuai
committed

Commits on Apr 17, 2016

[SPARK-13904][SCHEDULER] Add support for pluggable cluster manager

Hemant Bhanawat
authored and
rxin
committed
Mark ExternalClusterManager as private[spark].
rxin
committed
[SPARK-14632] randomSplit method fails on dataframes with maps in schema

sbcd90
authored and
rxin
committed

Commits on Apr 18, 2016

Revert "[SPARK-14647][SQL] Group SQLContext/HiveContext state into SharedState"
Andrew Or
committed
[SPARK-13363][SQL] support Aggregator in RelationalGroupedDataset
cloud-fan
committed
[SPARK-14696][SQL] Add implicit encoders for boxed primitive types

rxin
authored and
cloud-fan
committed
[SPARK-14423][YARN] Avoid same name files added to distributed cache again

jerryshao
authored and
Marcelo Vanzin
committed
[SPARK-14614] [SQL] Add `bround` function

dongjoon-hyun
authored and
davies
committed
[SPARK-14473][SQL] Define analysis rules to catch operations not supported in streaming

tdas
authored and
zsxwing
committed
[SPARK-14306][ML][PYSPARK] PySpark ml.classification OneVsRest support export/import

yinxusen
authored and
jkbradley
committed
[SPARK-14580][SPARK-14655][SQL] Hive IfCoercion should preserve predicate.

dongjoon-hyun
authored and
rxin
committed
[SPARK-14564][ML][MLLIB][PYSPARK] Python Word2Vec missing setWindowSize method

jasoncl
authored and
jkbradley
committed
[HOTFIX] Fix Scala 2.10 compilation break.
rxin
committed
[SPARK-14647][SQL] Group SQLContext/HiveContext state into SharedState

Andrew Or
authored and
yhuai
committed
[SPARK-14440][PYSPARK] Remove pipeline specific reader and writer

yinxusen
authored and
mengxr
committed
[SPARK-14299][EXAMPLES] Remove duplications for scala.examples.ml

yinxusen
authored and
mengxr
committed
[MINOR] Revert removing explicit typing (changed in some examples and StatFunctions)

HyukjinKwon
authored and
rxin
committed
[SPARK-14710][SQL] Rename gen/genCode to genCode/doGenCode to better reflect the semantics

sameeragarwal
authored and
rxin
committed
[SPARK-14674][SQL] Move HiveContext.hiveconf to HiveSessionState

Andrew Or
authored and
yhuai
committed
[SPARK-14504][SQL] Enable Oracle docker tests

lresende
authored and
JoshRosen
committed
[SPARK-14713][TESTS] Fix the flaky test NettyBlockTransferServiceSuite
zsxwing
committed
[SPARK-14628][CORE][FOLLLOW-UP] Always tracking read/write metrics

cloud-fan
authored and
rxin
committed

Commits on Apr 19, 2016

[SPARK-14515][DOC] Add python example for ChiSqSelector

zhengruifeng
authored and
jkbradley
committed
[SPARK-14714][ML][PYTHON] Fixed issues with non-kwarg typeConverter arg for Param constructor
jkbradley
committed
[SPARK-14711][BUILD] Examples jar not a part of distribution.

markgrover
authored and
Marcelo Vanzin
committed
[SPARK-13227] Risky apply() in OpenHashMap

CodingCat
authored and
rxin
committed
[SPARK-14667] Remove HashShuffleManager
rxin
committed
[SPARK-14719] WriteAheadLogBasedBlockHandler should ignore BlockManager put errors

JoshRosen
authored and
tdas
committed
[SPARK-14718][SQL] Avoid mutating ExprCode in doGenCode

sameeragarwal
authored and
rxin
committed
[SPARK-14722][SQL] Rename upstreams() -> inputRDDs() in WholeStageCodegen

sameeragarwal
authored and
rxin
committed
[SPARK-14595][SQL] add input metrics for FileScanRDD

cloud-fan
authored and
rxin
committed
[SPARK-14398][SQL] Audit non-reserved keyword list in ANTLR4 parser

bomeng
authored and
hvanhovell
committed
[SPARK-14577][SQL] Add spark.sql.codegen.maxCaseBranches config option

dongjoon-hyun
authored and
cloud-fan
committed
[SPARK-13681][SPARK-14458][SPARK-14566][SQL] Add back once removed CommitFailureTestRelationSuite and SimpleTextHadoopFsRelationSuite

liancheng
authored and
yhuai
committed
[SPARK-14491] [SQL] refactor object operator framework to make it easy to eliminate serializations

cloud-fan
authored and
davies
committed
[SPARK-13904] Add exit code parameter to exitExecutor()

tedyu
authored and
zsxwing
committed
[SPARK-12457] Fixed the Wrong Description and Missing Example in Collection Functions

gatorsmile
authored and
rxin
committed
[SPARK-14676] Wrap and re-throw Await.result exceptions in order to capture full stacktrace

JoshRosen
authored and
rxin
committed
[SPARK-14675][SQL] ClassFormatError when use Seq as Aggregator buffer type

cloud-fan
authored and
yhuai
committed
[SPARK-14656][CORE] Fix Benchmark.getPorcessorName() always return "Unknown processor" on Linux

kiszk
authored and
hvanhovell
committed
[SPARK-14042][CORE] Add custom coalescer support

nezihyigitbasi
authored and
rxin
committed
[SPARK-4226] [SQL] Support IN/EXISTS Subqueries

hvanhovell
authored and
davies
committed
[SPARK-14733] Allow custom timing control in microbenchmarks

ericl
authored and
rxin
committed
[SPARK-12224][SPARKR] R support for JDBC source

felixcheung
authored and
shivaram
committed
Revert "[SPARK-14719] WriteAheadLogBasedBlockHandler should ignore BlockManager put errors"
JoshRosen
committed

Commits on Apr 20, 2016

[SPARK-14717] [PYTHON] Scala, Python APIs for Dataset.unpersist differ in default blocking value

felixcheung
authored and
davies
committed
[SPARK-14407][SQL] Hides HadoopFsRelation related data source API into execution/datasources package #12178

liancheng
authored and
yhuai
committed
[SPARK-13929] Use Scala reflection for UDTs

joan38
authored and
marmbrus
committed
[SPARK-14705][YARN] support Multiple FileSystem for YARN STAGING DIR

lianhuiwang
authored and
Marcelo Vanzin
committed
[SPARK-13905][SPARKR] Change signature of as.data.frame() to be consistent with the R base package.

Sun Rui
authored and
shivaram
committed
[SPARK-13419] [SQL] Update SubquerySuite to use checkAnswer for validation

lresende
authored and
davies
committed
[SPARK-14704][CORE] create accumulators in TaskMetrics

cloud-fan
authored and
rxin
committed
[SPARK-14600] [SQL] Push predicates through Expand

cloud-fan
authored and
davies
committed
[MINOR] [SQL] Re-enable `explode()` and `json_tuple()` testcases in ExpressionToSQLSuite

dongjoon-hyun
authored and
davies
committed
[SPARK-14639] [PYTHON] [R] Add `bround` function in Python/R.

dongjoon-hyun
authored and
davies
committed
[SPARK-9013][SQL] generate MutableProjection directly instead of return a function

cloud-fan
authored and
rxin
committed
[SPARK-14679][UI] Fix UI DAG visualization OOM.

rdblue
authored and
srowen
committed
[SPARK-14687][CORE][SQL][MLLIB] Call path.getFileSystem(conf) instead of call FileSystem.get(conf)

lw-lin
authored and
srowen
committed
[SPARK-14635][ML] Documentation and Examples for TF-IDF only refer to HashingTF

hhbyyh
authored and
srowen
committed
[SPARK-8171][WEB UI] Javascript based infinite scrolling for the log page

ajbozarth
authored and
sarutak
committed
[SPARK-14555] First cut of Python API for Structured Streaming

brkyvz
authored and
marmbrus
committed
[SPARK-14742][DOCS] Redirect spark-ec2 doc to new location

srowen
authored and
rxin
committed
[SPARK-14725][CORE] Remove HttpServer class

jerryshao
authored and
rxin
committed
[MINOR][ML][PYSPARK] Fix omissive param setters which should use _set method

yanboliang
authored and
Nick Pentreath
committed
generate dataframe API create table for some datasource tables
xwu0226
committed
synch up with master branch
xwu0226
committed
[SPARK-14478][ML][MLLIB][DOC] Doc that StandardScaler uses the corrected sample std
jkbradley
committed
[SPARK-14741][SQL] Fixed error in reading json file stream inside a partitioned directory

tdas
authored and
marmbrus
committed
[SPARK-14720][SPARK-13643] Move Hive-specific methods into HiveSessionState and Create a SparkSession class

Andrew Or
authored and
rxin
committed
[MINOR][ML][PYSPARK] Fix omissive params which should use TypeConverter

yanboliang
authored and
jkbradley
committed
[SPARK-14678][SQL] Add a file sink log to support versioning and compaction

zsxwing
authored and
marmbrus
committed
[SPARK-13842] [PYSPARK] pyspark.sql.types.StructType accessor enhancements

shea-parkes
authored and
davies
committed
[SPARK-14749][SQL, TESTS] PlannerSuite failed when it run individually

sbcd90
authored and
rxin
committed
update upon review
xwu0226
committed
synch up with latest change
xwu0226
committed

Commits on Apr 21, 2016

synch up again
xwu0226
committed