Skip to content
This repository has been archived by the owner on Aug 2, 2022. It is now read-only.

Merge develop to master #553

Merged
merged 49 commits into from
Jul 9, 2020
Merged

Merge develop to master #553

merged 49 commits into from
Jul 9, 2020

Conversation

joshuali925
Copy link
Contributor

Issue #, if available:

Description of changes:

  • Merge all changes in develop to master, bump master to 1.9 again

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

penghuo and others added 30 commits April 6, 2020 09:46
* add basic parser support

* Reduce the permission by removing java.security.AllPermission
* update

* update ut

* add more ut

* support missing and null value

* update doc and BuiltinFunctionRepository interface
* m

* Added antlr files

* Added wildcard

* Implemented parser for commands of simple syntax

* addressed comments

* Enabled parsing nested fields and arrays in field

* Added unit tests for nested fields

* Added Java doc for classes

* Replaced the imported parser with static methods in the parser

* Addressed comments

* Addressed comments

* Addressed comments

* changed LogicalPlan to UnresolvedPlan; added test for index name with dots; changed the funcName to String in Function expression

* Reverted nest

* Removed constant and replaced it with literalValue in antlr parser

* Simplified the accept methods

* Update

* Added builder pattern

* Rolled back to remove builder

* update

* Revert "Added builder pattern"

This reverts commit acb1575

* update
* change the package from plans to ast

* move ast definition to core module
* Added antlr files

* Added wildcard

* Implemented parser for commands of simple syntax

* addressed comments

* Enabled parsing nested fields and arrays in field

* Added unit tests for nested fields

* Added Java doc for classes

* Replaced the imported parser with static methods in the parser

* Addressed comments

* changed LogicalPlan to UnresolvedPlan; added test for index name with dots; changed the funcName to String in Function expression

* Enabled the rest of comparison operations; modified related tests

* Added optional arguments in commands

* Reverted nest

* Removed constant and replaced it with literalValue in antlr parser

* Simplified the accept methods

* Added builder pattern

* Rolled back to remove builder

* Revert "Added builder pattern"

This reverts commit acb1575

* Added argument factory; refracted in tests

* Added sparkline aggregation

* improved parser and argument factory test coverage

* Added java doc for ArgumentFactory class

* Added field with optional arguments; added tests

* Added qualifiedname node as nested field

* Expression -> UnresolvedExpression; DSL -> AstDSL

* Updated copyright 2019 -> 2020

* Replaced getMethod in Relation with string return type

* Addressed comments

* Added assert in ppl service test
* update

* update

* add doc

* change the package name from schema to symbol

* fix build issue
* Add elasticsearch storage implementation

* Add elasticsearch storage implementation

* Add more test cases for better coverage

* Exclude security access from test coverage verification

* Add more ES type for test

* Refactor and more JavaDocs

* Add toString for es domain class

* Remove useless jacoco dir exclude

* Add JavaDoc and UT for non exist field case
* add aggregator

* update

* update

* add sum aggregator

* update license header

* update bindingtuple

* address comments
* added binary operations in ppl parser

* Removed sparkline aggregation term

* Moved function call and binary arithmetic to 'expression'
* Move response listener interface to common module and add java doc

* Add json response formatter and UT

* Add json response formatter and UT

* Add json response formatter and UT

* Add enum for pretty format

* Move to protocol module

* Move to protocol module

* Implement json formatter

* Add more UTs

* Refactor

* Fix error in ppl

* Add total and size field

* Refactor

* Refactor

* Refactor

* Refactor

* Add JavaDoc

* Add JavaDoc

* Add to-do and UT for missing values
* add LogicalProject and LogicalRemove

* add todo comments

* add physical project and remove operator

* update
* Add implement interface

* Add JavaDoc

* Add index scan and UT

* Add index scan and UT

* Add more UT for coverage

* Add more UT for coverage

* Add more UT for coverage

* Add more UT for coverage

* Add more JavaDoc

* Add more UTs for coverage

* Prepare for PR

* Prepare for PR

* Prepare for PR

* UT

* Add planner

* Add planner

* Add more operator visit methods
* added test base

* added doc

* upgraded junit5; added comments for test jar
* Add es executor implementation

* Implement schedule method

* Add more UT

* Create index name resolver

* Integrate each component in Spring

* Fix PPL IT

* Fix PPL IT

* Remove execution engine generic type

* Add query response

* Add java doc

* Add IT
* [PPL] Support sort command

* address comments
* dedup operator

* update deduper

* add dedup ast node

* add logical dedup

* add dedup operator to ElasticsearchIndex

* address comments
* Add standalone IT and rest client impl

* Add standalone IT and rest client impl

* Add rest client UT

* Add more UT

* Add cleanup method

* Add assertion for cleanup method

* Avoid cleanup multiple times

* Don't cleanup at last page automatically

* More comments

* UT covers all branches
* Add standalone IT and rest client impl

* Add standalone IT and rest client impl

* Add rest client UT

* Add more UT

* Add cleanup method

* Add assertion for cleanup method

* Avoid cleanup multiple times

* Don't cleanup at last page automatically

* More comments

* UT covers all branches

* Fix compiling error after merge
* Remove row field in json response

* Fix IT
* [PPL] Support Count aggregator and OR operator

* address comments
…ields commands (#496)

* Redefined null lists to empty lists

* Added PPL query analysis integration test

* Added PPL where command integration test

* Added PPL fields command integration test

* Added PPL search command integration test

* Addressed comments
* Set up gradle.build

* Added sql and ppl parser

* Added bash parser

* Added category.json and sample docs to help user setup doctest
* Added integration tests for dedup, rename, sort, stats commands; implemented util methods to get schema, result set, column names etc.
dai-chen and others added 19 commits June 1, 2020 14:04
* enfore checkstyle for core module

* enfore checkstyle for ppl module

* enfore checkstyle for plugin module

* enfore checkstyle for protocol module

* enfore checkstyle for common module

* enfore checkstyle for integ-test module

* add google checkstyle

* enfore checkstyle for elasticsearch module

* update
* Move sql src to legacy src and pass compile

* Move sql test and pass all UT

* Move sql IT and pass all IT

* Pass gradle build

* Pass all github workflows

* Pass checkstyle

* Pass doctest, comparison test and test with remote cluster

* Reformat legacy test code
* add interface

* update

* search command

* add dedup

* update commands

* update syntax

* wording

* remove sample

* address comments

* update

* update

* add multiple fields description for rename
…523)

* Added syntax check exception

* Update

* Update

* Added integ test case
* Supported expression in syntax

* Added integ test case
* move index mapping definition to standalone json files

* Migrate functions to use mapping json file

* simply code to load mapping file

* split index mapping definition into separated file for legacy integTest

* Revert changes for legacy/../TestUtils.java

This reverts commit b73ad70.
This reverts commit f65122a.
* support expression in syntax and parser

* Support nested expression in syntax

* Support <, <=, >, >= in expression;
Corrected column names for functions/operators;
Added unit tests for <, <=, >, >=.

* Added tests

* Supported NOT, XOR operators in analyzer;
Added integration test cases.

* Support NOTEQUAL(!=)

* Removed the value compare table respect to null and missing fields

* Added syntax check exception

* address comments

* Removed compareTo method from ExprValue interface
* Add new SQL module with support for SELECT literal

* Add support for more data types

* Route request to new frontend

* Add more UT

* Fix doctest

* Add more UT

* Add more UT

* Fix checkstyle and jacoco

* Address PR

* Add more docs

* Use new syntax check exception

* Unregister new handler and add UT

* Support fetch size 0 which is default request by JDBC driver

* Address PR comments
* update

* add doc

* address comments

* address comments
* Add comparison test base class and sample IT

* Close connection

* Add refresh=true

* Add refresh=true

* Add comment to explain why not close REST client

* Organize test case in txt file

* Support fetch size 0 which is default request by JDBC driver

* Explain comparison test result for easy troubleshooting

* Run queries in a file by a batch

* Prepare for PR

* Prepare PR

* Remove unused query files
* Added like operator

* Added integration test case

* Change the matches method argument order

* generified building methods for function bundles and function builders

* Added tests

* Separate matches method from operator utils
* Add select expression support

* Add UT

* Add function

* More UT

* Change doc

* Add comparison test cases

* Add test for edge case

* Change doc
* Add plugin setting for new sql module

* Add doc

* Disable new engine by default and change doctest

* Enable new engine before comparison test

* Enable new engine before comparison test

* Remove include directive

* Remove note directive

* Update old doc

* Delete usused IT
* Redefine the Expression interface and Type

* address comments
@joshuali925 joshuali925 merged commit 893cd18 into master Jul 9, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants