Skip to content
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

[NSE-196] clean up native sql options #215

Merged
merged 4 commits into from
Apr 15, 2021

Conversation

zhouyuan
Copy link
Collaborator

What changes were proposed in this pull request?

fixes: #196
Signed-off-by: Yuan Zhou yuan.zhou@intel.com

How was this patch tested?

locally verified

@github-actions
Copy link

#196


// for all operators
val enableCpu = getCpu()

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

missing option for project and hashagg

@github-actions
Copy link


Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
@zhouyuan zhouyuan force-pushed the wip_cleanup_option branch from e926f6e to 360b0e7 Compare April 12, 2021 11:59
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
@github-actions
Copy link


@zhouyuan zhouyuan requested a review from weiting-chen April 13, 2021 05:43
@zhouyuan
Copy link
Collaborator Author

@weiting-chen we might should provide a sample configuration as well

@weiting-chen
Copy link
Collaborator

@weiting-chen we might should provide a sample configuration as well

The code looks good for me, just confirm one thing:
The implementation is if the CPU model is not from Intel, all the functions will be set to false and back to row-based processing.
Can we give some warning messages to help the users to know their functions may not work in non-Intel CPU?

For sample configuration, we can add it in the document for OAP v1.1 release. Check if this PR can backport to v1.1 as well.

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
@github-actions
Copy link


@zhouyuan zhouyuan merged commit b4c2bd1 into oap-project:master Apr 15, 2021
zhouyuan added a commit to zhouyuan/native-sql-engine that referenced this pull request Apr 15, 2021
* clean up native sql options

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* adding more options

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* adding more options

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* adding warning log for running on non-intel cpu

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
zhouyuan added a commit that referenced this pull request Apr 19, 2021
* [NSE-229] Fix the deprecated code warning in shuffle_split_test (#230)

* fix the deprecated code warning in shuffle_split_test

* fix the code style

* format update

* [NSE-239] Adopt ARROW-7011 (#240)

* [NSE-224] update third party code (#242)

* update third party code

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* fix format

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* [NSE-176]Arrow install order issue (#231)

* Add Arrow install script

* [NSE-176]Add Arrow install Script in Arrow Data Source

* remove popd parameter for ubuntu

* Change variables to BFS

* Update Arrow Header and Find Arrow function

* Fix one issue with reading wrong Arrow Path

* Update ARROW_CSV=ON

* Update build_arrow=OFF in Scala UT

* Install parent pom file in Scala UT

* [NSE-196] clean up native sql options (#215)

* clean up native sql options

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* adding more options

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* adding more options

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* adding warning log for running on non-intel cpu

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* [NSE-206]doc update on feature support status (#253)

* update operators support status

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* update docs on operators supporting status

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* fix

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* [NSE-241] fix hashagg result length (#249)

* fix hashagg result length

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* optimize on getting batch size

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* using fixed sized output len for hashagg

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* fix format

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

* [NSE-248] fix arrow dependency order (#259)

* Only read .so.300.0.0

* Fix arroow dataset dependency issue

* Add ARROW_S3=ON, Add symlink copy in CMakeList.

Co-authored-by: JiaKe <ke.a.jia@intel.com>
Co-authored-by: Hongze Zhang <hongze.zhang@intel.com>
Co-authored-by: Wei-Ting Chen <weiting.chen@intel.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

clean up options for native sql engine
2 participants