-
Notifications
You must be signed in to change notification settings - Fork 181
Add ClickBench IT Suite #3860
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add ClickBench IT Suite #3860
Conversation
Signed-off-by: Lantao Jin <ltjin@amazon.com>
|
@noCharger please review it |
integ-test/src/test/java/org/opensearch/sql/calcite/clickbench/PPLClickBenchIT.java
Outdated
Show resolved
Hide resolved
|
|
||
| @Override | ||
| protected Set<Integer> ignored() { | ||
| return Set.of(29, 41, 43); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
q29: REGEXP_REPLACE() is not supported.
q41: Failed in Calcite engine, TBD
q43: DATE_TRUNC() is not supported.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Update: only q29 is ignored.
q29: REGEXP_REPLACE() is not supported.
q41: a bug of Sarg, fixed in latest commit
q43: DATE_TRUNC() is not supported. Using DATE_FORMAT() instead. ref link
| @@ -0,0 +1,5 @@ | |||
| source=hits | |||
| | where like(URL, '%google%') and SearchPhrase != '' | |||
| | stats /* min(URL), */ count() as c by SearchPhrase | |||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can not push down min aggregation on TEXT field in OpenSearch, commented it out.
| @@ -0,0 +1,7 @@ | |||
| // EventDate >= '2013-07-01' should work in v3 | |||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should be resolved by #3831
Signed-off-by: Lantao Jin <ltjin@amazon.com>
Signed-off-by: Lantao Jin <ltjin@amazon.com>
noCharger
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the change.
|
The backport to To backport manually, run these commands in your terminal: # Navigate to the root of your repository
cd $(git rev-parse --show-toplevel)
# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add ../.worktrees/sql/backport-2.19-dev 2.19-dev
# Navigate to the new working tree
pushd ../.worktrees/sql/backport-2.19-dev
# Create a new branch
git switch --create backport/backport-3860-to-2.19-dev
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 9af1567bbb4b04cafbfd40f460f3c0384b31dc81
# Push it to GitHub
git push --set-upstream origin backport/backport-3860-to-2.19-dev
# Go back to the original working tree
popd
# Delete the working tree
git worktree remove ../.worktrees/sql/backport-2.19-devThen, create a pull request where the |
* Add clickbench IT Suite Signed-off-by: Lantao Jin <ltjin@amazon.com> * Add original SQL and fix the bug of Sarg point (q41) Signed-off-by: Lantao Jin <ltjin@amazon.com> * fix IT of Sarg related Signed-off-by: Lantao Jin <ltjin@amazon.com> * Fix UT Signed-off-by: Lantao Jin <ltjin@amazon.com> --------- Signed-off-by: Lantao Jin <ltjin@amazon.com> (cherry picked from commit 9af1567)
Description
Similar to #3822
Add ClickBench (https://github.com/ClickHouse/ClickBench) to PPL IT suite.
Only one documentation in clickbench index.
It prints the end2end execution times, on my laptop is:
Related Issues
Resolves #[Issue number to be closed when this PR is merged]
Check List
--signoff.By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.