Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Backport 2.8] Support for pagination in v2 engine of SELECT * FROM <table> queries #1685

Merged
merged 2 commits into from
May 30, 2023

Conversation

opensearch-trigger-bot[bot]
Copy link
Contributor

Backport 57ce303 from #1666

#1666)

v2 SQL engine can now paginate simple queries. Pagination is initiated by setting fetch_size property in the request JSON.

Pagination is implemented using the OpenSearch Scroll API. Please see pagination-v2.md for implementation details.
---------

Signed-off-by: MaxKsyunz <maxk@bitquilltech.com>
Signed-off-by: Yury-Fridlyand <yury.fridlyand@improving.com>
Signed-off-by: Max Ksyunz <maxk@bitquilltech.com>
Co-authored-by: Yury-Fridlyand <yury.fridlyand@improving.com>
Co-authored-by: GabeFernandez310 <Gabriel.Fernandez@improving.com>
Co-authored-by: Andrew Carbonetto <andrewc@bitquilltech.com>
(cherry picked from commit 57ce303)
@codecov
Copy link

codecov bot commented May 30, 2023

Codecov Report

Merging #1685 (43f7ef4) into 2.8 (5d0cb13) will increase coverage by 0.06%.
The diff coverage is 100.00%.

@@             Coverage Diff              @@
##                2.8    #1685      +/-   ##
============================================
+ Coverage     97.21%   97.28%   +0.06%     
- Complexity     4223     4332     +109     
============================================
  Files           374      388      +14     
  Lines         10570    10809     +239     
  Branches        739      761      +22     
============================================
+ Hits          10276    10515     +239     
  Misses          287      287              
  Partials          7        7              
Flag Coverage Δ
sql-engine 97.28% <100.00%> (+0.06%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...ch/sql/planner/optimizer/LogicalPlanOptimizer.java 100.00% <ø> (ø)
...pensearch/sql/planner/physical/FilterOperator.java 100.00% <ø> (ø)
...pensearch/sql/planner/physical/NestedOperator.java 100.00% <ø> (ø)
...java/org/opensearch/sql/storage/StorageEngine.java 100.00% <ø> (ø)
...rc/main/java/org/opensearch/sql/storage/Table.java 100.00% <ø> (ø)
...ch/sql/opensearch/client/OpenSearchRestClient.java 100.00% <ø> (ø)
...ch/sql/opensearch/response/OpenSearchResponse.java 100.00% <ø> (ø)
...rch/sql/opensearch/setting/OpenSearchSettings.java 100.00% <ø> (ø)
...ql/opensearch/storage/OpenSearchStorageEngine.java 100.00% <ø> (ø)
...ge/script/aggregation/AggregationQueryBuilder.java 100.00% <ø> (ø)
... and 47 more

Somehow the import is required in 2.x but not 3.0

Signed-off-by: MaxKsyunz <maxk@bitquilltech.com>
@Yury-Fridlyand Yury-Fridlyand merged commit 8ea39ef into 2.8 May 30, 2023
@github-actions github-actions bot deleted the backport/backport-1666-to-2.8 branch May 30, 2023 22:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants