Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rollover alias supports restored searchable snapshot index #16483

Merged
merged 4 commits into from
Nov 4, 2024

Conversation

kkewwei
Copy link
Contributor

@kkewwei kkewwei commented Oct 25, 2024

Description

Using ISM to rollover alias and restore remote index will use _aliases and _rollover api, we should exclude the searchable snapshot index from checkBlock.

Related Issues

Resolves #16419

Check List

  • Functionality includes testing.
  • API changes companion pull request created, if applicable.
  • Public documentation issue/PR created, if applicable.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Copy link
Contributor

✅ Gradle check result for c9b2ee0: SUCCESS

Copy link

codecov bot commented Oct 25, 2024

Codecov Report

Attention: Patch coverage is 87.50000% with 2 lines in your changes missing coverage. Please review.

Project coverage is 72.05%. Comparing base (0363aa7) to head (33a32a0).
Report is 6 commits behind head on main.

Files with missing lines Patch % Lines
...dmin/indices/rollover/TransportRolloverAction.java 0.00% 2 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##               main   #16483      +/-   ##
============================================
+ Coverage     72.00%   72.05%   +0.04%     
- Complexity    65038    65053      +15     
============================================
  Files          5313     5313              
  Lines        303454   303469      +15     
  Branches      43910    43910              
============================================
+ Hits         218510   218668     +158     
+ Misses        67040    66896     -144     
- Partials      17904    17905       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

❕ Gradle check result for a577a7c: UNSTABLE

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

Signed-off-by: kkewwei <kkewwei@163.com>
Copy link
Contributor

❕ Gradle check result for d177114: UNSTABLE

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

@kkewwei
Copy link
Contributor Author

kkewwei commented Oct 29, 2024

❕ Gradle check result for d177114: UNSTABLE

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

org.opensearch.remotestore.RemoteStoreStatsIT.testDownloadStatsCorrectnessSinglePrimarySingleReplica #14310

@kkewwei
Copy link
Contributor Author

kkewwei commented Oct 29, 2024

@andrross, please have a look when you are free.

Signed-off-by: kkewwei <kewei.11@bytedance.com>
Copy link
Contributor

❕ Gradle check result for 4a7bf3d: UNSTABLE

  • TEST FAILURES:
      1 org.opensearch.remotestore.RemoteStoreStatsIT.testDownloadStatsCorrectnessSinglePrimaryMultipleReplicaShards

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

Signed-off-by: kkewwei <kewei.11@bytedance.com>
Copy link
Contributor

github-actions bot commented Nov 1, 2024

✅ Gradle check result for 9b08dd3: SUCCESS

Signed-off-by: kkewwei <kewei.11@bytedance.com>
Copy link
Contributor

github-actions bot commented Nov 2, 2024

✅ Gradle check result for 33a32a0: SUCCESS

@kkewwei
Copy link
Contributor Author

kkewwei commented Nov 3, 2024

@andrross, please have a look when you are free.

@andrross andrross added the backport 2.x Backport to 2.x branch label Nov 4, 2024
@andrross andrross merged commit 4c35a2b into opensearch-project:main Nov 4, 2024
41 of 42 checks passed
@opensearch-trigger-bot
Copy link
Contributor

The backport to 2.x failed:

The process '/usr/bin/git' failed with exit code 128

To backport manually, run these commands in your terminal:

# Navigate to the root of your repository
cd $(git rev-parse --show-toplevel)
# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add ../.worktrees/OpenSearch/backport-2.x 2.x
# Navigate to the new working tree
pushd ../.worktrees/OpenSearch/backport-2.x
# Create a new branch
git switch --create backport/backport-16483-to-2.x
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 4c35a2b418aa4cf14b8f49d7639d386b96752ae8
# Push it to GitHub
git push --set-upstream origin backport/backport-16483-to-2.x
# Go back to the original working tree
popd
# Delete the working tree
git worktree remove ../.worktrees/OpenSearch/backport-2.x

Then, create a pull request where the base branch is 2.x and the compare/head branch is backport/backport-16483-to-2.x.

@andrross
Copy link
Member

andrross commented Nov 5, 2024

It turns out #5277 (from 2 years ago!) was never backported and that is at least one of the causes of the backport conflict here. I'm going to create a backport for #5277 before retrying the backport here.

@kkewwei kkewwei deleted the support_rollover branch November 5, 2024 02:36
@kkewwei kkewwei restored the support_rollover branch November 5, 2024 02:37
@andrross andrross added backport 2.x Backport to 2.x branch and removed backport 2.x Backport to 2.x branch labels Nov 5, 2024
@opensearch-trigger-bot
Copy link
Contributor

The backport to 2.x failed:

The process '/usr/bin/git' failed with exit code 128

To backport manually, run these commands in your terminal:

# Navigate to the root of your repository
cd $(git rev-parse --show-toplevel)
# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add ../.worktrees/OpenSearch/backport-2.x 2.x
# Navigate to the new working tree
pushd ../.worktrees/OpenSearch/backport-2.x
# Create a new branch
git switch --create backport/backport-16483-to-2.x
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 4c35a2b418aa4cf14b8f49d7639d386b96752ae8
# Push it to GitHub
git push --set-upstream origin backport/backport-16483-to-2.x
# Go back to the original working tree
popd
# Delete the working tree
git worktree remove ../.worktrees/OpenSearch/backport-2.x

Then, create a pull request where the base branch is 2.x and the compare/head branch is backport/backport-16483-to-2.x.

andrross pushed a commit to andrross/OpenSearch that referenced this pull request Nov 5, 2024
…earch-project#16483)

Signed-off-by: kkewwei <kkewwei@163.com>
Signed-off-by: kkewwei <kewei.11@bytedance.com>
(cherry picked from commit 4c35a2b)
mch2 pushed a commit that referenced this pull request Nov 6, 2024
… (#16568)

Signed-off-by: kkewwei <kkewwei@163.com>
Signed-off-by: kkewwei <kewei.11@bytedance.com>
(cherry picked from commit 4c35a2b)

Co-authored-by: kkewwei <kewei.11@bytedance.com>
@kkewwei kkewwei deleted the support_rollover branch November 7, 2024 08:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.x Backport to 2.x branch backport-failed bug Something isn't working Search:Searchable Snapshots
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Rollovering aliases should support remote snapshot index
2 participants