Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix system_repository setting is restored after cluster metadata recovery from local disk #10556

Merged

Conversation

linuxpi
Copy link
Collaborator

@linuxpi linuxpi commented Oct 11, 2023

Description

  • system_repository setting value was removed during toXContent call of RepositoriesMetadata
  • This was done to remove this setting from GetRepositoies API call
  • But toXContent also serializes data for persistent local disk state.
  • So during cluster state recovery from local disk, this system_repository setting was lost.
  • This change ensures system_respository setting is persisted in local disk state

Related Issues

Resolves #10555

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)
  • Public documentation issue/PR created

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@github-actions github-actions bot added the bug Something isn't working label Oct 11, 2023
@github-actions
Copy link
Contributor

github-actions bot commented Oct 11, 2023

Compatibility status:

Checks if related components are compatible with change b3860c3

Incompatible components

Incompatible components: [https://github.com/opensearch-project/neural-search.git]

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/notifications.git]

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@codecov
Copy link

codecov bot commented Oct 11, 2023

Codecov Report

Merging #10556 (b3860c3) into main (a54108c) will decrease coverage by 0.01%.
Report is 2 commits behind head on main.
The diff coverage is 36.36%.

@@             Coverage Diff              @@
##               main   #10556      +/-   ##
============================================
- Coverage     71.18%   71.17%   -0.01%     
- Complexity    58407    58411       +4     
============================================
  Files          4844     4845       +1     
  Lines        275306   275312       +6     
  Branches      40086    40086              
============================================
- Hits         195969   195955      -14     
- Misses        62948    62992      +44     
+ Partials      16389    16365      -24     
Files Coverage Δ
...ibs/core/src/main/java/org/opensearch/Version.java 78.09% <100.00%> (ø)
...in/java/org/opensearch/index/shard/IndexShard.java 69.47% <ø> (-0.47%) ⬇️
...ster/repositories/get/GetRepositoriesResponse.java 56.25% <0.00%> (ø)
...nsearch/cluster/metadata/RepositoriesMetadata.java 75.00% <0.00%> (-1.93%) ⬇️
...dex/translog/transfer/TranslogTransferManager.java 79.37% <50.00%> (ø)
...search/index/translog/InternalTranslogManager.java 66.43% <0.00%> (-0.93%) ⬇️
...anslog/transfer/TranslogUploadFailedException.java 50.00% <50.00%> (ø)

... and 436 files with indirect coverage changes

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@gbbafna
Copy link
Collaborator

gbbafna commented Oct 11, 2023

    org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testReplicationAfterPrimaryRefreshAndFlush
    org.opensearch.search.aggregations.metrics.CardinalityWithRequestBreakerIT.testRequestBreaker {p0={"search.concurrent_segment_search.enabled":"true"}}

Unrelated failures .

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@linuxpi linuxpi force-pushed the fix-system-repo-setting-restore branch from 13a08e7 to 112f624 Compare October 12, 2023 05:47
@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@linuxpi linuxpi force-pushed the fix-system-repo-setting-restore branch from 112f624 to 3e39eb0 Compare October 12, 2023 07:11
@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

…very from local disk

Signed-off-by: bansvaru <bansvaru@amazon.com>
Signed-off-by: bansvaru <bansvaru@amazon.com>
Signed-off-by: bansvaru <bansvaru@amazon.com>
@linuxpi linuxpi force-pushed the fix-system-repo-setting-restore branch from 3e39eb0 to b3860c3 Compare October 12, 2023 08:07
@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

  • RESULT: UNSTABLE ❕
  • TEST FAILURES:
      1 org.opensearch.search.SearchWeightedRoutingIT.testMultiGetWithNetworkDisruption_FailOpenEnabled

@gbbafna gbbafna merged commit 9c06228 into opensearch-project:main Oct 12, 2023
13 of 16 checks passed
@linuxpi linuxpi deleted the fix-system-repo-setting-restore branch October 12, 2023 10:46
@gbbafna gbbafna added the backport 2.x Backport to 2.x branch label Oct 12, 2023
opensearch-trigger-bot bot pushed a commit that referenced this pull request Oct 12, 2023
…very from local disk (#10556)

Signed-off-by: bansvaru <bansvaru@amazon.com>
(cherry picked from commit 9c06228)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
gbbafna pushed a commit that referenced this pull request Oct 14, 2023
…very from local disk (#10556) (#10592)

(cherry picked from commit 9c06228)

Signed-off-by: bansvaru <bansvaru@amazon.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
deshsidd pushed a commit to deshsidd/OpenSearch that referenced this pull request Oct 19, 2023
…very from local disk (opensearch-project#10556)

Signed-off-by: bansvaru <bansvaru@amazon.com>
Signed-off-by: Siddhant Deshmukh <deshsid@amazon.com>
austintlee pushed a commit to austintlee/OpenSearch that referenced this pull request Oct 23, 2023
…very from local disk (opensearch-project#10556)

Signed-off-by: bansvaru <bansvaru@amazon.com>
shiv0408 pushed a commit to Gaurav614/OpenSearch that referenced this pull request Apr 25, 2024
…very from local disk (opensearch-project#10556)

Signed-off-by: bansvaru <bansvaru@amazon.com>
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.x Backport to 2.x branch bug Something isn't working skip-changelog
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] [Remote Store] Post cluster manager recovery from local disk, system_repository setting is always false
3 participants