Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Draft] Original changes against main #13

Open
wants to merge 153 commits into
base: main
Choose a base branch
from
Open

[Draft] Original changes against main #13

wants to merge 153 commits into from

Conversation

Arpit-Bandejiya
Copy link
Collaborator

Description

[Describe what this change achieves]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • API changes companion pull request created.
  • Failing checks are inspected and point to the corresponding known issue(s) (See: Troubleshooting Failing Builds)
  • Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)
  • Public documentation issue/PR created

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

shiv0408 and others added 30 commits February 6, 2024 20:22
@shiv0408
Split the cluster state remote global metadata file to metadata attri…
6bf7bc9 
…bute files

Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Upload all the metadata attributes in parallel
5d6a0ad 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Added javadocs
279dbbe 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Address PR comment
0542849 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Add Integ test
c9fb25b 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Added a bwc test
fc270d1 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Address PR comments
adb4cf2 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Modify Custom's fromXContent
0b38736 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Remove ClusterMetadataManifest constructor
c86c0f1 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Added tests
3ed92e5 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
remove stale global metadata files
e1f517e 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
spotless apply
cd5c9a5 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Merge branch 'main' into cluster_state_split
2bd97d7
@shiv0408
Merge branch 'main' into remote_state_collab
8008ab2
@shiv0408
Refactored RemoteClusterStateService into smaller files
33cfeb0 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Merge branch 'main' into cluster_state_split
8244c6d
@shiv0408
Optimize stale file deletion
5f62745 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@himshikha
Initial commit for RemoteRoutingTableService setup
d5a17ed 
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Adds unit test for remote routing setup
9176015 
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
@Bukhtawar
Initial commit for index routing table manifest
a17cf06 
Signed-off-by: Bukhtawar Khan <bukhtawa@amazon.com>
@Bukhtawar
Changes for IndexRoutingTableHeader
3dd93b4 
Signed-off-by: Bukhtawar Khan <bukhtawa@amazon.com>
@Bukhtawar
Revert unintentional changes for IndexRoutingTableHeader
933cdc2 
Signed-off-by: Bukhtawar Khan <bukhtawa@amazon.com>
@Bukhtawar
Changes for IndexRoutingTableInputStream
f35f0dc 
Signed-off-by: Bukhtawar Khan <bukhtawa@amazon.com>
@shiv0408
Merge branch 'main' into cluster_state_split
425cf20 
# Conflicts:
#	server/src/main/java/org/opensearch/gateway/remote/RemoteClusterStateService.java
#	server/src/test/java/org/opensearch/gateway/remote/RemoteClusterStateServiceTests.java
@shiv0408
fix build after merge
8efc1ed 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Merge branch 'main' into cluster_state_split
6c637c0
@shiv0408
Optimize remote state stale file deletion
55ed245 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Added UT
bef9d2e 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Refactored into a clean up manager file
6bed64b 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Add UT
bb4b71f 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
soosinha and others added 5 commits June 3, 2024 08:28
@soosinha
Address remote state interface comments
bb335f6
@Arpit-Bandejiya
Implement diffUtils in RemoteRoutingTable
6776c03 
Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
@Arpit-Bandejiya
refactoring in remote routing table service
65a04a2 
Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
@shiv0408
Fix snapshot de/ser
2afe186 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@shiv0408
Fix snapshot de/ser
633b183 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
soosinha and others added 18 commits June 5, 2024 17:47
@soosinha
Address interface comments
7f2391c
@shiv0408
read cluster state custom from diff
caf61a6 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@soosinha
Remove get/set method from interface
e1eddbe 
Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
@soosinha
Merge branch 'main' into remote_state_collab
944f8b2
@soosinha
disable checksum for debugging
8b71d2c
@soosinha
Use byte buffer
87ade4c
@shiv0408
Use InputStreams rather than XContent for serialization
5c3e28b 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@soosinha
Add Remote Entity implementation unit tests
3147aa3
@soosinha
Add unit tests for Remote Entity implementation
0742523 
Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
@soosinha
Add publication flag and remote routing table check
26a12cf 
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
@soosinha
Add manifest file name
5b83599 
Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
@soosinha
Renaming test files
e47d285 
Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
@soosinha
Send manifest file name
79eb089 
Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
@soosinha
Send manifest file name in remote publish request
fa24988 
Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
@soosinha
Create serde utility for Writable classes
5c6f418 
Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
@soosinha
ChecksumWritableBlobStoreFormat Unit test
a813834 
Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
@soosinha
Fixing build
e8c8413 
Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
@shiv0408
Handle read ClusterState for V1 manifest
4def30f 
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@soosinha soosinha soosinha left review comments

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@Arpit-Bandejiya @soosinha @shiv0408 @himshikha @Bukhtawar