Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Draft] Original changes against main #13

Open
wants to merge 153 commits into
base: main
Choose a base branch
from
Open

[Draft] Original changes against main #13

wants to merge 153 commits into from

Commits on Feb 6, 2024

  1. Split the cluster state remote global metadata file to metadata attri… 

    …bute files

Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    6bf7bc9 View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2024

  1. Upload all the metadata attributes in parallel 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    5d6a0ad View commit details
    Browse the repository at this point in the history

  2. Added javadocs 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    279dbbe View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. Address PR comment 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    0542849 View commit details
    Browse the repository at this point in the history

  2. Add Integ test 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    c9fb25b View commit details
    Browse the repository at this point in the history

  3. Added a bwc test 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    fc270d1 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2024

  1. Address PR comments 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    adb4cf2 View commit details
    Browse the repository at this point in the history

  2. Modify Custom's fromXContent 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    0b38736 View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. Remove ClusterMetadataManifest constructor 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    c86c0f1 View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. Added tests 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    3ed92e5 View commit details
    Browse the repository at this point in the history

  2. remove stale global metadata files 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    e1f517e View commit details
    Browse the repository at this point in the history

  3. spotless apply 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    cd5c9a5 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into cluster_state_split

    @shiv0408
    shiv0408 committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    2bd97d7 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2024

  1. Merge branch 'main' into remote_state_collab

    @shiv0408
    shiv0408 committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    8008ab2 View commit details
    Browse the repository at this point in the history

  2. Refactored RemoteClusterStateService into smaller files 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    33cfeb0 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2024

  1. Merge branch 'main' into cluster_state_split

    @shiv0408
    shiv0408 committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    8244c6d View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. Optimize stale file deletion 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    5f62745 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. Initial commit for RemoteRoutingTableService setup 

    Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
    @himshikha
    himshikha authored and Himshikha Gupta committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    d5a17ed View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. Adds unit test for remote routing setup 

    Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
    Himshikha Gupta committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    9176015 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Initial commit for index routing table manifest 

    Signed-off-by: Bukhtawar Khan <bukhtawa@amazon.com>
    @Bukhtawar
    Bukhtawar authored and Himshikha Gupta committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    a17cf06 View commit details
    Browse the repository at this point in the history

  2. Changes for IndexRoutingTableHeader 

    Signed-off-by: Bukhtawar Khan <bukhtawa@amazon.com>
    @Bukhtawar
    Bukhtawar authored and Himshikha Gupta committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    3dd93b4 View commit details
    Browse the repository at this point in the history

  3. Revert unintentional changes for IndexRoutingTableHeader 

    Signed-off-by: Bukhtawar Khan <bukhtawa@amazon.com>
    @Bukhtawar
    Bukhtawar authored and Himshikha Gupta committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    933cdc2 View commit details
    Browse the repository at this point in the history

  4. Changes for IndexRoutingTableInputStream 

    Signed-off-by: Bukhtawar Khan <bukhtawa@amazon.com>
    @Bukhtawar
    Bukhtawar authored and Himshikha Gupta committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    f35f0dc View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. Merge branch 'main' into cluster_state_split 

    # Conflicts:
#	server/src/main/java/org/opensearch/gateway/remote/RemoteClusterStateService.java
#	server/src/test/java/org/opensearch/gateway/remote/RemoteClusterStateServiceTests.java
    @shiv0408
    shiv0408 committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    425cf20 View commit details
    Browse the repository at this point in the history

  2. fix build after merge 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    8efc1ed View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2024

  1. Merge branch 'main' into cluster_state_split

    @shiv0408
    shiv0408 committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    6c637c0 View commit details
    Browse the repository at this point in the history

  2. Optimize remote state stale file deletion 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    55ed245 View commit details
    Browse the repository at this point in the history

  3. Added UT 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    bef9d2e View commit details
    Browse the repository at this point in the history

  4. Refactored into a clean up manager file 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    6bed64b View commit details
    Browse the repository at this point in the history

  5. Add UT 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    bb4b71f View commit details
    Browse the repository at this point in the history

  6. Modify the Integ test 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    1febb68 View commit details
    Browse the repository at this point in the history

  7. Address PR comments 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    494aacc View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. Address further PR comment 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 2, 2024
    Configuration menu
    Copy the full SHA
    928b650 View commit details
    Browse the repository at this point in the history

  2. apply spotless 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 2, 2024
    Configuration menu
    Copy the full SHA
    2ebfc6d View commit details
    Browse the repository at this point in the history

  3. Address PR comment 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 2, 2024
    Configuration menu
    Copy the full SHA
    8f5d7d7 View commit details
    Browse the repository at this point in the history

  4. Add changelog 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 2, 2024
    Configuration menu
    Copy the full SHA
    4e3c9e9 View commit details
    Browse the repository at this point in the history

  5. apply spotless 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 2, 2024
    Configuration menu
    Copy the full SHA
    5ea5dbb View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. removed unnecessary method 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    fb0b6aa View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. Input stream fixes

    Himshikha Gupta committed May 6, 2024
    Configuration menu
    Copy the full SHA
    cae6632 View commit details
    Browse the repository at this point in the history

  2. Checksum calculation at end of file

    Himshikha Gupta committed May 6, 2024
    Configuration menu
    Copy the full SHA
    40fec5f View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Add toXContent and fromXContent for DiscoveryNode and DiscoveryNodes 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    d5fc147 View commit details
    Browse the repository at this point in the history

  2. fixing checksum

    Himshikha Gupta committed May 7, 2024
    Configuration menu
    Copy the full SHA
    b9887b4 View commit details
    Browse the repository at this point in the history

  3. test fix 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    15d06bc View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Add to and from XContent to ClusterBlock and ClusterBlocks 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    87625d3 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. Address further PR comments 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    032ced2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into cluster_state_split

    @shiv0408
    shiv0408 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    dd76f39 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. Fix test failures 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 13, 2024
    Configuration menu
    Copy the full SHA
    e81db21 View commit details
    Browse the repository at this point in the history

  2. Made minor requested changes 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 13, 2024
    Configuration menu
    Copy the full SHA
    04140ff View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into async_delete 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 13, 2024
    Configuration menu
    Copy the full SHA
    1a6940f View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into cluster_state_split

    @shiv0408
    shiv0408 committed May 13, 2024
    Configuration menu
    Copy the full SHA
    b20537a View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Add read flow for IndexRoutingTable 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya authored and Himshikha Gupta committed May 14, 2024
    Configuration menu
    Copy the full SHA
    c20c6ac View commit details
    Browse the repository at this point in the history

  2. Moving routing table version from IndexRouting stream to manifest 

    Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
    Himshikha Gupta committed May 14, 2024
    Configuration menu
    Copy the full SHA
    381630b View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'shiv0408/OpenSearch/cluster_state_split… 

    …' into async-write
    Himshikha Gupta committed May 14, 2024
    Configuration menu
    Copy the full SHA
    eb1b7ec View commit details
    Browse the repository at this point in the history

  4. Draft changes for Diff manifest upload 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    a10b062 View commit details
    Browse the repository at this point in the history

  5. Download cluster state from remote

    @soosinha
    soosinha committed May 14, 2024
    Configuration menu
    Copy the full SHA
    acdb97e View commit details
    Browse the repository at this point in the history

  6. Fix default time interval 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    2025f70 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. Merge remote-tracking branch 'shiv0408/OpenSearch/remote_state_collab… 

    …' into async-write
    Himshikha Gupta committed May 15, 2024
    Configuration menu
    Copy the full SHA
    289feb4 View commit details
    Browse the repository at this point in the history

  2. Merging from remote cluster state

    Himshikha Gupta committed May 15, 2024
    Configuration menu
    Copy the full SHA
    b09bce7 View commit details
    Browse the repository at this point in the history

  3. Download cluster state from remote

    @soosinha
    soosinha authored and Himshikha Gupta committed May 15, 2024
    Configuration menu
    Copy the full SHA
    df8ddad View commit details
    Browse the repository at this point in the history

  4. Added parser for ClusterDiffManifest 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    df3c088 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into async_delete 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    3ff82b3 View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'shiv/async-write' into remote_state_collab

    @Arpit-Bandejiya
    Arpit-Bandejiya committed May 15, 2024
    Configuration menu
    Copy the full SHA
    96cf135 View commit details
    Browse the repository at this point in the history

  7. Fixig build failures

    Himshikha Gupta committed May 15, 2024
    Configuration menu
    Copy the full SHA
    774f0c8 View commit details
    Browse the repository at this point in the history

  8. Merge pull request #9 from himshikha/async-write 

    Fixig build failures
    @himshikha
    himshikha committed May 15, 2024
    Configuration menu
    Copy the full SHA
    bf54d72 View commit details
    Browse the repository at this point in the history

  9. spotless changes for ClusterBlocks 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    5febe86 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. Merge branch 'main' into async_delete

    @shiv0408
    shiv0408 committed May 16, 2024
    Configuration menu
    Copy the full SHA
    12632fc View commit details
    Browse the repository at this point in the history

  2. remove duplicate diff object from manifest 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 16, 2024
    Configuration menu
    Copy the full SHA
    bd45e85 View commit details
    Browse the repository at this point in the history

  3. Add remote-routing table diff 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed May 16, 2024
    Configuration menu
    Copy the full SHA
    54f1f3d View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into async_delete

    @shiv0408
    shiv0408 committed May 16, 2024
    Configuration menu
    Copy the full SHA
    3825951 View commit details
    Browse the repository at this point in the history

  5. Add transport call to publish remote state

    @soosinha
    soosinha committed May 16, 2024
    Configuration menu
    Copy the full SHA
    f222634 View commit details
    Browse the repository at this point in the history

  6. Fix EmptyMap warning in StreamReader 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed May 16, 2024
    Configuration menu
    Copy the full SHA
    560ecb8 View commit details
    Browse the repository at this point in the history

  7. Add basic read-remote-routing flow 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed May 16, 2024
    Configuration menu
    Copy the full SHA
    4c33720 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. Move diff manifest to new class and fix fromXContent 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 17, 2024
    Configuration menu
    Copy the full SHA
    3186372 View commit details
    Browse the repository at this point in the history

  2. Fix cluster state publication

    @soosinha
    soosinha committed May 17, 2024
    Configuration menu
    Copy the full SHA
    8912b0c View commit details
    Browse the repository at this point in the history

  3. Clean up global metadata attribute objects from remote 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 17, 2024
    Configuration menu
    Copy the full SHA
    b604b09 View commit details
    Browse the repository at this point in the history

  4. Refactor remote state

    @soosinha
    soosinha committed May 17, 2024
    Configuration menu
    Copy the full SHA
    dc204c1 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2024

  1. Add Code for reading from diff file and constructing the Routing Table 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed May 18, 2024
    Configuration menu
    Copy the full SHA
    4056877 View commit details
    Browse the repository at this point in the history

  2. Add Remote Routing read in remote cluster state publication 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed May 18, 2024
    Configuration menu
    Copy the full SHA
    70fae29 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2024

  1. Add clusterUUID when downloading state

    @soosinha
    soosinha committed May 19, 2024
    Configuration menu
    Copy the full SHA
    093d926 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. Add fixes for remote routing table 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed May 20, 2024
    Configuration menu
    Copy the full SHA
    034f54b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'async_delete' into remote_state_collab 

    # Conflicts:
#	server/src/internalClusterTest/java/org/opensearch/gateway/remote/RemoteClusterStateServiceIT.java
#	server/src/main/java/org/opensearch/cluster/metadata/TemplatesMetadata.java
#	server/src/main/java/org/opensearch/gateway/remote/ClusterMetadataManifest.java
#	server/src/main/java/org/opensearch/gateway/remote/RemoteClusterStateService.java
#	server/src/test/java/org/opensearch/gateway/remote/ClusterMetadataManifestTests.java
#	server/src/test/java/org/opensearch/gateway/remote/RemoteClusterStateServiceTests.java
    @shiv0408
    shiv0408 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    8201f2a View commit details
    Browse the repository at this point in the history

  3. Fix build failure after merge 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    ce63a5a View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. Added support for reading cluster state files in parallel 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 21, 2024
    Configuration menu
    Copy the full SHA
    eeff23f View commit details
    Browse the repository at this point in the history

  2. Read diff files asynchronously 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 21, 2024
    Configuration menu
    Copy the full SHA
    7242dad View commit details
    Browse the repository at this point in the history

  3. add missed semicolon 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 21, 2024
    Configuration menu
    Copy the full SHA
    44e1d25 View commit details
    Browse the repository at this point in the history

  4. Fix tests after merge 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 21, 2024
    Configuration menu
    Copy the full SHA
    9982d79 View commit details
    Browse the repository at this point in the history

  5. Enable Routing Table parallel read 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed May 21, 2024
    Configuration menu
    Copy the full SHA
    6d33900 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Create new remote state interfaces and add implementations 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed May 22, 2024
    Configuration menu
    Copy the full SHA
    99687b0 View commit details
    Browse the repository at this point in the history

  2. Remove RemoteObject Store interface 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed May 22, 2024
    Configuration menu
    Copy the full SHA
    3e1f31f View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Reverting dev testing configuration

    @soosinha
    soosinha committed May 23, 2024
    Configuration menu
    Copy the full SHA
    043a170 View commit details
    Browse the repository at this point in the history

  2. Refactor discoverynodes and clusterblocks

    @soosinha
    soosinha committed May 23, 2024
    Configuration menu
    Copy the full SHA
    3e3dfc8 View commit details
    Browse the repository at this point in the history

  3. Async write flow for routing table

    Himshikha Gupta committed May 23, 2024
    Configuration menu
    Copy the full SHA
    89a10ac View commit details
    Browse the repository at this point in the history

  4. Merge pull request #11 from himshikha/async-write 

    Async write flow for routing table
    @himshikha
    himshikha committed May 23, 2024
    Configuration menu
    Copy the full SHA
    6ae16f5 View commit details
    Browse the repository at this point in the history

  5. Add metadata version and change codec version to V3 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    8f0902c View commit details
    Browse the repository at this point in the history

  6. Minor Refactoring for RemoteReadResults 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed May 23, 2024
    Configuration menu
    Copy the full SHA
    7d630e2 View commit details
    Browse the repository at this point in the history

  7. Set metadata version in cluster state

    @soosinha
    soosinha committed May 23, 2024
    Configuration menu
    Copy the full SHA
    c1cd20c View commit details
    Browse the repository at this point in the history

  8. remove excessive logging 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed May 23, 2024
    Configuration menu
    Copy the full SHA
    bb8c208 View commit details
    Browse the repository at this point in the history

  9. Merge remote-tracking branch 'refs/remotes/shiv/remote_state_collab' … 

    …into remote_state_collab
    @Arpit-Bandejiya
    Arpit-Bandejiya committed May 23, 2024
    Configuration menu
    Copy the full SHA
    5dc642e View commit details
    Browse the repository at this point in the history

  10. Fix build issue 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed May 23, 2024
    Configuration menu
    Copy the full SHA
    a9ddead View commit details
    Browse the repository at this point in the history

  11. Fixing build

    @soosinha
    soosinha committed May 23, 2024
    Configuration menu
    Copy the full SHA
    f7fef97 View commit details
    Browse the repository at this point in the history

  12. Add custom metadata diff 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    ae2ed6b View commit details
    Browse the repository at this point in the history

  13. Add RemoteIndexMetadata unit tests 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed May 23, 2024
    Configuration menu
    Copy the full SHA
    a96304d View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Enable remote routing by default with remote state 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed May 24, 2024
    Configuration menu
    Copy the full SHA
    6d1990c View commit details
    Browse the repository at this point in the history

  2. Correct the diff creation logic 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed May 24, 2024
    Configuration menu
    Copy the full SHA
    e022d78 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2024

  1. Delete stale index routing files

    Shailendra Singh committed May 25, 2024
    Configuration menu
    Copy the full SHA
    ca2640b View commit details
    Browse the repository at this point in the history

  2. Fix stale file blob path for indices routing

    Shailendra Singh committed May 25, 2024
    Configuration menu
    Copy the full SHA
    9aa707e View commit details
    Browse the repository at this point in the history

  3. Use isRemoteStateNode condition 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed May 25, 2024
    Configuration menu
    Copy the full SHA
    3aaa6a8 View commit details
    Browse the repository at this point in the history

  4. Add metadata version

    @soosinha
    soosinha committed May 25, 2024
    Configuration menu
    Copy the full SHA
    5d70c59 View commit details
    Browse the repository at this point in the history

  5. Correct blob path for download

    @soosinha
    soosinha committed May 25, 2024
    Configuration menu
    Copy the full SHA
    6a4c721 View commit details
    Browse the repository at this point in the history

  6. Custom toXContent implementations 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    fda3031 View commit details
    Browse the repository at this point in the history

  7. Add indexMetadataListener count to latch 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 25, 2024
    Configuration menu
    Copy the full SHA
    1ea5b01 View commit details
    Browse the repository at this point in the history

Commits on May 26, 2024

  1. Change RemoteObject interface signature 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed May 26, 2024
    Configuration menu
    Copy the full SHA
    9d687fa View commit details
    Browse the repository at this point in the history

  2. refactor manifest manager 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed May 26, 2024
    Configuration menu
    Copy the full SHA
    677b632 View commit details
    Browse the repository at this point in the history

  3. Refactor cleanup manager 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed May 26, 2024
    Configuration menu
    Copy the full SHA
    e12131d View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. Prevent loading ephemeral objects in restore flow 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed May 27, 2024
    Configuration menu
    Copy the full SHA
    f4f773f View commit details
    Browse the repository at this point in the history

  2. Add transient settings to manifest 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 27, 2024
    Configuration menu
    Copy the full SHA
    14a279d View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. Create RemoteObjectStore class and corresponding implementations

    @soosinha
    soosinha committed May 28, 2024
    Configuration menu
    Copy the full SHA
    523889c View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Add remote state implementation unit tests 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed May 29, 2024
    Configuration menu
    Copy the full SHA
    9b1cab6 View commit details
    Browse the repository at this point in the history

  2. Update interface to use entity U 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed May 29, 2024
    Configuration menu
    Copy the full SHA
    9aeea21 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. Remove duplicate tests 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 30, 2024
    Configuration menu
    Copy the full SHA
    1952bac View commit details
    Browse the repository at this point in the history

  2. Add parsing for DiffableStringMap 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 30, 2024
    Configuration menu
    Copy the full SHA
    fc9160c View commit details
    Browse the repository at this point in the history

  3. Add status to cluster block serialization 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 30, 2024
    Configuration menu
    Copy the full SHA
    35970d9 View commit details
    Browse the repository at this point in the history

  4. fix cluster block tests 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 30, 2024
    Configuration menu
    Copy the full SHA
    e541318 View commit details
    Browse the repository at this point in the history

  5. Minor refactoring for read flow 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed May 30, 2024
    Configuration menu
    Copy the full SHA
    e8fec03 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. Upload consistent settings and customs object to remote 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed May 31, 2024
    Configuration menu
    Copy the full SHA
    00f0249 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. Address remote state interface comments

    @soosinha
    soosinha committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    bb335f6 View commit details
    Browse the repository at this point in the history

  2. Implement diffUtils in RemoteRoutingTable 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    6776c03 View commit details
    Browse the repository at this point in the history

  3. refactoring in remote routing table service 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    65a04a2 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. Fix snapshot de/ser 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    2afe186 View commit details
    Browse the repository at this point in the history

  2. Fix snapshot de/ser 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    633b183 View commit details
    Browse the repository at this point in the history

  3. Add UTs for RemoteRoutingTableService 

    Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
    @Arpit-Bandejiya
    Arpit-Bandejiya committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    1c0bbf9 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'refs/remotes/shiv/remote_state_collab' … 

    …into remote_state_collab
    @Arpit-Bandejiya
    Arpit-Bandejiya committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    f15da96 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. Make arraylist synchronized 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    0333312 View commit details
    Browse the repository at this point in the history

  2. Update remote publication to skip download on master node

    @soosinha
    soosinha committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    148eca5 View commit details
    Browse the repository at this point in the history

  3. Add unit tests for uploadBlobAsync

    @soosinha
    soosinha committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    23f49e5 View commit details
    Browse the repository at this point in the history

  4. Address interface comments

    @soosinha
    soosinha committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    7f2391c View commit details
    Browse the repository at this point in the history

  5. read cluster state custom from diff 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    caf61a6 View commit details
    Browse the repository at this point in the history

  6. Remove get/set method from interface 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    e1eddbe View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. Merge branch 'main' into remote_state_collab

    @soosinha
    soosinha committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    944f8b2 View commit details
    Browse the repository at this point in the history

  2. disable checksum for debugging

    @soosinha
    soosinha committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    8b71d2c View commit details
    Browse the repository at this point in the history

  3. Use byte buffer

    @soosinha
    soosinha committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    87ade4c View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Use InputStreams rather than XContent for serialization 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    5c3e28b View commit details
    Browse the repository at this point in the history

  2. Add Remote Entity implementation unit tests

    @soosinha
    soosinha committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    3147aa3 View commit details
    Browse the repository at this point in the history

  3. Add unit tests for Remote Entity implementation 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    0742523 View commit details
    Browse the repository at this point in the history

  4. Add publication flag and remote routing table check 

    Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
    @soosinha
    Himshikha Gupta authored and soosinha committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    26a12cf View commit details
    Browse the repository at this point in the history

  5. Add manifest file name 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    5b83599 View commit details
    Browse the repository at this point in the history

  6. Renaming test files 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    e47d285 View commit details
    Browse the repository at this point in the history

  7. Send manifest file name 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    79eb089 View commit details
    Browse the repository at this point in the history

  8. Send manifest file name in remote publish request 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    fa24988 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2024

  1. Create serde utility for Writable classes 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    5c6f418 View commit details
    Browse the repository at this point in the history

  2. ChecksumWritableBlobStoreFormat Unit test 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    a813834 View commit details
    Browse the repository at this point in the history

  3. Fixing build 

    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
    @soosinha
    soosinha committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    e8c8413 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Handle read ClusterState for V1 manifest 

    Signed-off-by: Shivansh Arora <hishiv@amazon.com>
    @shiv0408
    shiv0408 committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    4def30f View commit details
    Browse the repository at this point in the history