Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rollback and Snapshot support for remote storage #433

Open
wants to merge 10 commits into
base: master
Choose a base branch
from

Conversation

bluesign
Copy link
Collaborator

Description

Added rollback and snapshot support for remote storage
Remote storage now can use any storage backend ( redid etc )
Added some sanity checks ( don't query blocks on archive after fork etc )


For contributor use:

  • Targeted PR against master branch
  • Linked to GitHub issue with discussion and accepted design OR link to spec that describes this work
  • Code follows the standards mentioned here
  • Updated relevant documentation
  • Re-reviewed Files changed in the GitHub PR explorer
  • Added appropriate labels

@codecov-commenter
Copy link

codecov-commenter commented Jun 22, 2023

Codecov Report

Merging #433 (6053c52) into master (107065f) will decrease coverage by 0.61%.
The diff coverage is 26.19%.

@@            Coverage Diff             @@
##           master     #433      +/-   ##
==========================================
- Coverage   54.51%   53.90%   -0.61%     
==========================================
  Files          27       27              
  Lines        3590     3651      +61     
==========================================
+ Hits         1957     1968      +11     
- Misses       1473     1522      +49     
- Partials      160      161       +1     
Flag Coverage Δ
unittests 53.90% <26.19%> (-0.61%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
server/utils/emulator.go 0.00% <0.00%> (ø)
storage/memstore/memstore.go 10.85% <0.00%> (-0.19%) ⬇️
storage/store.go 56.94% <ø> (ø)
server/server.go 55.73% <14.28%> (+1.25%) ⬆️
storage/remote/store.go 36.81% <27.82%> (-8.90%) ⬇️

@bluesign bluesign marked this pull request as ready for review June 26, 2023 17:25
@bluesign bluesign requested a review from peterargue June 26, 2023 17:26
Copy link
Contributor

@peterargue peterargue left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is awesome! Thanks for cleaning this up @bluesign

@bluesign bluesign added the Feature A new user feature or a new package API label Jun 29, 2023
Copy link
Contributor

@janezpodhostnik janezpodhostnik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work. Left one comment.

storage/remote/store_test.go Outdated Show resolved Hide resolved
@bluesign
Copy link
Collaborator Author

@janezpodhostnik btw somehow archive node version switched stuff from Paths to Registers, and broke this, I can go over this PR or make a new one to fix

@bluesign
Copy link
Collaborator Author

@peterargue can you help me with store_test? I tried but couldn't manage this fixture parts

@bluesign
Copy link
Collaborator Author

I tried to fix this, but stuck again with some conflicts @sideninja

archive, flow-go and contracts related.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature A new user feature or a new package API
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants