Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

11-to-12: Re-work logic to use the backup file for both migrate and revert #150

Merged
merged 7 commits into from
Feb 15, 2022

Commits on Jan 14, 2022

  1. fs-repo-11-to-12: add environment variables for configuring the numbe…

    …r of workers and the sync size
    aschmahmann committed Jan 14, 2022
    Configuration menu
    Copy the full SHA
    4dd1944 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2022

  1. Configuration menu
    Copy the full SHA
    09055a5 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    368fcab View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2022

  1. Rename SYNC_SIZE env var to SYNC_SIZE_BYTES

    Avoid that there is confusion about the unit used.
    hsanjuan committed Jan 19, 2022
    Configuration menu
    Copy the full SHA
    ff44fe3 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    939db64 View commit details
    Browse the repository at this point in the history
  3. 11-to-12: Re-work logic to use the backup file for both migrate and r…

    …evert
    
    Before: we Query all keys and write a backup file. Then Query all keys and
    perform the swaps. This may cause that our query keeps getting results for all
    the keys that we are writing while we run it.
    
    After: we perform a Prepare() step where we query all the keys and write the
    backup file. Then we read the backup file to perform the swaps without making
    another query.
    
    This also means that the migration (swapper.Run()) becomes very similar to the
    revert (swapper.Revert()), since both read from the backup file. We are thus
    able to refactor code and re-use logic better.
    
    We have also tuned down the noise when encountering multihashes that are not
    CIDv0s.
    hsanjuan committed Jan 19, 2022
    Configuration menu
    Copy the full SHA
    af29094 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2022

  1. Configuration menu
    Copy the full SHA
    fa319e8 View commit details
    Browse the repository at this point in the history