Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

unixfs autosharding with config #8527

Closed
wants to merge 9 commits into from
Closed

unixfs autosharding with config #8527

wants to merge 9 commits into from

Commits on Nov 15, 2021

  1. tmp chore: bump deps

    @aschmahmann
    aschmahmann committed Nov 15, 2021
    Configuration menu
    Copy the full SHA
    d9d3321 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2021

  1. add support for setting automatic unixfs sharding threshold from the … 

    …config
    @aschmahmann
    aschmahmann committed Nov 16, 2021
    Configuration menu
    Copy the full SHA
    86d41db View commit details
    Browse the repository at this point in the history

  2. test: have tests use low cutoff for sharding to mimic old behavior

    @aschmahmann
    aschmahmann committed Nov 16, 2021
    Configuration menu
    Copy the full SHA
    66e0f98 View commit details
    Browse the repository at this point in the history

  3. fix: omitempty UnixFSShardingSizeThreshold 

    - applies fix from go-ipfs-config which removes null when default
- escapes JSON string when passed in sharness script
    @lidel @aschmahmann
    lidel authored and aschmahmann committed Nov 16, 2021
    Configuration menu
    Copy the full SHA
    36c1eda View commit details
    Browse the repository at this point in the history

  4. bump interop tests to branch with new go-ipfs sharding config option

    @aschmahmann
    aschmahmann committed Nov 16, 2021
    Configuration menu
    Copy the full SHA
    75a3db0 View commit details
    Browse the repository at this point in the history

  5. bump go-unixfs and go-mfs

    @aschmahmann
    aschmahmann committed Nov 16, 2021
    Configuration menu
    Copy the full SHA
    2bed2a2 View commit details
    Browse the repository at this point in the history

  6. change error message to match the current error

    @aschmahmann
    aschmahmann committed Nov 16, 2021
    Configuration menu
    Copy the full SHA
    9775022 View commit details
    Browse the repository at this point in the history

  7. Add automatic sharding/unsharding tests (#8547) 

    * test: add tests for automatic sharding and unsharding
* refactor: changed some naming in the sharding sharness tests to make more sense

Co-authored-by: Adin Schmahmann <adin.schmahmann@gmail.com>
    @schomatis @aschmahmann
    schomatis and aschmahmann committed Nov 16, 2021
    Configuration menu
    Copy the full SHA
    e0b6bb4 View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2021

  1. docs: Experimental.ShardingEnabled migration 

    This ensures existing users of global sharding experiment get notified
that the flag no longer works + that autosharding happens automatically.

For people who NEED to keep the old behavior (eg. have no time to
migrate today) there is a note about restoring it with
`UnixFSShardingSizeThreshold`.
    @lidel
    lidel committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    b14aa37 View commit details
    Browse the repository at this point in the history