Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve shard efficiency of sampling for fractional stream repeats. #391

Merged
merged 26 commits into from
Sep 9, 2023
Merged

Improve shard efficiency of sampling for fractional stream repeats. #391

merged 26 commits into from
Sep 9, 2023

Commits on Aug 21, 2023

  1. Improve shard-efficiency of sampling fractional stream repeats.

    @knighton
    knighton committed Aug 21, 2023
    Configuration menu
    Copy the full SHA
    e8d3bf9 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2023

  1. Merge branch 'main' into james/sparse-sampling

    @knighton
    knighton authored Aug 28, 2023
    Configuration menu
    Copy the full SHA
    831ce45 View commit details
    Browse the repository at this point in the history

  2. Fix (np.expand_dims).

    @knighton
    knighton committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    48cd9f0 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'james/sparse-sampling' of github.com:mosaicml/streaming… 

    … into james/sparse-sampling
    @knighton
    knighton committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    436f0d3 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2023

  1. Merge branch 'main' into james/sparse-sampling

    @knighton
    knighton authored Aug 29, 2023
    Configuration menu
    Copy the full SHA
    071ae24 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into james/sparse-sampling

    @knighton
    knighton authored Aug 29, 2023
    Configuration menu
    Copy the full SHA
    c4e5623 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into james/sparse-sampling

    @knighton
    knighton authored Aug 29, 2023
    Configuration menu
    Copy the full SHA
    1a165a3 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. Merge branch 'main' into james/sparse-sampling

    @knighton
    knighton authored Sep 5, 2023
    Configuration menu
    Copy the full SHA
    94b3841 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'james/sparse-sampling' of github.com:mosaicml/streaming… 

    … into james/sparse-sampling
    James Knighton authored and James Knighton committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    f4e5ae5 View commit details
    Browse the repository at this point in the history

  3. Redesign sampling for sparsity.

    James Knighton authored and James Knighton committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    1f73e50 View commit details
    Browse the repository at this point in the history

  4. Hook up args.

    @knighton
    knighton committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    8ec04c6 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. Rename get_shard_sampling -> get_sampling.

    @knighton
    knighton committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    7eae135 View commit details
    Browse the repository at this point in the history

  2. Fix bug, add some tests.

    @knighton
    knighton committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    23392bf View commit details
    Browse the repository at this point in the history

  3. Test sampling balance.

    @knighton
    knighton committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    3c6343b View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2023

  1. Merge branch 'main' into james/sparse-sampling

    @knighton
    knighton authored Sep 7, 2023
    Configuration menu
    Copy the full SHA
    a40302b View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2023

  1. Merge branch 'main' into james/sparse-sampling

    @knighton
    knighton authored Sep 8, 2023
    Configuration menu
    Copy the full SHA
    57579b2 View commit details
    Browse the repository at this point in the history

  2. Misc.

    @knighton
    knighton committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    d4d92cf View commit details
    Browse the repository at this point in the history

  3. Fix statistics test.

    @knighton
    knighton committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    189b3f2 View commit details
    Browse the repository at this point in the history

  4. Elaborate on docstrings.

    @knighton
    knighton committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    1b5c5ff View commit details
    Browse the repository at this point in the history

  5. Rewrite algorithm to be more performant.

    @knighton
    knighton committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    b460e50 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into james/sparse-sampling

    @knighton
    knighton authored Sep 8, 2023
    Configuration menu
    Copy the full SHA
    c391bcf View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' into james/sparse-sampling

    @karan6181
    karan6181 authored Sep 8, 2023
    Configuration menu
    Copy the full SHA
    bcd5ecf View commit details
    Browse the repository at this point in the history

  8. Pyright.

    @knighton
    knighton committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    9e4ea89 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'james/sparse-sampling' of github.com:mosaicml/streaming… 

    … into james/sparse-sampling
    @knighton
    knighton committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    7d27c4a View commit details
    Browse the repository at this point in the history

  10. fstring the ValueErrors.

    @knighton
    knighton committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    09562c3 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2023

  1. Merge branch 'main' into james/sparse-sampling

    @karan6181
    karan6181 authored Sep 9, 2023
    Configuration menu
    Copy the full SHA
    794aa3f View commit details
    Browse the repository at this point in the history