Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add metadata caching for DreamBooth dataset #1206

Merged
merged 3 commits into from
Mar 26, 2024
Merged

Add metadata caching for DreamBooth dataset #1206

merged 3 commits into from
Mar 26, 2024

Commits on Mar 24, 2024

  1. [Experimental] Add cache mechanism for dataset groups to avoid long w… 

    …aiting time for initilization (#1178)

* support meta cached dataset

* add cache meta scripts

* random ip_noise_gamma strength

* random noise_offset strength

* use correct settings for parser

* cache path/caption/size only

* revert mess up commit

* revert mess up commit

* Update requirements.txt

* Add arguments for meta cache.

* remove pickle implementation

* Return sizes when enable cache

---------

Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>
    @KohakuBlueleaf @kohya-ss
    KohakuBlueleaf and kohya-ss authored Mar 24, 2024
    Configuration menu
    Copy the full SHA
    ae97c8b View commit details
    Browse the repository at this point in the history

  2. refactor metadata caching for DreamBooth dataset

    @kohya-ss
    kohya-ss committed Mar 24, 2024
    Configuration menu
    Copy the full SHA
    0253472 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2024

  1. Merge branch 'dev' into dataset-cache

    @kohya-ss
    kohya-ss committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    c86e356 View commit details
    Browse the repository at this point in the history