Skip to content

Commit

Permalink
33 generate spatial image data (#35)
Browse files Browse the repository at this point in the history
* Squashed commit of the following:

commit 695539472ffe006a56c8c942dd09a2b819bc9f08
Merge: 86eec0b 4a3ff27
Author: Kirill Trapeznikov <kirill.trapeznikov@str.us>
Date:   Tue Jun 28 20:20:23 2022 +0000

    Merge branch 'master' of github.com:stresearch/gaia

commit 4a3ff27
Author: ktrapeznikov <ktrapeznikov@gmail.com>
Date:   Tue Jun 28 16:19:57 2022 -0400

    Dataset (#34)

    * Squashed commit of the following:

    commit 86eec0bcd8acdfb1ad25ca9b8fa2eccf925694f9
    Merge: 2e2f458 4974acc
    Author: Kirill Trapeznikov <kirill.trapeznikov@str.us>
    Date:   Tue Jun 28 20:06:52 2022 +0000

        Merge branch '19-fix-mean-bias'

    commit 2e2f45865aee0ed3c0c3c8253ba73aff7339c14b
    Merge: 59be221 f6bedff
    Author: Kirill Trapeznikov <kirill.trapeznikov@str.us>
    Date:   Tue Jun 28 20:04:25 2022 +0000

        Merge branch 'master' of github.com:stresearch/gaia

    commit 4974acc399c308d00d12915d6ccca394c48ee689
    Author: Kirill Trapeznikov <kirill.trapeznikov@str.us>
    Date:   Tue Jun 28 20:01:30 2022 +0000

        updates

    commit 98b0f42
    Author: Kirill Trapeznikov <kirill.trapeznikov@str.us>
    Date:   Wed Jun 8 00:30:51 2022 +0000

        minor fixes

    commit 59be221
    Merge: c160d9f e225ecd
    Author: Kirill Trapeznikov <kirill.trapeznikov@str.us>
    Date:   Wed Jun 8 00:18:30 2022 +0000

        Merge branch 'master' of github.com:stresearch/gaia

    commit c160d9f
    Author: Kirill Trapeznikov <kirill.trapeznikov@str.us>
    Date:   Wed Jun 8 00:18:22 2022 +0000

        adding changes to dataset

    * delete

    Co-authored-by: Kirill Trapeznikov <kirill.trapeznikov@str.us>

commit 86eec0bcd8acdfb1ad25ca9b8fa2eccf925694f9
Merge: 2e2f458 4974acc
Author: Kirill Trapeznikov <kirill.trapeznikov@str.us>
Date:   Tue Jun 28 20:06:52 2022 +0000

    Merge branch '19-fix-mean-bias'

commit 2e2f45865aee0ed3c0c3c8253ba73aff7339c14b
Merge: 59be221 f6bedff
Author: Kirill Trapeznikov <kirill.trapeznikov@str.us>
Date:   Tue Jun 28 20:04:25 2022 +0000

    Merge branch 'master' of github.com:stresearch/gaia

commit 4974acc399c308d00d12915d6ccca394c48ee689
Author: Kirill Trapeznikov <kirill.trapeznikov@str.us>
Date:   Tue Jun 28 20:01:30 2022 +0000

    updates

commit 98b0f42
Author: Kirill Trapeznikov <kirill.trapeznikov@str.us>
Date:   Wed Jun 8 00:30:51 2022 +0000

    minor fixes

commit 59be221
Merge: c160d9f e225ecd
Author: Kirill Trapeznikov <kirill.trapeznikov@str.us>
Date:   Wed Jun 8 00:18:30 2022 +0000

    Merge branch 'master' of github.com:stresearch/gaia

commit c160d9f
Author: Kirill Trapeznikov <kirill.trapeznikov@str.us>
Date:   Wed Jun 8 00:18:22 2022 +0000

    adding changes to dataset

* delete

* adding ignore

Co-authored-by: Kirill Trapeznikov <kirill.trapeznikov@str.us>
  • Loading branch information
ktrapeznikov and ktrapeznikov authored Jun 28, 2022
1 parent 4a3ff27 commit 2c30e89
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 4 deletions.
3 changes: 2 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -124,6 +124,7 @@ stats.pt
*.html
*.nc
**/libtorch
*.mp4
cache/*

# keep
!docs/**
6 changes: 3 additions & 3 deletions gaia/data.py
Original file line number Diff line number Diff line change
Expand Up @@ -491,13 +491,13 @@ def default_data(
","
),
outputs="PRECT,PRECC,PTEQ,PTTEND".split(","),
flatten=split == "train",
shuffle = split == "train",
flatten= False,
shuffle = False,
subsample_factor=4,
compute_stats=True,
cache = os.path.join(cache,split),
s3_client_kwargs=s3_client_kwargs,
time_steps=2,
time_steps=0,
)


Expand Down

0 comments on commit 2c30e89

Please sign in to comment.