Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support chunking the time/band dimensions #116

Merged
merged 22 commits into from
Feb 2, 2022
Merged

Support chunking the time/band dimensions #116

merged 22 commits into from
Feb 2, 2022

Commits on Jan 12, 2022

  1. WIP

    gjoseph92 committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    5b8dd93 View commit details
    Browse the repository at this point in the history
  2. working, somewhat-reasonable first test

    Still pretty complicated. Probably need some helpers in order to test the more interesting stuff. Also would like to hypothesis?
    gjoseph92 committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    b70b453 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    961f76f View commit details
    Browse the repository at this point in the history
  4. start groundwork for multi-chunk asset table

    opening asset table probably works; reads still todo. a few missteps along the way:
    * `np.vectorize` on `asset_table_to_reader_and_window` is segfaulting. May have to do with all the extra arguments? Don't care to gdb it; just moved the vectorization into the function
    * Blockwise wants to fuse the reader table to the reads. I'm not sure it's good that blockwise optimization tries to fuse such a large expansion, but probably kinda makes sense. Unfortunately the way to disable it (annotations) feels like a little bit of a hack
    gjoseph92 committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    f0f58e9 View commit details
    Browse the repository at this point in the history
  5. multi-element reader table

    Passing dtype and fill_value into `fetch_raster_window`, instead of storing them in the reader table, simplifies things a lot. Also lets us get rid of those fields on the reader protocol.
    gjoseph92 committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    be28969 View commit details
    Browse the repository at this point in the history
  6. update comments

    gjoseph92 committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    ae17864 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    6e0016e View commit details
    Browse the repository at this point in the history
  8. no need to round

    gjoseph92 committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    f37e5ed View commit details
    Browse the repository at this point in the history
  9. hypothesis for dtype and fill value

    small steps!
    gjoseph92 committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    b81527e View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    50e4476 View commit details
    Browse the repository at this point in the history
  11. hypothesis for chunksize_yx

    gjoseph92 committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    2a728ec View commit details
    Browse the repository at this point in the history
  12. clean up strategies

    gjoseph92 committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    87176e5 View commit details
    Browse the repository at this point in the history
  13. support full chunk sizes!

    gjoseph92 committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    99c3818 View commit details
    Browse the repository at this point in the history
  14. comments

    gjoseph92 committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    beee6aa View commit details
    Browse the repository at this point in the history
  15. Use window_from_bounds fix

    gjoseph92 committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    8a40e3c View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    335c36a View commit details
    Browse the repository at this point in the history
  17. fix comments

    gjoseph92 committed Jan 12, 2022
    Configuration menu
    Copy the full SHA
    34ca1ef View commit details
    Browse the repository at this point in the history

Commits on Jan 14, 2022

  1. Can't use standard collections as types in 3.8

    [PEP 585](https://www.python.org/dev/peps/pep-0585/) is only available in 3.9. We're still supporting 3.8 for now; planetary computer uses it, as do probably many others
    gjoseph92 committed Jan 14, 2022
    Configuration menu
    Copy the full SHA
    c4f759a View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2022

  1. Configuration menu
    Copy the full SHA
    ab51354 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2022

  1. Configuration menu
    Copy the full SHA
    883c8fa View commit details
    Browse the repository at this point in the history
  2. Test broadcast-trick logic

    gjoseph92 committed Feb 1, 2022
    Configuration menu
    Copy the full SHA
    1b03d4b View commit details
    Browse the repository at this point in the history
  3. update docstring

    gjoseph92 committed Feb 1, 2022
    Configuration menu
    Copy the full SHA
    0466561 View commit details
    Browse the repository at this point in the history