Community meeting - August 4th at 1 PM Eastern

[abkfenris]

We've got another meeting coming up. I'm expecting it may be a quiet one as I know a handful of folks will already be out.

If you don't have an invite, get in touch and we can make that happen.

[abkfenris]

Attendees:

• Alex Kerney / Gulf of Maine Research Institute / @abkfenris
• Joe Hamman / Earthmover / @jhamman
• Xavier Nogueira / LimnoTech / @xaviernogueira
• Kristen Thyng / Axios Data Science

Agenda and Notes:

• Kristen is from Axiom and replacing Kyle in a few cases
• Joe
  • Zarr v3 is finalized
  • Leading a working group to get the python implementation up to speed
    • Zarr-Python → Refactoring zarr-developers/zarr-python#1480
    • Pretty major refactor
    • Implications for the Zarr Router and Kerchunk
      • Store layout has changed
      • Built a converter
      • The chunk binaries are the same
      • Metadata changes
  • Xavier: TLDR on Zarr V3 changes?
    • Not as huge as the initial proposed spec
    • More flexibility around metadata and chunk extensions
    • ZEP002? Martin is working on a variable chunk size implementation extension
      • Ex: a dataset with an initial bulk update and then daily appends
• Alex
  • Tinkering with Xpublish-config
• Xavier
  • Want to build a STAC-Catalog plugin
  • Catalog router/provider plugin
• Kristen
  • Reading what packages Kyle built
    • Xpublish host
• Afterwards Alex and Xavier chatted about catalogs and maybe 'loading plugins', that is a set of plugins that know given a string or maybe a dict can figure out if they can load and return a dataset to whatever plugin is calling it. That way various catalog plugins can share the logistics of loading data, and just need to know how to extract those details from their catalog type.
  • Xavier is going to start a repo or discussion that we can contribute different examples of catalogs to and explore how to make a shared routing convention