Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get a list of parameters and vertical levels by reading the bodies of a minimal set of .idx files #2

Open
3 tasks
JackKelly opened this issue Dec 2, 2024 · 1 comment

Comments

@JackKelly
Copy link
Owner

Get a list of parameters and vertical levels by:

  • reading the bodies of the first day's worth of .idx files, and the bodies of the last day's worth of .idx files.
  • If the first and last days have the same coordinate labels then assume that the coordinate labels stay the same across the entire dataset, and we're done.
  • If the coords in the first and last days differ then begin an "over-eager" binary search of the .idx files to find when coordinates change (e.g. when the NWP is upgraded an more ensemble members are added - see NWPs change shape over time. How to detect, store, and handle these changes? hypergrib#15). Submit many GET requests at once. The coords might change more than once.

Beware that, for example, the GEFS analysis step doesn't include the same parameters as the forecast steps! (Which is why it's important to read an entire day's worth of data).

Ignore step in the body of the .idx file. It's easier to get the step from the filename! (for GEFS, at least!). See JackKelly/hypergrib#21

@JackKelly
Copy link
Owner Author

I'm considering implementing this in Python. See JackKelly/hypergrib#28.

@JackKelly JackKelly transferred this issue from JackKelly/hypergrib Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant