Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Efficiently access NetCDF files in S3 #928

Closed
forman opened this issue Feb 26, 2024 · 0 comments · Fixed by #929
Closed

Efficiently access NetCDF files in S3 #928

forman opened this issue Feb 26, 2024 · 0 comments · Fixed by #929
Assignees
Labels
CCI KE enhancement New feature or request in progress The assignee is working on it

Comments

@forman
Copy link
Member

forman commented Feb 26, 2024

Is your feature request related to a problem? Please describe.

We need to efficiently access a huge archive of climate data files in NetCDF format stored in a S3-compatible object storage via the data store framework. The data files are indexed using kerchunk.

Describe the solution you'd like

Add a new filesystem data store that supports the reference protocol.

Additional context

https://climate.esa.int/

@forman forman added enhancement New feature or request in progress The assignee is working on it CCI KE labels Feb 26, 2024
@forman forman self-assigned this Feb 26, 2024
@forman forman mentioned this issue Feb 26, 2024
7 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CCI KE enhancement New feature or request in progress The assignee is working on it
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant