Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Explore use of Zarrita #196

Open
3 tasks done
oruebel opened this issue May 20, 2024 · 2 comments
Open
3 tasks done

[Feature]: Explore use of Zarrita #196

oruebel opened this issue May 20, 2024 · 2 comments
Labels
category: proposal proposed enhancements or new features priority: low alternative solution already working and/or relevant to only specific user(s)
Milestone

Comments

@oruebel
Copy link
Contributor

oruebel commented May 20, 2024

What would you like to see added to HDMF-ZARR?

See NeurodataWithoutBorders/nwb_benchmarks#65

Zarrita is a prototype implementation of Zarr v3 with support for sharding. It may have better performance than normal Zarr.

Is your feature request related to a problem?

Sharding helps address the issue of many files and is something that also DANDI is interested in. Since this is Zarr v3 it is exploratory right now, but is something we should get an understanding off so that we are ready when the feature becomes available and also so we can provide feedback early on in case we discover issues.

What solution would you like?

...

Do you have any interest in helping implement the feature?

Yes.

Code of Conduct

@oruebel oruebel added category: proposal proposed enhancements or new features priority: low alternative solution already working and/or relevant to only specific user(s) labels May 20, 2024
@oruebel oruebel added this to the Future milestone May 20, 2024
@mavaylon1
Copy link
Contributor

@oruebel Interesting. Let's add this as a discussion item in the coming weeks during lunch.

@oruebel
Copy link
Contributor Author

oruebel commented May 20, 2024

Let's add this as a discussion item in the coming weeks during lunch.

Sounds good.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: proposal proposed enhancements or new features priority: low alternative solution already working and/or relevant to only specific user(s)
Projects
None yet
Development

No branches or pull requests

2 participants