Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Correctly extract grouped attrs #183

Merged
merged 7 commits into from
Aug 15, 2024
Merged

Correctly extract grouped attrs #183

merged 7 commits into from
Aug 15, 2024

Conversation

ppinchuk
Copy link
Collaborator

@ppinchuk ppinchuk commented Aug 14, 2024

Correctly extract attrs, chunks, shapes, etc. for datasets belonging to a group.
This includes Resource and MultiFileResource.

This does not include the RechunkH5 class since it was not built for grouped datasets (added this as a note to the docstring) and would require more careful refactoring. This could be a future endeavor.

Did not find any other instances of reading datasets using h5py directly in rex, but it's possible I missed some. Can fix those in the same manner if/when they come up.

Also marked that BC test that keeps failing as flaky for more flexibility.

Copy link
Collaborator

@bnb32 bnb32 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for doing this. Looks good!

@ppinchuk ppinchuk merged commit a96af89 into main Aug 15, 2024
16 checks passed
@ppinchuk ppinchuk deleted the pp/grouped_attrs branch August 15, 2024 20:48
github-actions bot pushed a commit that referenced this pull request Aug 15, 2024
Correctly extract grouped attrs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

self.datasets conflict with self.res.h5 when self.res.h5 includes groups
2 participants