Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extend GDSDataset Capability to IterableDataset from Torch #8143

Open
nv-mmanohara opened this issue Oct 11, 2024 · 1 comment
Open

Extend GDSDataset Capability to IterableDataset from Torch #8143

nv-mmanohara opened this issue Oct 11, 2024 · 1 comment
Assignees

Comments

@nv-mmanohara
Copy link

Description: The GDSDataset currently inherits from PersistentDataset, which in turn inherits from Torch Dataset. We would like to extend the GDS capability to include IterableDataset as well to expedite the loading of data.

Proposed Changes:

  1. Create a new class of GDSDataset to inherit from IterableDataset.
  2. Ensure compatibility with existing functionalities of GDSDataset.

Benefits:

  1. Faster data loading.
  2. Improved performance for large datasets.

Additional Context: This change aims to enhance the efficiency of data handling within the GDS framework by leveraging the iterable capabilities of IterableDataset.

@Nic-Ma
Copy link
Contributor

Nic-Ma commented Oct 12, 2024

@KumoLiu Please help from MONAI side if @nv-mmanohara faces any problems during development.

Thanks in advance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants