You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently adaptdl.torch.AdaptiveDataLoader only supports map-style datasets, which allows random access and implements the __getitem__() and __len__() protocols. It might be desirable to add supports to iterable-style datasets since sometimes the dataset might adopt a lazy loading strategy and we cannot know the size of dataset beforehand.
The text was updated successfully, but these errors were encountered:
Currently
adaptdl.torch.AdaptiveDataLoader
only supports map-style datasets, which allows random access and implements the__getitem__()
and__len__()
protocols. It might be desirable to add supports to iterable-style datasets since sometimes the dataset might adopt a lazy loading strategy and we cannot know the size of dataset beforehand.The text was updated successfully, but these errors were encountered: