Skip to content

Commit

Permalink
[DataPipe] Fixing fsspec DataPipe to be compatible with new version o…
Browse files Browse the repository at this point in the history
…f fsspec

ghstack-source-id: fa91e4dec9c48f7c5057a66e73b1bc6eb702ec93
Pull Request resolved: #957
  • Loading branch information
NivekT committed Jan 20, 2023
1 parent 5f3e968 commit 1d0a789
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion torchdata/datapipes/iter/load/fsspec.py
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,7 @@ def __iter__(self) -> Iterator[str]:
if fs.isfile(path):
yield root
else:
for file_name in fs.ls(path):
for file_name in fs.ls(path, detail=False): # Ensure it returns List[str], not List[Dict]
if not match_masks(file_name, self.masks):
continue

Expand Down

0 comments on commit 1d0a789

Please sign in to comment.