Skip to content

Commit

Permalink
Small README update for DataLoader2
Browse files Browse the repository at this point in the history
ghstack-source-id: d2afec85ab0fdaddaa9bb9dddc8f1924732b35fa
Pull Request resolved: #541
  • Loading branch information
NivekT committed Jun 23, 2022
1 parent 6c8f778 commit c8cd06e
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 5 deletions.
7 changes: 3 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -208,10 +208,9 @@ the `DataLoader` as long as a `ShardingFiler` DataPipe exists in your pipeline.

Q: What is the upcoming plan for DataLoader?

A: There will be a new version of DataLoader in the next release. At the high level, the plan is that DataLoader V2 will
only be responsible for multiprocessing, distributed, and similar functionalities, not data processing logic. All data
processing features, such as the shuffling and batching, will be moved out of DataLoader to DataPipe. At the same time,
the current/old version of DataLoader should still be available and you can use DataPipes with that as well.
A: DataLoader2 is in the prototype phase and more features are actively being developed. Please see the README file in
`torchdata/dataloader2`. If you would like to experiment with it (or other prototype features), we encourage you to
install the nightly version of this library.

Q: Why is there an Error saying the specified DLL could not be found at the time of importing `portalocker`?

Expand Down
3 changes: 2 additions & 1 deletion torchdata/dataloader2/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -82,4 +82,5 @@ A sequence of graph utilities are provided to help users to define their own `Re
## Prototype Usage and Feedback

`DataLoader2` is stable in terms of API, but functionally not complete yet. We welcome early adopters and feedback, as
well as potential contributors.
well as potential contributors. If you are interested in trying it out, we encourage you to install the nightly version
of this library.

0 comments on commit c8cd06e

Please sign in to comment.