-
Notifications
You must be signed in to change notification settings - Fork 6.8k
[MXNET-141] Add tutorial Gluon Datasets and DataLoaders #10251
Conversation
d018530
to
fbb3230
Compare
Looks fine to me, @thomelane |
|
@piiswrong agree with num_workers. Will add commentary on that, and use it in the examples. |
It shouldn't matter that much, espesially when you are randomly accessing with shuffle |
…ved Gluon DataLoader to Module DataIter wrapper.
@piiswrong Okay, good to know, I've removed the section on RecordIO. We should mention on the website/docs more clearly that it's not recommended, this could confuse new users otherwise. And even add a deprecation warning to the Also realized that I had used And lastly, I've removed the wrapper to convert from DataLoader to DataIter based on your email feedback. I think keeping DataIter to DataLoader would still be useful for the case where people have already implemented a lot of augmentation, etc, using DataIters. |
* Added tutorial for Gluon datasets and data loaders. * Changes as per code review. * Added link to tutorial in index.md. * Cut section on RecordIO. Moved num_workers discussion higher up. Removed Gluon DataLoader to Module DataIter wrapper.
* Added tutorial for Gluon datasets and data loaders. * Changes as per code review. * Added link to tutorial in index.md. * Cut section on RecordIO. Moved num_workers discussion higher up. Removed Gluon DataLoader to Module DataIter wrapper.
* Added tutorial for Gluon datasets and data loaders. * Changes as per code review. * Added link to tutorial in index.md. * Cut section on RecordIO. Moved num_workers discussion higher up. Removed Gluon DataLoader to Module DataIter wrapper.
* Added tutorial for Gluon datasets and data loaders. * Changes as per code review. * Added link to tutorial in index.md. * Cut section on RecordIO. Moved num_workers discussion higher up. Removed Gluon DataLoader to Module DataIter wrapper.
Description
Intro to Datasets and Dataloaders.
Using own data with Included Dataset objects (including RecordIO format).
Using own data with Custom Dataset objects.
Wrappers for converting between DataLoader and DataIters.
Checklist
N/A. Added single markdown file.
Comments
https://issues.apache.org/jira/browse/MXNET-141