Train and Validation DataLoaders #2933
Unanswered
AndreyBocharnikov
asked this question in
Q&A
Replies: 1 comment
-
These fields are used by nemo to keep the track of the data loaders and return them to the PTL. If you search the whole repo, you will find them. Some examples are inside nemo/classes/ModelPT.py file. The data loaders are created automatically when you create a model by passing the config as it contains the data loaders' info. No need to create them separately. PTL would use these data loaders to create batches and handle the whole process of the training. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello! I am quite new to NeMo and pytorch lightning, so I am a bit confused about calling
trainer.fit(model)
withouttrain_dataloader
andvalidation_dataloader
as it is done in many examples e.g.examples/tts/talknet_spect.py
, but I fount thatself._train_dl
andself._validation_dl
are being initialised as train and validation dataloaders respectively in line 204 and 207 ofnemo/collections/tts/models/talknet.py
script, but I can not find where they are being used? Is it pytorch lightning convention that such fields are used as data loaders or they they are used somehow in NeMo? Couldn't find either of options. Can somebody please help me understand this, thank you.Beta Was this translation helpful? Give feedback.
All reactions