num_workers=1 in DataLoader

[YoelShoshan]

Wondering - is there any reason that num_workers is hardcoded to 1, and there's no usage of more workers?

[rosinality]

It is due to this: 211cb45 I remember using 1 workers is more efficient for low resolutions.

[YoelShoshan]

I see - makes sense since the multi-process communication becomes heavier than the inter process communication overhead, due to the extremely small work that a single worker needs to do in small resolutions.
A possible solution is to reinitialize DataLoader with bigger workers_num as the resolution increases but I assume it's not high priority.

[rosinality]

Yes. And using distributed training will be even better.