mutil gpus

[stevenXS]

Has anyone solved the mutil-gpus traing probem?

[MinaGabriel]

Did you find a solution for this?

[ScottHoang]

I have found a solution to this. I leverage Pytorch distributed package with Nvidia Apex to train on 4 rtx 2080ti with a batch size of 80.

[jxhno1]

How to do that for your saying 'leverage Pytorch distributed package with Nvidia Apex to train on 4 rtx 2080ti with a batch size of 80' Is that easy or not, Thank you!

[ScottHoang]

@jxhno1 it is definitely not very hard to do. It is just time-consuming for first-timer. You will have to dig deep into PyTorch Cuda API functionalities. But once you are able to deploy one model, you can do for all of them. It is something everyone should pick up since it can be applied generally.

[genqiaolynn]

can you solute multi gpu for training?Thanks!

[Flova]

Duplicate of #520