DDP, MPIEnv and numdevices #19927
Unanswered
timocafe
asked this question in
DDP / multi-GPU / multi-node
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello,
I am confused by the API and the different scenario using the MPI plugin. Let's consider a single node 2 GPUs (XPU I am working for intel). I want to run on the two GPUs only.
Using DDP setting and basic training, if I do
python main.py
:The trainer will spawn 1 additional process and do parallel training.
Now if I plug
MPIEnvironment()
, and start my jobmpirun -n 2 python main.py
.Do I still need to specify
devices = 2
in the trainer ?Beta Was this translation helpful? Give feedback.
All reactions