Multiple GPU Windows System #19866
Unanswered
ptrem
asked this question in
DDP / multi-GPU / multi-node
Replies: 1 comment 2 replies
-
It's bit late, but i believe nccl backend for ddp training is not supported for windows.
|
Beta Was this translation helpful? Give feedback.
2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi,
I have a Workstation with two RTX A6000 GPUs and a Windows System 🙈
and I would like to use both GPUs with Lightning-AI.
It's possible to use just use one of the GPUs but i get the following error if I try to use both GPUs.
The training works fine for:
But I can't use for example
devces=2
,devices=[0, 1]
ordevices=-1
.In every case I get the following error:
RuntimeError: Distributed package doesn't have NCCL built in
Has anyone an idea how to run Lightning on Multiple GPUs on a Windows System?
Thanks
Beta Was this translation helpful? Give feedback.
All reactions