Replies: 2 comments 1 reply
-
By default KCPP only displays the first 4 GPUs individually. However, if you select 'All' then it will use al 5, and you can control it with tensor_split |
Beta Was this translation helpful? Give feedback.
0 replies
-
Thanks! And with regards to tensor_split...is it in percentages? Or VRAM? I asked ChatGPT and it said something like 2,3,3,3,3. Here's what it originally said:
|
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I have four 3090s and one 4090 on an RomeD8-2T/EPYC 7F52 rig with 32GB RAM. I'm running PopOS.
I just installed Kobold last night, and when I run the program, it's only showing 4 GPUs when I click the GPU ID drop-down menu: Three 3090s and the one 4090.
I ran nvidia-smi, and all five GPUs are showing up.
I'm using the GUI and not the CLI.
Anyone know why this could be happening?
Many thanks.
Beta Was this translation helpful? Give feedback.
All reactions