February 26, 20251 yr Hello, I have oobabooga setup in docker, it's not a CA template. I have it working when I only have one GPU running in Unraid but whenever I add a second GPU it tries to use both of them. I have the NVIDIA_VISIBLE_DEVICES set to the GPU ID from the Nivida plugin and nvidia-smi still shows both GPUs. I have tested both GPU IDs on the oobabooga container and it always shows both. On other container (tdarr, ollama, code-project) the NVIDIA_VISIBLE_DEVICES setting works to limit the GPU. Does the oobabooga container not support it? I thought it was a docker thing not container specific though. Here is the link to the docker hub and github for oobabooga docker I'm using. Attached are setup screenshots as well. https://github.com/Atinoda/text-generation-webui-docker https://hub.docker.com/r/atinoda/text-generation-webui/ Thanks!
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.