August 2, 2025Aug 2 I have been running the Docker containers for Ollama and Open-webui without issues except for slow responses. I note in the Ollama container setup the extra parameters is set for all GPUs. I have two NVIDIA GPUs installed, a 2060 Super and a Quadro P620. I would like specify only a specific GPU to be used by the container. How do I do that? Ive tried changing the parameter to --gpus=GPU-fd7c39b4-1d44-8d62-02c0-0d559985fa47 being the GPU I want to use but this is obviously wrong as the container fails.
August 2, 2025Aug 2 Community Expert Solution try this format instead:--gpus device=GPU-fd7c39b4-1d44-8d62-02c0-0d559985fa47more info here: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/docker-specialized.html
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.