Cyberschorsch

As far as I know it is possible to use the same GPU for multiple containers but not for containers AND a VM but I think that is not a limitation by Unraid itself

Helllo smrus852, just stumbled upon your post by chance. I run a setup with an NVIDIA 2080 Super and run Ollama, Open WebUI and Flowise without any issues. Unraid and the Custom Apps System allows for this very easily. There is a plugin which is called Nvidia-Driver which makes it dead simple to support Nvidia and Cuda and passthrough to docker containers. I attached a screenshot of the installed plugin and its settings. It takes like 2 clicks to install it. Hope that helps!

This is the support thread for all my docker templates. Please always review the application documentation and issue-queue in the repos first if you have any issues. Repo: https://github.com/Cyberschorsch/unraid-templates Flowise Open source low-code tool for developers to build customized LLM orchestration flow and AI agents. Application: https://flowiseai.com/ Application Repo: https://github.com/FlowiseAI/Flowise Docs: https://docs.flowiseai.com/ Template-URL: