Hi!

Im currently NOT running Unraid, but because of the recent announcement of TrueNas Scale moving to TalosOS and me not liking that, I've half way decided to move to Unraid. But before I do so - even if just for testing - I want to ask some things about Community Apps and GPU support.

Ive havent dealt with it much in TrueNas, but apps seems to be able to utilize GPU's for their processes. Plex and Immich for example have a selector for that during setup. So they can use GPU acceleration - although Im not sure wether or not that really works. 

 

Besides those I also want to run the OpenWebUI/Ollama App and that one likely really needs the GPU support. Id prefer If I would not have to run it in a VM, since Id like to be able to split up my GPU for multiple Apps that might need it - but worst case id passtrough the GPU or even use a dedicated machine for Ollama. 

Here is the importatnt part though:
If the above is possible - just have the GPU connected and have multiple apps/dockers use them for their tasks: Is that possible with an NVIDIA GPU and what about driver installation? Immich for Exmaple needs specific minimum Driver Version for GPU Machine Learning from Nvidia, but I presume that that does not exactly exist for Unraid.  (Immich: https://immich.app/docs/features/ml-hardware-acceleration/)

I know Linux drivers exist for Linux, and ive seen some Nvidia Announcement for OpenSource Drivers, but I dont want to sink time and money into even just a test Migration, to find out i might be better off having stayed with TrueNas Scale. 

So:
- Can Multiple Apps use the same app as needed?
- Can Immich specifically use the GPU for its AI things while running as a Community app instead of a dedicated machine/VM?
- How do I get a GPU to work in Unraid generally if #1 is possible? Do I need to install drivers, does it just work? 
(Also: I dont have an NVIDIA GPU (other than basic GT 430 and GT 710), but IM asking because based on the Answer I want to get a used 3090 for Immich/GPU acceleration in general for all these and other things.
Also Also: I have a 6700XT, but based on my current (limited) experience, CUDA is just sooo much better supported I feel myself kinda forced to go Nvidia currently. But if this is wrong im Open to even Intel GPU's if they supported all of the above somewhat)

Thanks for Reading and for help!

Helllo smrus852,

 

just stumbled upon your post by chance. 

 

I run a setup with an NVIDIA 2080 Super and run Ollama, Open WebUI and Flowise without any issues. Unraid and the Custom Apps System allows for this very easily.

There is a plugin which is called Nvidia-Driver which makes it dead simple to support Nvidia and Cuda and passthrough to docker containers.

 

I attached a screenshot of the installed plugin and its settings. It takes like 2 clicks to install it.

 

Hope that helps!

Edited August 29, 20241 yr by Cyberschorsch
Added a screenshot

@Cyberschorsch

 

Thanks, thats mich easier than I expected. I read a bunch of post talking abouz using NVIDIA, but nome ever mentioned how they installed the driver.

 

Just one more thing to be annoying about: With that driver installed, can mutiple Apps/Dockers use the same GPU or is it like a VM with complete passtrough?

 

As far as I know it is possible to use the same GPU for multiple containers but not for containers AND a VM but I think that is not a limitation by Unraid itself

17 hours ago, smrus852 said:

With that driver installed, can mutiple Apps/Dockers use the same GPU or is it like a VM with complete passtrough?

Yes, no issue with that.

 

You can also look at the support thread here (first post how to install the driver <- seems more complicated than it is because the tutorial is really detailed, second post is an example to use the driver in containers like Emby/Jellyfin/Plex) :

 

 

It is also possible to browse through the apps here:

https://unraid.net/community/apps#r

 

 

You can also register Trail here (30 day + 2 times 15 days extension if needed) :

https://unraid.net/getting-started