smrus852

@Cyberschorsch Thanks, thats mich easier than I expected. I read a bunch of post talking abouz using NVIDIA, but nome ever mentioned how they installed the driver. Just one more thing to be annoying about: With that driver installed, can mutiple Apps/Dockers use the same GPU or is it like a VM with complete passtrough?

Hi! Im currently NOT running Unraid, but because of the recent announcement of TrueNas Scale moving to TalosOS and me not liking that, I've half way decided to move to Unraid. But before I do so - even if just for testing - I want to ask some things about Community Apps and GPU support. Ive havent dealt with it much in TrueNas, but apps seems to be able to utilize GPU's for their processes. Plex and Immich for example have a selector for that during setup. So they can use GPU acceleration - although Im not sure wether or not that really works. Besides those I also want to run the OpenWebUI/Ollama App and that one likely really needs the GPU support. Id prefer If I would not have to run it in a VM, since Id like to be able to split up my GPU for multiple Apps that might need it - but worst case id passtrough the GPU or even use a dedicated machine for Ollama. Here is the importatnt part though: If the above is possible - just have the GPU connected and have multiple apps/dockers use them for their tasks: Is that possible with an NVIDIA GPU and what about driver installation? Immich for Exmaple needs specific minimum Driver Version for GPU Machine Learning from Nvidia, but I presume that that does not exactly exist for Unraid. (Immich: https://immich.app/docs/features/ml-hardware-acceleration/) I know Linux drivers exist for Linux, and ive seen some Nvidia Announcement for OpenSource Drivers, but I dont want to sink time and money into even just a test Migration, to find out i might be better off having stayed with TrueNas Scale. So: - Can Multiple Apps use the same app as needed? - Can Immich specifically use the GPU for its AI things while running as a Community app instead of a dedicated machine/VM? - How do I get a GPU to work in Unraid generally if #1 is possible? Do I need to install drivers, does it just work? (Also: I dont have an NVIDIA GPU (other than basic GT 430 and GT 710), but IM asking because based on the Answer I want to get a used 3090 for Immich/GPU acceleration in general for all these and other things. Also Also: I have a 6700XT, but based on my current (limited) experience, CUDA is just sooo much better supported I feel myself kinda forced to go Nvidia currently. But if this is wrong im Open to even Intel GPU's if they supported all of the above somewhat) Thanks for Reading and for help!