t3rminus

#!/bin/sh echo "Reticulating Splines..." # Load persistant files mkdir -p /opt/persist mount -o loop /boot/config/persist.img /opt/persist rm -rf /opt/persist/lost+found cp -a /opt/persist/* / # umount /opt/persist # rmdir /opt/persistLoads some persisted files onto the root file system, mostly some little scripts I wrote to do cleanup and archival: root@Vault:/opt/persist# tree . └── usr └── local └── bin ├── appledouble ├── cleardot ├── cleards └── tgz 4 directories, 4 filesI am not modifying the driver in any way.

I've tried disabling the iGPU, with the same result. The NVidia driver is loaded, and does appear to work fine from the host. I have GPU Statistics plugin installed, and it correctly recognizes the GPU and shows the live stats on the dashboard. It's just the nvidia-container-toolkit/docker usage that fails. docker run -d --name='Jellyfin' --net='bridge' --pids-limit 2048 -e TZ="America/Los_Angeles" -e HOST_OS="Unraid" -e HOST_HOSTNAME="Vault" -e HOST_CONTAINERNAME="Jellyfin" -e 'JELLYFIN_PublishedServerUrl'='vault.d3rg.tech' -e 'NVIDIA_VISIBLE_DEVICES'='GPU-c96d3b5a-bdb2-4b41-b817-22755b00d28d' -e 'NVIDIA_DRIVER_CAPABILITIES'='all' -e 'PUID'='99' -e 'PGID'='100' -e 'UMASK'='022' -l net.unraid.docker.managed=dockerman -l net.unraid.docker.webui='http://[IP]:[PORT:8096]' -l net.unraid.docker.icon='https://raw.githubusercontent.com/linuxserver/docker-templates/master/linuxserver.io/img/jellyfin-logo.png' -p '8096:8096/tcp' -p '7359:7359/udp' -v '/mnt/user/TV/':'/data/tvshows':'rw' -v '/mnt/user/Movies/':'/data/movies':'rw' -v '/mnt/cache/appdata/Jellyfin/cache':'/cache':'rw' -v '/mnt/user/appdata/Jellyfin':'/config':'rw' --runtime=nvidia --gpus all 'jellyfin/jellyfin:latest' 9985f38b1bc250975d10e97c9ba1af1b7e5ea916a030ab9b1ab1fd62d1b593f0 docker: Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running prestart hook #0: exit status 1, stdout: , stderr: Auto-detected mode as 'legacy' nvidia-container-cli: initialization error: load library failed: libnvidia-ml.so.1: cannot open shared object file: permission denied: unknown.Here's the latest diagnostics. vault-diagnostics-20251230-1104.zip

Here are my current diagnostics. vault-diagnostics-20251230-0912.zip

Ultimately, I will be using Jellyfin, and beszel-agent-nvidia to monitor the system. Both were confirmed working prior to this. Noted. I will use the v580 I wouldn't, other than as a sanity check. I'm mostly trying to demonstrate it's not actually a permissions issue, despite the logs saying "Permission denied" The ubuntu docker container is the documented way to test nvidia-container-toolkit, per NVidia's documentation: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/1.17.6/sample-workload.html I assume you mean v580.x considering my card wouldn't be supported on v590.x? I have completed the following steps: Remove the Nvidia Driver plugin Reboot Install the Nvidia Driver plugin Go to the plugin page and select Driver version v580.119.02 Click "Update & Download" Reboot Configure Jellyfin per the first post: docker run -d --name='Jellyfin' --net='bridge' --pids-limit 2048 -e TZ="America/Los_Angeles" -e HOST_OS="Unraid" -e HOST_HOSTNAME="Vault" -e HOST_CONTAINERNAME="Jellyfin" -e 'NVIDIA_VISIBLE_DEVICES'='GPU-c96d3b5a-bdb2-4b41-b817-22755b00d28d' -e 'NVIDIA_DRIVER_CAPABILITIES'='all' -e 'PUID'='99' -e 'PGID'='100' -e 'UMASK'='022' -l net.unraid.docker.managed=dockerman -l net.unraid.docker.webui='http://[IP]:[PORT:8096]' -l net.unraid.docker.icon='https://raw.githubusercontent.com/linuxserver/docker-templates/master/linuxserver.io/img/jellyfin-logo.png' -p '8096:8096/tcp' -p '7359:7359/udp' -v '/mnt/user/TV/':'/data/tvshows':'rw' -v '/mnt/user/Movies/':'/data/movies':'rw' -v '/mnt/cache/appdata/Jellyfin/cache':'/cache':'rw' -v '/mnt/user/appdata/Jellyfin':'/config':'rw' --runtime=nvidia 'jellyfin/jellyfin:latest' 7fba60687a82316ca2dcb78868ea64ac4f3f6a16a8c8f41306278774d3df934c docker: Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running prestart hook #1: exit status 1, stdout: , stderr: Auto-detected mode as 'legacy' nvidia-container-cli: initialization error: load library failed: libnvidia-ml.so.1: cannot open shared object file: permission denied: unknown. The command failed. I updated my BIOS/Firmware in the process of troubleshooting, entirely to add options for Resizable BAR and Above 4G Decoding. I can confirm they are both enabled.

I've been struggling with this for literal days now, and I'm losing my mind trying to get nvidia support in docker. It worked fine for several weeks, and then I rebooted after (I believe) it automatically downloaded the "latest" 590 updated driver, which broke compatibility with my GTX 1050 Ti. I would prefer to keep using this card for transcoding and similar... Now whenever I try and run any container that requires the GPU, I get the following error(s): # docker run --rm --runtime=nvidia -e NVIDIA_VISIBLE_DEVICES=GPU-c96d3b5a-bdb2-4b41-b817-22755b00d28d -e NVIDIA_DRIVER_CAPABILITIES=all ubuntu nvidia-smi docker: Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running prestart hook #1: exit status 1, stdout: , stderr: Auto-detected mode as 'legacy' nvidia-container-cli: initialization error: load library failed: libnvidia-ml.so.1: cannot open shared object file: permission denied: unknown.# nvidia-container-cli -d /dev/tty info -- WARNING, the following logs are for debugging purposes only -- I1230 04:18:39.723995 107649 nvc.c:396] initializing library context (version=1.17.9~1.17.9, build=e78456a41c71d73eabf7a85d1e531a108789349b) I1230 04:18:39.724072 107649 nvc.c:367] using root / I1230 04:18:39.724080 107649 nvc.c:368] using ldcache /etc/ld.so.cache I1230 04:18:39.724098 107649 nvc.c:369] using unprivileged user 65534:65534 I1230 04:18:39.724165 107649 nvc.c:413] attempting to load dxcore to see if we are running under Windows Subsystem for Linux (WSL) I1230 04:18:39.724260 107649 nvc.c:415] dxcore initialization failed, continuing assuming a non-WSL environment I1230 04:18:39.724480 107650 rpc.c:71] starting driver rpc service I1230 04:18:39.724951 107649 rpc.c:135] driver rpc service terminated with signal 15 nvidia-container-cli: initialization error: load library failed: libnvidia-ml.so.1: cannot open shared object file: permission denied I1230 04:18:39.724997 107649 nvc.c:455] shutting down library contextHowever nvidia-smi works fine on the unraid host, and the GPU is detected and loaded by the driver. GPU stats shows the card on the dashboard, and as far as I can tell, everything should be working. /usr/lib/libnvidia-ml.so.1 exists and has 0755 permissions /usr/lib64/libnvidia-ml.so.1 exists and has 0755 permissions But as soon as I try and run it in a container... load library failed: libnvidia-ml.so.1: permission denied: unknown Things I've tried: Downgrading the driver to all 580.* versions and the single listed 575.* version Downgrading Unraid to 7.2.0 (where it did seem to be working for a while) Removing the plugin entirely, rebooting, reinstalling the plugin and driver Adjusting various settings in /etc/nvidia-container-toolkit/config.toml (including no-cgroups=true/false), debug logging, ldstore/ldconfig settings, etc. Running containers with various combinations of --runtime=nvidia and --gpus=all flags, as well as visible devices and driver capabilities environment variables Various permissions on the libraries (0777/0644, etc) Various users:groups for nvidia-container-runtime (65564:65564) nvidia-ctk runtime configure Adding nvidia-persistenced to startup scripts Full path/implicit path to the runtime in /etc/docker/daemon.json Rebooting, rebooting, rebooting restarting the docker service over and over and over I would appreciate any insight into the issue that anyone can provide. I'm about to give up entirely. vault-diagnostics-20251229-2006.zip