I just also ran into this issue as well (have had the nvidia plugin driver installed and working fine, plex working, etc). Came to find Plex stopped and refused to start. Even tried a remove and reinstall and discovered nvidia driver was the issue.

In the plugin I was showing the driver installed and on the latest version. However it also stated nvidia-smi failed error. Further research shows that the latest driver has dropped support for several older cards including my Quadro P2000 it seems.

After changing to the production driver v580.119.02, allowing it to download/install and a reboot, it now shows my Quadro P2000 and Plex is running once again.

17 minutes ago, The Alien said:

I just also ran into this issue as well (have had the nvidia plugin driver installed and working fine, plex working, etc). Came to find Plex stopped and refused to start. Even tried a remove and reinstall and discovered nvidia driver was the issue.

In the plugin I was showing the driver installed and on the latest version. However it also stated nvidia-smi failed error. Further research shows that the latest driver has dropped support for several older cards including my Quadro P2000 it seems.

After changing to the production driver v580.119.02, allowing it to download/install and a reboot, it now shows my Quadro P2000 and Plex is running once again.

Any idea on how to downgrade ???

Nvidia Info:

Nvidia Driver Version: 580.119.02

Open Source Kernel Module: No

Installed GPU(s):
Failed to initialize NVML: Driver/library version mismatch
NVML library version: 590.44

I dont know why i keep getting this error when using the last version

42 minutes ago, The Alien said:

I just also ran into this issue as well (have had the nvidia plugin driver installed and working fine, plex working, etc). Came to find Plex stopped and refused to start. Even tried a remove and reinstall and discovered nvidia driver was the issue.

In the plugin I was showing the driver installed and on the latest version. However it also stated nvidia-smi failed error. Further research shows that the latest driver has dropped support for several older cards including my Quadro P2000 it seems.

After changing to the production driver v580.119.02, allowing it to download/install and a reboot, it now shows my Quadro P2000 and Plex is running once again.

That worked! I also had a Quadro P2000.

@shremi, goto settings->NVIDIA driver->select production branch

My issue is that i cannot seem to downgrade .

Whenever the plugin is installed it gets the 590 version , and if i manually select the 580 production version i get the :

Installed GPU(s):
Failed to initialize NVML: Driver/library version mismatch
NVML library version: 590.44

So i am in a loop cannot do anything

7 hours ago, bobalot said:

Not really sure how to fix this.

Please read this post:

1 hour ago, The Alien said:

Further research shows that the latest driver has dropped support for several older cards including my Quadro P2000 it seems.

Please also see this post:

1 hour ago, shremi said:

I dont know why i keep getting this error when using the last version

Please always post your Diagnostics when posting hardware related questions, please also see this post:

21 minutes ago, shremi said:

Whenever the plugin is installed it gets the 590 version , and if i manually select the 580 production version i get the

Did you also reboot after selecting driver version 580?

Again, Diagnostics would be very helpful.

1 hour ago, ich777 said:

Uploading Attachment...Did you also reboot after selecting driver version 580?

Again, Diagnostocs would be very helpful.

Hi there sure , it seems that i am stuck in some weird loop where my system does not want to install another driver , yes i have tried multiple times rebooting after installing the 580 version , so far i managed to get it to work using the opensource version , that one it did wanted to take however once with that one installed it simply does not want to go to the 580 version.

In the meantime i have managed to instal an RTX 2XX card i had as my pc backup/spare but will be super usefull to know why is my system behaving like this .

So far if i can revert to the open source package i think i can make it work until i find a solution

Uploading Attachment...

tower-diagnostics-20251216-0004.zip

Edited December 16, 2025Dec 16 by shremi

24 minutes ago, shremi said:

it seems that i am stuck in some weird loop where my system does not want to install another driver

Have you seen this recommended post yet:
https://forums.unraid.net/topic/98978-plugin-nvidia-driver/page/178/#findComment-1487747

Please also look at the post above, if you have the same two PHP errors like in the screenshot follow the steps from the linked post.

On 11/18/2024 at 9:44 PM, ich777 said:

The plugin is broken, you‘ll see that on the two php warnings on the page.

 

Please do the following:

1. Uninstall the Nvidia driver plugin,

2. Reboot

3. Pull a fresh copy from the CA App

4. Go to the Nvidida Plugins website and slelct the driver that you want to use

5. Reboot again

Thanks , yes this is the process i am doing and it is not working

4 minutes ago, shremi said:

Thanks , yes this is the process i am doing and it is not working

And what is the popup saying when you change the driver version?

Any output? I can't see your screenshot.

What about Nvidia Driver version: 580.119.02 or have you yet tried the version below that version?
I'll trigger a recompilation from that driver.

42 minutes ago, ich777 said:

And what is the popup saying when you change the driver version?

Any output? I can't see your screenshot.

What about Nvidia Driver version: 580.119.02 or have you yet tried the version below that version?
I'll trigger a recompilation from that driver.

So far it does not work with :

v580.119.02

v580.105.08

I am going to reboot and check if the open source driver is working for me other than the 590.44.01 those 2 are the ones who stick

52 minutes ago, shremi said:

I am going to reboot and check if the open source driver is working for me other than the 590.44.01 those 2 are the ones who stick

Do you have additional diagnostics from a 580 driver?

5 hours ago, The Alien said:

I just also ran into this issue as well (have had the nvidia plugin driver installed and working fine, plex working, etc). Came to find Plex stopped and refused to start. Even tried a remove and reinstall and discovered nvidia driver was the issue.

In the plugin I was showing the driver installed and on the latest version. However it also stated nvidia-smi failed error. Further research shows that the latest driver has dropped support for several older cards including my Quadro P2000 it seems.

After changing to the production driver v580.119.02, allowing it to download/install and a reboot, it now shows my Quadro P2000 and Plex is running once again.

Thank you for this! This has fixed my issue as well, shame that nvidia have dropped support.

2 hours ago, showstopper said:

Thank you for this! This has fixed my issue as well, shame that nvidia have dropped support.

Please read this post:

22 hours ago, ich777 said:

Do you have additional diagnostics from a 580 driver?

tower-diagnostics-20251216-0004.zip
I captured this yesterday does this work ?

3 hours ago, shremi said:

I captured this yesterday does this work ?

I'm really not sure what's going on since this shouldn't happen at all:

Dec 16 00:03:10 Tower kernel: NVRM: API mismatch: the client 'nvidia-smi' (pid 12017)

Dec 16 00:03:10 Tower kernel: NVRM: has the version 580.119.02, but this kernel module has

Dec 16 00:03:10 Tower kernel: NVRM: the version 580.95.05. Please make sure that this

Dec 16 00:03:10 Tower kernel: NVRM: kernel module and all NVIDIA driver components

Dec 16 00:03:10 Tower kernel: NVRM: have the same version.

Dec 16 00:03:10 Tower kernel: NVRM: API mismatch: the client 'nvidia-smi' (pid 12025)

Dec 16 00:03:10 Tower kernel: NVRM: has the version 580.119.02, but this kernel module has

Dec 16 00:03:10 Tower kernel: NVRM: the version 580.95.05. Please make sure that this

Dec 16 00:03:10 Tower kernel: NVRM: kernel module and all NVIDIA driver components

Dec 16 00:03:10 Tower kernel: NVRM: have the same version.

Do you have any custom scripts in place which replacing nvidia-smi? Or do you maybe have an AI/LXC container which is possibly using another version from nvidia-smi.

It's very strange since it seems you are the only one who has this issue so I assume this has something to do with your machine. Even the post two above yours says that the driver 580.119.02 works just fine.

Hi all!

I am trying to add a 5060ti to my server, next to my 1660super.

After not seeing the card in Unraid, I tried switching to the opensource drivers, but still only the 1660 super shows up:

root@Fenrir:~# nvidia-smi -L

GPU 0: NVIDIA GeForce GTX 1660 SUPER (UUID: GPU-d3aa70ab-7012-fa6d-a9c0-d793b052fba6)

However:

root@Fenrir:~# lspci | grep -i nvidia

01:00.0 VGA compatible controller: NVIDIA Corporation GB206 [GeForce RTX 5060 Ti] (rev a1)

01:00.1 Audio device: NVIDIA Corporation GB206 High Definition Audio Controller (rev a1)

81:00.0 VGA compatible controller: NVIDIA Corporation TU116 [GeForce GTX 1660 SUPER] (rev a1)

81:00.1 Audio device: NVIDIA Corporation TU116 High Definition Audio Controller (rev a1)

81:00.2 USB controller: NVIDIA Corporation TU116 USB 3.1 Host Controller (rev a1)

81:00.3 Serial bus controller: NVIDIA Corporation TU116 USB Type-C UCSI Controller (rev a1)

...not sure what nvidia-persistenced should do, but I tried adding it to my go file, but to no avail.

The 1660super still works, but hopefully someone can help Thanks!

Edited December 18, 2025Dec 18 by MaTi

19 hours ago, ich777 said:

I'm really not sure what's going on since this shouldn't happen at all:

Dec 16 00:03:10 Tower kernel: NVRM: API mismatch: the client 'nvidia-smi' (pid 12017)

Dec 16 00:03:10 Tower kernel: NVRM: has the version 580.119.02, but this kernel module has

Dec 16 00:03:10 Tower kernel: NVRM: the version 580.95.05. Please make sure that this

Dec 16 00:03:10 Tower kernel: NVRM: kernel module and all NVIDIA driver components

Dec 16 00:03:10 Tower kernel: NVRM: have the same version.

Dec 16 00:03:10 Tower kernel: NVRM: API mismatch: the client 'nvidia-smi' (pid 12025)

Dec 16 00:03:10 Tower kernel: NVRM: has the version 580.119.02, but this kernel module has

Dec 16 00:03:10 Tower kernel: NVRM: the version 580.95.05. Please make sure that this

Dec 16 00:03:10 Tower kernel: NVRM: kernel module and all NVIDIA driver components

Dec 16 00:03:10 Tower kernel: NVRM: have the same version.

Do you have any custom scripts in place which replacing nvidia-smi? Or do you maybe have an AI/LXC container which is possibly using another version from nvidia-smi.

It's very strange since it seems you are the only one who has this issue so I assume this has something to do with your machine. Even the post two above yours says that the driver 580.119.02 works just fine.

Thanks for getting back is there a command line i can use to check for this ???

My scripts are only related to backups and file management nothing that touches the GPU.

As for docker containers i only use nvidia for Jellyfin and Frigate , everything else is not gpu bound.

12 hours ago, MaTi said:

I am trying to add a 5060ti to my server, next to my 1660super.

Are you sure that you have Resizable BAR Support, Above 4G Decoding enabled and are on the latest BIOS version?

Dec 17 19:04:19 Fenrir kernel: NVRM: This PCI I/O region assigned to your NVIDIA device is invalid:

Dec 17 19:04:19 Fenrir kernel: NVRM: BAR1 is 0M @ 0x0 (PCI:0000:01:00.0)

Dec 17 19:04:19 Fenrir kernel: nvidia 0000:01:00.0: probe with driver nvidia failed with error -1

Dec 17 19:04:19 Fenrir kernel: NVRM: The NVIDIA probe routine failed for 1 device(s).

Dec 17 19:04:19 Fenrir kernel: NVRM: loading NVIDIA UNIX Open Kernel Module for x86_64 580.95.05 Release Build (dvs-builder@U22-I3-B17-02-5) Tue Sep 23 09:55:41 UTC 2025

24 minutes ago, shremi said:

Thanks for getting back is there a command line i can use to check for this ???

What happens when you issue nvidia-smi from a Unraid terminal?

I just can assume that something is replacing nvidia-smi with an older version since nobody else is having this issue so far.

18 minutes ago, ich777 said:

What happens when you issue nvidia-smi from a Unraid terminal?

I just can assume that something is replacing nvidia-smi with an older version since nobody else is having this issue so far.

right now it is fixed since i moved to a rtx 2070 supper but i plan on using the 1060 again :

yestertay showed like this :

Failed to initialize NVML: Driver/library version mismatch

NVML library version: 590.44

3 minutes ago, shremi said:

Failed to initialize NVML: Driver/library version mismatch

NVML library version: 590.44

That's really strange to me since I always compile from the official driver package and all files should be the same driver version because it's the package from Nvidia and TBH others would have the same issue as you, so my assumption was something is replacing the nvidia-smi library or other libraries on your system.

35 minutes ago, ich777 said:

That's really strange to me since I always compile from the official driver package and all files should be the same driver version because it's the package from Nvidia and TBH others would have the same issue as you, so my assumption was something is replacing the nvidia-smi library or other libraries on your system.

I can reproduce the issue and it’s a kernel/userspace version split, not scripts.
After selecting Production 580.119.02, nvidia-smi and nvidia-container are 580.119.02, but /proc/driver/nvidia/version and modinfo nvidia show the Open Kernel Module 580.95.05 (Dual MIT/GPL) still loaded.
dmesg shows: “API mismatch… client has 580.119.02 but kernel module has 580.95.05”.
Also both NVML libs exist on disk: libnvidia-ml.so.580.95.05 and libnvidia-ml.so.580.119.02 in /usr/lib and /usr/lib64.
So the plugin updates userspace but does not replace/load the matching kernel module when switching from Open Source driver to Production branch.

13 minutes ago, shremi said:

So the plugin updates userspace but does not replace/load the matching kernel module when switching from Open Source driver to Production branch.

Two question, do you reboot when switching versions?

Do you install the package manually?

Sorry but I really can't tell what's wrong since nobody else seem to have that issue and the drivers for Unraid 7.2.2 are downloaded a lot, here are the numbers from GitHub:

name: 6.12.54-Unraid,

name: nvidia-575.64.05-6.12.54-Unraid-1.txz,

download_count: 795,

name: nvidia-580.105.08-6.12.54-Unraid-1.txz,

download_count: 17521,

name: nvidia-580.119.02-6.12.54-Unraid-1.txz,

download_count: 424,

name: nvidia-580.65.06-6.12.54-Unraid-1.txz,

download_count: 124,

name: nvidia-580.95.05-6.12.54-Unraid-1.txz,

download_count: 9395,

name: nvidia-590.44.01-6.12.54-Unraid-1.txz,

download_count: 10315,

name: nvos-580.95.05-6.12.54-Unraid-1.txz,

download_count: 1671,

17 minutes ago, shremi said:

After selecting Production 580.119.02, nvidia-smi and nvidia-container are 580.119.02, but /proc/driver/nvidia/version and modinfo nvidia show the Open Kernel Module 580.95.05 (Dual MIT/GPL) still loaded.
dmesg shows: “API mismatch… client has 580.119.02 but kernel module has 580.95.05”.
Also both NVML libs exist on disk: libnvidia-ml.so.580.95.05 and libnvidia-ml.so.580.119.02 in /usr/lib and /usr/lib64.

I just downloaded the open source driver package for version 580.95.05 and every library is consistned and has only 580.95.05 in them.

I also downloaded the driver package for version 580.119.02 and there are only the libraries for driver 580.119.02 in it.

Then I did the same for the driver package for version 590.44.01 and the libraries match the driver version.

So to speak, I really don't know what the issue on your system is, everything is in the correct spot.

You'll find the packages here if you want to take a look at them yourself:

https://github.com/unraid/unraid-nvidia-driver/releases/tag/6.12.54-Unraid

I really don't know what's going on on your system.