On 8/31/2025 at 7:59 AM, sausuke said:

Anyone how to solve this? I'm on 7.1.4 and using Open Source Driver: v575.57.08 with nvidia 5070ti. When I stopped using VM with GPU passthrough, sometimes nvidia driver cannot detect the 5070ti anymore? I need to restart the server again for it to appear?

Here's the log

Finally solved this problem, it's on this thread https://forums.developer.nvidia.com/t/575-64-nvrm-out-of-memory-error-causes-dgpu-to-not-be-usable-after-some-time/336877/11

I upgraded to the latest beta 7.2.0 beta and the same problem exist with latest driver v580.76.05. Used chat gpt to convert it to userscript. That Out of memory [NV_ERR_NO_MEMORY] (0x00000051) occurs on when using VM and playing a game or benchmark related like heaven benchmark.

How to create that error:
Open VM>Play a game or heaven benchmark>Shutdown VM> and when I go to Nvidia driver in settings keep refreshing and you'll see that Check failed: Out of memory [NV_ERR_NO_MEMORY] error and GPU will disappear later.

No error when just booting Windows VM and shutdown.

I haven't tried the latest driver in windows if that fixes this error. Will update later

here's the userscript and use it after VM releases my 5070ti to Unraid OS

#!/bin/bash

ERR_TEXT="NV_ERR"

LOOKBACK_MIN=5

ERR_LINE=$(dmesg | grep "$ERR_TEXT" | tail -n 1)

echo "$ERR_LINE"

if [ -n "$ERR_LINE" ]; then

ERR_TS=$(echo "$ERR_LINE" | awk -F'[][]' '{print $2}')

CURR_TS=$(cat /proc/uptime | awk '{print $1}')

ERR_TS_INT=$(printf "%.0f" "$ERR_TS")

CURR_TS_INT=$(printf "%.0f" "$CURR_TS")

TS_DIFF=$(((CURR_TS_INT - ERR_TS_INT)/60))

echo " $ERR_TEXT found, occurred $TS_DIFF minutes ago"

if [ "$TS_DIFF" -le "$LOOKBACK_MIN" ]; then

echo " syncing and dropping caches"

sync

sleep 5

if echo 3 > /proc/sys/vm/drop_caches; then

echo " caches successfully dropped"

else

echo " error dropping caches"

fi

else

echo " $ERR_TEXT is not recent; try re-running your VM"

fi

else

echo " $ERR_TEXT not found in recent dmesg buffer"

fi

logs after that error using that script

Edited September 7, 2025Sep 7 by sausuke

Hello, will the next Unraid version support the proprietary driver for the 5000 - series graphics card? Currently, when using Steam Headless, acceleration features such as DLSS cannot be called.

4 hours ago, 王若凡 said:

Hello, will the next Unraid version support the proprietary driver for the 5000 - series graphics card? Currently, when using Steam Headless, acceleration features such as DLSS cannot be called.

AFAIK the Proprietary driver doesn't support 5000 series anymore.

However for certain games you have to pass over custom start arguments to be able to use some Nvidia features, at least this was the case on my Debian Linux Desktop computer for some games but most games nowadays support it right OOB. I'm not familiar with Steam Headless much but maybe a package in the container is missing since you also need some base OS packages but that is just a guess.

hey so I have an issue and havent seen a definitive fix so far. My Nvidia GPU wont update drivers. its a RTX 2070. the nivida tool gives this error.

I tried manually updating with terminal and no luck there either. i do have an error about something being depreciated but google gives nothing about the error or a fix. Im hoping someone here can help. I am currently here are the settings.

1 hour ago, DemonWarriorTech said:

hey so I have an issue and havent seen a definitive fix so far. My Nvidia GPU wont update drivers. its a RTX 2070. the nivida tool gives this error.

There is a Recommended Post on top of this thread, which is sadly not easily visible anymore since the new design, however here is the link to the post (this applies to your issue):

On 9/7/2025 at 9:27 AM, sausuke said:

Finally solved this problem, it's on this thread https://forums.developer.nvidia.com/t/575-64-nvrm-out-of-memory-error-causes-dgpu-to-not-be-usable-after-some-time/336877/11

I upgraded to the latest beta 7.2.0 beta and the same problem exist with latest driver v580.76.05. Used chat gpt to convert it to userscript. That Out of memory [NV_ERR_NO_MEMORY] (0x00000051) occurs on when using VM and playing a game or benchmark related like heaven benchmark.

How to create that error:
Open VM>Play a game or heaven benchmark>Shutdown VM> and when I go to Nvidia driver in settings keep refreshing and you'll see that Check failed: Out of memory [NV_ERR_NO_MEMORY] error and GPU will disappear later.

No error when just booting Windows VM and shutdown.

I haven't tried the latest driver in windows if that fixes this error. Will update later

here's the userscript and use it after VM releases my 5070ti to Unraid OS

#!/bin/bash

ERR_TEXT="NV_ERR"

LOOKBACK_MIN=5

ERR_LINE=$(dmesg | grep "$ERR_TEXT" | tail -n 1)

echo "$ERR_LINE"

if [ -n "$ERR_LINE" ]; then

ERR_TS=$(echo "$ERR_LINE" | awk -F'[][]' '{print $2}')

CURR_TS=$(cat /proc/uptime | awk '{print $1}')

ERR_TS_INT=$(printf "%.0f" "$ERR_TS")

CURR_TS_INT=$(printf "%.0f" "$CURR_TS")

TS_DIFF=$(((CURR_TS_INT - ERR_TS_INT)/60))

echo " $ERR_TEXT found, occurred $TS_DIFF minutes ago"

if [ "$TS_DIFF" -le "$LOOKBACK_MIN" ]; then

echo " syncing and dropping caches"

sync

sleep 5

if echo 3 > /proc/sys/vm/drop_caches; then

echo " caches successfully dropped"

else

echo " error dropping caches"

fi

else

echo " $ERR_TEXT is not recent; try re-running your VM"

fi

else

echo " $ERR_TEXT not found in recent dmesg buffer"

fi

logs after that error using that script

Update to this, got the same error NV_ERR_NO_MEMORY when using latest driver in Windows VM after shutdown, but I used the 5070ti in Invoke Ai with no problems with Unraid apps unlike lower version of Nvidia Driver in plugin. I guess I will just use the userscript and test the later version of Nvidia drivers for Unraid

On 9/9/2025 at 3:32 PM, ich777 said:

There is a Recommended Post on top of this thread, which is sadly not easily visible anymore since the new design, however here is the link to the post (this applies to your issue):

thank you! that seemed to work! it was driving me nuts

On 8/26/2025 at 5:30 AM, ich777 said:

Please post your Diagnostics, I can't say anything without them.

Okay, so sorry for the delay. Been troubleshooting some bad RAM, had a drive die, and been moving. After all these other issues have been fixed. I'm still having an issue with the driver. Attached are diags.

I saw that you suggested updating to the beta. I actually have a ticket open with Lime support about long restart times, and it's apparently related to the NVIDIA driver. (at least according to them) I'd like to prevent updating to the beta until they advise me to.

Thoughts based on what you're seeing?

unraid-diagnostics-20250912-0036 ANON.zip

2 hours ago, lukeb873 said:

Thoughts based on what you're seeing?

Not really, where does it fail to transcode? Plex?

Please also make sure to lower the PCIe Gen for the slot that the card is in to PCIe Gen 3

I really can't tell what's going on since this seems like some hardware incompatibility issue, maybe a newer driver will fix this issue if Nvidia releases one.

JellyFin. Typically, I see it disappear from my GPU stats plugin, and that's how I know it's now messed up and won't be able to do any sort of hardware transcoding.

Could you say more about why I need to lower this?

Gotcha. In the other post, you've recommended moving to the beta. Is this still something you might recommend? I'm still waiting to hear back from Lime support to see what they have to say.

2 hours ago, lukeb873 said:

Could you say more about why I need to lower this?

Something seems to be messed up with 5000 series and the PCIe 5.0 specification, however for your usecase that shouldn affect performance.

2 hours ago, lukeb873 said:

Is this still something you might recommend?

You can try that, since it helped other people, I recommended that because of a newer driver and of course also newer Kernel.

2 hours ago, lukeb873 said:

I'm still waiting to hear back from Lime support to see what they have to say.

I don't think that they can say much because this is basically a 3rd party driver and ot would be probably better to ask on the Nvodia Developer Forums.

However it seems to me that this is a general issue with 5000 series cards and some Motherboards (especially AMD based) since you are not allone with that issue, but most of the time lowering PCIe version is enough to avoid that issue.

So this is what Lime Support said: I can see the exact same issue with the Nvidia driver still occurring quite often. I can see repeated cycles of out of memory followed by RmInitAdapter failed The drive is still crashing and trying to reset the GPU. Hopefully the Nvidia forums might be able to help you with this. But I'd say this is almost certainly the cause of your parity checks pausing because when the driver crashes, it can freeze the system and so interrupt the I/O operations like the parity check. The system will recover from the driver crash, but the parity process isn't always able to actually resume on its own. Looking at the logs, this is what I would suspect. Now, as you've already tried just reseating the cables, I'm assuming you've got a sufficient power supply because your RTX 5070 does use quite a lot of wattage, and an unstable power supply can cause this kind of issue. But that said, if it's happening when the GPU isn't really under load, it makes this probably less likely. 

I do have a Corsair RM1000X so the PSU isn't the issue. As he stated, I've been having issues with the parity check randomly pausing which he's saying seems to be related to the driver crashing.

On 9/13/2025 at 11:36 PM, ich777 said:

Something seems to be messed up with 5000 series and the PCIe 5.0 specification, however for your usecase that shouldn affect performance.

So when the GPU diagnostics plugin does work, it says PCIe Gen (MAX): 4 (4), which I would think means it's not even running at Gen5 in the first place. Would you still recommend going down to gen3?

On 9/13/2025 at 11:36 PM, ich777 said:

You can try that, since it helped other people, I recommended that because of a newer driver and of course also newer Kernel.

I want to see if I can get my Immich container fixed first prior to going to a beta, but after that, I'd be open to moving to the beta.

34 minutes ago, lukeb873 said:

Would you still recommend going down to gen3?

Yes.

34 minutes ago, lukeb873 said:

I do have a Corsair RM1000X so the PSU isn't the issue.

How old is the power supply? You know that PSUs degrade over time and this wouldn't be the first time a user installing a new power supply after 8 years and the issue is gone.

However I still think it's related to hardware incompatibilty or the driver not being fully bug free.

Hello,

I’ve been running into an issue for several weeks where my Nvidia GPU keeps disappearing.

• I replaced the GPU

• I tested different Nvidia driver versions

• I changed the PCIe slot

• I uninstalled the GPU Statistics plugin

• I uninstalled the Nvidia plugin, rebooted the server, and reinstalled it

• I disabled pcie_aspm

The only thing that temporarily fixes it is rebooting the server — but after some time, the GPU disappears again.

I have another Unraid server with the same motherboard and two GPUs, and I don’t have any issues on that system. However, on that machine I don’t use the Nvidia plugin, since both GPUs are used only for VM passthrough.

At this point I don’t know what else to try… It’s quite problematic because the GPU is used by Jellyfin, and as soon as the GPU disappears I get playback errors until I reboot.

Do you have any ideas that could help me move forward with troubleshooting this issue?

Here is the GPU specification when everything is working :

Thanks in advance.

unraid-diagnostics-20250925-0848.zip

Edited September 25, 2025Sep 25 by thymon

2 hours ago, thymon said:

Do you have any ideas that could help me move forward with troubleshooting this issue?

Please update your BIOS since it seems to be way out of date.

However this seems like a common issue with newer drivers, I can only tell you to go to the Nvidia Developer forums and describe your issue there since it seems a lot of users, mostly with AMD Systems experiencing such issues.

However I would recommend that you update your BIOS first.

BTW, you have a lot of and I mean a lot of SSH messages in your syslog, is everything good there?

2 hours ago, ich777 said:

BTW, you have a lot of and I mean a lot of SSH messages in your syslog, is everything good there?

Yes, I saw that too. But I think it's either my rsync scripts or the LuckyBackup docker. I need to look into that. Thanks for your reply, I'll start by updating the BIOS.

Please excuse me if I'm mistaken, but is this the Closed Source Driver and would this support the 5000 series? (just got the 5060Ti)

https://www.nvidia.com/en-us/drivers/details/254665/

On 9/25/2025 at 8:47 AM, thymon said:

Yes, I saw that too. But I think it's either my rsync scripts or the LuckyBackup docker. I need to look into that. Thanks for your reply, I'll start by updating the BIOS.

Have you had any luck? I facing the same problem with a 2070 Super. It works for a while after reboot but then just disappears .

5 hours ago, AnnabellaRenee87 said:

Please excuse me if I'm mistaken, but is this the Closed Source Driver and would this support the 5000 series? (just got the 5060Ti)

https://www.nvidia.com/en-us/drivers/details/254665/

Actually, does it matter if its closed or open source? I'm gonna be using it for transcoding, gaming and maybe AI with dockers.

Yes steam link works with the dockered version of steam.

Hi, this plugin has been working great for me for a few months until my server needed a restart today.

It's a Proxmox host with Unraid VM and GPU pass through to unraid.

Rebooting my Unraid would hang at rc.local Installing packages from /boot/extra, and removing the nvidia driver install package would let the boot finish.

Trying to re-install the driver now it hangs/never progresses past Installing...

The only way it seems to have a stable system now is to remove the nvidia-drivers. Changing from latest to a past version number that was previously working doesn't change anything.

The GPU is passed through and seen by Unraid in lspci.

Any help is appreciated.

Downloading plugin
plugin: installing: nvidia-driver.plg
Executing hook script: CA_preHook
Clearing Community Applications plugin cache
Executing hook script: pre_plugin_checks
plugin: downloading: nvidia-driver-2025.03.25.txz ...
plugin: downloading: nvidia-driver-2025.03.25.txz ... 100%
plugin: downloading: nvidia-driver-2025.03.25.txz ... done


+==============================================================================
| Installing new package /boot/config/plugins/nvidia-driver/nvidia-driver-2025.03.25.txz
+==============================================================================

Verifying package nvidia-driver-2025.03.25.txz.
Installing package nvidia-driver-2025.03.25.txz:
PACKAGE DESCRIPTION:
Package nvidia-driver-2025.03.25.txz installed.

+==============================================================================
| WARNING - WARNING - WARNING - WARNING - WARNING - WARNING - WARNING - WARNING
|
| Don't close this window with the red 'X' in the top right corner until the 'DONE' button is displayed!
|
| WARNING - WARNING - WARNING - WARNING - WARNING - WARNING - WARNING - WARNING
+==============================================================================

-----------------Downloading Nvidia Driver Package v580.82.09------------------
----------This could take some time, please don't close this window!------------

----Successfully downloaded Nvidia Driver Package v580.82.09, please wait!----

-----------------Installing Nvidia Driver Package v580.82.09-------------------

01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP104 [GeForce GTX 1070] [10de:1b81] (rev a1)
	Subsystem: Dell Device [1028:3301]
	Kernel modules: nouveau
01:00.1 Audio device [0403]: NVIDIA Corporation GP104 High Definition Audio Controller [10de:10f0] (rev a1)
	Subsystem: Dell Device [1028:3301]

tower-diagnostics-20251004-1059.zip

6 hours ago, AnnabellaRenee87 said:

Please excuse me if I'm mistaken, but is this the Closed Source Driver

Can you please go a bit more in detail?

However all the drivers are closed source ones except for the option where it says Open Source.

30 minutes ago, AnnabellaRenee87 said:

Actually, does it matter if its closed or open source?

For 5000 Series cards, yes.

5000 Series only supports Open Srouce

2000 Series up to 4000 Series support both Closed and Open Source (including the 1600 series cards)

Everything below 2000 supports Closed Source only

16 minutes ago, reveno said:

	Kernel modules: nouveau

I think it should be pretty obvious why it's not working, another driver is used.
You have to blacklist the nouveau driver.

@SimonF shouldn't the nouveau driver be blacklisted by default, I have seen now many reports with that issue.

1 hour ago, ich777 said:

I think it should be pretty obvious why it's not working, another driver is used.
You have to blacklist the nouveau driver.

@SimonF shouldn't the nouveau driver be blacklisted by default, I have seen now many reports with that issue.

Thanks for the reply.

On the Proxmox host nouveau has been blacklisted;

proxmox# lspci | grep -i nvidia
01:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1070] (rev a1)
01:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev a1)

I never blacklisted the nouveau driver in Unraid before and it worked. Given that the nvidia drivers are not installed/won't install, isn't it using nouveau the expected behaviour?

It's passed through as raw device, primary GPU is unticked.

To blacklist it in Unraid - do I add this to my /boot/config/go file?

echo "blacklist nouveau" >> /etc/modprobe.d/blacklist.conf 

21 minutes ago, reveno said:

I never blacklisted the nouveau driver in Unraid before and it worked. Given that the nvidia drivers are not installed/won't install, isn't it using nouveau the expected behaviour?

Nope it is not, usually it should be disabled by default.

21 minutes ago, reveno said:

To blacklist it in Unraid - do I add this to my /boot/config/go file?

Please read:

Version 7.1.0 2025-05-05 | Unraid Docs

Dieses Release fügt drahtloses Networking, die Möglichkeit, TrueNAS und andere Fremdpools zu importieren, mehrere Verbesserungen an VMs, erste Schritte hin zu einem responsiven WebGUI und mehr hinzu.

Just do:

mkdir -p /boot/config/modprobe.d

echo "blacklist nouveau" > /boot/config/modprobe.d/nouveau.conf

One from the terminal and that's enough.

19 hours ago, ich777 said:

I think it should be pretty obvious why it's not working, another driver is used.
You have to blacklist the nouveau driver.

@SimonF shouldn't the nouveau driver be blacklisted by default, I have seen now many reports with that issue.

Yes should be blacklist by default.