I have nvidia rtx 3060 12gb gpu installed on unraid server for running local llm AI models but its using only 7300mb gpu vram instead of 12gb gpu statistics plugin shows 7300 mb vram utilisation at 100% usage i have latest nvidia drivers installed by using nvidia plugin from community applications.

can anyone please provide me a solution. 

 

Edited February 23, 20242 yr by drmetro

Please use the Nvidia plugin support thread:

 

1 hour ago, drmetro said:

can anyone please provide me a solution. 

Please take a look again:

This is the frequency from your Memory.

 

What you are after is:

 

Which means it uses roughly 9GB, however I would strongly recommend that you ask in the support thread from the container that you are using since the application seems not using all of your VRAM and I can't do anything driver wise and this is also not driver related (are you sure it should use the full 12GB since if it is right on the edge it can crash)?

 

If you got any further driver related questions please use the official support thread from the driver as @JorgeB linked already.