[PLUGIN] GPU Statistics

[sersh]

Plugin writes:

Quote

Vendor command returned no data.

Vendor data valid, but not enough received.

And don't work. Unraid 6.12.4, gpu statistics 2023.10.29d

gpujson

nas-unraid-diagnostics-20231031-0855.zip

Edited October 31, 2023 by sersh

[ich777]

14 minutes ago, sersh said:

And don't work. Unraid 6.12.4, gpu statistics 2023.10.29d

Please post your Diagnostics too.

[sersh]

8 minutes ago, ich777 said:

Please post your Diagnostics too.

Updated post above.

Edited October 31, 2023 by sersh

[SimonF]

13 hours ago, sersh said:

Updated post above.

what does timeout -k .500 .400 intel_gpu_top -J -s 250 show?

[sersh]

9 hours ago, SimonF said:

what does timeout -k .500 .400 intel_gpu_top -J -s 250 show?

Nothing, only [.

 

Edited November 1, 2023 by sersh

[SimonF]

1 hour ago, sersh said:

Nothing, only [.

 

does intel_gpu_top show anything

[sersh]

1 hour ago, SimonF said:

does intel_gpu_top show anything

Yes, it works.

 

[bb12489]

My Arc a770m isn't showing up properly on my dashboard, but intel_gpu_top shows proper activity when transcoding. 

[SimonF]

2 hours ago, bb12489 said:

My Arc a770m isn't showing up properly on my dashboard, but intel_gpu_top shows proper activity when transcoding. 

Which version of gpustat and top are you using. Can you provide output of cat /tmp/gpujson

[kaares]

I'm having this issue too on a arc 380 card.

Statistics addon not updating, but intel_gpu_top will happily show the data in terminal.

 

GPU Statistics 2023.10.29d

Intel GPU TOP 2023.09.13

 

I'm getting some info in /var/log/phplog that might be of use.

[09-Nov-2023 19:43:26 Europe/Berlin] PHP Fatal error:  Uncaught TypeError: in_array(): Argument #2 ($haystack) must be of type array, bool given in /usr/local/emhttp/plugins/gpustat/lib/Main.php:130
Stack trace:
#0 /usr/local/emhttp/plugins/gpustat/lib/Main.php(130): in_array('0000:83:00.0', false)
#1 /usr/local/emhttp/plugins/gpustat/lib/Intel.php(95): gpustat\lib\Main->checkVFIO('0000:83:00.0')
#2 /usr/local/emhttp/plugins/gpustat/gpustatusmulti.php(71): gpustat\lib\Intel->getStatistics()
#3 {main}
  thrown in /usr/local/emhttp/plugins/gpustat/lib/Main.php on line 130

 

Output of cat /tmp/gpujson

Time = Thu, 09 Nov 2023 19:29:22 +0100
[]

 

Edited November 9, 2023 by kaares
More details

[SimonF]

24 minutes ago, kaares said:

I'm having this issue too on a arc 380 card.

Statistics addon not updating, but intel_gpu_top will happily show the data in terminal.

 

GPU Statistics 2023.10.29d

Intel GPU TOP 2023.09.13

 

I'm getting some info in /var/log/phplog that might be of use.

[09-Nov-2023 19:43:26 Europe/Berlin] PHP Fatal error:  Uncaught TypeError: in_array(): Argument #2 ($haystack) must be of type array, bool given in /usr/local/emhttp/plugins/gpustat/lib/Main.php:130
Stack trace:
#0 /usr/local/emhttp/plugins/gpustat/lib/Main.php(130): in_array('0000:83:00.0', false)
#1 /usr/local/emhttp/plugins/gpustat/lib/Intel.php(95): gpustat\lib\Main->checkVFIO('0000:83:00.0')
#2 /usr/local/emhttp/plugins/gpustat/gpustatusmulti.php(71): gpustat\lib\Intel->getStatistics()
#3 {main}
  thrown in /usr/local/emhttp/plugins/gpustat/lib/Main.php on line 130

 

Output of cat /tmp/gpujson

Time = Thu, 09 Nov 2023 19:29:22 +0100
[]

 

Can you edit the following to see if this fixes your issue and then I will release a fix.

 

nano /usr/local/emhttp/plugins/gpustat/lib/Main.php line 130

 

to if ($files) $vfio = in_array($pciid, $files) ; else $vfio = $files ;

 

    /**
     * Checks if card is bound to VFIO
     *
     * @param string $pciid
     * @return bool $vfio
     */
    protected function checkVFIO(string $pciid)
    {
        $files = scandir("/sys/bus/pci/drivers/vfio-pci/") ;
        if ($files) $vfio = in_array($pciid, $files) ; else $vfio = $files ;
        return $vfio ;
    }

 

[kaares]

That fixed it on my end! 👍

 

****

Updated the plugin, still ok👍

Edited November 9, 2023 by kaares

[bb12489]

This fixed it for me as well! Thanks. 

 

[B_Sinn3d]

My dashboard widget no longer stays expanded.  I have get it to expand by minimizing then expanding but quickly closes.  I was able to get a screenshot and it says "GPU not available bound to VFIO or inuse in a VM." 

 

I am not passing it through and not being used by VM.  Could this be because I have unraid said to launch in GUI mode?  It has been running in GUI mode for a while not but only recently noticed that the widget no longer shows correctly.  It is still being used by Plex correctly when its needed.

 

 

 

 

 

[SimonF]

6 hours ago, B_Sinn3d said:

My dashboard widget no longer stays expanded.  I have get it to expand by minimizing then expanding but quickly closes.  I was able to get a screenshot and it says "GPU not available bound to VFIO or inuse in a VM." 

 

I am not passing it through and not being used by VM.  Could this be because I have unraid said to launch in GUI mode?  It has been running in GUI mode for a while not but only recently noticed that the widget no longer shows correctly.  It is still being used by Plex correctly when its needed.

 

 

 

 

 

Which version are you using and can you provide cat /tmp/gpujson & unraid vers

 

also try ctrl + F5 in dashboard to see if that fixes.

[B_Sinn3d]

I am on the latest version 2023-11-09 but when I noticed it I was on 2023-10-29.  Unraid is 6.12.4.

 

cntrl + F5 didn't help but I just cleared browser data from all time and it appears to be working now and the message is no longer showing that the GPU is not available. 

 

I appreciate you taking the time on this.

[Indi]

I just installed this app but not seeing any usage data

I have 2023.11.09 installed
Unraid 6.12.4
1660 Super GPU
Tried clearing browser cache
Unchecked, applied, rechecked, applied the GPU 

[alturismo]

1 hour ago, Indi said:

I just installed this app but not seeing any usage data

may expand your Info what you expect to see, which app is currently using your dGPU, Plex, Jelly, Emby, ... ?

 

you are sure your dGPU is currently in use ?

[Indi]

2 hours ago, alturismo said:

may expand your Info what you expect to see, which app is currently using your dGPU, Plex, Jelly, Emby, ... ?

 

you are sure your dGPU is currently in use ?

That is a good thought, I started a transcode in Emby and I see very little usage now. The active apps doesn't show anything, though that hasn't worked for me in a long time (I used the old plug-in before I upgraded to 6.12.4). 

Seems it is working, but the tasks I was running just aren't using the GPU as much as I thought 😛 thanks for the help!

 

[bogus-nationalization6850]

Just moved my usb to a different server and my gpu stats are flashing in and out, it was Nvidia now im using intel igpu, ive uninstalled the plugin, reinstalled it and selected the correct gpu, but the stats aren't displaying consistently. is there anywhere else I can look to fix this?

Edited December 6, 2023 by bogus-nationalization6850

[SimonF]

6 hours ago, bogus-nationalization6850 said:

Just moved my usb to a different server and my gpu stats are flashing in and out, it was Nvidia now im using intel igpu, ive uninstalled the plugin, reinstalled it and selected the correct gpu, but the stats aren't displaying consistently. is there anywhere else I can look to fix this?

Can you post diagnostics and also /tmp/gpujson?

 

and run

timeout -k .500 .600 intel_gpu_top -J -s 250 -d pci:slot=0000:00:02.0

[mikeyosm]

Something odd happens when I add a second GPU to my UNRAID server.

Without a dGPU plugged in (Radeon WX4100) the GPU stats plugin display the Intel iGPU stats.

When I plug the dGPU in, the stats plugin refuses to show the iGPU stats but displays the dGPU stats.

Both GPUs are selectable in the drop-down menu.

[ich777]

30 minutes ago, mikeyosm said:

Both GPUs are selectable in the drop-down menu.

Please post your Diagnostics with the dGPU installed.

[SimonF]

44 minutes ago, mikeyosm said:

Something odd happens when I add a second GPU to my UNRAID server.

Without a dGPU plugged in (Radeon WX4100) the GPU stats plugin display the Intel iGPU stats.

When I plug the dGPU in, the stats plugin refuses to show the iGPU stats but displays the dGPU stats.

Both GPUs are selectable in the drop-down menu.

Also can you include  cat /tmp/gpujson 

[mikeyosm]

56 minutes ago, SimonF said:

Also can you include  cat /tmp/gpujson 

Sure - 

 

cat /tmp/gpujson
Time = Wed, 06 Dec 2023 19:16:50 +0000
{"00:02.0":{"clock":"N\/A","fan":"N\/A","memclock":"N\/A","memutil":"N\/A","memused":"N\/A","power":"N\/A","powermax":"N\/A","rxutil":"N\/A","txutil":"N\/A","temp":"N\/A","tempmax":"N\/A","util":"N\/A","error":[{"code":301,"message":"Vendor command returned no data.","extra":""}],"vfio":false,"vfiochk":false,"vfiochkid":"0000:00:02.0","panel":1},"02:00.0":{"clock":0.21,"fan":"N\/A","memclock":0.3,"memutil":"0.1%","memused":5.69,"power":"N\/A","powermax":"N\/A","rxutil":"N\/A","txutil":"N\/A","temp":"32 \u00b0C","tempmax":99,"util":"0%","vendor":"AMD","name":"Radeon Pro WX 4100","event":"0%","vertex":"0%","texture":"0%","shaderexp":"0%","sequencer":"0%","shaderinter":"0%","scancon":"0%","primassem":"0%","depthblk":"0%","colorblk":"0%","gfxtrans":"0%","transused":6.39,"memclockutil":"20%","clockutil":"17.8%","tempunit":"C","voltage":0.72,"voltageunit":"V","vfio":false,"vfiochk":false,"vfiochkid":"0000:02:00.0","panel":2}}

 

diagnostics-20231206-1917.zip