[PLUGIN] GPU Statistics

May 8May 8

9 minutes ago, SimonF said:
If you run qmassa on the cmdline does it show fan speed? But will look into it.

0 is probably correct right now.

Also, vram looks correct.

It also shows power. Power draw in the plugin does not work (always 0 and has not worked before but looks to show there?)

What I see:

Capture_ServerDashboard_–_Brave_2026-05-08_22-14-15_76824953.png

Edited May 8May 8 by Niklas

Quote

May 8May 8

31 minutes ago, Niklas said:
0 is probably correct right now.
Also, vram looks correct.
It also shows power. Power draw in the plugin does not work (always 0 and has not worked before but looks to show there?)
What I see:

i915 is using intel_gpu_top. Will look about using qmassa from that also.

Quote

1

May 9May 9

21 hours ago, Niklas said:
0 is probably correct right now.
Also, vram looks correct.
It also shows power. Power draw in the plugin does not work (always 0 and has not worked before but looks to show there?)
What I see:

I have not release this as yet. but if you put this files into /usr/local/emhttp/plugins/gpustat for the page file and /usr/local/emhttp/plugins/gpustat/lib for the .php

On the settings there is now an option for Intel backend for i915.

This is is how my A770 looks with top + qmassa. Plex is tanscoding and VM is using virtio3d and running glxgears. Please give it a go an let me know any feedback when you can.

GPUStatSettings.page Intel.php

Quote

May 9May 9

1 hour ago, SimonF said:
I have not release this as yet. but if you put this files into /usr/local/emhttp/plugins/gpustat for the page file and /usr/local/emhttp/plugins/gpustat/lib for the .php
On the settings there is now an option for Intel backend for i915.
This is is how my A770 looks with top + qmassa. Plex is tanscoding and VM is using virtio3d and running glxgears. Please give it a go an let me know any feedback when you can.
GPUStatSettings.page Intel.php

Looking good! PCI bus utilization shows more (not stuck on 1 as usual with Linux and Arc).

Fan show N/A when qmassa show 0. When it spins, it shows up but then back to N/A when it stops.

Provoked the fan to turn on with some local ollama ai work. The ?-active app is qmassa.
GPU Clock (MHz) show 0 when not under load but that's normal maybe?

Capture_ServerDashboard_–_Brave_2026-05-09_21-50-10_01446767.png

Edited May 9May 9 by Niklas

Quote

May 10May 10

@Niklas Thanks for testing.

Attached an updated file to show zero fan and not show qmassa in apps.

Also I noticed the PCI gen is 4 but max is 3. So this should be fixed with an updated main.php which goes in the lib directory.

Intel.php Main.php

Quote

May 10May 10

Thanks @SimonF!

PCIe Gen (Max): 3 (4)Lanes (Max): 8 (8), looking good. Just a missing space/delimiter before Lanes.

Fan still shows N/A at 0.

Edited May 10May 10 by Niklas

Quote

May 10May 10

2 hours ago, Niklas said:
Thanks @SimonF!

PCIe Gen (Max): 3 (4)Lanes (Max): 8 (8), looking good. Just a missing space/delimiter before Lanes.
Fan still shows N/A at 0.

If this one looks ok now for the fan, I will release a version tonight.

Intel.php

Quote

May 10May 10

4 minutes ago, SimonF said:
If this one looks ok now for the fan, I will release a version tonight.
Intel.php

Working! Very nice. Thanks!

It could be mentioned that the numbers report "rpm" but that's not important.

Edit: This is what I said to qwen3.5:0.8b to get the fan to turn on. Lots of thinking there. Hejsan means like a friendly "Hi" in Swedish. ;)

Edited May 10May 10 by Niklas

Quote

May 10May 10

Release 2026.05.10

With this release you can now select the backend processing for i915. The default option is just to use intel_gpu_top.

Changing to top + qmassa will show fans, power draw memory usage for ARC cards.

qmassa can be set on its own, but you will loose utilisation. For XE drivers just qmassa is used as it support these metrics also.

PCI reporting has been updated to look at upstream speeds to remove the x1 reporting.

Quote

1

May 10May 10

When using intel_gpu_top + qmassa the "GPU Clock (MHz)" show 0 when the card has no work. Only showing values over 0 under load.

When using qmassa only it shows a frequency at idle, and thats probably correct. In my case it will never be 0 as my hw is too old to get the card down in the lowest power saving state.

Could FRQ-GT0 from qmassa be used in intel_gpu_top + qmassa mode too?

Right now qmassa show FRQ-GT0 1000/2450 (this is probably correct, 2450 is my card max) and intel-gpu-top show 0/ 0 MHz.

In qmassa only mode it seem to use FRQ-GT0 but then I lose other stats ofc.

Edit: Under load, intel_gpu_top shows 864/1279 MHz with both values jumping around, qmassa looks correct with ~2100/2450 (snapshotted just now), only the first number changes. Like 2100 of max 2450. My frequency will never be 0. At the same time qmassa has FRQ-GT0 and also requested and actual.

Unraid 7.3.0-rcs

qmassa:

FRQ-GT0: 800/2450
Requested [767]

Actual [800]

intel_gpu_top:
0/ 0 MHz

/sys/kernel/debug/dri/0000:03:00.0# cat i915_frequency_info

PM MASK=0x00000000

pm_intrmsk_mbz: 0x00000000

RPSTAT1: 0x00018103

RPNSWREQ: 767MHz

Lowest (RPN) frequency: 300MHz

Nominal (RP1) frequency: 600MHz

Max non-overclocked (RP0) frequency: 2450MHz

Current freq: 767 MHz

Actual freq: 800 MHz

Min freq: 300 MHz

Boost freq: 2450 MHz

Max freq: 2450 MHz

efficient (RPe) frequency: 600 MHz

But the frequency seems to stop at what it was at when the load was removed so idk. ;)
Yeah, it stays on the last reading when it goes back to idle so the freq is probably not updating as it should with no load..

Edited May 10May 10 by Niklas

Quote

May 11May 11

12 hours ago, Niklas said:
When using intel_gpu_top + qmassa the "GPU Clock (MHz)" show 0 when the card has no work. Only showing values over 0 under load.
When using qmassa only it shows a frequency at idle, and thats probably correct. In my case it will never be 0 as my hw is too old to get the card down in the lowest power saving state.
Could FRQ-GT0 from qmassa be used in intel_gpu_top + qmassa mode too?
Right now qmassa show FRQ-GT0 1000/2450 (this is probably correct, 2450 is my card max) and intel-gpu-top show 0/ 0 MHz.
In qmassa only mode it seem to use FRQ-GT0 but then I lose other stats ofc.
Edit: Under load, intel_gpu_top shows 864/1279 MHz with both values jumping around, qmassa looks correct with ~2100/2450 (snapshotted just now), only the first number changes. Like 2100 of max 2450. My frequency will never be 0. At the same time qmassa has FRQ-GT0 and also requested and actual.
Unraid 7.3.0-rcs

qmassa:
FRQ-GT0: 800/2450
Requested [767]
Actual [800]
intel_gpu_top:
0/ 0 MHz

/sys/kernel/debug/dri/0000:03:00.0# cat i915_frequency_info
PM MASK=0x00000000
pm_intrmsk_mbz: 0x00000000
RPSTAT1: 0x00018103
RPNSWREQ: 767MHz
Lowest (RPN) frequency: 300MHz
Nominal (RP1) frequency: 600MHz
Max non-overclocked (RP0) frequency: 2450MHz
Current freq: 767 MHz
Actual freq: 800 MHz
Min freq: 300 MHz
Boost freq: 2450 MHz
Max freq: 2450 MHz
efficient (RPe) frequency: 600 MHz

But the frequency seems to stop at what it was at when the load was removed so idk. ;)
Yeah, it stays on the last reading when it goes back to idle so the freq is probably not updating as it should with no load..

Here is an updated files for freq and text, space between Lanes and Fan (RPM)

Intel.php gpustatusmovablemulti.page

Quote

May 11May 11

4 hours ago, SimonF said:
Here is an updated files for freq and text, space between Lanes and Fan (RPM)
Intel.php gpustatusmovablemulti.page

Looking good! The freq stops at the last value it reads under load but that's what qmassa say so..

Edited May 11May 11 by Niklas

Quote

May 15May 15

@SimonF Been about a year since I've been on this page looking for a situation with my b580.

Rolled up Unraid to 7.3.0 so using the default kernel again, over Thor's, and noticed that the PCI lanes, power draw and fan report values now - awesome work. Somewhat minor item now, appears with the more recent 2026.5.11 release the active apps has broken for myself when detecting transcoding sessions with Emby. Below is a screenshot of what it used to be (Around May 1, apologies I don't have the exact plugin version available but safe to say it would have been the released version for that time period) and what it is now when doing the same transcoding function.

image.png.87e1059bcd11f9519f3df451ca766b13.png

Quote

May 15May 15

5 minutes ago, jaybird2203 said:
@SimonF Been about a year since I've been on this page looking for a situation with my b580.
Rolled up Unraid to 7.3.0 so using the default kernel again, over Thor's, and noticed that the PCI lanes, power draw and fan report values now - awesome work. Somewhat minor item now, appears with the more recent 2026.5.11 release the active apps has broken for myself when detecting transcoding sessions with Emby. Below is a screenshot of what it used to be (Around May 1, apologies I don't have the exact plugin version available but safe to say it would have been the released version for that time period) and what it is now when doing the same transcoding function.

Try doing ctlr + F5 to reload the page as may have cache the JavaScript.

Quote

May 15May 15

No dice. Still not detecting. Below is the output of "ps aux | grep ffmpeg" both while transcoding and not for reference.

Transcoding - 
 ps aux | grep ffmpeg
nobody     20229  6.1  1.0 275874176 1395524 ?   Sl   16:29   3:35 /system/EmbyServer -programdata /config -ffdetect /bin/ffdetect -ffmpeg /bin/ffmpeg -ffprobe /bin/ffprobe -restartexitcode 3
nobody    303184  7.0  0.0 114020 28284 ?        Sl   17:26   0:07 /bin/ffmpeg -loglevel +timing -y -print_graphs_file /config/logs/ffmpeg-remux-2436e0ea-6ba6-424a-bc70-0ce0fa8be41e_1graph.txt -copyts -start_at_zero -f matroska,webm -ss 00:10:48.000 -c:v:0 hevc -noautorotate -c:v:1 mjpeg -c:v:2 mjpeg -c:v:3 mjpeg -c:v:4 mjpeg -i /mnt/Movies/somemovie.mkv -map 0:0 -map 0:1 -sn -c:v:0 copy -bsf:v:0 hevc_mp4toannexb -c:a:0 libmp3lame -ab:a:0 192000 -ac:a:0 2 -metadata:s:a:0 language=eng -filter:a:0 volume=1.4 -disposition:a:0 default -max_delay 5000000 -avoid_negative_ts disabled -f segment -map_metadata -1 -map_chapters -1 -segment_format mpegts -segment_list /tmp/transcoding-temp/CD650F/CD650F.m3u8 -segment_list_type m3u8 -segment_time 00:00:06.000 -segment_time_delta -00:10:48.000 -segment_start_number 108 -individual_header_trailer 0 -write_header_trailer 0 -segment_write_temp 1 /tmp/transcoding-temp/CD650F/CD650F_%d.ts

not transcoding
 ps aux | grep ffmpeg
nobody     20229  5.9  1.0 275874128 1387148 ?   Sl   16:29   3:40 /system/EmbyServer -programdata /config -ffdetect /bin/ffdetect -ffmpeg /bin/ffmpeg -ffprobe /bin/ffprobe -restartexitcode 3
root      333301  0.0  0.0   4280  2504 pts/2    S+   17:31   0:00 grep ffmpeg

Quote

May 16May 16

13 hours ago, jaybird2203 said:

No dice. Still not detecting. Below is the output of "ps aux | grep ffmpeg" both while transcoding and not for reference.

Transcoding - 
 ps aux | grep ffmpeg
nobody     20229  6.1  1.0 275874176 1395524 ?   Sl   16:29   3:35 /system/EmbyServer -programdata /config -ffdetect /bin/ffdetect -ffmpeg /bin/ffmpeg -ffprobe /bin/ffprobe -restartexitcode 3
nobody    303184  7.0  0.0 114020 28284 ?        Sl   17:26   0:07 /bin/ffmpeg -loglevel +timing -y -print_graphs_file /config/logs/ffmpeg-remux-2436e0ea-6ba6-424a-bc70-0ce0fa8be41e_1graph.txt -copyts -start_at_zero -f matroska,webm -ss 00:10:48.000 -c:v:0 hevc -noautorotate -c:v:1 mjpeg -c:v:2 mjpeg -c:v:3 mjpeg -c:v:4 mjpeg -i /mnt/Movies/somemovie.mkv -map 0:0 -map 0:1 -sn -c:v:0 copy -bsf:v:0 hevc_mp4toannexb -c:a:0 libmp3lame -ab:a:0 192000 -ac:a:0 2 -metadata:s:a:0 language=eng -filter:a:0 volume=1.4 -disposition:a:0 default -max_delay 5000000 -avoid_negative_ts disabled -f segment -map_metadata -1 -map_chapters -1 -segment_format mpegts -segment_list /tmp/transcoding-temp/CD650F/CD650F.m3u8 -segment_list_type m3u8 -segment_time 00:00:06.000 -segment_time_delta -00:10:48.000 -segment_start_number 108 -individual_header_trailer 0 -write_header_trailer 0 -segment_write_temp 1 /tmp/transcoding-temp/CD650F/CD650F_%d.ts

not transcoding
 ps aux | grep ffmpeg
nobody     20229  5.9  1.0 275874128 1387148 ?   Sl   16:29   3:40 /system/EmbyServer -programdata /config -ffdetect /bin/ffdetect -ffmpeg /bin/ffmpeg -ffprobe /bin/ffprobe -restartexitcode 3
root      333301  0.0  0.0   4280  2504 pts/2    S+   17:31   0:00 grep ffmpeg

Does this file exist and show any data? /tmp/hostapps

When transcoding.

Run qmassa in the terminal does it should any drm client.

cat /sys/kernel/debug/dri/0000:04:00.0/clients

Quote

May 16May 16

I just created a GitHub issue, but then realised the repo seems dead, so reposting here.

gpustat seems to be spamming my phplog, my system has been online for 3 days and half my log drive is taken by a phplog that's 53MB, spammed with:

[16-May-2026 13:52:00 Europe/London] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[16-May-2026 13:52:00 Europe/London] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_11_00.0.json' -d '0000:11:00.0' 2>&1
[16-May-2026 13:52:00 Europe/London] gpustat: qmassa return code: 0, output lines: 1
[16-May-2026 13:52:00 Europe/London] gpustat: qmassa output has 3 lines
[16-May-2026 13:52:00 Europe/London] gpustat: Device 0000:11:00.0 has 0 clients in qmassa output
[16-May-2026 13:52:00 Europe/London] gpustat: Found 0 DRM clients for 0000:11:00.0
[16-May-2026 13:52:00 Europe/London] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[16-May-2026 13:52:00 Europe/London] gpustat: Found 0 clients from sysfs fallback
[16-May-2026 13:52:00 Europe/London] gpustat: Transformed data has 0 clients
[16-May-2026 13:52:02 Europe/London] gpustat: qmassa return code: 0, output lines: 1
[16-May-2026 13:52:02 Europe/London] gpustat: qmassa output has 4 lines
[16-May-2026 13:52:02 Europe/London] gpustat: Device 0000:11:00.0 has 0 clients in qmassa output
[16-May-2026 13:52:02 Europe/London] gpustat: Found 0 DRM clients for 0000:11:00.0
[16-May-2026 13:52:02 Europe/London] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[16-May-2026 13:52:02 Europe/London] gpustat: Transformed data has 0 clients
[16-May-2026 13:52:41 Europe/London] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[16-May-2026 13:52:41 Europe/London] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_11_00.0.json' -d '0000:11:00.0' 2>&1
[16-May-2026 13:52:43 Europe/London] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[16-May-2026 13:52:43 Europe/London] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_11_00.0.json' -d '0000:11:00.0' 2>&1
[16-May-2026 13:52:43 Europe/London] gpustat: qmassa return code: 0, output lines: 1
[16-May-2026 13:52:43 Europe/London] gpustat: qmassa output has 3 lines
[16-May-2026 13:52:43 Europe/London] gpustat: Device 0000:11:00.0 has 0 clients in qmassa output
[16-May-2026 13:52:44 Europe/London] gpustat: Found 0 DRM clients for 0000:11:00.0
[16-May-2026 13:52:44 Europe/London] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[16-May-2026 13:52:44 Europe/London] gpustat: Found 0 clients from sysfs fallback
[16-May-2026 13:52:44 Europe/London] gpustat: Transformed data has 0 clients
[16-May-2026 13:52:45 Europe/London] gpustat: qmassa return code: 0, output lines: 1
[16-May-2026 13:52:45 Europe/London] gpustat: qmassa output has 4 lines
[16-May-2026 13:52:45 Europe/London] gpustat: Device 0000:11:00.0 has 0 clients in qmassa output
[16-May-2026 13:52:46 Europe/London] gpustat: Found 0 DRM clients for 0000:11:00.0
[16-May-2026 13:52:46 Europe/London] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[16-May-2026 13:52:46 Europe/London] gpustat: Transformed data has 0 clients

Unsure when it started, I noticed my log drive was full and rebooted, and then it's half filled again

Thanks,

Josh

Quote

May 16May 16

1 hour ago, Proddy said:

I just created a GitHub issue, but then realised the repo seems dead, so reposting here.

gpustat seems to be spamming my phplog, my system has been online for 3 days and half my log drive is taken by a phplog that's 53MB, spammed with:

[16-May-2026 13:52:00 Europe/London] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[16-May-2026 13:52:00 Europe/London] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_11_00.0.json' -d '0000:11:00.0' 2>&1
[16-May-2026 13:52:00 Europe/London] gpustat: qmassa return code: 0, output lines: 1
[16-May-2026 13:52:00 Europe/London] gpustat: qmassa output has 3 lines
[16-May-2026 13:52:00 Europe/London] gpustat: Device 0000:11:00.0 has 0 clients in qmassa output
[16-May-2026 13:52:00 Europe/London] gpustat: Found 0 DRM clients for 0000:11:00.0
[16-May-2026 13:52:00 Europe/London] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[16-May-2026 13:52:00 Europe/London] gpustat: Found 0 clients from sysfs fallback
[16-May-2026 13:52:00 Europe/London] gpustat: Transformed data has 0 clients
[16-May-2026 13:52:02 Europe/London] gpustat: qmassa return code: 0, output lines: 1
[16-May-2026 13:52:02 Europe/London] gpustat: qmassa output has 4 lines
[16-May-2026 13:52:02 Europe/London] gpustat: Device 0000:11:00.0 has 0 clients in qmassa output
[16-May-2026 13:52:02 Europe/London] gpustat: Found 0 DRM clients for 0000:11:00.0
[16-May-2026 13:52:02 Europe/London] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[16-May-2026 13:52:02 Europe/London] gpustat: Transformed data has 0 clients
[16-May-2026 13:52:41 Europe/London] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[16-May-2026 13:52:41 Europe/London] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_11_00.0.json' -d '0000:11:00.0' 2>&1
[16-May-2026 13:52:43 Europe/London] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[16-May-2026 13:52:43 Europe/London] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_11_00.0.json' -d '0000:11:00.0' 2>&1
[16-May-2026 13:52:43 Europe/London] gpustat: qmassa return code: 0, output lines: 1
[16-May-2026 13:52:43 Europe/London] gpustat: qmassa output has 3 lines
[16-May-2026 13:52:43 Europe/London] gpustat: Device 0000:11:00.0 has 0 clients in qmassa output
[16-May-2026 13:52:44 Europe/London] gpustat: Found 0 DRM clients for 0000:11:00.0
[16-May-2026 13:52:44 Europe/London] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[16-May-2026 13:52:44 Europe/London] gpustat: Found 0 clients from sysfs fallback
[16-May-2026 13:52:44 Europe/London] gpustat: Transformed data has 0 clients
[16-May-2026 13:52:45 Europe/London] gpustat: qmassa return code: 0, output lines: 1
[16-May-2026 13:52:45 Europe/London] gpustat: qmassa output has 4 lines
[16-May-2026 13:52:45 Europe/London] gpustat: Device 0000:11:00.0 has 0 clients in qmassa output
[16-May-2026 13:52:46 Europe/London] gpustat: Found 0 DRM clients for 0000:11:00.0
[16-May-2026 13:52:46 Europe/London] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[16-May-2026 13:52:46 Europe/London] gpustat: Transformed data has 0 clients

Unsure when it started, I noticed my log drive was full and rebooted, and then it's half filled again

Thanks,

Josh

Correct repo is here, https://github.com/SimonFair/gpustat-unraid

I will look into it, do you have errors set on PHP log settings?

Can you provide some info on the GPU you are using and the driver?

Quote

May 16May 16

40 minutes ago, SimonF said:
Correct repo is here, https://github.com/SimonFair/gpustat-unraid
I will look into it, do you have errors set on PHP log settings?
Can you provide some info on the GPU you are using and the driver?

My PHP log level is set to default

The GPU is an Intel Arc Battlemage B580, using the XE driver

Thanks,

Josh

Quote

1

May 16May 16

32 minutes ago, Proddy said:
My PHP log level is set to default
The GPU is an Intel Arc Battlemage B580, using the XE driver
Thanks,
Josh

Created a new version 2026.05.16 which adds a debug option to settings so should not show the log entries now unless enabled.

Quote

1

May 16May 16

19 minutes ago, SimonF said:
Created a new version 2026.05.16 which adds a debug option to settings so should not show the log entries now unless enabled.

Awesome, thanks for the quick turnaround, much appreciated

Quote

May 16May 16

7 hours ago, SimonF said:
Does this file exist and show any data? /tmp/hostapps
When transcoding.
Run qmassa in the terminal does it should any drm client.
cat /sys/kernel/debug/dri/0000:04:00.0/clients

/tmp/hostapps does not exist. qmassa below also doesn't show any clients and the cat /sys... command for my setup shows two entries.

Quote

May 17May 17

14 hours ago, jaybird2203 said:
/tmp/hostapps does not exist. qmassa below also doesn't show any clients and the cat /sys... command for my setup shows two entries.

If you can install the latest plugin version.

Then replace this file in /usr/local/emhttp/plugins/gpustat/include

Enable debug in the settings. Run a transcode and then logs are here.

/var/log/gpustats.debug

Main.php

Quote

May 17May 17

12 hours ago, SimonF said:
If you can install the latest plugin version.
Then replace this file in /usr/local/emhttp/plugins/gpustat/include
Enable debug in the settings. Run a transcode and then logs are here.
/var/log/gpustats.debug
Main.php

Just attempted to remove/install the 5.16 version of the plugin then ran through the details as requested. Not sure I did it correctly as the /include location needed to be created but still enabled the debugging and ran the transcode.

First time the transcode was detected, as was the video load etc but debug logs point to a number of parsing errors. See below. Then I disabled debug and attempted the transcode again, didn't detect the transcode any subsequent times.

[17-May-2026 17:37:18 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:18 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:20 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:20 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:20 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:37:21 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:37:21 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:37:21 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:37:21 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:21 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:23 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:23 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:23 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:37:23 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:37:23 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:37:23 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:37:24 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:24 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:26 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:26 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:26 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:37:26 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:37:26 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:37:26 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:37:27 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:27 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:29 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:29 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:29 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:37:29 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:37:29 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:37:29 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:37:29 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:29 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:31 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:31 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:31 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:37:32 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:37:32 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:37:32 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:37:32 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:32 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:34 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:34 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:34 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:37:34 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:37:34 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:37:34 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:37:35 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:35 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:37 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:37 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:37 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:37:37 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:37:37 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:37:37 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:37:38 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:38 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:40 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:40 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:40 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:37:40 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:37:40 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:37:40 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:37:41 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:41 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:43 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:43 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:43 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:37:43 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:37:43 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:37:43 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:37:43 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:43 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:45 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:45 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:45 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:37:46 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:37:46 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:37:46 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:37:46 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:46 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:48 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:48 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:48 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:37:48 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:37:48 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:37:48 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:37:49 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:49 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:51 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:51 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:51 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:37:51 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:37:51 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:37:51 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:37:52 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:52 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:54 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:54 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:54 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:37:54 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:37:54 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:37:54 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:37:54 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:54 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:56 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:56 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:56 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:37:57 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:37:57 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:37:57 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:37:57 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:37:57 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:37:59 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:37:59 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:37:59 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:00 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:00 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:00 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:00 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:00 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:02 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:02 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:02 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:02 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:02 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:02 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:03 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:03 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:05 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:05 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:05 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:05 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:05 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:05 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:06 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:06 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:08 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:08 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:08 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:08 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:08 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:08 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:08 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:08 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:10 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:10 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:10 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:11 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:11 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:11 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:11 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:11 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:13 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:13 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:13 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:13 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:13 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:13 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:14 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:14 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:16 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:16 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:16 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:16 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:16 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:16 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:17 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:17 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:19 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:19 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:19 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:19 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:19 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:19 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:20 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:20 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:22 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:22 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:22 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:22 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:22 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:22 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:22 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:22 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:24 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:24 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:24 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:25 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:25 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:25 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:25 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:25 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:27 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:27 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:27 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:27 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:27 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:27 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:28 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:28 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:30 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:30 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:30 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:30 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:30 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:30 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:31 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:31 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:31 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:31 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:33 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:33 EDT] gpustat: qmassa output has 3 lines
[17-May-2026 17:38:33 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:38:33 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:38:33 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:33 EDT] gpustat: qmassa output has 3 lines
[17-May-2026 17:38:33 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:38:33 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:38:34 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:34 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:36 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:36 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:36 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:36 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:36 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:36 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:37 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:37 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:39 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:39 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:39 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:39 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:39 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:39 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:39 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:39 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:39 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:39 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:41 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:41 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:38:41 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:38:41 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:38:41 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:41 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:38:41 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:38:41 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:38:42 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:42 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:44 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:44 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:44 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:44 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:44 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:44 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:45 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:45 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:45 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:45 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:47 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:47 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:47 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:47 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:47 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:47 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:47 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:47 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:47 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:47 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:47 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:47 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:48 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:48 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:50 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:50 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:50 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:50 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:50 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:50 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:51 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:51 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:51 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:51 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:53 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:53 EDT] gpustat: qmassa output has 3 lines
[17-May-2026 17:38:53 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:38:53 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:38:53 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:53 EDT] gpustat: qmassa output has 3 lines
[17-May-2026 17:38:53 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:38:53 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:38:54 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:54 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:56 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:56 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:56 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:56 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:56 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:56 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:57 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:57 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:59 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:38:59 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:38:59 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:38:59 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:59 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:38:59 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:38:59 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:38:59 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:38:59 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:38:59 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:01 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:01 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:39:01 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:39:01 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:39:01 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:39:01 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:39:01 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:01 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:39:01 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:39:02 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:39:02 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:39:02 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:39:02 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:02 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:04 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:04 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:39:04 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:39:04 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:04 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:04 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:39:04 EDT] gpustat: Found 1 clients from fdinfo fallback
[17-May-2026 17:39:04 EDT] gpustat: Transformed data has 1 clients
[17-May-2026 17:39:05 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:05 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:06 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:06 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:39:06 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:06 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:07 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:07 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:39:07 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:07 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:08 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:08 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:10 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:10 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:39:10 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:39:10 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:39:10 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:39:10 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:39:10 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:39:10 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:10 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:10 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:10 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:12 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:12 EDT] gpustat: qmassa output has 3 lines
[17-May-2026 17:39:12 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:12 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:12 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:12 EDT] gpustat: qmassa output has 3 lines
[17-May-2026 17:39:12 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:12 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:13 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:13 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:15 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:15 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:39:15 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:39:16 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:39:16 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:39:16 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:39:16 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:39:16 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:16 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:18 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:18 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:39:18 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:39:18 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:18 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:18 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:39:18 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:39:18 EDT] gpustat: Found 0 clients from sysfs fallback
[17-May-2026 17:39:18 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:39:18 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:39:19 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:19 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:20 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:20 EDT] gpustat: qmassa output has 3 lines
[17-May-2026 17:39:20 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:20 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:21 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:21 EDT] gpustat: qmassa output has 3 lines
[17-May-2026 17:39:21 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:21 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:21 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:21 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:23 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:23 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:39:23 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:39:24 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:39:24 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:39:24 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:39:24 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:39:24 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:24 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:26 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:26 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:39:26 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:39:26 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:39:26 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:39:26 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:39:26 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:39:27 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:27 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:27 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:27 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:29 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:29 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:39:29 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:29 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:29 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:29 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:39:29 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:29 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:30 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:30 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:32 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:32 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:39:32 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:39:32 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:39:32 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:39:32 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:39:32 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:39:33 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:33 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:33 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:33 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:35 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:35 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:39:35 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:35 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:35 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:35 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:39:35 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:35 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:36 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:36 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:38 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:38 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:39:38 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:39:38 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:39:38 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:39:38 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:39:38 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:39:38 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:38 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:41 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:41 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:39:41 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:39:41 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:41 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:41 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:39:41 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:39:41 EDT] gpustat: Found 0 clients from sysfs fallback
[17-May-2026 17:39:41 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:39:41 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:39:41 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:41 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:43 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:43 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:39:43 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:43 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:43 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:43 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:39:43 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:43 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:44 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:44 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:46 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:46 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:39:46 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:39:46 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:39:46 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:39:46 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:39:46 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:39:47 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:47 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:47 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:47 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:49 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:49 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:39:49 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:49 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:49 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:49 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:39:49 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:49 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:50 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:50 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:52 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:52 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:39:52 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:39:52 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:39:52 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:39:52 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:39:52 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:39:52 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:52 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:54 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:54 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:39:54 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:39:55 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:55 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:55 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:39:55 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:39:55 EDT] gpustat: Found 0 clients from sysfs fallback
[17-May-2026 17:39:55 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:39:55 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:39:55 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:55 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:39:57 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:57 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:39:57 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:57 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:57 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:39:57 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:39:57 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:39:57 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:39:58 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:39:58 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:40:00 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:40:00 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:40:00 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:40:00 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:40:00 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:40:00 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:40:00 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:40:01 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:40:01 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:40:03 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:40:03 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:40:03 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:40:03 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:40:03 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:40:03 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:40:03 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:40:03 EDT] gpustat: Found 0 clients from sysfs fallback
[17-May-2026 17:40:03 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:40:03 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:40:03 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:40:03 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:40:05 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:40:05 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:40:05 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:40:05 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:40:05 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:40:05 EDT] gpustat: qmassa output has 5 lines
[17-May-2026 17:40:05 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:40:05 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:40:06 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:40:06 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:40:08 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:40:08 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:40:08 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:40:08 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:40:08 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:40:08 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:40:08 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:40:09 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:40:09 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:40:09 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:40:09 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:40:11 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:40:11 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:40:11 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:40:11 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:40:11 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:40:11 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:40:11 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:40:11 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:40:11 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:40:11 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:40:11 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:40:11 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:40:11 EDT] gpustat: Found 0 clients from sysfs fallback
[17-May-2026 17:40:11 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:40:11 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:40:12 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:40:12 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:40:14 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:40:14 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:40:14 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:40:14 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:40:14 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:40:14 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:40:14 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:40:15 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:40:15 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:40:15 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:40:15 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:40:17 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:40:17 EDT] gpustat: qmassa output has 3 lines
[17-May-2026 17:40:17 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:40:17 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:40:17 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:40:17 EDT] gpustat: qmassa output has 3 lines
[17-May-2026 17:40:17 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error
[17-May-2026 17:40:17 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure
[17-May-2026 17:40:17 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:40:17 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:40:19 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:40:19 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:40:19 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:40:20 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:40:20 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:40:20 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:40:20 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
[17-May-2026 17:40:25 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa
[17-May-2026 17:40:25 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1
[17-May-2026 17:40:27 EDT] gpustat: qmassa return code: 0, output lines: 1
[17-May-2026 17:40:27 EDT] gpustat: qmassa output has 4 lines
[17-May-2026 17:40:27 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output
[17-May-2026 17:40:27 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0
[17-May-2026 17:40:27 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection
[17-May-2026 17:40:27 EDT] gpustat: Transformed data has 0 clients
[17-May-2026 17:40:27 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample

Edited May 17May 17 by jaybird2203

Quote

June 1Jun 1

I'm having the issue with an ARC A310 where it isn't showing anything but fan usage and power draw. I've set it to top + qmassa... I've got tdarr almost constantly running GPU transcodes and I did confirm it is running when I did the requested support commands/documentation:

1&2:

root@[redacted]:~# timeout -k .500 .400 intel_gpu_top -J -s 250

root@[redacted]:~# cd /usr/local/emhttp/plugins/gpustat/ && php ./gpustatus.php

Could not open input file: ./gpustatus.php

3):

4) the contents of '/boot/config/plugins/gpustat/gpustat.cfg':

MULTIGPU = "85:00.0"

TEMPFORMAT = "F"

UIREFRESH = 1

UIREFRESHINT = 2000

DEBUGLOG = 0

DISPCLOCKS = 1

DISPPCIUTIL = 1

DISPPWRDRAW = 1

DISPPWRSTATE = 1

DISPMEMUTIL = 0

DISPTEMP = 0

DISPFAN = 1

DISPSESSIONS = 1

DISPENCDEC = 0

DISPTHROTTLE = 0

INTELBACKEND = "top_qmassa"

DISP3DRENDER = 1

DISPBLITTER = 1

DISPVIDEO = 1

DISPVIDENH = 1

DISPCOMPUTE = 1

DISPINTERRUPT = 1

DISPPWRDRWSEL = "GPU"

DISPEVENT = 0

DISPVERTEX = 0

DISPTEXTURE = 0

DISPSHADEREXP = 0

DISPSEQUENCER = 0

DISPSHADERINTER = 0

DISPSCANCON = 0

DISPPRIMASSEM = 0

DISPDEPTHBLK = 0

DISPCOLORBLK = 0

DISPGFXTRANS = 0

MULTIGPUJSON = "%7B%2285%3A00.0%22%3A%7B%22id%22%3A%2285%3A00.0%22%2C%22model%22%3A%22DG2+%5BArc+A310%5D%22%2C%22vendor%22%3A%22i>

Quote

[PLUGIN] GPU Statistics

Featured Replies

Top Posters In This Topic

Popular Days

Most Popular Posts

juan11perez

mlapaglia

SimonF

Posted Images

Join the conversation

Top Posters In This Topic

Popular Days

Most Popular Posts

juan11perez

mlapaglia

SimonF

Posted Images

Account

Navigation

Search

Configure browser push notifications

Chrome (Android)

Chrome (Desktop)

Safari (iOS 16.4+)

Safari (macOS)

Edge (Android)

Edge (Desktop)

Firefox (Android)

Firefox (Desktop)