-
[PLUGIN] GPU Statistics
Just attempted to remove/install the 5.16 version of the plugin then ran through the details as requested. Not sure I did it correctly as the /include location needed to be created but still enabled the debugging and ran the transcode. First time the transcode was detected, as was the video load etc but debug logs point to a number of parsing errors. See below. Then I disabled debug and attempted the transcode again, didn't detect the transcode any subsequent times. [17-May-2026 17:37:18 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:18 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:20 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:20 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:20 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:37:21 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:37:21 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:37:21 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:37:21 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:21 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:23 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:23 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:23 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:37:23 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:37:23 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:37:23 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:37:24 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:24 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:26 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:26 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:26 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:37:26 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:37:26 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:37:26 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:37:27 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:27 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:29 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:29 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:29 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:37:29 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:37:29 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:37:29 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:37:29 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:29 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:31 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:31 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:31 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:37:32 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:37:32 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:37:32 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:37:32 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:32 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:34 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:34 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:34 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:37:34 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:37:34 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:37:34 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:37:35 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:35 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:37 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:37 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:37 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:37:37 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:37:37 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:37:37 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:37:38 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:38 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:40 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:40 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:40 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:37:40 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:37:40 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:37:40 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:37:41 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:41 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:43 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:43 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:43 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:37:43 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:37:43 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:37:43 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:37:43 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:43 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:45 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:45 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:45 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:37:46 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:37:46 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:37:46 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:37:46 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:46 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:48 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:48 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:48 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:37:48 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:37:48 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:37:48 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:37:49 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:49 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:51 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:51 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:51 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:37:51 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:37:51 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:37:51 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:37:52 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:52 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:54 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:54 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:54 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:37:54 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:37:54 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:37:54 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:37:54 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:54 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:56 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:56 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:56 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:37:57 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:37:57 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:37:57 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:37:57 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:37:57 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:37:59 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:37:59 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:37:59 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:00 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:00 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:00 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:00 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:00 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:02 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:02 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:02 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:02 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:02 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:02 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:03 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:03 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:05 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:05 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:05 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:05 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:05 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:05 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:06 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:06 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:08 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:08 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:08 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:08 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:08 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:08 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:08 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:08 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:10 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:10 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:10 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:11 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:11 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:11 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:11 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:11 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:13 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:13 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:13 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:13 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:13 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:13 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:14 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:14 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:16 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:16 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:16 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:16 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:16 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:16 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:17 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:17 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:19 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:19 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:19 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:19 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:19 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:19 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:20 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:20 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:22 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:22 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:22 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:22 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:22 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:22 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:22 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:22 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:24 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:24 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:24 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:25 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:25 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:25 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:25 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:25 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:27 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:27 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:27 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:27 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:27 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:27 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:28 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:28 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:30 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:30 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:30 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:30 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:30 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:30 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:31 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:31 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:31 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:31 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:33 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:33 EDT] gpustat: qmassa output has 3 lines [17-May-2026 17:38:33 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:38:33 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:38:33 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:33 EDT] gpustat: qmassa output has 3 lines [17-May-2026 17:38:33 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:38:33 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:38:34 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:34 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:36 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:36 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:36 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:36 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:36 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:36 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:37 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:37 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:39 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:39 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:39 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:39 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:39 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:39 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:39 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:39 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:39 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:39 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:41 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:41 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:38:41 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:38:41 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:38:41 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:41 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:38:41 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:38:41 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:38:42 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:42 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:44 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:44 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:44 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:44 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:44 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:44 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:45 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:45 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:45 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:45 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:47 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:47 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:47 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:47 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:47 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:47 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:47 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:47 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:47 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:47 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:47 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:47 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:48 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:48 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:50 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:50 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:50 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:50 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:50 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:50 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:51 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:51 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:51 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:51 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:53 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:53 EDT] gpustat: qmassa output has 3 lines [17-May-2026 17:38:53 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:38:53 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:38:53 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:53 EDT] gpustat: qmassa output has 3 lines [17-May-2026 17:38:53 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:38:53 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:38:54 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:54 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:56 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:56 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:56 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:56 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:56 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:56 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:57 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:57 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:59 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:38:59 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:38:59 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:38:59 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:59 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:38:59 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:38:59 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:38:59 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:38:59 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:38:59 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:01 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:01 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:39:01 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:39:01 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:39:01 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:39:01 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:39:01 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:01 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:39:01 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:39:02 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:39:02 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:39:02 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:39:02 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:02 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:04 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:04 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:39:04 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:39:04 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:04 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:04 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:39:04 EDT] gpustat: Found 1 clients from fdinfo fallback [17-May-2026 17:39:04 EDT] gpustat: Transformed data has 1 clients [17-May-2026 17:39:05 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:05 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:06 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:06 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:39:06 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:06 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:07 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:07 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:39:07 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:07 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:08 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:08 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:10 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:10 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:39:10 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:39:10 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:39:10 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:39:10 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:39:10 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:39:10 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:10 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:10 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:10 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:12 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:12 EDT] gpustat: qmassa output has 3 lines [17-May-2026 17:39:12 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:12 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:12 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:12 EDT] gpustat: qmassa output has 3 lines [17-May-2026 17:39:12 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:12 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:13 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:13 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:15 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:15 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:39:15 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:39:16 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:39:16 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:39:16 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:39:16 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:39:16 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:16 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:18 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:18 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:39:18 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:39:18 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:18 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:18 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:39:18 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:39:18 EDT] gpustat: Found 0 clients from sysfs fallback [17-May-2026 17:39:18 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:39:18 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:39:19 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:19 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:20 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:20 EDT] gpustat: qmassa output has 3 lines [17-May-2026 17:39:20 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:20 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:21 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:21 EDT] gpustat: qmassa output has 3 lines [17-May-2026 17:39:21 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:21 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:21 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:21 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:23 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:23 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:39:23 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:39:24 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:39:24 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:39:24 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:39:24 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:39:24 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:24 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:26 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:26 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:39:26 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:39:26 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:39:26 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:39:26 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:39:26 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:39:27 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:27 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:27 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:27 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:29 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:29 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:39:29 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:29 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:29 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:29 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:39:29 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:29 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:30 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:30 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:32 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:32 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:39:32 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:39:32 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:39:32 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:39:32 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:39:32 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:39:33 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:33 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:33 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:33 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:35 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:35 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:39:35 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:35 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:35 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:35 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:39:35 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:35 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:36 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:36 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:38 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:38 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:39:38 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:39:38 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:39:38 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:39:38 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:39:38 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:39:38 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:38 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:41 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:41 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:39:41 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:39:41 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:41 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:41 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:39:41 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:39:41 EDT] gpustat: Found 0 clients from sysfs fallback [17-May-2026 17:39:41 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:39:41 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:39:41 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:41 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:43 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:43 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:39:43 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:43 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:43 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:43 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:39:43 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:43 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:44 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:44 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:46 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:46 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:39:46 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:39:46 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:39:46 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:39:46 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:39:46 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:39:47 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:47 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:47 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:47 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:49 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:49 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:39:49 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:49 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:49 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:49 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:39:49 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:49 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:50 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:50 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:52 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:52 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:39:52 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:39:52 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:39:52 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:39:52 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:39:52 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:39:52 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:52 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:54 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:54 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:39:54 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:39:55 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:55 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:55 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:39:55 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:39:55 EDT] gpustat: Found 0 clients from sysfs fallback [17-May-2026 17:39:55 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:39:55 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:39:55 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:55 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:39:57 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:57 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:39:57 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:57 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:57 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:39:57 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:39:57 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:39:57 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:39:58 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:39:58 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:40:00 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:40:00 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:40:00 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:40:00 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:40:00 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:40:00 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:40:00 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:40:01 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:40:01 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:40:03 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:40:03 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:40:03 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:40:03 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:40:03 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:40:03 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:40:03 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:40:03 EDT] gpustat: Found 0 clients from sysfs fallback [17-May-2026 17:40:03 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:40:03 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:40:03 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:40:03 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:40:05 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:40:05 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:40:05 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:40:05 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:40:05 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:40:05 EDT] gpustat: qmassa output has 5 lines [17-May-2026 17:40:05 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:40:05 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:40:06 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:40:06 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:40:08 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:40:08 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:40:08 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:40:08 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:40:08 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:40:08 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:40:08 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:40:09 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:40:09 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:40:09 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:40:09 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:40:11 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:40:11 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:40:11 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:40:11 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:40:11 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:40:11 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:40:11 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:40:11 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:40:11 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:40:11 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:40:11 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:40:11 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:40:11 EDT] gpustat: Found 0 clients from sysfs fallback [17-May-2026 17:40:11 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:40:11 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:40:12 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:40:12 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:40:14 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:40:14 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:40:14 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:40:14 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:40:14 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:40:14 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:40:14 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:40:15 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:40:15 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:40:15 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:40:15 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:40:17 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:40:17 EDT] gpustat: qmassa output has 3 lines [17-May-2026 17:40:17 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:40:17 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:40:17 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:40:17 EDT] gpustat: qmassa output has 3 lines [17-May-2026 17:40:17 EDT] gpustat: Failed to parse qmassa JSON for 0000:0a:00.0: Syntax error [17-May-2026 17:40:17 EDT] gpustat: Using cached qmassa sample for 0000:0a:00.0 after parse failure [17-May-2026 17:40:17 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:40:17 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:40:19 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:40:19 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:40:19 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:40:20 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:40:20 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:40:20 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:40:20 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample [17-May-2026 17:40:25 EDT] gpustat: qmassa path lookup result: /usr/local/sbin/qmassa [17-May-2026 17:40:25 EDT] gpustat: Executing qmassa command: timeout 10 /usr/local/sbin/qmassa -wxa -m 1000 -n 2 -t '/tmp/gpustat_qmassa_0000_0a_00.0.json' -d '0000:0a:00.0' 2>&1 [17-May-2026 17:40:27 EDT] gpustat: qmassa return code: 0, output lines: 1 [17-May-2026 17:40:27 EDT] gpustat: qmassa output has 4 lines [17-May-2026 17:40:27 EDT] gpustat: Device 0000:0a:00.0 has 0 clients in qmassa output [17-May-2026 17:40:27 EDT] gpustat: Found 0 DRM clients for 0000:0a:00.0 [17-May-2026 17:40:27 EDT] gpustat: qmassa returned no clients, falling back to sysfs for client detection [17-May-2026 17:40:27 EDT] gpustat: Transformed data has 0 clients [17-May-2026 17:40:27 EDT] gpustat: Reused cached qmassa clients for 0000:0a:00.0 due to empty client sample
-
[PLUGIN] GPU Statistics
/tmp/hostapps does not exist. qmassa below also doesn't show any clients and the cat /sys... command for my setup shows two entries.
-
[PLUGIN] GPU Statistics
No dice. Still not detecting. Below is the output of "ps aux | grep ffmpeg" both while transcoding and not for reference. Transcoding - ps aux | grep ffmpeg nobody 20229 6.1 1.0 275874176 1395524 ? Sl 16:29 3:35 /system/EmbyServer -programdata /config -ffdetect /bin/ffdetect -ffmpeg /bin/ffmpeg -ffprobe /bin/ffprobe -restartexitcode 3 nobody 303184 7.0 0.0 114020 28284 ? Sl 17:26 0:07 /bin/ffmpeg -loglevel +timing -y -print_graphs_file /config/logs/ffmpeg-remux-2436e0ea-6ba6-424a-bc70-0ce0fa8be41e_1graph.txt -copyts -start_at_zero -f matroska,webm -ss 00:10:48.000 -c:v:0 hevc -noautorotate -c:v:1 mjpeg -c:v:2 mjpeg -c:v:3 mjpeg -c:v:4 mjpeg -i /mnt/Movies/somemovie.mkv -map 0:0 -map 0:1 -sn -c:v:0 copy -bsf:v:0 hevc_mp4toannexb -c:a:0 libmp3lame -ab:a:0 192000 -ac:a:0 2 -metadata:s:a:0 language=eng -filter:a:0 volume=1.4 -disposition:a:0 default -max_delay 5000000 -avoid_negative_ts disabled -f segment -map_metadata -1 -map_chapters -1 -segment_format mpegts -segment_list /tmp/transcoding-temp/CD650F/CD650F.m3u8 -segment_list_type m3u8 -segment_time 00:00:06.000 -segment_time_delta -00:10:48.000 -segment_start_number 108 -individual_header_trailer 0 -write_header_trailer 0 -segment_write_temp 1 /tmp/transcoding-temp/CD650F/CD650F_%d.ts not transcoding ps aux | grep ffmpeg nobody 20229 5.9 1.0 275874128 1387148 ? Sl 16:29 3:40 /system/EmbyServer -programdata /config -ffdetect /bin/ffdetect -ffmpeg /bin/ffmpeg -ffprobe /bin/ffprobe -restartexitcode 3 root 333301 0.0 0.0 4280 2504 pts/2 S+ 17:31 0:00 grep ffmpeg
-
[PLUGIN] GPU Statistics
@SimonF Been about a year since I've been on this page looking for a situation with my b580. Rolled up Unraid to 7.3.0 so using the default kernel again, over Thor's, and noticed that the PCI lanes, power draw and fan report values now - awesome work. Somewhat minor item now, appears with the more recent 2026.5.11 release the active apps has broken for myself when detecting transcoding sessions with Emby. Below is a screenshot of what it used to be (Around May 1, apologies I don't have the exact plugin version available but safe to say it would have been the released version for that time period) and what it is now when doing the same transcoding function.
-
7.3RC1 internal boot wizard unable to partition mirrored zfs pool?
Suggested steps to proceed to rebuild the boot pool from its current state then? Sorted it out on my side. May not have been 100% correct but this was the steps I followed - booted back to the USB drive, removed pool, ran through the wizard again.
-
7.3RC1 internal boot wizard unable to partition mirrored zfs pool?
Correct, I had removed the existing pool (was only created just before going through the wizard the first time) and selected the drives to be used for the boot pool. It was this portion that didn't allow the ability to define a partition size and used the full drive. That was the sequence that I followed and the drives are now fully assigned for the boot pool. Should the wizard have the ability to define a partition size?
-
-
7.3RC1 internal boot wizard unable to partition mirrored zfs pool?
Hi All, Not sure this is a bug or not but feel free to move from here to the bug reports if it is in fact an issue. Ran through the steps to move to the TPM license on 7.3b2 without issue then upgraded to 7.3rc1 before moving to the internal drive function. (Couldn't find the screws to mount my older SSDs back into the server in my available time hence the different versions used for each stage.) Just ran through the wizard on the boot pool tab and followed the prompts as expected. Within that wizard there was no ability, that I could see, to select the existing mirrored pool nor the ability to select a partition size if the drives were being put into a pool from this tool. End result is a zfs mirrored boot drive pool consuming the full size of the SSDs...Positive is that it does in fact boot direct from SSD - selected shutdown and pulled the USB flash from the server before next power up. Would have liked the ability to define a partition for the boot and a partition for the rest of the drive. Is the inability to creation partitions at the time the pool is created through this wizard expected or did I just mess something up? The Internal boot FAQs do not list any such detail so figured I'd ask here to start.
-
Docker "host" mode on separate NIC?
Greatly appreciate the above breakdown. I'll give it an attempt shortly when time permits.
-
Docker "host" mode on separate NIC?
Hi All, Currently setup: running unraid 7.0.1 and my docker network is set for br0 which has eth0 (10G pci card) attached and my docker network is currently setup as ipvlan. I have eth1 (1G on motherboard) available for this activity. This works fine for my use up to my current situation. Target approach: I'm attempting to setup a headless steam install to be able to share my Arc b580 with other dockers compared to allocating it to a VM or dockers - obviously can't do both and currently have dockers utilizing the GPU so the pass through appears to work so far. I've tried the steam headless docker but that can't utilize the gpu, its detected but vainfo does not open it so I've moved to the linuxserver.io image of steamos. That appears to detect my gpu properly although when ran in host mode it breaks my unraid network settings preventing community applications from connecting out. Per the linuxserver details it is recommended to use either host or macvlan for this docker yet host mode breaks my setup and looking to avoid trying to setup all dockers on macvlan and break it all. Question: Is there a method to utilize the second NIC for a "host" mode of operations without impacting the core unraid functionality and still be accessible on the same subnet? Was thinking of assigning the NIC to only this docker and using a dedicated IP within my 192.168 subnet beyond the unraid IP. I may be looking at this in the wrong way but trying to determine the best method forward for this situation so any assistance is greatly appreciated. Also wasn't 100% on where to post but please feel free to move as needed.
-
[PLUGIN] GPU Statistics
Sounds good to me. I'll be ready to test as much as needed to polish this up. I also have no issue flipping between Unraid and thor kernels as part of the testing as well.
-
[PLUGIN] GPU Statistics
Just to throw some more details at this. When i have the GPU passing through to my VM and actively transcoding within the VM the details "change". See below. Prior images/data were pulled when the GPU was not being passed through to the VM. Yet while I have another docker actually using the xe driver and also transcoding content the client portion of the plugin does update but the rest appears to be empty (which is expected due to null responses).
-
[PLUGIN] GPU Statistics
-
[PLUGIN] GPU Statistics
inteljson did exist in my tmp folder, here's the contents before i deleted the file then the command was ran. tmpinteljson.txt output of inteltest as copied, also wasn't sure if the buildXEJSON id was supposed to match my details or the 04 that was written but there was no difference in the output between 0000:04:00.0 or 0000:0a:00.0 04 php test.txt
-
[PLUGIN] GPU Statistics
tree output tree sysbuspcidevices0.txt diagnostics tower-diagnostics-20250417-1941.zip
-
[PLUGIN] GPU Statistics
Want to say that the combo of the latest GPU stat/Intel_gpu_top plugins have broken the baseline detection I had with my Arc B580. Unless its always been "broken" and the latest updates simply exposed that. The GPU works via passthrough to a Windows 11 VM (installed the latest Intel GPU Drivers through this VM as part of troubleshooting this situation), the GPU is shown as an option to be selected in the gpu stat options, see below. Although the widget still reports the following. This used to function. I also updated the kernel to 6.14.1, updated to Unraid 7.0.1 as well as removed/reinstalled both plugins. No change. Same output of lspci -k in the comment below.
jaybird2203
Members
-
Joined
-
Last visited