I've been reading through quite a few topics and have tried quite a few things, but i'm not able to get over ~105MBps during a parity check or mover operation and wanted to see if there is anything I'm overlooking or if this is just a unraid limitation with my setup. I've seen that a lot of the tunables do pretty little on latest versions though I have tried playing with a few but have them back to defaults now. I'm running 7.0 rc1 but this has been the same for quite a while (at least through the 6.12.x releases). mover tops out around the same speed when on reconstruct write. drops a bit to around 80MBps when on read/modify/write. I do believe my old netapp disk shelf was a bottleneck so i replaced some hardware but haven't seen an increase in speed which led me to doing all the disk speed testing below.

 

My slowest drive has tested around 245-250MBps and the controller benchmark shows full drive speed (up to lowest drive speed) for all 4 of my hbas. The link speeds to the controllers all look correct, and I don't think it should be a pcie lane issue. Array has 30 drives (xfs) and I have 3 cache pools (all zfs) with a total of 8 nvme drives spread across those pools. 

 

I'm not that worried about mover speed and my overall system performance is good. I would really like to get the parity check time down if possible since I don't see a reason for it to be bottlenecked. Can anyone shed any light on if there are any other bottlenecks I can test for or anything else I should be checking? 

 

Threadripper 3975wx - asus Pro WS WRX80E-SAGE SE WIFI II -

HBA's: 2x LSI 9300-8e connected to supermicro sas 3 backplanes. 2x LSI 9211-8i with breakout cables to those drives. 

 

Disk speed docker test results:

Graphs look normal, post the diags during a parity check.

Attached after letting it run for 5-10 minutes. let me know if that's okay or if I need to do something else. Thank you!

 

tower-diagnostics-20241212-1853.zip

It looks like a CPU bottleneck, parity check is single threaded:

 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND
3854444 root      20   0       0      0      0 R 100.0   0.0  10:46.76 unraidd0

 

Is the CPU in performance mode? Al check that it's boosting and not running at base speeds.

Well that's certainly not what I expected it to be. Thank you for taking a look, at least I have a place to look now. I'd noticed that 1 core was typically hitting 100% in the dashboard gui but wasn't sure if that was the cause. 

 

I'll have to check bios settings to see if there's anything else i can tweak

 

CPU frequency is going over base clock of 3.5, boost is supposed to be 4.2 and I'm seeing cores over 4.1 so i'm assuming this is working as expected. also checked that it's set to performance mode in the tips and tweaks plugin.

Did a little more digging and this CPU doesn't support any overclocking so I believe It's running normally and is as much as I can push it without upgrading to a unlocked/newer cpu but i'm guessing that won't get me a ton more speed. 

 

Also ran across a few more threads that look to be in the same boat. 

 

Thanks @JorgeB for taking a look and verifying

I would still expect that CPU to be faster, but the more disks you have, the more load it causes, especially with dual parity.