Are my speeds typical?

[FoxxMD]

I'm transferring from a locally attached external usb 3.0 drive to a 7200rpm HP Enterprise drive (disk 1) -- parity drive is also a 7200rpm HPE.

 

Both transferring smaller files (~30MB CR2 files) and larger files (4GB ISOs) I see ~25MB/s using rsync. Here's what I see as a peak on the array devices screen.

 

• All disks are using onboard SATA III in AHCI mode (motherboard) except for cache SSDs which are on a pci card
• md_num_stripes=2048,md_sync_window=768,md_sync_thresh=384
• The share I'm transferring to on disk1 is set not use cache
• Barely using my cpu/memory

 

Read speeds using diskspeed.sh look fine:

 

/dev/sda: 158 MB/sec avg
/dev/sdc (Disk 4): 130 MB/sec avg
/dev/sdd (Disk 3): 173 MB/sec avg
/dev/sde (Disk 1): 139 MB/sec avg
/dev/sdf (Disk 2): 116 MB/sec avg
/dev/sdg: 499 MB/sec avg
/dev/sdh (Parity): 141 MB/sec avg
/dev/sdi (Cache): 369 MB/sec avg
/dev/sdj (Cache 2): 367 MB/sec avg

 

I was getting about the same speed for parity check which seems woefully slow compared to some of the user benchmarks. Is ~25MB/s really the best I can expect??

 

Edited October 2, 2018 by FoxxMD
specify cache use, read speeds, and load numbers

[itimpi]

That speed does seem low.   However if that is also the same sort of speed you are getting for a parity check then it sounds as if something is limiting throughput.

 

you should post your system diagnostics zip file (obtained via Tools->Diagnostics) so that others can look to see if they can spot any issues.    Giving a time around when you were experiencing the issue can help pinpoint which part of the logs might be relevant. 

[Vr2Io]

Pls try turn on reconstruct write（turbo write）and confirm the USB device in 3.0 port instead 2.0

Edited October 2, 2018 by Benson

[trurl]

You could also try copying from another source. Most people get a little better speed than that even over GB ethernet. Or try copying from one disk on the server to another to see if you get different results. 

[FoxxMD]

Quote

Pls try turn on reconstruct write

This has made the most difference so far. Doubled my write speed -- ~48-53MB/s depending on file size (small-large respectively)

Quote

confirm the USB device in 3.0 port instead 2.0

Confirmed, double-checked port and also checked with lsusb

 

/:  Bus 09.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/4p, 5000M
    |__ Port 1: Dev 2, If 0, Class=Mass Storage, Driver=usb-storage, 5000M

 

I have also attached a diagnostics zip for those interested.

 

I tried several different transfer methods IE over my GB ethernet and disk-to-disk but still saw speeds capped around 55MB/s. This is much better but still seems low. 

tower-diagnostics-20181002-1747.zip

[Vr2Io]

Everything should be normal, just some bit slow, pls note writting to array will limit by slowest disk in array and seems be disk2, 

 

/dev/sdf (Disk 2): 116 MB/sec avg