Duplicati Backup Speeds on LAN using Unassigned Disk Mount

I’ve been tinkering with the Duplicati file upload since I have a large data set. And curious if anyone has any watch outs for settings. Since I’m new to this.

Settings and info:

- LAN backup to second Unraid server using Unassigned Disks

- Stable 10GBe network between the servers, plugged into same switch

Host Server

- AMD Ryzen 5 4500, 128gb ram 3200, XFS

- Drives: (1) Parity 16TB 7200, (2) 16TB [second parity is in UPS hands]

Destination Server

- Dual Intel E5 2620v2, 256gb 1333, ZFS
- Drives: (2) Parity 16TB 7200, (3) 16TB 7200

Default settings were slow as molasses. 
 

Just curious if any of the following are red flags for speed or risk. Since it’s a stable LAN, assume tinkering with config is best bet.

My speeds with these settings are considerably faster, but nothing to write home about. I can see the file progress bar move and server load is heavier. Spikes to 1 to 6 Gbps every now and again, holding steady at 30-60Mbps on the Unraid dashboard.

Set file size to 250mb since the Duplicati docs indicate that anything above 1gb slows it down. Many of my images are 80mb, so assume the blocks will group a couple at a time compressed.

At 20 asynchronous, the processor seems to hold between 30-70% spiking to 90% max. Unsure is this is related or because of the next set of settings. 
 

Assuming that I have the overhead with processor and RAM, these are good to push the backup speeds, but that’s based on reading and not application. 
 

This combination seems good. I’m tempted to try 500MB or 750MB block size, but the transfer speeds are much better at the moment. 
 

Curious if anyone has expertise here. And if I have any incorrect assumptions or settings that are off. I couldn’t find the compression size setting because I’m not worried about disk space, but assume that is just space on destination server/drives setting and less about speed as long as the server is filling the queue of files, that’s a non-issue.

Thank you for any thoughts. Seems like a reasonable speed for what it is.

Edited July 20, 20232 yr by pixelsandpointers