Unraid + Syncthing - Starts Fast then Speeds Drop

[Resviole]

I am trying to use Syncthing via a docker container to sync files from a remote server to my own. The remote server is 10Gbit, and Syncthing works at 400Mbps+ to other devices in my local network (tested via Syncthing on Synology NAS). On my Unraid server the speeds start at ~250Mbps then drops to 2-5Mbps within 10 seconds.

 

Server specs

Unraid version: 6.9.0-beta35

Hardware: Ryzen 5600x with 32GB memory

Main array: 4x 14tb 7200rpm drives, 1 set as parity.

Cache array: 2x Samsung 970 Evo Plus M.2 500GB

 

Troubleshooting attempted so far

1. Set the Unraid share used by Syncthing to public, confirmed I could read and write from/to the share via SMB to a Windows PC at a consistent 110MB/s.
2. For troubleshooting purposes, set the share to Cache only and confirmed all files are on the cache array.
3. Ran the "Docker Safe New Perms" tool
4. Ran Fix Common Problems + Tips and Tweaks - all is as recommended, no issues
5. Searched the syncthing forums and google, found other references to issues with Syncthing on Unraid but no resolution threads. The threads are sparse (one thread every year or two).
6. Confirmed CPU and Memory are good, both are extremely low usage
7. Checked the Unraid syslog, no warnings or errors that seem related
8. Recreated the Syncthing container
9. Followed tweaking guides - changed tunable (md_write_method) to reconstruct write and tunable (md_num_stripes) to 8192. I don't think these matter since I have the share set to cache only though.
10. Verified no smart errors
11. Set dynamix ssd trim to run daily
12. Gave full permissions to appdata in case permissions issue - chmod -R 777 /mnt/user/appdata/syncthing/
13. Confirmed SyncThing versions match (1.11.1 on both sides)
14. Confirmed UPnP is properly creating the port forwarding on my router (it is forwarding a port above 40000 to my internal port 22000 on the receiver side)
15. Increased logging and reviewed - found failed to exchange Hello messages warnings, unsure if this is a concern as it relates to slow speeds. See attached log (the items in square brackets are modified to hide private info)
16. Manually created a port forward on router on receive side: source ip [internal ip of server], external port 22000, internal port 22000
17. Confirmed Relay is not being used by checking the "Address" section under "Remote Devices" on the sender and receiver side. Both list the IP:Port directly without a "relay://" before them

 

Any help or tips to resolve this would be appreciated. Thanks in advance!

SyncThingErrorLog.txt

Edited November 30, 2020 by Resviole
Added latest troubleshooting steps

[Resviole]

Self-replying as this is now resolved and I can get a sustained 300mbit+.

 

The solution was to add a new variable to the Syncthing docker container named UMASK_SET with a value of 000. I'm using the linuxserver.io docker image and it appears permissions were the cause of the speed issues.

[Judd35472]

On 12/1/2020 at 6:48 PM, Resviole said:

Self-replying as this is now resolved and I can get a sustained 300mbit+.

 

The solution was to add a new variable to the Syncthing docker container named UMASK_SET with a value of 000. I'm using the linuxserver.io docker image and it appears permissions were the cause of the speed issues.

Thx!  Was driving me crazy for weeks.  Looks like this fixed my issue as well - binhex version.

[monano]

On 12/1/2020 at 3:48 PM, Resviole said:

Self-replying as this is now resolved and I can get a sustained 300mbit+.

 

The solution was to add a new variable to the Syncthing docker container named UMASK_SET with a value of 000. I'm using the linuxserver.io docker image and it appears permissions were the cause of the speed issues.

Thanks so much for posting this. It is exactly what worked for me.

[Januszmirek]

I am experiencing similar issue with speeds. having said that I am not syncing my local Mac to cache drive on Unraid, but rather to a share set up on one of array discs (hdd). My initial syncing speeds are atrocious (20-100kbps) increasing to 25-100(occasionally) Mbps. Obviously my Mac machine and Unraid are on same 1gbit network. I am using latest 1.22 and 1.23 versions of app on mac and unraid. Both machines show TCP LAN connection type. Where do I start troubleshooting the issue?

Edited January 21, 2023 by Januszmirek