Network disk access is suddenly painfully slow at 30-200 kbps

[DeKinci]

Without any major changes in configuration network disk usage on unraid server became unusably slow.

Problem persists after restarts.

 

Short config (diagnostics attached):

• Unraid 6.8.3
• 2x WD red 4 TB, data and parity
• Plextor 1TB SSD cache

 

Evidences:

1. Loading folder in windows (smb) takes a few seconds
2. Downloading or *uploading files in windows or android or ubuntu (nfs mount) starts at a few kbps, but fails
3.     * uploading from ubuntu nfs mount works at full speed
4. Plex video loads (caches) every second for 5-10 seconds
5. Minecraft server has seconds of in-game action delay

 

Evidences against disk failure:

Copying file via terminal happens at high speed

    (tested in /mnt/user directory, so unraid internal mounting systems work fine,

    as well as /mnt/cache and /mnt/disk1, so ssd and disks work fine)

 

Evidences against network failure:

Updating docker image happens at usual speed

 

Weak evidences against SMB issue:

• NFS mount downloading shows speeds aroung 30-100kbps
• ! But uploading works at full speed (100 MiBps)
• Downloading of uploaded file while mounted is at 276MiB, faster than internet connection, so it's probably cached
• Downloading of uploaded file after unmount-mount is at 30-100kbps again

 

I don't really have a clue how to keep debugging it. No configuration changes happened for at least a day when this issue occurred and everything worked fine for around a year before that. Also using safe mode is last possible option as for now I only have remote access to the server.

 

Diagnostics info attached (idk where to look in them so might've missed an elephant).

mars-diagnostics-20210301-0244.zip

[JorgeB]

Run a single stream iperf test.

[DeKinci]

Sadly results are fine:

[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 62.3 MBytes 52.2 Mbits/sec 350 sender
[ 4] 0.00-10.00 sec 59.9 MBytes 50.2 Mbits/sec receiver

[JorgeB]

6 minutes ago, DeKinci said:

Sadly results are fine:

Not really, unless you're using WiFi.

[DeKinci]

It's wifi over VPN on a router over 50 Mbits internet connection.

It's not like they are 200 kbps I get in reads

[DeKinci]

Looks like I'm missing 1 in 10 pings from my pc to unraid server, will keep investigating this