Extremely slow transfer speeds over SMB


dannydev

Recommended Posts

I've been trying to find a solution to this problem since I've started using UNRAID, I've tried transferring files to and from the server from my drives, my cache, etc. I get better transfers using my reverse proxy online. My motherboard has two lan ports, 2.5G Realtek and 1G Intel, everything goes thru the 2.5G port. I'm wired directly to the same network switch (which is 5 port 1G) as the server, but I average around 1mb/s - 2mb/s. I've also tried using SMB -> SMB Extras: max protocol = SMB2_02. Not sure what to try next. 

terra-diagnostics-20210210-1538.zip

Link to comment
20 minutes ago, dannydev said:

I'm wired directly to the same network switch (which is 5 port 1G) as the server, but I average around 1mb/s - 2mb/s.

Are you talking about MB/s or  Mb/s    (MB =  Megabytes  and Mb = Megabits)?  

 

Is this a speed for the transfer of very large files of 10GB or larger or thousands of very small files (~ 1KB to 10KB)?

Edited by Frank1940
Link to comment

First thing.  The best speed you could see would be around 120MB/s.  (From the description you have given your network speed is capped at 1Gb/s which is about 120MB/s.)

 

I just copied a 3.7GB file from my Unraid server to my Desktop (WIN10 Pro v2004) and the transfer speed was varied a bit around 112MB/s.   Now I did not make a special effort to stop other network traffic (like my browser) but that is about the peak that can be achieved using 1Gb hardware.  (And your switch will make it a 1Gb network connection.)  I did check in your Diagnostic file, you only have a 1 Gb/s connection for both your NIC's.   IF you want a higher speed from that 2.5Gb NIC, you will have to get a new switch.  And obviously, you will also have to get a 2.5Gb NIC for your PC...

 

I would start troubleshooting your network.  First thing, I would do is to reboot your network switch.  These switches are small dedicated computers and a reboot will often fixed problems that are caused by their firmware.

Link to comment

It comes down now to testing by process of elimination to figure where the problem is at.  Hopefully, you  have access to another PC and you can setup some tests using a common file around 3 to 4 GB in size.  (Otherwise, you can run into problems of RAM caching skewing the results.)  You want to be moving files on all possible directions--- PC to PC, both PC's to server, Server to PC's.  

 

By the way, I had a similar problem several years back...   It turned out to be a Windows 7 NIC driver.   I had a devil of a time finding it as the two PC's I was using to test had the same MB and hence the same NIC!!!  Updated the NIC driver using the one on the MB's manufacturer's  website and the problem was fixed. 

 

I also noticed that you had enabled IPv6.  Do you actually require this?  I noticed that there is a lot of log activity where IPv6 operations are failing.  (In general, if you don't know that you need IPv6, your system doesn't require its use!)   (If you are in the USA, most ISP's will shield you from needing it. So you only need IPv4 enabled on your Unraid server.)

  • Like 1
Link to comment
1 hour ago, JorgeB said:

Start by doing a single stream iperf test.

My PC connecting to my Server PC, hardlined.

 

[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  6.82 MBytes  57.2 Mbits/sec                  
[  5]   1.00-2.00   sec  7.38 MBytes  61.9 Mbits/sec                  
[  5]   2.00-3.00   sec  7.25 MBytes  60.9 Mbits/sec                  
[  5]   3.00-4.00   sec  7.37 MBytes  61.8 Mbits/sec                  
[  5]   4.00-5.00   sec  7.22 MBytes  60.6 Mbits/sec                  
[  5]   5.00-6.00   sec  6.77 MBytes  56.8 Mbits/sec                  
[  5]   6.00-7.00   sec  6.64 MBytes  55.7 Mbits/sec                  
[  5]   7.00-8.00   sec  7.18 MBytes  60.2 Mbits/sec                  
[  5]   8.00-9.00   sec  7.22 MBytes  60.5 Mbits/sec                  
[  5]   9.00-10.00  sec  7.32 MBytes  61.4 Mbits/sec                  
[  5]  10.00-10.05  sec   382 KBytes  59.6 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.05  sec  71.5 MBytes  59.7 Mbits/sec

 

Server PC connecting to my PC, hardlined.

 

[ ID] Interval           Transfer     Bandwidth
[  5]   0.00-1.00   sec  6.25 MBytes  52.4 Mbits/sec
[  5]   1.00-2.01   sec  6.47 MBytes  53.9 Mbits/sec
[  5]   2.01-3.01   sec  6.05 MBytes  50.7 Mbits/sec
[  5]   3.01-4.00   sec  5.21 MBytes  43.9 Mbits/sec
[  5]   4.00-5.00   sec  6.16 MBytes  51.6 Mbits/sec
[  5]   5.00-6.00   sec  6.08 MBytes  51.1 Mbits/sec
[  5]   6.00-7.00   sec  6.08 MBytes  50.9 Mbits/sec
[  5]   7.00-8.00   sec  4.68 MBytes  39.3 Mbits/sec
[  5]   8.00-9.00   sec  4.87 MBytes  40.8 Mbits/sec
[  5]   9.00-10.00  sec  4.66 MBytes  39.2 Mbits/sec
[  5]  10.00-10.04  sec   165 KBytes  36.0 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  5]   0.00-10.04  sec  0.00 Bytes  0.00 bits/sec
[  5]   0.00-10.04  sec  56.7 MBytes  47.3 Mbits/sec

 

Pop_OS! Laptop to Server PC, wifi.

 

[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  34.7 MBytes   291 Mbits/sec                  
[  5]   1.00-2.00   sec  30.3 MBytes   254 Mbits/sec                  
[  5]   2.00-3.00   sec  30.8 MBytes   258 Mbits/sec                  
[  5]   3.00-4.00   sec  31.5 MBytes   264 Mbits/sec                  
[  5]   4.00-5.00   sec  34.0 MBytes   285 Mbits/sec                  
[  5]   5.00-6.00   sec  36.4 MBytes   305 Mbits/sec                  
[  5]   6.00-7.00   sec  34.9 MBytes   292 Mbits/sec                  
[  5]   7.00-8.00   sec  35.5 MBytes   297 Mbits/sec                  
[  5]   8.00-9.00   sec  30.6 MBytes   257 Mbits/sec                  
[  5]   9.00-10.00  sec  36.9 MBytes   310 Mbits/sec                  
[  5]  10.00-10.01  sec   348 KBytes   463 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.01  sec   336 MBytes   282 Mbits/sec                  receiver
-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------

See what I'm saying?

 

5 hours ago, Frank1940 said:

It comes down now to testing by process of elimination to figure where the problem is at.  Hopefully, you  have access to another PC and you can setup some tests using a common file around 3 to 4 GB in size.  (Otherwise, you can run into problems of RAM caching skewing the results.)  You want to be moving files on all possible directions--- PC to PC, both PC's to server, Server to PC's.  

 

By the way, I had a similar problem several years back...   It turned out to be a Windows 7 NIC driver.   I had a devil of a time finding it as the two PC's I was using to test had the same MB and hence the same NIC!!!  Updated the NIC driver using the one on the MB's manufacturer's  website and the problem was fixed. 

 

I also noticed that you had enabled IPv6.  Do you actually require this?  I noticed that there is a lot of log activity where IPv6 operations are failing.  (In general, if you don't know that you need IPv6, your system doesn't require its use!)   (If you are in the USA, most ISP's will shield you from needing it. So you only need IPv4 enabled on your Unraid server.)

 

I'll have to double check my drivers for all my systems then, because maybe it's just my PC? I just built both systems recently, and I'm more than certain they're up to date. Hmm.

 

Mine: 

Ryzen 7 3800x

Asus ROG Strix Mini ITX B550 w/ 2.5G Realtek

 

Server:

Ryzen 9 3900x

Crosshair VIII Hero X570 w/ 2.5G Realtek and 1G Intel (Inactive)

 

Also, forgot to mention, I'm messing around with IPv6 because of my Pi-Hole docker container, I wanted to try setting up both IPv4 and IPv6 for my DNS Server connections but that might be unnecessary. I'll most likely remove it.

Edited by dannydev
Link to comment
12 minutes ago, JorgeB said:

That confirms it's a network problem, try different source PC, NICs, switch, cables, etc.

Looks like you're correct, my motherboard's network adapter seems defective, tried using my usb3.0 to ethernet adapter instead and here's the results:

BUT: I'm still not getting the speeds I was hoping for, even if this is a significant improvement.

 

My PC (using usb3.0 to ethernet adapter) to Server PC, hardlined.

 

[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  21.4 MBytes   179 Mbits/sec
[  4]   1.00-2.00   sec  20.9 MBytes   175 Mbits/sec
[  4]   2.00-3.00   sec  19.0 MBytes   160 Mbits/sec
[  4]   3.00-4.00   sec  20.4 MBytes   171 Mbits/sec
[  4]   4.00-5.00   sec  19.9 MBytes   167 Mbits/sec
[  4]   5.00-6.00   sec  18.8 MBytes   157 Mbits/sec
[  4]   6.00-7.00   sec  20.9 MBytes   175 Mbits/sec
[  4]   7.00-8.00   sec  21.0 MBytes   176 Mbits/sec
[  4]   8.00-9.00   sec  20.8 MBytes   174 Mbits/sec
[  4]   9.00-10.01  sec  14.1 MBytes   118 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.01  sec   197 MBytes   165 Mbits/sec
[  4]   0.00-10.01  sec   197 MBytes   165 Mbits/sec

ss+(2021-02-11+at+01.11.23).png

Link to comment
1 minute ago, JorgeB said:

Try another PCIe NIC if available.

Just asked my roommate to test it, he got better scores than my computer and slightly better than my laptop over wifi.

 

[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  32.0 MBytes   268 Mbits/sec                  
[  5]   1.00-2.00   sec  28.6 MBytes   240 Mbits/sec                  
[  5]   2.00-3.00   sec  28.8 MBytes   242 Mbits/sec                  
[  5]   3.00-4.00   sec  24.5 MBytes   205 Mbits/sec                  
[  5]   4.00-5.00   sec  26.9 MBytes   225 Mbits/sec                  
[  5]   5.00-6.00   sec  26.9 MBytes   225 Mbits/sec                  
[  5]   6.00-7.00   sec  27.5 MBytes   231 Mbits/sec                  
[  5]   7.00-8.00   sec  28.3 MBytes   238 Mbits/sec                  
[  5]   8.00-9.00   sec  27.2 MBytes   229 Mbits/sec                  
[  5]   9.00-10.00  sec  30.2 MBytes   254 Mbits/sec                  
[  5]  10.00-10.04  sec  1.00 MBytes   228 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.04  sec   282 MBytes   236 Mbits/sec

 

Since my Mini ITX board only has one PCIe slot for my graphics card, I don't have any slots available for another NIC, my only option is to use that USB adapter.

Link to comment
6 minutes ago, JorgeB said:

That's still low, still some network issue.

Damn. Just tried a brand new network switch, now reaching around 40MB/s with the USB3.0 to ethernet adapter. Unfortunately, same 7MB/s with my motherboard's NIC, so that's definitely defective. STILL not the ~120MB/s I'm hoping for :(

 

My PC (USB3.0 to ethernet adapter) to Server PC, hardlined.

 

[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  40.4 MBytes   338 Mbits/sec
[  4]   1.00-2.00   sec  40.1 MBytes   337 Mbits/sec
[  4]   2.00-3.00   sec  40.1 MBytes   336 Mbits/sec
[  4]   3.00-4.00   sec  40.1 MBytes   337 Mbits/sec
[  4]   4.00-5.00   sec  40.1 MBytes   336 Mbits/sec
[  4]   5.00-6.00   sec  40.1 MBytes   337 Mbits/sec
[  4]   6.00-7.00   sec  40.0 MBytes   336 Mbits/sec
[  4]   7.00-8.00   sec  40.2 MBytes   337 Mbits/sec
[  4]   8.00-9.00   sec  40.0 MBytes   337 Mbits/sec
[  4]   9.00-10.00  sec  40.1 MBytes   336 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec   401 MBytes   337 Mbits/sec
[  4]   0.00-10.00  sec   401 MBytes   337 Mbits/sec

 

 

Link to comment
  • 1 year later...

I'm having the same exact issue. Copying from Windows 11 to unRAID and when copying from Ubuntu 22.04 to unRAID. I'm averaging 11-12MB/s which is abysmal. What might be the culprit is my cheap PCI-E 1x -> 8x sata adapter but I'm not 100% sure. That only manages 8 of my 12 drives so I feel like the speeds should at least be a lot higher 33% of the time but that doesn't seem to be the case.

 

I just finished a parity check and it averaged ~55MB/s so I know the internal speeds are good. The weird thing is that if I do a speedtest.net I get 1000mb up and 1000mb down easily from my desktop but if I start a transfer to unRAID and then do a speedtest simultaneously I get 10mb up/down on speedtest.net. So somehow the network is fully saturated only when transferring to unRAID? It's extremely peculiar. Not sure how to proceed. I downloaded iperf but that needs it running on both ends? And I have Windows 11 -> unRAID and Ubuntu 22.04 -> unRAID so not sure how to test what the real issue is.

 

EDIT: OMG I just checked my unRAID server just in case and it's showing 100mbps ethernet link speed... no idea why that's the case though. I have a B550M PRO-VDH WIFI motherboard which shows its network card is 1x Realtek® RTL8111HN Gigabit LAN...

EDIT2: After switching ports on my switch the link went from 100mbps to 1000mbps and transfers went from 11/12MB/s to 111MB/s. Glorious!

Edited by QVjS1tq2ZYkfp9xtLpHlK2kUt32LBhku
Link to comment
12 minutes ago, QVjS1tq2ZYkfp9xtLpHlK2kUt32LBhku said:

OMG I just checked my unRAID server just in case and it's showing 100mbps ethernet link speed...

 

Most of the time this is caused by a cat5/6 cable issue or a bad port on a switch.

 

If this is not the issue, then post up your diagnostics with your next post. 

 

By the way, it is not considered good form to hijack an old thread.  Always start a new one so the Folks who help out can keep things straight.  IT should be OK in this case, since this thread has been dead for over a year...

Edited by Frank1940
Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.