Typical gigabit transfer speeds?


Recommended Posts

What are typical gigabit network transfer speeds to your Unraid boxes from Windows machines?  When transferring large files like MKVs?  I see posts about guys saturating gigabit connections and averaging over 100MB/s.  I average 40-50 MB/s.  I never saw an improvement when I started using cache drives a long time ago either nor did the performance increase when I "upgraded" the cache drives.  I am currently using 2 500GB VelociRaptor 10K RPM drives in a btrfs cache pool.  I verified all my network wires today with a cable tester.  Any ideas?  I would LOVE to get 100 MB/s transfers.  Ethtool shows connected at 1000 Mbps.   Thanks, Andrew

network drops.JPG

slow transfer.JPG

Link to comment

40 to 60MB/s seems normal array write speed in default read/modify/write mode, you can change to reconstruct write (aka turbo write) and it should be considerably faster at the expense of all disks spinning up for writes. (settings -> disk settings)

 

For the cache speeds seem low, try the script attached to rule out any network issues, copy it to root folder of your flash share and type:

 

/boot/write_speed_test.sh /mnt/cache/test.dat

 

 

write_speed_test.sh

  • Upvote 1
Link to comment
3 minutes ago, johnnie.black said:

40 to 60MB/s seems normal array write speed in default read/modify/write mode, you can change to reconstruct write (aka turbo write) and it should be considerably faster at the expense of all disks spinning up for writes. (settings -> disk settings)

 

For the cache speeds seem low, try the script attached to rule out any network issues, copy it to root folder of your flash share and type:

 


/boot/write_speed_test.sh /mnt/cache/test.dat

 

 

write_speed_test.sh

Ok, so copy that attached file to the root of the flash drive and type that line in a telnet prompt? 

Link to comment

 I used to have a pair of WD Raptors 10K RPM spinners in RAID-0 (250GB), back when they were the top performers. They were only good for latency items after advancements in storage less than two years later. For raw write speeds they were easily outperformed by a single WD 2TB SATA drive. The substantially higher data density and larger cache on the SATA drive kicked the snot out of the Raptors. Now those 2TB drives are significantly outpaced by 4TB SATA drives. And those 4TB SATA drives are significantly out performed by 8TB and 10TB drives. They're utterly put to shame by SSDs.

 

The best thing you could do with those old drives are mount them on the wall or drop them off at a recycling center after wiping the contents.

 

Maybe the 500GB models are better than the ones I had, but there's only so far 5 to 7 year old tech can get.

Edited by BRiT
Link to comment
2 hours ago, BRiT said:

You're limited by your spinners for cache.

NO =>  the spinners can easily exceed Gb speeds for writes.     This may be a network issue;  or it's possible the shares aren't configured to be cached -- in which case the writes are directly to the array ... in which case 40-50 MB/s is a reasonable speed (actually it's fairly good).     If switching to reconstruct write mode (aka "turbo write") speeds things up, then that's indeed the problem.

 

allischalmersman =>  Are you sure the shares are configured to use the cache?    They have to be configured on a share-by-share basis.

 

  • Upvote 1
Link to comment
5 minutes ago, garycase said:

NO =>  the spinners can easily exceed Gb speeds for writes.     This may be a network issue;  or it's possible the shares aren't configured to be cached -- in which case the writes are directly to the array ... in which case 40-50 MB/s is a reasonable speed (actually it's fairly good).     If switching to reconstruct write mode (aka "turbo write") speeds things up, then that's indeed the problem.

 

allischalmersman =>  Are you sure the shares are configured to use the cache?    They have to be configured on a share-by-share basis.

 

Yes.  I even can transfer, and view the MKVs on the the cache drives before they are moved via the "Mover"

Link to comment

I have used multiple different switches and multiple PCs, no difference. This is a PCI Intel NIC and from what I read the drops are not abnormal? The errors idk about. I have another PCI NIC I could try. I have not tried another router. Connnections look like this PC>router>wall patch to basement>basement patch panel to switch>switch to tower. I will try connecting a laptop directly to the switch the Tower is on and try a transfer. Will that eliminate the router as a variable? Not a cheap router either. Its a Netgear R8000

 

No trees were harmed in the sending of this message, however, a significant number of electrons were terribly inconvenienced.

 

 

 

 

Link to comment

I know that I have a friend who complained about similar speed with his gigabit network.  Last week he finally replaced the switch and is now seeing gigabit speeds (100MB/sec. +). Drops are not uncommon in congested networks. But your counters are pretty high - especially if you've been restarting while troubleshooting this issue. Yes, if you connect directly to the switch you will remove the router and most of the cabling in your test.  Good idea.

  

  • Upvote 1
Link to comment
I know that I have a friend who complained about similar speed with his gigabit network.  Last week he finally replaced the switch and is now seeing gigabit speeds (100MB/sec. +). Drops are not uncommon in congested networks. But your counters are pretty high - especially if you've been restarting while troubleshooting this issue. Yes, if you connect directly to the switch you will remove the router and most of the cabling in your test.  Good idea.

Ive tried 2 different switches with exact same results. They were both Netgear though. I have 2 more Netgear prosafe plus PoE gigabit switches here I could try too. Ill do some testing.

No trees were harmed in the sending of this message, however, a significant number of electrons were terribly inconvenienced.

Link to comment

One thought about testing without the router connected.  If the PC uses DHCP for addressing and the router is the DHCP server you may not be able to talk to anything once your PC is plugged in.  You might have to assign a static address to test like this.  If it's not too hard to connect the PC into the switch in the basement it might be best to do so and leave everything else in place.

Link to comment
3 hours ago, johnnie.black said:

40 to 60MB/s seems normal array write speed in default read/modify/write mode, you can change to reconstruct write (aka turbo write) and it should be considerably faster at the expense of all disks spinning up for writes. (settings -> disk settings)

 

For the cache speeds seem low, try the script attached to rule out any network issues, copy it to root folder of your flash share and type:

 


/boot/write_speed_test.sh /mnt/cache/test.dat

 

 

write_speed_test.sh

I just installed turbo write! wow what a difference.  not using my Cache SSD writing to my media folder and getting 113MB/sec re-enabled Cache use and still pinning my gigabit connection at 113MB/sec

Link to comment

Connected laptop to same switch as Tower.  No difference (this is a different PC)

Changed Intel Pro1000 NIC to a different Dual Intel Pro1000 NIC.  No difference

Changed switch.  No difference.

Reconstruct write mode makes absolutely no difference

 

Scratching my head here.  Are there some settings that I don't know about?  Are there some montherboard BIOS settings that can control a PCI NIC that I don't understand?  What would you guys try next?  Would logs help?

 

no cache.JPG

using cache.JPG

Edited by allischalmersman
Link to comment

If the cables were faulty (a discontinuous pair) I'd expect the transfers to revert to 100Mb speed (e.g. 11MB/s) -- transfers in the range you're seeing aren't likely due to bad cables.

 

What is the SOURCE of the MKV's?   Are you certain it can "feed" the data at higher rates?   e.g. have you tried copying them to another PC ... and do you get 100MB+ rates with those copies?    If so, I suspect your issue is a networking parameter issue.   But first, confirm you get the higher speeds when copying to a different PC.

 

 

Link to comment
 
It won't make any difference if the issue is network related, did you try different ethernet cables?

Yes. And tested wall cabling with a cable tester. I also eliminates them by hooking a laptop directly to the switch the Tower is on and still slow speeds.

No trees were harmed in the sending of this message, however, a significant number of electrons were terribly inconvenienced.

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.