Hi guys,

 

Built my new rig a few weeks ago and am now populating it with the 800+ MKV movie files I have. I have run into a problem where my write speeds are disappointingly slow. Was initially getting about 6 MB/sec through my router and with placing all drives/servers onto a switch, I now max out at a consistent 8.4 MB/sec. I have not installed my parity drive yet as I heard write speeds would be even slower if parity was enabled.

 

Files are on a WD myBook Live 3TB drive. Trying to copy files from WD Live drive through the switch to the unRAID server. Is this the best setup without ripping the HDD out of the myBook enclosure and installing it directly into the server?

 

I tried searching and saw the "sysctl vm.highmem_is_dirtyable=1" command but did not improve speeds. Tried increasing tunables in Disk Settings slightly and did not see any improvement.

 

My rig: "Hurley"

Case: Lian Li PC-Q25B

Motherboard: ASUS P8H77-I LGA 1155

CPU: Intel Core i3-3220T 2.8GHz

RAM: G.SKILL Ripjaws X Series 8GB (2x4GB) DDR3 1866

Power Supply:  CORSAIR  CX430

HDD: (3x) WD Red 2TB WD20EFRX

unRAID: version: 5.0-rc11 Basic

 

Is your network 100Mb or 1Gb?

The switch has lights to indicate between 1Gbps and 100MBps. Orange for a 100MB connection and Green for a 1GB connection. All drives/servers are responding with green lights on the front of the switch.

What speeds do you get copying a large files from something else than the WD NAS box?  File size should be in the 1GB range for a reasonable comparison.

Hi guys,

 

Built my new rig a few weeks ago and am now populating it with the 800+ MKV movie files I have. I have run into a problem where my write speeds are disappointingly slow. Was initially getting about 6 MB/sec through my router and with placing all drives/servers onto a switch, I now max out at a consistent 8.4 MB/sec. I have not installed my parity drive yet as I heard write speeds would be even slower if parity was enabled.

 

Files are on a WD myBook Live 3TB drive. Trying to copy files from WD Live drive through the switch to the unRAID server. Is this the best setup without ripping the HDD out of the myBook enclosure and installing it directly into the server?

 

I tried searching and saw the "sysctl vm.highmem_is_dirtyable=1" command but did not improve speeds. Tried increasing tunables in Disk Settings slightly and did not see any improvement.

 

My rig: "Hurley"

Case: Lian Li PC-Q25B

Motherboard: ASUS P8H77-I LGA 1155

CPU: Intel Core i3-3220T 2.8GHz

RAM: G.SKILL Ripjaws X Series 8GB (2x4GB) DDR3 1866

Power Supply:  CORSAIR  CX430

HDD: (3x) WD Red 2TB WD20EFRX

unRAID: version: 5.0-rc11 Basic

 

How much memory do you have installed ?  Check out using the 4GB memory option during bootup and try then, also try that option combined with the dirtyable option..

 

Your symptoms show VERY like the ones more people are experiencing (and are fixing with dirtyable/mem parameter), so please double check your findings on that one..

What does "ethtool eth0" and "ifconfig" show?

I need to turn off the Wireless network adapter on my laptop to ensure its connecting through the hard wire. It doesn't automatically use the Ethernet cable when I plug it in. might not be the issue but its worth a look.

 

You should definitely try whats been suggested above too.

Do a couple of couples within a telnet session from disk to disk and see what speeds are then, that way you can rule out the network as cause...

Thanks everyone for the suggestions. I'll try each one out. Busy the next few days but I will report back findings when I am able to.

As a point of reference, I have virtually identical hardware to yours and my transfer speeds are no where near that slow.  Good luck troubleshooting.

 

Definitely interested in the results of ifconfig and ethtool.  First instinct makes me think somethings connected at 100Mbit, or possibly half-duplex.

As a point of reference, I have virtually identical hardware to yours and my transfer speeds are no where near that slow.  Good luck troubleshooting.

 

Definitely interested in the results of ifconfig and ethtool.  First instinct makes me think somethings connected at 100Mbit, or possibly half-duplex.

 

My hardware is nearly identical because I based my build off of yours 

My hardware is nearly identical because I based my build off of yours 

 

...which was based off of spencers build.  Seems it's becoming a fairly popular build lately as I've seen a few others here as well.   

Hi everyone, back from a small vacation and checked my server.

 

EVERY single transfer option seems to be locked at 8.4MB/sec.

1. WD Live to unRaid Server

2. unRAID server disk1 to unRAID server disk2

3. unRAID server to iMac desktop

4. Iomega HD to unRAID Server

 

Copying from WD Live to iMac desktop is "at least" double the speed (not sure how to get an accurate transfer rate reading in osx - the Finder copy transfer box is very minimal)

 

Attached are two images of 'ifconfig' and 'ethtool eth0' readings.

I am running full duplex. However, speed is only indicated at 100Mb/s - could be the issue - how do I get that corrected??

I don't know how to interpret any of the readings on my ifconfig

 

Let me know my next steps! Thanks for all the help everyone!

That is 100% your issue.  I assume when you said a disk1 to disk2 transfer that was through a client, i.e. via the Mac?  If you did the copy solely on the box via mc it should be much faster.

 

Since I'm still a Linux noob, I have no idea how to troubleshoot the fact that your server is connecting at 100 Mbit other than the obvious. Is the server connected with a quality CAT5e or CAT6 cable?  CAT5 won't cut it. Is it a premade cable, or did you crimp it yourself?  Have you tried a different port on the switch? 

That is 100% your issue.  I assume when you said a disk1 to disk2 transfer that was through a client, i.e. via the Mac?  If you did the copy solely on the box via mc it should be much faster.

 

Since I'm still a Linux noob, I have no idea how to troubleshoot the fact that your server is connecting at 100 Mbit other than the obvious. Is the server connected with a quality CAT5e or CAT6 cable?  CAT5 won't cut it. Is it a premade cable, or did you crimp it yourself?  Have you tried a different port on the switch?

 

Thanks Dirty. yes they were initiated through my imac as i haven't learned MC yet.

 

Probable reason why I'm only getting 100mb/sec? I looked up my wireless router specs and saw the ethernet ports only support 10/100!! Gosh I just assumed since I had a wireless-N router (Linksys E900) that the hardware was at least decent. So I guess I need to go out and get a Gigabit router? Any Suggestions for best router for the price?

 

HOWEVER.....

 

Welp... after trying a dozen different ideas... i worked myself into a snag i cant get out of. I can't access //tower anymore and it seems I am not getting an IP address. my "ifconfig" only shows as 127.0.0.1

 

attached is my syslog. what have i done?

syslog.txt

I looked at my syslog and it doesn't really differ from yours, so not sure what the issue is, but I'm no syslog expert.  Sounds at this point like a bad cable.  The eth0 interface isn't seeing anything, so possibly a bad cable or switchport.  Try a different cable and/or switchport.

 

Regarding the router, you'd be surprised how many routers out there, even current gen ones, only have 100Mb ports.  My suggestion for a replacement router would be the Asus RT-N66U.  It's not the cheapest router out there at ~$150, but it is an awesome router.  I've had many different consumer grade routers in my day, everything from Netgear to Linksys to D-Link, etc., and this Asus router puts them all to shame.  Gb Ethernet ports, simultaneous dual-band (2.4Ghz & 5GHz) triple-stream (450 Mb/s) wireless.  Best router I've ever owned by a long shot.  There is also an RT-N66R variant that you can buy at Best Buy.  The only difference is the model number (the R stands for retail), the hardware is identical and it runs the U series firmware.

A Gig-e switch will be cheaper than a new router.

A Gig-e switch will be cheaper than a new router.

 

I saw a Gigabit switch like the Netgear ones were pretty affordable, but how does it all connect in the setup?

I currently have: Moden > Router > Switch > unRAID server

Tried connecting the moden directly to the switch (with the router connected to the switch) and I wouldn't get a connection to the router, so I put the router before the switch.

In this case, my bottleneck would be the 100mbps Router. Should the router work connected to the switch or does the router have to be connected directly to the moden? If so, I'll probably have to get a 1Gbps router also.

A Gig-e switch will be cheaper than a new router.

 

I saw a Gigabit switch like the Netgear ones were pretty affordable, but how does it all connect in the setup?

I currently have: Moden > Router > Switch > unRAID server

Tried connecting the moden directly to the switch (with the router connected to the switch) and I wouldn't get a connection to the router, so I put the router before the switch.

In this case, my bottleneck would be the 100mbps Router. Should the router work connected to the switch or does the router have to be connected directly to the moden? If so, I'll probably have to get a 1Gbps router also.

 

You have it connected correctly.  The modem must connect to the WAN port on the router.  The switch connects to any LAN port on the router.  unRAID connects to the switch.  In other words, Modem -> Router -> Switch -> unRAID.  All of your other clients also need to connect to the switch.  As long as all of your clients are directly connected to the Gb switch, they will get Gb speeds between them.  The 100Mb connection between the switch and the router will only affect Internet speed and wireless client speed.  Your Internet connection is likely under 100Mb/s, so it will not be an issue.  Your wireless clients will also not be an issue unless you are running a high end router that has at least dual-stream radios capable of 300Mb/s theoretical, which is roughly 150Mb/s real world.

 

So in short, a Gb switch will suffice (and give full Gb speeds to all devices directly connected to the switch) UNLESS you have fast wireless AND having wireless clients be able to perform file transfers to unRAID at the highest possible speed is important.  If this is important then you need to look into getting a good router with Gb interfaces.

 

EDIT:  Had a typo, had a B that was supposed to be a b.

A Gig-e switch will be cheaper than a new router.

 

I saw a Gigabit switch like the Netgear ones were pretty affordable, but how does it all connect in the setup?

I currently have: Moden > Router > Switch > unRAID server

Tried connecting the moden directly to the switch (with the router connected to the switch) and I wouldn't get a connection to the router, so I put the router before the switch.

In this case, my bottleneck would be the 100mbps Router. Should the router work connected to the switch or does the router have to be connected directly to the moden? If so, I'll probably have to get a 1Gbps router also.

 

You have it connected correctly.  The modem must connect to the WAN port on the router.  The switch connects to any LAN port on the router.  unRAID connects to the switch.  In other words, Modem -> Router -> Switch -> unRAID.  All of your other clients also need to connect to the switch.  As long as all of your clients are directly connected to the Gb switch, they will get Gb speeds between them.  The 100Mb connection between the switch and the router will only affect Internet speed and wireless client speed.  Your Internet connection is likely under 100Mb/s, so it will not be an issue.  Your wireless clients will also not be an issue unless you are running a high end router that has at least dual-stream radios capable of 300Mb/s theoretical, which is roughly 150Mb/s real world.

 

So in short, a Gb switch will suffice (and give full Gb speeds to all devices directly connected to the switch) UNLESS you have fast wireless AND having wireless clients be able to perform file transfers to unRAID at the highest possible speed is important.  If this is important then you need to look into getting a good router with Gb interfaces.

 

EDIT:  Had a typo, had a B that was supposed to be a b.

 

Thanks for explaining it clearly for me. I understand the whole process now. I will most likely purchase a Gb switch and I'll look to learn MC to utilize the best possible transfer speeds - as opposed to the client transfers I have been doing currently.

No problem, glad to help. Keep in mind that MC is mostly used for copying files within unRAID (i.e. copying files between drives and/or shares in unRAID). For copying files to/from a client PC or Mac you'll need to use the built in functionality within the client OS or a special copying utility for said OS. The reason I brought up MC is when you stated you performed a copy from unRAID disk 1 to unRAID disk 2 it was still slow. Had you used MC it would have been as fast as the array allows. Since you did it from the Mac what effectively happens is the file gets copied from disk 1 to the Mac and then back to disk 2, hence the reason it was still slow because the file travels through the client. With MC you are telling the server to directly copy the file from disk 1 to disk 2.