SLOW transfer rates.


Recommended Posts

Hi Guys,

 

I have been running Unraid 5beta 12 since it came out, with no real compalints, until now.

And to be honest it has me stumped, the transfer rates on my system have dropped through the floor.  :o

the only thing I have done to the system (only today) is enable NTP to fix the time reporting and the slow down predates this.

other than that it works so i leave it alone.

Capacity is 60% on one drive and 70% on the other.

 

I have read

"to cache drive or not to cache drive"

and several other threads but i cant seem to find a reason for the slowdown.

 

I cant give you any "before" figures as i didnt bother to take any "it just worked"

But now i cant stream a movie with out chopping etc.

 

 

The server is a simple one

PRO -licence

1 x 2tb parity drive

2 x 2tb data drives

1 x 500gb cache drive.

 

Intel PCIE1gb nic card

 

I run UNMENU and Simple features, plus the monthly parity check script.

 

 

 

to give you some perspective:

If i copy a 700mb video file FROM the server to my laptop (connected via a 1GB switch) i get 9.5MBs using terra copy

if i write a file to the array i get 6MBs (to the share, so via the cache drive)

If i move a file internally (using Putty and then MC) i get 30MBs

 

I also ran "TOP" while copying the file from the box and the most it got to was 3% cpu and mem was the same.

Idle there is nothing taking CPU or RAM in amounts of 1%

 

UNMENU DISK SPEED TEST REUSLTS

 

/dev/sda: (Parity drive)

Timing cached reads:  1840 MB in  2.00 seconds = 920.15 MB/sec

Timing buffered disk reads:  346 MB in  3.02 seconds = 114.68 MB/sec

 

/dev/sdb:  (Data Disk 1)

Timing cached reads:  1954 MB in  2.00 seconds = 976.75 MB/sec

Timing buffered disk reads:  326 MB in  3.01 seconds = 108.34 MB/sec

 

/dev/sdc:  (Data Disk 2)

Timing cached reads:  1954 MB in  2.00 seconds = 977.38 MB/sec

Timing buffered disk reads:  406 MB in  3.00 seconds = 135.17 MB/sec

 

/dev/sdd: (Cache drive)

Timing cached reads:  1944 MB in  2.00 seconds = 972.03 MB/sec

Timing buffered disk reads:  250 MB in  3.01 seconds =  83.12 MB/sec

 

/dev/sde: (flash/boot drive)

Timing cached reads:  1850 MB in  2.00 seconds = 925.37 MB/sec

Timing buffered disk reads:  48 MB in  3.11 seconds =  15.44 MB/sec

 

 

Below are the vital details of the box plus some of the things asked for in other threads.

If you ask me to run a command please give me the command, i and still new to linux.

 

 

thank you for your time.

 

 

unRAID Version:

unRAID Server Pro, Version 5.0-beta12

Motherboard: ASUS M2N68-AM v2

Processor: 2.7GHz AMD AthlonTM 64 X2 Dual Core 5200+

Memory: 2 GB 800 MHz Speed

Network: 1000Mb/s Full Duplex

Uptime: 4 days, 3 hrs, 57 mins, 17 secs

 

LAN

Supported ports: [ TP ]

Supported link modes: 10baseT/Half 10baseT/Full

100baseT/Half 100baseT/Full

1000baseT/Full

Supports auto-negotiation: Yes

Advertised link modes: 10baseT/Half 10baseT/Full

100baseT/Half 100baseT/Full

1000baseT/Full

Advertised pause frame use: No

Advertised auto-negotiation: Yes

Speed: 1000Mb/s

Duplex: Full

Port: Twisted Pair

PHYAD: 1

Transceiver: internal

Auto-negotiation: on

MDI-X: off

Supports Wake-on: pumbg

Wake-on: g

Current message level: 0x00000001 (1)

Link detected: yes

 

 

 

Smart Report:-

 

smartctl 5.40 2010-10-16 r3189 [i486-slackware-linux-gnu] (local build)

Copyright © 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net

 

=== START OF INFORMATION SECTION ===

Model Family:    Western Digital Caviar Green (Adv. Format) family

Device Model:    WDC WD20EARS-60MVWB0

Serial Number:    WD-WCAZA4055935

Firmware Version: 51.0AB51

User Capacity:    2,000,398,934,016 bytes

Device is:        In smartctl database [for details use: -P show]

ATA Version is:  8

ATA Standard is:  Exact ATA specification draft version not indicated

Local Time is:    Thu Aug  9 20:02:21 2012 EST

SMART support is: Available - device has SMART capability.

SMART support is: Enabled

 

=== START OF READ SMART DATA SECTION ===

SMART overall-health self-assessment test result: PASSED

 

SMART Attributes Data Structure revision number: 16

Vendor Specific SMART Attributes with Thresholds:

ID# ATTRIBUTE_NAME          FLAG    VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE

  1 Raw_Read_Error_Rate    0x002f  200  200  051    Pre-fail  Always      -      0

  3 Spin_Up_Time            0x0027  163  162  021    Pre-fail  Always      -      6808

  4 Start_Stop_Count        0x0032  100  100  000    Old_age  Always      -      338

  5 Reallocated_Sector_Ct  0x0033  200  200  140    Pre-fail  Always      -      0

  7 Seek_Error_Rate        0x002f  200  200  051    Pre-fail  Always      -      0

  9 Power_On_Hours          0x0032  086  086  000    Old_age  Always      -      10632

10 Spin_Retry_Count        0x0033  100  100  051    Pre-fail  Always      -      0

11 Calibration_Retry_Count 0x0032  100  253  000    Old_age  Always      -      0

12 Power_Cycle_Count      0x0032  100  100  000    Old_age  Always      -      69

184 End-to-End_Error        0x0033  100  100  097    Pre-fail  Always      -      0

187 Reported_Uncorrect      0x0032  100  099  000    Old_age  Always      -      1

188 Command_Timeout        0x0032  100  001  000    Old_age  Always      -      4295098367

190 Airflow_Temperature_Cel 0x0022  074  062  040    Old_age  Always      -      26 (Min/Max 21/33)

192 Power-Off_Retract_Count 0x0032  200  200  000    Old_age  Always      -      39

193 Load_Cycle_Count        0x0032  200  200  000    Old_age  Always      -      299

196 Reallocated_Event_Count 0x0032  200  200  000    Old_age  Always      -      0

197 Current_Pending_Sector  0x0032  200  200  000    Old_age  Always      -      0

198 Offline_Uncorrectable  0x0030  200  200  000    Old_age  Offline      -      0

199 UDMA_CRC_Error_Count    0x0032  200  001  000    Old_age  Always      -      222782

200 Multi_Zone_Error_Rate  0x0008  200  200  000    Old_age  Offline      -      1

 

SMART Error Log Version: 1

No Errors Logged

 

SMART Self-test log structure revision number 1

No self-tests have been logged.  [To run self-tests, use: smartctl -t]

 

 

SMART Selective self-test log data structure revision number 1

SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS

    1        0        0  Not_testing

    2        0        0  Not_testing

    3        0        0  Not_testing

    4        0        0  Not_testing

    5        0        0  Not_testing

Selective self-test flags (0x0):

  After scanning selected spans, do NOT read-scan remainder of disk.

If Selective self-test is pending on power-up, resume after 0 minute delay.

 

 

 

 

SYSLOG (from unmenu)

Aug 10 04:40:01 tower syslogd 1.4.1: restart.

Aug 10 06:52:59 tower emhttp: shcmd (90): ln -sf /usr/share/zoneinfo/Australia/Sydney /etc/localtime-copied-from

Aug 10 06:52:59 tower emhttp: shcmd (91): cp /etc/localtime-copied-from /etc/localtime

Aug 10 06:52:59 tower emhttp: shcmd (92): /etc/rc.d/rc.ntpd restart |& logger

Aug 10 06:52:59 tower logger: Stopping NTP daemon...

Aug 10 06:53:00 tower ntpd[27274]: ntpd [email protected] Sat Apr 24 19:01:14 UTC 2010 (1)

Aug 10 06:53:00 tower logger: Starting NTP daemon:  /usr/sbin/ntpd -g

Aug 10 06:53:00 tower ntpd[27275]: proto: precision = 1.040 usec

Aug 10 06:53:00 tower ntpd[27275]: ntp_io: estimated max descriptors: 1024, initial socket boundary: 16

Aug 10 06:53:00 tower ntpd[27275]: Listen and drop on 0 v4wildcard 0.0.0.0 UDP 123

Aug 10 06:53:00 tower ntpd[27275]: Listen normally on 1 lo 127.0.0.1 UDP 123

Aug 10 06:53:00 tower ntpd[27275]: Listen normally on 2 eth0 192.168.2.44 UDP 123

Aug  9 19:47:51 tower kernel: mdcmd (85): spindown 2

Aug  9 19:48:42 tower crond[1035]: time disparity of -664 minutes detected

Aug  9 19:49:26 tower emhttp: shcmd (93): ln -sf /usr/share/zoneinfo/Australia/Sydney /etc/localtime-copied-from

Aug  9 19:49:26 tower emhttp: shcmd (94): cp /etc/localtime-copied-from /etc/localtime

Aug  9 19:49:26 tower emhttp: shcmd (95): /etc/rc.d/rc.ntpd restart |& logger

Aug  9 19:49:26 tower ntpd[27275]: ntpd exiting on signal 1

Aug  9 19:49:26 tower logger: Stopping NTP daemon...

Aug  9 19:49:27 tower ntpd[27403]: ntpd [email protected] Sat Apr 24 19:01:14 UTC 2010 (1)

Aug  9 19:49:27 tower logger: Starting NTP daemon:  /usr/sbin/ntpd -g

Aug  9 19:49:27 tower ntpd[27404]: proto: precision = 1.040 usec

Aug  9 19:49:27 tower ntpd[27404]: ntp_io: estimated max descriptors: 1024, initial socket boundary: 16

Aug  9 19:49:27 tower ntpd[27404]: Listen and drop on 0 v4wildcard 0.0.0.0 UDP 123

Aug  9 19:49:27 tower ntpd[27404]: Listen normally on 1 lo 127.0.0.1 UDP 123

Aug  9 19:49:27 tower ntpd[27404]: Listen normally on 2 eth0 192.168.2.44 UDP 123

Aug  9 19:53:27 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/mymovies.xml

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/mcm_id__tt0438488-534.dvdid.xml

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop1.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop2.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop3.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop4.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop5.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop6.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop7.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop8.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop9.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop10.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop11.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/Terminator Salvation.mkv

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/mymovies.xml

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/mcm_id__tt0438488-534.dvdid.xml

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop1.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop2.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop3.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop4.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop5.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop6.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop7.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop8.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop9.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop10.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/backdrop11.jpg

Aug  9 19:53:36 tower shfs/user: duplicate object: /mnt/disk2/Videos/Movies/HD Movies/Terminator Salvation/Terminator Salvation.mkv

Aug  9 19:58:42 tower kernel: set_rtc_mmss: can't update from 4 to 58

Aug  9 20:08:38 tower kernel: mdcmd (86): spindown 1

Aug  9 20:09:39 tower kernel: mdcmd (87): spindown 2

 

 

Link to comment

I have been running Unraid 5beta 12 since it came out, with no real compalints, until now.

And to be honest it has me stumped, the transfer rates on my system have dropped through the floor.

Have you tested multiple client machines? Have you checked the network speed of the client machine? It almost looks like you are connected wirelessly instead of wired.
Link to comment

Hi Jonathanm,

 

Thanks for taking the time to respond!

 

Actually i tested the READ from the server with TerraCopy both wired and wireless, and the wireless was 8MBs. But i can understand why you would ask that!

 

I have just done the following test with TerraCopy

Laptop (wired) from tower 9.5MBs

Media center (wired) from tower jumping around between 9.5 - 30MB/s  :o

laptop to media center 10MB/s

 

So the laptop is a problem, will have to address that, but it still does not explain the transfer rates from the Array to the media center dropping off enough for TerraCopy to display a speed change down to 9.5. (it drops down to 9.5 for about 30 seconds)

 

I will go out and get some new CAT6 cables and install them tonight a see what i get.

Any other ideas?

 

Are there any other reports i can run after a copy from the media center (connection that is intermittent ) that will give us some more info?

 

(just so we are clear my current network is all hardwired and is running Gigabit switches. I have wireless but i am hardwired for this, and wireless is disabled on the laptop.)

 

Again thanks for your time.

Link to comment

I have just done the following test with TerraCopy

Laptop (wired) from tower 9.5MBs

Media center (wired) from tower jumping around between 9.5 - 30MB/s  :o

laptop to media center 10MB/s

Can you try a different gigabit switch?

 

As another test, you could assign a static IP to both the laptop and the server, and connect directly from the laptop to the server without the switch.

 

It really sounds like you have a network problem, I don't think the server has anything to do with it.

Link to comment

ok, I brought home a better GB switch from work for the weekend, i will try that in there.

then i will try replacing the old network leads with new ones and see what i get.

 

Also another thing i should have mentioned at the start the server has a static IP.

 

thanks!

Link to comment

ok, I brought home a better GB switch from work for the weekend, i will try that in there.

then i will try replacing the old network leads with new ones and see what i get.

 

Also another thing i should have mentioned at the start the server has a static IP.

 

thanks!

Since the server already has a static IP, set your laptop to a static IP as well, and plug the network cable directly from the server to the laptop and run some transfers.
Link to comment

Ok,

 

Here is the setup.

Media-PC - static IP

UNRaid Tower - static IP

WD Mybook (eth connect version) - dymaic IP

Laptop - static IP

 

GB Ethernet switch in media closet

GB Ethernet Switch in Study

Internet provider modem Cisco EP3925 (gig eth port connected to switch in media closet

 

I tried all the tests below with new cables and on each switch/router to see is something was broken

Nothing was different from switch to switch/router

 

The file i used was a 6GB mkv movies file.

 

to narrow down the list of the culprits i first used a WD MYbook (it is the one with a Ethernet on it)

 

from the WDMYBOOK copied using TerraCopy,

 

to the Media-PC 30-32MB/s  - Verify of that same file with TC ran at 46MB/s

to the laptop 5.8MB/s (with static IP same)

 

I then copied the file to the WDMYBOOK from the Media-PC only getting 17-19MB/s and verify at 13MB/s

 

so, I then copied the same file (but the one on the UNRaid box)

 

From the UNRaid tower /SHARE/ to the laptop 8-9.5MB/s

From the UNRaid tower /DISK/ to the laptop same.

 

From the UnRaid tower /SHARE/ to the Media-PC 35-40MB/s

From the UNRaid tower /Disk/ to the Media-PC same

 

Getting a little frustrated at this point as the problem has disappeared, so i put back everything EXACTLY as it was

(ok, i am coming out. I have a label-er and i like it! everything gets labeled!)

 

Try and recreate the problem and its back up to 30-40MB/s. Now any sane person would quit while they were ahead and go grab a coldie and watch the olympics, but nooooo, no me. I pulled it all apart again and started over. New CAT6 cables all over, neatly tied up and separated from power.

 

The wife thought i had gone mad, muttering to myself and throwing cables over my shoulder as i disassembled the media closet.

 

What do i get for my efforts, other than a nice neat media closet (which is kinda cool on it own) ZIP!

 

 

So is 30-40MB/s read speed acceptable, i am l thinking not.

 

Link to comment

It's unclear how you are copying the files to each computer. Are you physically going to each computer and copying the file over  to it or using one computer as a pass through? Also, which file transfer protocol are you using for each test machine?

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.