JustinChase

Okay, I ended up getting the recommended PCIe card (Intel EXPI9301CTBLK 10/ 100/ 1000Mbps), and a new Gigabit switch (D-Link DGS-1008G 10/100/1000Mbps) which came with no disk/drivers and seems to have been recognized and is working fine. I used brand new cat6a cables also. This is all connected to a U-Verse 100Mbps & wireless G router/modem. all of the computers and my AVR is connected to my switch. I just verified the AVR is only 100Mbps also, so it may get hooked into the modem/router now. anyway, if I connect from my desktop, which is currently using wireless G to connect to the router (then to the switch) and I use Windows Explorer to move files, I get about 800KB/s to 1MB/s speeds. It sometimes starts out much slower, and builds up to that. I installed teracopy, but it gets the same speeds. I added this to the default go script and rebooted #!/bin/bash echo nameserver 192.168.1.254 >/etc/resolv.conf echo 192.168.1.150 media >>/etc/hosts I have set Jumbo frames to 9000, as per the max published by Intel for this card. I had tried with adding some code to change the read ahead to 2048, but that seemed unhelpful, so I removed it, and it seems to have made no difference. I tried copying the same file in Explorer from a computer connected directly to the switch with Gig-e and it was better, 31MB/s. It seems like this could be better, but maybe that's all i can expect. It's a copy of a 16GB mkv movie going from one disk to the other in the same array. it seems like it could go faster, but maybe the parity is the limiting factor. Anyway, is there any way to force these kinds of transfers to not be affected by the computer making the request. it seems if I ask this work to be done from a wireless connection, it goes really slow. from a wired connection, 30X faster. is this avoidable, and is there anything else I should try/do to improve speeds? syslog-2011-10-22.txt

Thanks for the nice guide! I'm a newbie to Linux, so please forgive me if this is a stupid question, but should this stay in the Go script, or does it only need to be run/installed one time, and can be removed after installing?

workgroup is set to workgroup. Should I give it my own name? I changed it to the workgroup name I use in Windows (Home, for example), and after rebooting both machines I can see the "tower" link under "Network" in Windows explorer. Expanding it shows the disks, the shares, and the flash drive; any/all of which I could choose to not show if I wanted.

Did you set the workgroup name under settings/SMB?

I knew there were issues with a realtek driver in the 5.12 beta, but I didn't think they applied to my NIC. whoops Regardless, I'm using 3TB drives, so 4.7 is not an option for me anyway. I'm going to just order a NIC and switch later today, but wanted to ask if there is any reason to prefer PCIe over PCI for the NIC? I have more PIC slots than PCIe, and may want to add another controller card to the PCIe slot someday, so I'm wondering if there's any reason not to order this (also highly recommended) PCI card instead of the highly recommended one linked to above? http://www.newegg.com/Product/Product.aspx?Item=N82E16833106121

Thanks all. Sadly, I don't know where I can pick up and Intel NIC locally, so I'm not going to be able to "fix" this over the weekend Oh well, I'll order an Intel NIC (or 2) and wait. I looked at the recommended NIC's and mine is listed there, so I'm not sure how "trustworthy" that list is "Realtek - RTL8169S, RTL8111B, RTL8111C, probably others too " I'll order a new switch also. I don't expect the jumbo frames to be magic, but every little bit helps, and since I have to replace parts, I suppose it's better to get the most features I can. Is there any way to "test" the NIC to make sure it's "fine"? I may buy the one I mentioned at Fry's and try it, since I could still return it if I know it won't/can't work.

I figured I should make sure my router handles jumbo packets (for streaming HD video), but it doesn't Way to go Cisco! The E3000 turns out to be a hunk of steaming crap! It's got VERY limited range, and seems to not have many common features, so it's up for sale now. I'm thinking about the switch below, to go with the card above. I use AT&T U-Verse, which requires you to use their wireless router anyway, and wireless N on the Cisco was a bust (20% signal one room/30' away), so I'm thinking that just replacing the E3000 with this switch will be more functional than the crappy/useless wireless N that the E3000 (sort of) provides. anyone used, or can comment on this switch, specifically with regards to matching up with the card above? I hate having to throw money at this problem, but I'd rather throw money at it that stab myself in the eye while waiting for the network http://www.frys.com/product/6446942?site=sr:SEARCH:MAIN_RSLT_PG Features and Benefits : 5*10/100/1000Base-T Gigabit Ethernet ports LAN 1, VIP port :high performance priority port for data connections IEEE 802.3x Flow Control for Full Duplex mode Back Pressure for Half Duplex mode Supports Full/Half Duplex in 10M and 100M mode Supports Full Duplex in 1000M mode Supports full wire speed reception and transmission Supports Store-and-forward operation Supports Asus Green Network feature, Link down detection and Cable length detection Supports 1K MAC Addresses Table Supports 832K bits Packet Buffer Memory Supports up to 12KB Jumbo Frames Supports Auto-detection for MDI/MD-X

Okay, thanks for the feedback. I'm very happy to know this is 'fixable' I'm looking at cards at Fry's (so I can pick one up after work) and they don't have any (affordable) intel cards on their site. I saw this Asus (NX1101 Series Gigabit Network Adapter), which shows this as it's feature set... Support IEEE 802.1q VLAN tagging Transmit/Receive FIFO (32K) support Support Wake-on-LAN (WoL) function and remote wake-up Crossover Detection & Auto-Correction 16KB Jumbo Frame Support I've seen some threads on Jubmo Frams Support, and 9000 was mentioned as good, so I'll assume 16000 is also good (better?) I can't find the actual chip information anywhwere, so I'm not sure if this would be compatible with unRAID. Any way to know for sure? They list Linux drivers available, so I think it will be fine, but I'm trying to avoid "sketchy" connections, so if I can't be sure, I'll pass. http://www.asus.com/Networks/Accessories/NX1101/#overview

**click here for final step of solution http://lime-technology.com/forum/index.php?topic=15845.msg149137#msg149137 I just did a search for AlbumArt in a folder on the unRAID server. it found about 3200 files, but it's taken nearly 5 minutes to show me those results, another 5 minutes to resort them, and it's taken another 5 minutes to delete 32.9 MB of data!!!! PLEASE tell me this is not normal. If this is normal (I'm new to unRAID), I'm going to have to find another solution. I'm ready to stab myself in the eye after waiting this long for a TRIVIAL task to get done. 33MB of data, 15 minutes; not cool. How do I fix this? syslog.txt

Apparently I was having issues with a windows share (the other "Recorded TV" folder), not on the unRAID box. so, it seems the fix is still fixing, sorry for the false alarm

I was having permissions issues on a new install, and found the "new permissions" link by poking around, and it took a while to run, but this morning, the file I was having issues with is fine. i was able to delete the file I couldn't delete yesterday. However, I was trying to find out why some recorded TV programs didn't get read by comskip. I thought I'd just change the name, and see if I could trick file watcher into starting it. BUT, I can't change the name, permissions issue I don't imagine I'm supposed to be having to do this fix frequently, so maybe I messed something else up? I'm a brand new user, and the reports of 5b12a were good, so I am running it; never run anything else prior. should I downgrade? I have Hitachi 3TB drives, and other than the above, everything seems great (well, slow network speed, but I've seen tweaks I haven't had a chance to try yet). anyway, other thoughts on the permissions solution?

I would also like to see how to do this please

thanks for the link on moving the files, but I was about 80% done by then. I never found a suitable solution to SyncToy in reading the drive shares, but I'll take a look and see if they were actually the drive shares and not the user shares. if so, I'd love to find a solution to the time it takes (I assume all attempts) to access and read the drives. it does seem to be folder dependent, without any actual evidence to back that up. Anyway, it took 45 hours to preclear, a couple of days work to copy the data back from the external drives. several hours to find the few discrepancies and verify byte to byte duplicates of the data, then another day for parity, then all day today for the parity check. But, I got this... Parity is valid. Last checked on Tue Oct 11 17:25:02 2011 CDT, finding 0 errors. that seems good. I haven't checked any logs, so I could be missing stuff, so if anyone has any suggestions in what to check to triple-check my setup, I'd be happy to do it It's been a long (somewhat stressful) week, but it does feel good to have a working system. I found a post about modifying the go script to change the packet? size. I'll give that a try in a bit, but I'm not wanting to tempt fate too much at this point. Any suggestions on changes/updates worth the effort? thanks again for the help

I restarted everything, and it eventually stabilized at 31MB/s. Seems that's the lower end of "normal" for USB 2.0. Weird thing is that if I start another/simultaneous copy procedure, it will start off at about 18MB/s, then drop down to ~12MB/s over a few minutes, and the original will drop down to ~25MB/s over about 5 minutes, and if a third copy is started, they all end up at about 35MB/s combined. i.e. ~10% faster than an individual transfer. I'm sure there is a reason, I don't know what it might be I'm still copying, and it looks like it will be tomorrow before it's all done. What is a good program/method to verify all is correctly duplicated? I've used SyncToy for years, and it's always done a good job or keeping my files/backups in sync. however, when it tried to read the files on unRAID, it takes FOREVER, in fact I gave up and killed it 3 times after waiting over an hour for a scan that took under 2 minutes on the windows drive. Is there some reason it doesn't like reading from unRAID? Is there anything I can do to 'fix' it? What other program/procedure/method would one use to verify data integrity after the copy?

Is a transfer rate of 4 MB/s a reasonable expectation when moving off of a USB 2.0 connected to windows, thru GB Lan to unRAID?

I clicked on the drive under Main, then changed "Export:" to "Yes (hidden)" and that removed it from view in Windows; excellent. I'm almost ready to start copying data to the shares. I have not added a parity drive to the array yet. Any other tricks to get a usb 2.0 external drive to copy fast and accurately to the unRAID box?

preclear report: - Final SMART section of one drive Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == [b]S.M.A.R.T Final Report for /dev/sda[/b] Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Disk: /dev/sda Oct 7 16:19:57 Storage preclear_disk-diff[7610]: smartctl 5.40 2010-10-16 r3189 [i486-slackware-linux-gnu] (local build) Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: === START OF INFORMATION SECTION === Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Device Model: Hitachi HDS5C3030ALA630 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Serial Number: MJ1323YNG1SUPC Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Firmware Version: MEAOA580 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: User Capacity: 3,000,592,982,016 bytes Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Device is: Not in smartctl database [for details use: -P showall] Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ATA Version is: 8 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ATA Standard is: ATA-8-ACS revision 4 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Local Time is: Fri Oct 7 16:19:53 2011 CDT Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART support is: Available - device has SMART capability. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART support is: Enabled Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: === START OF READ SMART DATA SECTION === Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART overall-health self-assessment test result: PASSED Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: General SMART Values: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Offline data collection status: (0x84)^IOffline data collection activity Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^Iwas suspended by an interrupting command from host. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^IAuto Offline Data Collection: Enabled. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Self-test execution status: ( 0)^IThe previous self-test routine completed Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^Iwithout error or no self-test has ever Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^Ibeen run. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Total time to complete Offline Oct 7 16:19:57 Storage preclear_disk-diff[7610]: data collection: ^I^I (37866) seconds. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Offline data collection Oct 7 16:19:57 Storage preclear_disk-diff[7610]: capabilities: ^I^I^I (0x5b) SMART execute Offline immediate. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^IAuto Offline data collection on/off support. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^ISuspend Offline collection upon new Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^Icommand. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^IOffline surface scan supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^ISelf-test supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^INo Conveyance Self-test supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^ISelective Self-test supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART capabilities: (0x0003)^ISaves SMART data before entering Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^Ipower-saving mode. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^ISupports SMART auto save timer. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Error logging capability: (0x01)^IError logging supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^IGeneral Purpose Logging supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Short self-test routine Oct 7 16:19:57 Storage preclear_disk-diff[7610]: recommended polling time: ^I ( 1) minutes. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Extended self-test routine Oct 7 16:19:57 Storage preclear_disk-diff[7610]: recommended polling time: ^I ( 255) minutes. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SCT capabilities: ^I (0x003d)^ISCT Status supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^ISCT Error Recovery Control supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^ISCT Feature Control supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^ISCT Data Table supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART Attributes Data Structure revision number: 16 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Vendor Specific SMART Attributes with Thresholds: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 1 Raw_Read_Error_Rate 0x000b 100 100 016 Pre-fail Always - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 2 Throughput_Performance 0x0005 134 134 054 Pre-fail Offline - 111 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 3 Spin_Up_Time 0x0007 134 134 024 Pre-fail Always - 501 (Average 538) Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 4 Start_Stop_Count 0x0012 100 100 000 Old_age Always - 25 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 5 Reallocated_Sector_Ct 0x0033 100 100 005 Pre-fail Always - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 7 Seek_Error_Rate 0x000b 100 100 067 Pre-fail Always - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 8 Seek_Time_Performance 0x0005 135 135 020 Pre-fail Offline - 31 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 9 Power_On_Hours 0x0012 100 100 000 Old_age Always - 183 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 10 Spin_Retry_Count 0x0013 100 100 060 Pre-fail Always - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 25 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 30 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 193 Load_Cycle_Count 0x0012 100 100 000 Old_age Always - 30 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 194 Temperature_Celsius 0x0002 166 166 000 Old_age Always - 36 (Min/Max 25/38) Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 196 Reallocated_Event_Count 0x0032 100 100 000 Old_age Always - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 197 Current_Pending_Sector 0x0022 100 100 000 Old_age Always - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 198 Offline_Uncorrectable 0x0008 100 100 000 Old_age Offline - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 199 UDMA_CRC_Error_Count 0x000a 200 200 000 Old_age Always - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART Error Log Version: 1 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: No Errors Logged Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART Self-test log structure revision number 1 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: No self-tests have been logged. [To run self-tests, use: smartctl -t] Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART Selective self-test log data structure revision number 1 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 1 0 0 Not_testing Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 2 0 0 Not_testing Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 3 0 0 Not_testing Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 4 0 0 Not_testing Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 5 0 0 Not_testing Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Selective self-test flags (0x0): Oct 7 16:19:57 Storage preclear_disk-diff[7610]: After scanning selected spans, do NOT read-scan remainder of disk. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: If Selective self-test is pending on power-up, resume after 0 minute delay.

preclear report: - Initial SMART section of one drive Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ========================================================================1.13 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == invoked as: ./preclear_disk.sh -A /dev/sda Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Hitachi HDS5C3030ALA630 MJ1323YNG1SUPC Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Disk /dev/sda has been successfully precleared Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == with a starting sector of 1 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Ran 1 cycle Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Using :Read block size = 8225280 Bytes Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Last Cycle's Pre Read Time : 10:33:01 (79 MB/s) Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Last Cycle's Zeroing time : 12:32:12 (66 MB/s) Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Last Cycle's Post Read Time : 20:47:52 (40 MB/s) Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Last Cycle's Total Time : 43:54:17 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Total Elapsed Time 43:54:17 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Disk Start Temperature: 34C Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Current Disk Temperature: 36C, Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ============================================================================ Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ** Changed attributes in files: /tmp/smart_start_sda /tmp/smart_finish_sda Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ATTRIBUTE NEW_VAL OLD_VAL FAILURE_THRESHOLD STATUS RAW_VALUE Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Temperature_Celsius = 166 176 0 ok 36 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: No SMART attributes are FAILING_NOW Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 0 sectors were pending re-allocation before the start of the preclear. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 0 sectors were pending re-allocation after pre-read in cycle 1 of 1. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 0 sectors were pending re-allocation after zero of disk in cycle 1 of 1. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 0 sectors are pending re-allocation at the end of the preclear, Oct 7 16:19:57 Storage preclear_disk-diff[7610]: the number of sectors pending re-allocation did not change. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 0 sectors had been re-allocated before the start of the preclear. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 0 sectors are re-allocated at the end of the preclear, Oct 7 16:19:57 Storage preclear_disk-diff[7610]: the number of sectors re-allocated did not change. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ============================================================================ Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ============================================================================ Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == [b]S.M.A.R.T Initial Report for /dev/sda [/b] Oct 7 16:19:57 Storage preclear_disk-diff[7610]: == Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Disk: /dev/sda Oct 7 16:19:57 Storage preclear_disk-diff[7610]: smartctl 5.40 2010-10-16 r3189 [i486-slackware-linux-gnu] (local build) Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: === START OF INFORMATION SECTION === Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Device Model: Hitachi HDS5C3030ALA630 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Serial Number: MJ1323YNG1SUPC Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Firmware Version: MEAOA580 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: User Capacity: 3,000,592,982,016 bytes Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Device is: Not in smartctl database [for details use: -P showall] Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ATA Version is: 8 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ATA Standard is: ATA-8-ACS revision 4 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Local Time is: Wed Oct 5 20:25:37 2011 CDT Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART support is: Available - device has SMART capability. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART support is: Enabled Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: === START OF READ SMART DATA SECTION === Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART overall-health self-assessment test result: PASSED Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: General SMART Values: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Offline data collection status: (0x80)^IOffline data collection activity Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^Iwas never started. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^IAuto Offline Data Collection: Enabled. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Self-test execution status: ( 0)^IThe previous self-test routine completed Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^Iwithout error or no self-test has ever Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^Ibeen run. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Total time to complete Offline Oct 7 16:19:57 Storage preclear_disk-diff[7610]: data collection: ^I^I (37866) seconds. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Offline data collection Oct 7 16:19:57 Storage preclear_disk-diff[7610]: capabilities: ^I^I^I (0x5b) SMART execute Offline immediate. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^IAuto Offline data collection on/off support. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^ISuspend Offline collection upon new Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^Icommand. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^IOffline surface scan supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^ISelf-test supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^INo Conveyance Self-test supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^ISelective Self-test supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART capabilities: (0x0003)^ISaves SMART data before entering Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^Ipower-saving mode. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^ISupports SMART auto save timer. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Error logging capability: (0x01)^IError logging supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^IGeneral Purpose Logging supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Short self-test routine Oct 7 16:19:57 Storage preclear_disk-diff[7610]: recommended polling time: ^I ( 1) minutes. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Extended self-test routine Oct 7 16:19:57 Storage preclear_disk-diff[7610]: recommended polling time: ^I ( 255) minutes. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SCT capabilities: ^I (0x003d)^ISCT Status supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^ISCT Error Recovery Control supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^ISCT Feature Control supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ^I^I^I^I^ISCT Data Table supported. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART Attributes Data Structure revision number: 16 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Vendor Specific SMART Attributes with Thresholds: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 1 Raw_Read_Error_Rate 0x000b 100 100 016 Pre-fail Always - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 2 Throughput_Performance 0x0005 134 134 054 Pre-fail Offline - 111 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 3 Spin_Up_Time 0x0007 134 134 024 Pre-fail Always - 501 (Average 538) Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 4 Start_Stop_Count 0x0012 100 100 000 Old_age Always - 25 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 5 Reallocated_Sector_Ct 0x0033 100 100 005 Pre-fail Always - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 7 Seek_Error_Rate 0x000b 100 100 067 Pre-fail Always - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 8 Seek_Time_Performance 0x0005 135 135 020 Pre-fail Offline - 31 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 9 Power_On_Hours 0x0012 100 100 000 Old_age Always - 139 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 10 Spin_Retry_Count 0x0013 100 100 060 Pre-fail Always - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 25 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 30 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 193 Load_Cycle_Count 0x0012 100 100 000 Old_age Always - 30 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 194 Temperature_Celsius 0x0002 176 176 000 Old_age Always - 34 (Min/Max 25/38) Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 196 Reallocated_Event_Count 0x0032 100 100 000 Old_age Always - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 197 Current_Pending_Sector 0x0022 100 100 000 Old_age Always - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 198 Offline_Uncorrectable 0x0008 100 100 000 Old_age Offline - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 199 UDMA_CRC_Error_Count 0x000a 200 200 000 Old_age Always - 0 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART Error Log Version: 1 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: No Errors Logged Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART Self-test log structure revision number 1 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: No self-tests have been logged. [To run self-tests, use: smartctl -t] Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SMART Selective self-test log data structure revision number 1 Oct 7 16:19:57 Storage preclear_disk-diff[7610]: SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 1 0 0 Not_testing Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 2 0 0 Not_testing Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 3 0 0 Not_testing Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 4 0 0 Not_testing Oct 7 16:19:57 Storage preclear_disk-diff[7610]: 5 0 0 Not_testing Oct 7 16:19:57 Storage preclear_disk-diff[7610]: Selective self-test flags (0x0): Oct 7 16:19:57 Storage preclear_disk-diff[7610]: After scanning selected spans, do NOT read-scan remainder of disk. Oct 7 16:19:57 Storage preclear_disk-diff[7610]: If Selective self-test is pending on power-up, resume after 0 minute delay.

Hi all. I'm a new user, and trying to get started. I've got the box built, and preclearing of 4 brand new drives finished last night. no errors reported, but my report is below, in case it needs to be reviewed. I precleared (4) 3TB drives, and it took about 45 hours! I was thinking closer to 30, but such is life. I noticed my read speeds kept getting slower over time. I assume this is because it starts from the outside of this disk and moves towards the center, which would go slower. however, this is just a guess I then added 2 of the disks to the array, then formatted them. All okay so far, I think. I then tried adding users, and discovered that they must be all lower case; okay, fixed. I then tried adding user shares. It would not accept them/allow it to be setup. I messed around a bit, then discovered that I had to go to the "Settings" tab (I had already set it to "yes"), then I also had to add the disk#s to "Included disk(s)". I tried adding them to the "User share" setup screen, that didn't work Now, I have finally added a "video" share, and I didn't specify to include, nor exclude any drives from the User share setup screen, and then it setup the share. Okay, progress. I went into windows to see if the share was visible, and it is!! Both disk1 and disk2 show a video folder on them. However, disk1 and disk2 being visible is not what I'd like. I have no desire to share these disks directly to windows. I ONLY want to allow/show the user shares. I don't want to deal directly with the drives themselves in windows, I really only want to see the shares. Is this possible? how? Also, while I'm at it, how is my logic in establishing the shares? I'm sure many of you have years using unRAID, and have tried lots of things that didn't work so well, and can maybe save me from silly mistakes. I should mention that I have read up on unRAID for HOURS on end (it took 45 hours to preclear, what do you think I did with much of that time waiting?), and have found LOTS of great information, but it all kind of runs together until you actually get to put it to work, which I'm now starting to do. Okay, here is how I had the RAID5 setup Backup (80GB) *Drivers *HTPC Tools *Calibration *Codecs-Filters-Utilities *Programs Documents (2GB) *Books *Comedy *Manuals Music (375GB) *Podcasts *to be cleaned Photos (70GB) *Adult *to be cleaned *Comedy *Traveling *Canada *Mexico *Baja *Geurrero *Panama Recorded TV (size varies, will likely use a 2-500gb drive, only for DVR) Videos (2TB) *Adult *Comedy *Documentaries *Formula 1 *Season *Movies *Television The only compelling reason I can think of to try to keep Documents or Music all on one physical drive, is just to use the one drive upon playback, saving energy vs. spinning up more drives. As far as structure, or finding something later, it makes little difference which drive the actual file is sitting on, correct? Is there any other reason, or thoughts on if I should care much about including or excluding drives to/from user shares? I know little about the mechanics of disk storage, but it seems I'd be better balancing the data across drives, vs. putting most/all on one drive until it's mostly full. Assuming I run into no major issues with unRAID, i see no reason to ever do anything but add/exchange for larger drives, all of which is handled by unRAID, so the physical location seems less important. However, the playback reason does warrant some consideration. Movies is the bulk of the storage, and probably should span multiple drives (only 2 for now), but as a guide suggested, set the split to keep all files of a movie together. I believe that's a split level 2 for my example above, or does that not let the movies folder be split, forcing movies and everything under it to stay on one drive, which I do not want? I figure I'll only include disk1 for Music, and only include disk2 for all the other main folders/shares. But, is this a good idea, or not? Is there a way to 'prefer' they stay on those disks, but if they need room to expand they 'could' move onto another disk? If so, how? Finally, how do I handle permissions for subfolders of the shares? I want to share all photos and videos, except one subfolder under each. *I* want access to that subfolder, but I don't want guests/others to have access. Specifically, I don't want them visible in windows on my network. thanks in advance for any help/guidance. I'm also trying to finish up the "my build" post I started, but now that preclearing is done, I'm focused on the shares and getting my data off of 2 external drives afap.

Excellent answer. It stopped any further time being invested in finding it I actually have all the data copied onto 2 2TB external drives, and it's still in tact on the original RAID array. Now that our visiting company has safely returned to their homes, I have finished disassembling the old HTPC and put much of those parts into the new box (and built 2 other computers) and I have confirmed that unRAID loads from the thumb drive I have. Good news. It sees the 4 drives from the existing RAID5 array, and sees that there are (the 3TB new) drives, but cannot access them, not surprisingly. I assume this is due to it not liking the HighPoint RocketRAID 640 card. Windows also doesn't see it/them either, and I haven't tried updating any drivers yet. I see plenty of drivers offered for it, and will install the windows drivers later this evening. There are BIOS drivers also, but I imagine they have some BIOS installed, so i'll not worry about that for now. http://www.highpoint-tech.cn/BIOS_Driver/page/rr640.htm As for Linux, there is an "Open Source driver" that "Supports Linux Kernel v2.4.x and v2.6.x ( x86 and x86_64)" and there are installers for 6 flavors of Linux, Mac and FreeDSB. i hope one of those can be used to get this card working on unRAID. I've read just a little so far, but I've seen "recompile Linux" mentioned a few times. I have ZERO experience with this, but I'm sure I could learn. I doubt it's worth it to me vs. getting a recommended card instead, but maybe some day. For now, I'm wondering how to even attempt to install any of the drivers for any of the flavors, or what my next step in unRAID is should the windows driver and/or BIOS install not magically resolve my issue, which I don't expect? I built, setup and "managed" a Linux mail server about 10 years ago, but remember little of Linux, so I'm still trying to learn what I need to learn, so sorry for any stupid questions. I've also read about setting up other RocketRaid cards, and I'm going to try this, if possible on this card also, but then I'm about out of ideas on what I might try next, if necessary. Any suggestions will be welcome, and I'll report back my progress as soon as I have something to report

Yeah, I figured that. I know the systems are different, and suspect it cannot be done either. However, I asked on another forum and was told it might be possible and to post here to see if anyone had any ideas on how it could be done. What I had imagined is to put all the hardware in the unRAID box, including the current boot drive, then install unRAID off the thumb drive, format (preclear?) only the new drives, then reboot into windows, access the RAID5 array, then copy to the new drives, but I don't know if unRAID will see the data properly (or more likely, Windows won't see the unRAID drives properly) if I do could it this way , since I believe they are formatted differently. I don't know anything close to sufficient about LINUX to know if there is a way to use unRAID to grab the data off the RAID5 array, since I think it requires the Intel Matrix Array to be running to understand the indexing. Again, I'm assuming it can't work, but hope there's a way I'm not seeing that will save me the extra copy step, and I could also avoid USB 2.0 speeds to copy 3TB of data; twice

I'm a complete noob to unRAID, but i did try searching, but didn't find a relevant answer, so... I'm currently using the Intel Matrix Raid array for my RAID5 in my HTPC. I've got 4 1TB drives, mostly full now. I plan to use this same motherboard in the unRAID box I'm building, along with the processor, memory and video card (temporarily until I can remote in, then I'll sell the video card). I have 4 4TB drives to install in the unRAID box to get it started, and will eventually add the 1TB drives, and some others I have. The question is; is there any way to keep the current RAID5 intact, and transfer the data to the unRAID system directly? I don't want to have to copy 2.75 TB of data to external drives, then copy back to the unRAID box if it's avoidable. I'm thinking that it's not going to be possible, but figured I'd ask here before I give up entirely. I don't know if would be possible to do some kind of dual-boot to keep the windows7 ability to see/use the Intel RAID, or if it’s possible some other way. I suppose I could build the unRAID on a different motherboard to keep the drives separated and transfer over the network, then rebuild it on the correct motherboard after the data is all copied. I hope that makes sense, and appreciate any feedback/guidance/help you can provide. Box will contain the following parts, and I’m expecting to purchase the PRO license… Motherboard Foxconn ELA LGA 775 Intel G33 ATX Intel Motherboard Processor Intel Pentium E5200 Wolfdale 2.5GHz 2MB L2 Cache LGA 775 65W Dual-Core Cooler Rosewill RCX-Z300 92mm Ball CPU Cooler Memory Patriot Viper 4GB (2 x 2GB) 240-Pin DDR2 800 (PC2 6400) Current Hard Drives (4) Samsung Spinpoint F1 1TB 7200 RPM 16MB Cache SATA 3.0Gb/s 3.5" Internal Hard Drives (4) Hitachi Deskstar 3TB 5400 RPM 32MB Cache SATA 6.0Gb/s 3.5" Internal Case Rosewill RSV-L4000 Black Metal / Steel, 1.0 mm thickness, 4U Rackmount Server Chassis 8 Internal Bays, 7 Included Cooling Fans Power Supply XFX Core Edition PRO550W ATX12V 2.2 & ESP12V 2.91 SLI Ready CrossFire Ready 80 PLUS BRONZE Certified Active PFC SATA card HighPoint RocketRAID 640 PCI-Express 2.0 x4 SATA III (6.0Gb/s) Controller Card