AndrewT

I ran reiserfsck on all disks and each indicates "No corruptions found" (attached) Any other ideas for why the mover script is crashing unRAID? This is quite troubling. reiserfsck.txt

I ran reiserfsck --check /dev/sde1 (on my cache drive) and output is in my 1st post, which looks like the cache drive is okay? Are you suggesting disks in the array might be screwed up, causing the mover to fail?

Thanks for the link. I had many shares on many disks with extended attributes which were removed. I verified these were removed with the rmattrs script again by using getfattr -d I then invoked the mover script with the webGUI and again unRAID crashed. When I restart, the parity check indicates 0 errors. Running getfattr -d on the "DC" share for each disk again shows extended attributes for the same disks (2, 3, 5, 6, 7, and 10) despite me never mounting the shares after rmattrs removed them. I've collected syslogs of the crashes, because I've tried this now a few times with the same result -- unRAID crashes within just a few minutes of mover. There's more than just the "DC" and "Movies" directories to be moved with file contents, but only on the 3rd crash did it even get as far as trying some Movies. I have attached 3 syslogs. crash1.txt crash2.txt crash3.txt.zip

I run many plugins (see my signature). Only because of running a virtual machine did I need to upgrade from 4GB to 8GB of ram. I use the "Stats" tab in the Dynamix WebGUI to see how much ram I'm using and I'm always surprised how little I actually use (<4GB) when not running a virtual machine with 4GB ram.

Is there a way to identify which files will cause mover to crash? A directory containing a series of tarballs were being added to the Cache disk (ultimately destined for a share on the array) when I invoked the mover script -- yes, stupid. I suspect these files are the cause of mover now crashing unRAID when I invoke the mover script. I deleted the whole directory, but mover still crashes unRAID. I ran a SMART extended test and reiserfsck on the cache disk, neither had anything that stood out to me as an erroneous disk. ~~~~~~~~~~ Background ~~~~~~~~~~ For a long time I've used my Cache disk exclusively for running apps, but I recently changed most of my shares to Use cache disk: Yes I have ~1.3 TB of data on my Cache disk that needs to be transferred to different shares. Based on this size, my guess is the mover never has ran properly in the past month or so. With Dynamix WebGui v2.2.6 (latest version) running, I selected "Move now" to invoke the mover script under Main -> Array Operation. The WebGui then shows "moving now..." but ends up freezing unRAID. By freezing I mean the WebGui is non-responsive, I cannot telnet in, and when I plug in a keyboard and monitor I cannot even see text to copy the syslog onto the flash drive. The keyboard numlock LED doesn't turn green, so it seems the whole unRAID OS is crashed. I waited 5 days thinking the mover might somehow still complete and then had to do a hard shutoff by holding the power button. Immediately after turning back on and booting up, the parity check had 0 errors. I again tried to invoke the mover and unRAID crashed again. Finally, I watched the syslog as I invoked mover on the webGUI one more time with: tail -f --lines=100 /var/log/syslog This is the syslog output: Aug 15 18:34:01 Tower crond[1228]: exit status 1 from user root /usr/lib/sa/sa1 1 1 & 1>/dev/null 2>&1 Aug 15 18:34:01 Tower kernel: crond[14017]: segfault at 4001e51c ip 4001e51c sp bfccc064 error 15 in ld-2.11.1.so[4001e000+1000] Aug 15 18:35:01 Tower crond[1228]: exit status 1 from user root /usr/lib/sa/sa1 1 1 & 1>/dev/null 2>&1 Aug 15 18:35:01 Tower kernel: crond[15264]: segfault at 4001e51c ip 4001e51c sp bfccc064 error 15 in ld-2.11.1.so[4001e000+1000] Aug 15 18:35:17 Tower emhttp: shcmd (605): /usr/local/sbin/mover |& logger & Aug 15 18:35:17 Tower logger: mover started Aug 15 18:35:17 Tower logger: skipping CompletedDownloads/ Aug 15 18:35:17 Tower logger: moving DC/ Aug 15 18:35:17 Tower logger: ./DC/._Frosty the Snowman (1969) Aug 15 18:35:17 Tower logger: .d..t...... ./ Aug 15 18:35:17 Tower logger: rsync: get_xattr_names: llistxattr("DC",1024) failed: Input/output error (5) Aug 15 18:35:18 Tower logger: .d..t.....x DC/ Aug 15 18:35:18 Tower logger: >f......... DC/._Frosty the Snowman (1969) Aug 15 18:35:18 Tower logger: rsync: get_xattr_names: llistxattr("DC",1024) failed: Input/output error (5) Aug 15 18:35:18 Tower logger: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7] Aug 15 18:35:18 Tower logger: ./DC/The Roots of the Matrix/VIDEO_TS/VTS_01_0.BUP Aug 15 18:35:18 Tower logger: .d..t...... ./ Aug 15 18:35:18 Tower logger: rsync: get_xattr_names: llistxattr("DC",1024) failed: Input/output error (5) Aug 15 18:35:18 Tower logger: .d..t.....x DC/ Aug 15 18:35:18 Tower logger: .d..t...... DC/The Roots of the Matrix/VIDEO_TS/ Aug 15 18:35:18 Tower logger: >f......... DC/The Roots of the Matrix/VIDEO_TS/VTS_01_0.BUP Aug 15 18:35:18 Tower logger: rsync: get_xattr_names: llistxattr("DC",1024) failed: Input/output error (5) Aug 15 18:35:18 Tower logger: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7] Aug 15 18:35:18 Tower logger: ./DC/The Roots of the Matrix/VIDEO_TS/VTS_01_0.IFO Aug 15 18:35:18 Tower logger: .d..t...... ./ Aug 15 18:35:18 Tower logger: rsync: get_xattr_names: llistxattr("DC",1024) failed: Input/output error (5) Aug 15 18:35:18 Tower logger: .d..t.....x DC/ Aug 15 18:35:18 Tower logger: >f......... DC/The Roots of the Matrix/VIDEO_TS/VTS_01_0.IFO Aug 15 18:35:18 Tower logger: rsync: get_xattr_names: llistxattr("DC",1024) failed: Input/output error (5) Aug 15 18:35:18 Tower logger: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7] Aug 15 18:35:18 Tower logger: ./DC/The Roots of the Matrix/VIDEO_TS/VTS_01_0.VOB Aug 15 18:35:18 Tower logger: .d..t...... ./ Aug 15 18:35:18 Tower logger: rsync: get_xattr_names: llistxattr("DC",1024) failed: Input/output error (5) Aug 15 18:35:18 Tower logger: .d..t.....x DC/ Aug 15 18:35:18 Tower logger: >f......... DC/The Roots of the Matrix/VIDEO_TS/VTS_01_0.VOB Aug 15 18:35:21 Tower logger: rsync: get_xattr_names: llistxattr("DC",1024) failed: Input/output error (5) Aug 15 18:35:21 Tower logger: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7] Aug 15 18:35:21 Tower logger: ./DC/The Roots of the Matrix/VIDEO_TS/VTS_01_1.VOB Aug 15 18:35:21 Tower logger: .d..t...... ./ Aug 15 18:35:21 Tower kernel: ------------[ cut here ]------------ Aug 15 18:35:21 Tower kernel: kernel BUG at mm/slub.c:3409! Aug 15 18:35:21 Tower kernel: invalid opcode: 0000 [#1] SMP Aug 15 18:35:21 Tower kernel: Modules linked in: md_mod sg acpi_cpufreq mperf r8168(O) fam15h_power atiixp i2c_piix4 i2c_core k10temp hwmon sata_sil24 mvsas libsas scsi_transport_sas ahci libahc reiserfsck --check /dev/sde1 reiserfsck 3.6.24 Will read-only check consistency of the filesystem on /dev/sde1 Will put log info to 'stdout' Do you want to run this program?[N/Yes] (note need to type Yes if you do):Yes ########### reiserfsck --check started at Fri Aug 15 17:53:09 2014 ########### Replaying journal: Done. Reiserfs journal '/dev/sde1' in blocks [18..8211]: 0 transactions replayed Checking internal tree.. finished Comparing bitmaps..finished Checking Semantic tree: finished No corruptions found There are on the filesystem: Leaves 388567 Internal nodes 2572 Directories 763024 Other files 397427 Data block pointers 303639590 (3027182 of them are zero) Safe links 0 ########### reiserfsck finished at Fri Aug 15 18:19:37 2014 ###########

I am now in the process of rebuilding the array with the new disk (plugins disabled). Is a follow-up parity check the way to confirm all files are recovered perfectly?

I do have a 1-pass precleared disk (same 2 TB size) I want to add for array expansion but am apprehensive to swap it out and rebuild the array with the help of the parity disk. I have ~1.2 TB of files (not backed up anywhere else) on my cache drive that need to go onto the array and whenever I invoke the mover script unRAID goes completely unresponsive/crashed. Even the monitor plugged into the server goes blank and keyboard can't revive it to grab a syslog. I'm fairly certain the crash is because I invoked the mover while adding a large directory of tarballs (yes, stupid). I deleted that partial directory off the cache disk but am waiting to try to move the important files on the cache until the red ball disk goes back to green.

**EDIT**: syslog attached My disk7 (sdh) shows a red ball after I restarted unRAID. I followed the Troublshooting section on obtaining smart reports-- first short which didn't seem to show anything, then the long report. Any idea why it went to a red disk or what's wrong with the drive? It's about a 2 year old drive, so I didn't expect this just yet. I wish I logged it, but I think this disk once before went red after a restart and I just restarted again and it went to green. The Troubleshooting documentation indicates "it is NEVER a fluke" to turn red, so I'm unsure what to do. SMART REPORT: smartctl 6.2 2013-07-26 r3841 [i686-linux-3.9.11p-unRAID] (local build) Copyright © 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Family: Western Digital Caviar Green (AF) Device Model: WDC WD20EARS-00MVWB0 Firmware Version: 51.0AB51 User Capacity: 2,000,398,934,016 bytes [2.00 TB] Sector Size: 512 bytes logical/physical Device is: In smartctl database [for details use: -P show] ATA Version is: ATA8-ACS (minor revision not indicated) SATA Version is: SATA 2.6, 3.0 Gb/s Local Time is: Tue Aug 12 13:29:17 2014 EDT SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x84) Offline data collection activity was suspended by an interrupting command from host. Auto Offline Data Collection: Enabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: (39000) seconds. Offline data collection capabilities: (0x7b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. Short self-test routine recommended polling time: ( 2) minutes. Extended self-test routine recommended polling time: ( 376) minutes. Conveyance self-test routine recommended polling time: ( 5) minutes. SCT capabilities: (0x3035) SCT Status supported. SCT Feature Control supported. SCT Data Table supported. SMART Attributes Data Structure revision number: 16 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 0 3 Spin_Up_Time 0x0027 219 156 021 Pre-fail Always - 4033 4 Start_Stop_Count 0x0032 096 096 000 Old_age Always - 4628 5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0 7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 0 9 Power_On_Hours 0x0032 076 076 000 Old_age Always - 17982 10 Spin_Retry_Count 0x0032 100 100 000 Old_age Always - 0 11 Calibration_Retry_Count 0x0032 100 100 000 Old_age Always - 0 12 Power_Cycle_Count 0x0032 099 099 000 Old_age Always - 1943 192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age Always - 97 193 Load_Cycle_Count 0x0032 173 173 000 Old_age Always - 81372 194 Temperature_Celsius 0x0022 118 083 000 Old_age Always - 32 196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0 197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0030 200 200 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0 200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 0 SMART Error Log Version: 1 No Errors Logged SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Extended offline Completed without error 00% 17964 - # 2 Short offline Completed without error 00% 17958 - SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay. syslog_RedBall_after_reboot.txt.zip

How do you go about upgrading from SD files to HD? Do you get rid of the SD files? In the case of Movies using CouchPotato, under Settings -> Renamer: <thename> (<year>) <quality>.<ext> will allow you to have 720P and 480P saved in the same Movie Title directory. For more than a year I only grabbed SD quality, because I was trying to conserve disk space. More recently, I have gone back to get 720P movies now, which has dramatically increased my array size. I could imagine 1080P quality movies and TV shows would fill up an array quickly. Getting rid of the SD files in my opinion only becomes necessary once your array is filled (which mine is not) although removing all *480P.* files in the Movies share wouldn't be too hard to execute recursively.

Has anyone recently noticed a problem with CP finding correct movies on Spotweb? In the attached screenshot, you'll notice it's pulling several movies (with different tt### corresponding to IMDB unique movie identifier #s) while grabbing the same NZB file that has nothing to do with the movie. I've let it go through and it really is the identical movie, in this case Life of Pi, downloaded over and over again despite having different tt## tags at the end of it. FWIW, I also have "Detect Duplicate Downloads: Discard" in SAB. It seems there's something going on incorrectly with CP searching and tagging NZB files from Spotweb. I do have Life of Pi on my CP Wanted list, but it still does not show any NZB has been found much less snatched/sent to SAB. I just updated CouchPotato + SAB and this started happening. Spotweb is the same version as a few months ago installed according the instructions described in this thread. edit: CP actually uses the tt## tag to post-process which results in several different movies tagged incorrectly. Last night I thought I was going to watch a Comedy/Romance movie and it turned out to be The Collector instead(!).

Our phpVbox leader Lanie can affirm, but you have both described the two different approaches to get the install up and running. Either fix the root unraid user/pw or comment the prompt out altogether.

I ran v5 with all of these plugins with 1x4GB ram stick without *ever* having unraid act suspiciously slow, muchless crash on me. I never tried the v4.7 OS. The only reason I added a second 4GB stick was because I've been trying out different OSes (just for fun) on phpVirtualBox and started trying out Newznab. If Nmatrix were still around, I'd only be checking on it once every couple weeks. I also run all apps in the /mnt/cache/.apps/ directory, which seems quite common for organization. I'd strongly recommend updating to the v5 unraid... it's here to stay (for quite awhile anyways). Two things you really need to know about it is to run everything you can (apps and file transfers) as the 'nobody' user instead of 'root' to avoid permissions issues and that # installplg pluginname.plg installs the plugins for v5 you find (no unMenu needed).

I would love to only check on my unraid array once a month (as a reasonable goal), and I think automatic emails when drives fail is a major essential component missing to the stock unraid OS to give users the piece of mind. I think the 64-bit unraid OS is an excellent opportunity to poll the user community what should be added. Certainly those with 64-bit processors would have increased hardware performance to handle a few added packages and draw in some new users with attractive features. All that being said, I am very happy with the current v5 unraid OS as-is. Without the knowledgeable and helpful community though, I'm not sure I would've ever considered unraid.

If you wanted to build something more powerful you wouldn't necessarily need to buy a huge rackmount server case ($$$). You'd probably just want a new mobo, cpu, and ram. If you reuse everything else to save money such as the SYBA SATA cards, PSU, and case, you could save quite a bit. If it were me, I'd wait several months before making an upgrade based on newznab requirements to make sure you're really happy with it and see using/maintaining it long-term.

It seems either physically separating unraid from another server running apps or running both in the same box with ESXI, you'll need to have all of these apps automatically add files into the unraid array (e.g., to provide updated TV shows or something). I'm not sure how to have the array shares automatically mount in either scenario, but given that you're using multiple apps, this might be an important consideration. You mention money is of consideration, so if your other motherboard can be upgraded to something like 8 or 16GB of DDR3 ram, I'd lean towards ESXI in one case. With the Gigabyte EP45-UD3LR mobo, DDR2 ram prices aren't worth an ESXI build, which would then require selling both to fund a new mobo with cheaper DDR3 ram.

I'm trying to setup the DNS Server using the /boot/extra/simpleFeatures.dns.server-1.0.5-i486-1.tgz In the unraid webGUI under Network Services, there are many options and I'm not sure how to set this up. I have a few different addresses that I'd like to have as local-only Newznab on http://192.168.0.30:8882 (unraid static IP running Newznab on port 8882 with the SFwebserver) Spotweb on http://192.168.0.30:8884 (unraid static IP running Spotweb on port 8882 with the SFwebserver) with the overall goal of having working web addresses I can put into Sickbeard and Couchpotato for these to work as advised/described elsewhere: http://lime-technology.com/forum/index.php?topic=24676.msg222592#msg222592

Try this (This will work with most of the ansi/vt100/xterm terminal emulations): echo -n -e "\033[H\033[2J" you could create an alias in your script or in your execution profile, but depending on how you invoke your script, and where you define the alias, it might/might-not be available in the script. alias clear='echo -n -e "\033[H\033[2J"' Wow, you've gotta be kidding me! I am so happy to have this (now saved and archived away). I have no idea how from the above command one might remember it as 'clear' but it's impressive some of you somehow make sense of it.

The website looks great and will be very useful, so thank you!

I wanted to say thank you to lainie, nars, and dnoyeb for their help. I got the phpVirtualBox working and am super excited!! I had to do the modified series of commands dnoyeb mentioned in I actually only ran the last lines and at the time I was in root not the vbox directory. It seemed several times people mentioned modifying the config.php file, but somehow I was under the impression I could get it working then worry about modifying it. To be clear any new users, you *must* edit this file (be to just do it with vi editor if using Windows+Putty) or you will not be able to access the phpvbox. I was confused because the phpvbox also has a user and password (admin / admin) but you must enter the unraid username and password into the config.php file. For example, if your user is "root" and password is "MoreSecureThanThis" (without quotes), this should appear in the file at the top: /* Username / Password for system user that runs VirtualBox */ var $username = 'root'; var $password = 'MoreSecureThanThis'; after modifying this file and executing the above 3 commands starting with vbox, everything worked

I haven't restarted or shutdown my server in several months, and I need to add a stick of ram today, so I went to powerdown the box by using the keyboard and monitor connected to it. I have installed several plugins on 5.0-rc8a since my last restart or shutdown including simplefeatures as well as a mysql database (used for xbmc). My system will not halt as is hanging with the following information below. This is in my syslog following the shutdown command: Dec 31 11:51:18 Tower shutdown[23034]: shutting down for system halt Dec 31 11:52:10 Tower init: Switching to runlevel: 0 Dec 31 11:52:18 Tower init: no more processes left in this runlevel Dec 31 11:55:59 Tower kernel: scsi_verify_blk_ioctl: 36 callbacks suppressed Dec 31 11:55:59 Tower kernel: hdparm: sending ioctl 2285 to a partition! Dec 31 11:56:04 Tower last message repeated 5 times Dec 31 11:56:04 Tower kernel: smartctl: sending ioctl 2285 to a partition! ------------------------------ ------------------------------ ------------------------------ root@Tower:~# shutdown - h now Broadcast message from root (tty1) (Mon Dec 31 11:51:18 2012) The system is going down for the system halt NOW! INIT: Switching to runlevel : 0 INIT: Sending processes the TERM signal INIT: Sending processes the KILL signal Running shutdown script /etc/rc.d/rc.0: Saving system time to the hardware clock (UTC). ERROR! MySQL server PID file coudl not be found! INIT: no more processes left in this runlevel

AFP Share Secure Settings Export: Yes Security: Public TimeMachine volume size limit: (Empty) No, the ATV just connects to password protected Wi-Fi. I know this is not the issue because when I use the Zeroconf Browser, I can actually navigate through the unRAID "Tower" shares. For ATV1 only, XBMC runs as an application within the Mac OS, so XBMC only needs to mount the actual AFP Share/Directory.

I've done two things in the past week or so (1) upgrade the OS from 5.0rc-3 to 5.0-rc8a and (2) run the "New Permissions" process under the unRAID webGUI "Utils" because I accidentally moved a handful of movies as root and couldn't access them as 'nobody' user. Now I cannot even play TV show episodes anymore on the ATV1/XBMC. I believe the AFP is working fine to access the unRAID server, because I can mount and play TV episodes on my Mac Pro desktop running Mountain Lion by: Go -> Connect to Server ... -> Server Address: afp://10.0.1.30/TV -> Connect -> Registered Name: nobody Password: (left blank) -> OK -> mounts drive but takes ~1 min to load all of the folders, but again I can play all the episodes. Interestingly, the Server Address: afp://Tower._afpovertcp._tcp.local/TV also works with the Mac Pro. Also, when telnetting in as root with Putty, I can see the permissions is set to the username "nobody" part of the "users" usergroup by executing # ls -l when I'm in the /mtn/user/TV/ user share directory. e.g., root@Tower:~# drwxrwx--- 1 nobody users 576 2012-09-16 14:07 Breaking\ Bad/root@Tower:/mnt/user/TV# drwxrwx--- 1 nobody users 576 2012-09-16 14:07 Breaking\ Bad/ When I use my Apple TV 1 running XBMC, I for some reason cannot gain proper permissions to open/play the episode files with this approach: 1-arrow to the right on the TV Shows main menu, select Files. 2-select “Add Videos…”, select “Browse”, arrow down and select “Zeroconf Browser” 3-locate the name of your unRaid server, e.g., “Tower (AFP)” and click on it, 4-select the directory/share you want to make accessible to XBMC e.g., TV, click OK The connection then shows: afp://10.0.1.30:548/TV/ 5- Enter a name for this media Source: “TV Shows server” -> OK I can see the TV Show directories but cannot play the episodes. Please advise on what I might be doing incorrectly. unRAID specs: unRAID Server Pro version: 5.0-rc8a, "Tower" as static IP 10.0.1.30, AFP enabled

It sounds like the program beets worked alright for you. I actually used MediaMonkey which mostly uses info from Amazon to add all useful metadata. FWIW, it took me a long time of trying out different programs, but I've only found MediaMonkey (free version) to be better than iTunes for quickly and easily navigating huge music libraries.

probably because the user "nobody" has no login shell defined in the usual unRAID distribution. Can we just instead somehow login with Telnet using Putty as "nobody" and no password? Or is login via SSH required for non-root users? I'm wanting to install Crashplan, which requires openSSH installation, but I don't even understand how one installs openSSH as "nobody" rather than "root" if telnet doesn't work?

Bob, are you able to login as "nobody" or simply cannot see the user in your web GUI? I can deal with a phantom user in the web GUI but not being able to login (directly via CLI from the unRaid server or via Putty telnet) is a serious issue. The only workaround for this seems to be to install plugins as root and then re-run the new permissions command so that I can run the applications as nobody rather than root.