madburg Posted September 10, 2012 Share Posted September 10, 2012 Tom, there seems to be a bug with new permissions and the unRAID web page, I have noticed it since at least 5b12a and even in 5.0-rc6-r8168-test2. To reproduce. 1 parity drive, 1 cache drive, 15 data drives (from Disk 1 to Disk 15) many TB of data on the data drives. Once you click start, the weg gui will display permissions being set on: cache disk 1 disk 10 disk 11 disk 12 disk 13 disk 14 and then stops displaying any more (after these 7 disks). Via terminal using Top I see chmod and chown still running. Counting how many times chomd followed by chown run before these processes stop does NOT equal the total of 15 disks. Can this be looked into and somehow fixed for the Web GUI or have this logged in the syslog if the GUI is to much trouble? As everyone should know that the function did successfully complete on all disks. Update: Confirmed, via terminal, lsof | grep chmod (and chown) I was able to follow which "next" disk new permissions ran on. It moved on to disk 15, disk 2, disk 3, and moved to disk4. Seems to have crashed on disk 4 as I was waiting for chown to appear via 'top' and it disappeared and varies new processes appeared and are not going away. Syslog shows nothing during the running of new permissions. Nothing running or connected to the unRAID server. Also access to web interface no longer available (The webpage cannot be found). Via terminal I was able to issue a 'powerdown' command and gracefully shutdown the unRAID server. 2 Screenshots attached, one showing the webpage always stopping to display updates after disk 14 and second screenshot of the processes running after the crash. Tom, really hoping for you to chime in and if need be what to try, in order to help you solve this. If any one else has an array with greater than 15 data drives with a parity and cache drive and can test the new permissions that would be great. More Details: Disks are as followed: Disk 1 = 3TB Disk 2 = 3TB Disk 3 = 3TB Disk 4 = 3TB Disk 5 = 3TB Disk 6 = 3TB Disk 7 = 160GB Disk 8 = 160GB Disk 9 = 160GB Disk 10 = 160GB Disk 11 = 250GB Disk 12 = 2TB Disk 13 = 2TB Disk 14 = 2TB Disk 15 = 2TB Disk 16 = 2TB (new disk added for testing the clearing and formatting under unRAID in 5.0-rc6-r8168-test2, separate post filed for issue on this) Cache = 2TB Running reiserfsck on /dev/md4 and /md5 to rule out any issues with the drives, strongly believe it crashed on Disk 4 but running checking on both #4 & #5. Will update as soon as reiserfsck finishes on them. reiserfsck checked out fine on both disk 4 and disk 5 so not the issue here. root@PNTower:/dev# reiserfsck /dev/md4 reiserfsck 3.6.21 (2009 www.namesys.com) ************************************************************* ** If you are using the latest reiserfsprogs and it fails ** ** please email bug reports to [email protected], ** ** providing as much information as possible -- your ** ** hardware, kernel, patches, settings, all reiserfsck ** ** messages (including version), the reiserfsck logfile, ** ** check the syslog file for any related information. ** ** If you would like advice on using this program, support ** ** is available for $25 at www.namesys.com/support.html. ** ************************************************************* Will read-only check consistency of the filesystem on /dev/md4 Will put log info to 'stdout' Do you want to run this program?[N/Yes] (note need to type Yes if you do):Yes ########### reiserfsck --check started at Wed Sep 12 00:25:53 2012 ########### Replaying journal: Done. Reiserfs journal '/dev/md4' in blocks [18..8211]: 0 transactions replayed Checking internal tree.. finished Comparing bitmaps..finished Checking Semantic tree: finished No corruptions found There are on the filesystem: Leaves 416660 Internal nodes 2488 Directories 287 Other files 1323 Data block pointers 421412652 (0 of them are zero) Safe links 0 ########### reiserfsck finished at Wed Sep 12 01:53:19 2012 ########### root@PNTower:/dev# reiserfsck /dev/md5 reiserfsck 3.6.21 (2009 www.namesys.com) ************************************************************* ** If you are using the latest reiserfsprogs and it fails ** ** please email bug reports to [email protected], ** ** providing as much information as possible -- your ** ** hardware, kernel, patches, settings, all reiserfsck ** ** messages (including version), the reiserfsck logfile, ** ** check the syslog file for any related information. ** ** If you would like advice on using this program, support ** ** is available for $25 at www.namesys.com/support.html. ** ************************************************************* Will read-only check consistency of the filesystem on /dev/md5 Will put log info to 'stdout' Do you want to run this program?[N/Yes] (note need to type Yes if you do):Yes ########### reiserfsck --check started at Wed Sep 12 00:27:09 2012 ########### Replaying journal: Done. Reiserfs journal '/dev/md5' in blocks [18..8211]: 0 transactions replayed Checking internal tree.. finished Comparing bitmaps..finished Checking Semantic tree: finished No corruptions found There are on the filesystem: Leaves 417448 Internal nodes 2484 Directories 197 Other files 1161 Data block pointers 422233391 (0 of them are zero) Safe links 0 ########### reiserfsck finished at Wed Sep 12 01:50:52 2012 ########### Quote Link to comment
madburg Posted September 20, 2012 Author Share Posted September 20, 2012 Update: Using 5RC8a, no change, web page stops displaying progress of new permissions running. No guarantee it completes. Quote Link to comment
dbrowne Posted October 2, 2012 Share Posted October 2, 2012 I'm facing a similar problem. Can't access share on my last 2 discs and not getting any feedback on how far along the ownership renaming is going. Quote Link to comment
jbartlett Posted October 3, 2012 Share Posted October 3, 2012 Have you tried manually running the chmod/chown commands on disc4? Quote Link to comment
cyrnel Posted December 10, 2012 Share Posted December 10, 2012 I just ran into what looks like the same thing, though I was also preclearing a disk. In my case New Permissions was on disk 6 of 10 when emhttp stopped responding. Shell access still okay. All screen sessions got this output: root@Tower1:~# screen -r 917203+7 records in 917203+7 records out 1923519705088 bytes (1.9 TB) copied, 10398.5 s, 185 MB/s Wrote 1,923,519,705,088 bytes out of 3,000,592,982,016 bytes (64% Done) Message from syslogd@Tower1 at Mon Dec 10 02:20:48 2012 ... Message from syslogd@Tower1 at Mon Dec 10 02:20:48 2012 ... Tower1 kernel: Process scsi_eh_0 (pid: 853, ti=f2602000 task=f76806c0 task.ti=f2602000) Tower1 kernel: Stack: Message from syslogd@Tower1 at Mon Dec 10 02:20:48 2012 ... Tower1 kernel: Call Trace: Message from syslogd@Tower1 at Mon Dec 10 02:20:48 2012 ... Tower1 kernel: EIP: [<f851a7bf>] mvs_slot_task_free+0xf/0x118 [mvsas] SS:ESP 0068:f2603eb8 Message from syslogd@Tower1 at Mon Dec 10 02:20:48 2012 ... Tower1 kernel: Code: 02 00 ff 75 dc ff 70 10 89 d8 ff 96 c0 00 00 00 31 c0 5b 5e 8d 65 f4 5b 5e 5f 5d c3 55 89 e5 57 89 c7 56 89 d6 53 89 cb 83 ec 0c <83> 79 08 00 0f 84 f7 00 00 00 f6 42 14 05 75 44 8b 49 0c 85 c9 This is 5.0-rc8a AiO. Hate seeing mvsas. Quote Link to comment
limetech Posted December 11, 2012 Share Posted December 11, 2012 I just ran into what looks like the same thing, though I was also preclearing a disk. In my case New Permissions was on disk 6 of 10 when emhttp stopped responding. ... Do you have the entire system log? Quote Link to comment
limetech Posted December 11, 2012 Share Posted December 11, 2012 Tom, there seems to be a bug with new permissions and the unRAID web page, I have noticed it since at least 5b12a and even in 5.0-rc6-r8168-test2. ... The sequence: cache disk1 disk10 disk11 : disk2 disk21 : disk3 disk4 : disk9 is normal because this how the directory names get sorted. From your testing is there a single particular disk it stops on? Quote Link to comment
cyrnel Posted December 12, 2012 Share Posted December 12, 2012 Attached are my two latest syslogs (most recent saved and current). Sorry for the minimal information; drowning a bit here. syslog-20121208-033018.zip syslog-2012-12-11.zip Quote Link to comment
madburg Posted January 11, 2013 Author Share Posted January 11, 2013 With 5.0RC9a, the new permissions completes successfully. Via the new browser window, it hangs at first, but if left alone it eventually displays the new permission status and its progress in its entirety. 17 Drives: completed, elapsed time: 00:24:41 Good job Tom! Quote Link to comment
limetech Posted January 11, 2013 Share Posted January 11, 2013 With 5.0RC9a, the new permissions completes successfully. Via the new browser window, it hangs at first, but if left alone it eventually displays the new permission status and its progress in its entirety. 17 Drives: completed, elapsed time: 00:24:41 Good job Tom! The window is not 'hanging', the script is simply running without outputting much text. First iteration of this script used 'find' to traverse the directory structure of a disk to change the mode and owner, outputting the directory name for each directory. However, for large numbers of directories this causes the web browser window to become enormous while also slowing down the operation by an order of magnitude because each line being sent to the window is actually a javascript call. Anyway, programming for output going to a web browser window has some limitations you don't see with something like, e.g., a telnet window. Quote Link to comment
madburg Posted January 11, 2013 Author Share Posted January 11, 2013 Most important is it works and waiting on the output is no issue, here Quote Link to comment
ufopinball Posted February 4, 2013 Share Posted February 4, 2013 Have you tried manually running the chmod/chown commands on disc4? How might one do the settings manually? Can it be done per-disk, or per-directory? I've tried running the new permissions script several times now and the output it always this: /usr/local/sbin/newperms processing /mnt/disk1 ... chmod -R u-x,go-rwx,go+u,ugo+X /mnt/disk1 Several hours later, the drives are spun down, disk activity leds are dark, and the output log never gets past disk1. The webgui is still running, but no longer shows activity on any disk. I've got about a dozen drives attached. Disk1 has a lot of little files (JPEGs, code, etc.), and it checks out okay with resierfsck: root@Cortex:~# reiserfsck --check /dev/md1 reiserfsck 3.6.21 (2009 www.namesys.com) ************************************************************* ** If you are using the latest reiserfsprogs and it fails ** ** please email bug reports to [email protected], ** ** providing as much information as possible -- your ** ** hardware, kernel, patches, settings, all reiserfsck ** ** messages (including version), the reiserfsck logfile, ** ** check the syslog file for any related information. ** ** If you would like advice on using this program, support ** ** is available for $25 at www.namesys.com/support.html. ** ************************************************************* Will read-only check consistency of the filesystem on /dev/md1 Will put log info to 'stdout' Do you want to run this program?[N/Yes] (note need to type Yes if you do):Yes ########### reiserfsck --check started at Mon Feb 4 13:06:42 2013 ########### Replaying journal: Done. Reiserfs journal '/dev/md1' in blocks [18..8211]: 0 transactions replayed Checking internal tree.. finished Comparing bitmaps..finished Checking Semantic tree: finished No corruptions found There are on the filesystem: Leaves 554382 Internal nodes 3466 Directories 24812 Other files 1153288 Data block pointers 440939076 (0 of them are zero) Safe links 0 ########### reiserfsck finished at Mon Feb 4 14:24:01 2013 ########### This is the 4th time I've tried running the new permissions script. Today I am running on RC11a with no plugins and a stock 'go' file. I'll attach my syslog in case it helps. FWIW, I'm not having problems accessing any files with the way I am using unRAID ... however, just to stay "current", I'd like to complete the recommended operations ... even if I have to break it up into a few operations per disk at the top-level directories. Cortex-Syslog-2013-02-04.txt Quote Link to comment
dgaschk Posted February 5, 2013 Share Posted February 5, 2013 What happens when it's run using the GUI? Leave the window open all night. Quote Link to comment
ufopinball Posted February 5, 2013 Share Posted February 5, 2013 What happens when it's run using the GUI? Leave the window open all night. Well, that's how I have been attempting it, using the standard GUI button. I'd say the utility hung, but according to "ps", the process itself died somehow because it was no longer listed. How might I do this same procedure manually? Quote Link to comment
itimpi Posted February 5, 2013 Share Posted February 5, 2013 How might I do this same procedure manually? You can do this from a telnet/console session using the command newperms The command can optionally take a parameter to do a specific location. Something like newperms /mnt/disk1 Quote Link to comment
ufopinball Posted February 8, 2013 Share Posted February 8, 2013 How might I do this same procedure manually? You can do this from a telnet/console session using the command newperms The command can optionally take a parameter to do a specific location. Something like newperms /mnt/disk1 Very cool ... apparently you can not only do it by disk, but also by directory: newperms /mnt/disk1/Documents I've completed the process for all 12 disks in my server now, thanks a bunch! Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.