Hello, I need a little advice please.

 

 

unRAID Server Plus

version: 5.0.5

 

On Sunday I accidentally turned off the wrong plug socket and switched off the power to both my servers while they were on. After powering back on they both ran through a parity check. All drives had green balls after powering back up.

 

My main tower server is fine however my microserver, which is used mainly for music storage, corrected 12 errors which has made me lose some files. The server has also been unresponsive a few times.

 

Checked the unmenu smart output and there are no red smart errors on any of the drives.

 

I use JRiver for my music so when I rebuilt my music library it gave me a list of all the files that were missing and they are all on disk2. Some of the missing files show up when browsing to the individual disk but don't show in the user share. Eg: I can see some missing files in \\MICROSERVER\disk2\Music\Lossless Music Collection as opposed to the mapped drive L:\Lossless Music Collection which shows an empty folder. Some files still don't show in the individual disk. Not much music is missing but I'd like to try recover the files.

 

I get the following logs when browsing a folder with missing files:

 

May 7 18:14:08 MicroServer shfs/user: shfs_readdir: fstatat: 2000 - Teleportation (13) Permission denied (Drive related)

May 7 18:14:08 MicroServer shfs/user: shfs_readdir: readdir_r: /mnt/disk2/Music/Lossless Music Collection/Trance/Man With No Name (13) Permission denied

 

May 7 18:16:41 MicroServer shfs/user: shfs_readdir: fstatat: 11 - Robert Gitelman - Children Of The Sun.flac (13) Permission denied (Drive related)

May 7 18:16:41 MicroServer shfs/user: shfs_readdir: readdir_r: /mnt/disk2/Music/Lossless Music Collection/Trance/Matt Darey/2005 - Upfront Trance (2CD) (DJ Mix)/CD1 (13) Permission denied

 

I have tried running the New Permissions utility but this hasn't fixed the issue as the files are still missing.

 

I found a similar thread here http://lime-technology.com/forum/index.php?topic=29364.0 which suggests:

You can run raiserfsck on the drive that has just been rebuilt.    Put the array into maintenance mode and then run reiserfsck against the /dev/md? device where ? corresponds to the disk number.

 

Would that also work in my case? Are there any other commands I have to do before or after the raiserfsck? Is it best to run this directly with a monitor and keyboard connected to the server instead of telnet?

 

Attached current syslog. I have just run a JRiver library update which scans the entire music collection so this has highlighted the problem folders as they show (13) Permission denied at the end of the syslog.

 

Thank you for any help.

syslog-2014-05-07_missing_files.zip

Just found another problem now too. I'm currently unable to edit a few files due to requiring permission from MICROSERVER\nobody

 

I assume this will be due to running the New Permissions utility. How do I give myself permission to make changes to my files again please?

 

EDIT: How strange, I also started getting the message on some files that I needed permission from user bens (which is my own windows log in name) on files that I had successfully edited earlier this evening. Rebooting both server and my PC now lets me edit any file again.

 

The problem above started when I got the following error in Tagscanner when trying to tag some music that was in the same subfolder as some of the missing files: "Access violation at address 0040553E in module 'Tagscan.exe'. Read of address 00000002."

 

I tried to tag the album again after the reboot which replicated the problem, after that I started getting the message again that I needed permission from bens or from nobody to modify any files.

 

I'm guessing the files I tried to tag are corrupt and editing them caused a problem with the server.

 

Just checked the logs and noticed a problem:

"Remounting filesystem read-only"

 

May  7 22:34:42 MicroServer shfs/user: shfs_read: read: (5) Input/output error (Errors)
May  7 22:34:42 MicroServer shfs/user: shfs_read: read: (5) Input/output error (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS (device md2): Remounting filesystem read-only (Drive related)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:42 MicroServer kernel: REISERFS warning: reiserfs-5090 is_tree_node: node level 6481 does not match to the expected one 1 (Minor Issues)
May  7 22:34:42 MicroServer kernel: REISERFS error (device md2): vs-5150 search_by_key: invalid format found in block 464259370. Fsck? (Errors)
May  7 22:34:56 MicroServer shfs/user: shfs_open: open: /mnt/disk2/Music/Lossless Music Collection/Trance/Three Drives/2011 - Best Of Three Drives/01 - Three Drives - Greece 2000.flac (30) Read-only file system
May  7 22:35:35 MicroServer shfs/user: shfs_rename: rename: /mnt/disk2/Music/Lossless Music Collection/Trance/Terra Ferma/2000 - The Adventures Of/02 - Terra Ferma - Keep Moving.flac /mnt/disk2/Music/Lossless Music Collection/Trance/Terra Ferma/2000 - The Adventures Of/02 - Terra Ferma - Keep Moving2.flac (30) Read-only file system
May  7 22:39:57 MicroServer shfs/user: shfs_rename: rename: /mnt/disk2/Music/Lossless Music Collection/Trance/Tiesto/Singles/2002 - Tiesto $stuff$ Junkie XL - Obsession [NEBT 029] WEB/01 - Tiësto $stuff$ Junkie XL - Obsession (Original Full Length Mix).flac /mnt/disk2/Music/Lossless Music Collection/Trance/Tiesto/Singles/2002 - Tiesto $stuff$ Junkie XL - Obsession [NEBT 029] WEB/01 - Tiësto $stuff$ Junkie XL - Obsession (Original Full Length Mix)2.flac (30) Read-only file system

 

My server definitely looks to be having the same problem as the one I linked to above.

 

If I don't hear back from anyone saying it's a bad idea then tomorrow night I'll try his solution of:

I put the array into Maintenance Mode.  Telnetted in and typed reiserfsck /dev/md10 where is 10 is the replaced red balled drive.  Got an reiserfsck message and it said type Yes to continue.

 

I got the following returned after various steps.  Looking up this flag now for syntax to run.

 

finished

3 found corruptions can be fixed only when running with --rebuild-tree

 

...update, running with --rebuild-tree. 

See check disk filesystems in my sig.

Just thought I might comment on a possible misconception implied by the Subject.

 

Unlike other "RAID" systems, each data disk in unRAID is completely independent, in that each file is completely contained on a single data disk. Parity correction only writes to parity, not to any data disk. So, the loss of a data file cannot be due to a parity check.

Thanks for the link dgaschk. Running the Reiser file system test now 

 

And thanks for the correction trurl. Sorry mazahaerlol I don't understand.

 

Can anyone recommend a decent but hopefully not too expensive UPS that could safely power down my 17 drive server and 5 drive microserver in case of loss of power?

... Sorry mazahaerlol I don't understand....

Totally random comment of a spambot failing to not be obvious.

Scan finished:

 

finished Comparing bitmaps..vpf-10640: The on-disk and the correct bitmaps differs.

Bad nodes were found, Semantic pass skipped

26 found corruptions can be fixed only when running with --rebuild-tree

 

I'm guessing reiserfsck --fix-fixable won't be much use here?

 

Starting --rebuild-tree...

 

I had to do this once before too when I started the much worse thread that also included having to do --rebuild-sb: Stripe ATA errors, Disk9 showing as unformatted after crash  (http://lime-technology.com/forum/index.php?topic=25304)

All successful.

 

Most files recovered normally and reappeared in their correct folders unharmed and a few were recovered in the lost+found folder.

 

Marking as SOLVED. 

Can anyone recommend a decent but hopefully not too expensive UPS that could safely power down my 17 drive server and 5 drive microserver in case of loss of power?

Did you search the forums for UPS sizing?

If there's nothing there...and I don't recall seeing anything,

then I suggest you post this as a new thread....I've seen several ways of 'calculating' the requirements, PLUS, depending upon how the UPS fail-signal-utility is setup, it may be necessary to keep the ROUTERS and SWITCHES up (for the PC with the UPS signal to issue the powerdowns to the other devices, for example.)

Could be a thread of general interest.