UnlawfulMind Posted September 19, 2018 Share Posted September 19, 2018 I am fairly new at this whole UNRAID thing. I was using a really old system and everything was fine. I moved over to a newer system. All looked fine. Then an hour or so later, i get the "Unmountable: No file system" message on 4 of my 5 data drives. I thought maybe it was the controller card not playing well with the upgrade. So i purchased another one and even put 2 of the drives on the onboard SATA ports. I have swapped out all the cables and still am getting the same 4 drives as unable to mount. I ran the Maintenance Mode and tried to check them, this is all i get: Phase 1 - find and verify superblock... sb realtime bitmap inode 18446744073709551615 (NULLFSINO) inconsistent with calculated value 97 would reset superblock realtime bitmap ino pointer to 97 sb realtime summary inode 18446744073709551615 (NULLFSINO) inconsistent with calculated value 98 would reset superblock realtime summary ino pointer to 98 Phase 2 - using internal log - zero log... Log inconsistent (didn't find previous header) empty log check failed zero_log: cannot find log head/tail (xlog_find_tail=5) I have a lot of data on these drives and really would like to get it back. I know UNRAID is not a backup system, but i cant afford to have several different methods of backing up data. I am ready to lose a drive and have to rebuild it. But 4 at the same time. This cant be real. tower-diagnostics-20180918-2124.zip Quote Link to comment
trurl Posted September 19, 2018 Share Posted September 19, 2018 10 minutes ago, UnlawfulMind said: I am fairly new at this whole UNRAID thing. I was using a really old system and everything was fine. What exactly do you mean by a "really old system"? Was this a system that you acquired which already had Unraid on it? Do you know what the filesystem of the drives was? The diagnostics seem to indicate XFS, which is the default for V6, but if this was an old system it might have been using the V5 filesystem ReiserFS. Answer the questions and tell us anything else but don't try anything else without further advice. Quote Link to comment
UnlawfulMind Posted September 19, 2018 Author Share Posted September 19, 2018 Sorry, it is an old system physically, but I installed unraid on it about 6 mo this ago. My first installment was 6.4.1, I think. The file system is XFS. Quote Link to comment
JorgeB Posted September 19, 2018 Share Posted September 19, 2018 It's very likely a serious hardware problem, I would start by running Memtest, if no errors are detected it could be a board/controller issue, and in that case I would try to repair the the filesystem on a different server, like the old one. Quote Link to comment
UnlawfulMind Posted September 19, 2018 Author Share Posted September 19, 2018 (edited) I am running the Memtest right now. I dont think it could be hardware related. The computer was used by my wife for the last year or so. When i first booted up the server, it showed everything. Then i put the sides back on the tower and the 4 drives unmounted. I thought maybe the cable got pinched, but i replaced all of them. Even after a hardware issue is fixed, will unraid not mount them automatically? Edited September 19, 2018 by UnlawfulMind Quote Link to comment
JorgeB Posted September 19, 2018 Share Posted September 19, 2018 That type of xfs_repair error would indicate serious corruption, very unlikely to be caused by cable issue caused by cables, or an hardware problem like a controller issue. I wouln't try starting the array or doing anymore filesystem repairs on that server or it can make it worse, if the other server can fix the disks you know it'w hardware related, though they can be damage beyond repair, but don't think so. Quote Link to comment
UnlawfulMind Posted September 19, 2018 Author Share Posted September 19, 2018 If I hook it up to the old system, how do I go about repairing it? Quote Link to comment
UnlawfulMind Posted September 20, 2018 Author Share Posted September 20, 2018 Well i just hooked it up to the old system and it is doing the exact same thing. I am lost. I really cant lose this data and I'm too broke to afford backups. Quote Link to comment
trurl Posted September 20, 2018 Share Posted September 20, 2018 1 hour ago, UnlawfulMind said: I'm too broke to afford backups. Not much help at the moment, but you need to reconsider this. You must have another copy of anything important and irreplaceable. How exactly did you try to repair the filesystem before. I know you said Maintenance Mode, which is good, but then what? Did you do something from the webUI or from the command line? Quote Link to comment
UnlawfulMind Posted September 20, 2018 Author Share Posted September 20, 2018 I did it from the webUI. I tried the xfs_repair -L command and it would keep saying bad primary superblock - bad magic number!!! I just switched everything back to the original system and now i am getting a "Cannot Find Device "bond0" I tried to save a diagnostic file to the USB, but it didnt seem to work. Now it will not give me an IP to log in to. I have even got a brand new USB drive and installed a fresh copy of UNRAID on it. Quote Link to comment
JorgeB Posted September 20, 2018 Share Posted September 20, 2018 Delete from the flash drive config folder network.cfg and network-rules.cfg and reboot Quote Link to comment
UnlawfulMind Posted September 20, 2018 Author Share Posted September 20, 2018 I tried that already. it didnt work. I even unhooked all of the drives and just tried to boot from the USB, it still sees that the bond0 connection is not there. It cant save it to the RAM, right? That is the only memory that i can think of that would save a setting like that. Quote Link to comment
UnlawfulMind Posted September 20, 2018 Author Share Posted September 20, 2018 I took some pics of the boot up process. Quote Link to comment
bonienl Posted September 20, 2018 Share Posted September 20, 2018 Something goes wrong in reading your flash device. Try the following: 1) Move the USB stick to another port, prefably USB2 2) Use a different USB stick alltogether Quote Link to comment
UnlawfulMind Posted September 20, 2018 Author Share Posted September 20, 2018 (edited) I have already tried 3 different sticks and all 8 of my ports on the back of the board. I am so stumped. I have an old 2GB USB drive that i will try. But that is my last one. Edited September 20, 2018 by UnlawfulMind Quote Link to comment
bonienl Posted September 20, 2018 Share Posted September 20, 2018 Something else you can try: 1) Reformat the USB stick (make a backup first if needed), label it as UNRAID 2) Download the zio file and unzip it to your USB device 3) Run "make_bootable" 4) Start the system with the newly prepared stick Quote Link to comment
UnlawfulMind Posted September 20, 2018 Author Share Posted September 20, 2018 I did what you recommended. I went out and bought a PNY USB flash drive, 16gb. Formatted, and unzipped the link you gave me to it. made it bootable by opening in administrator. Still doing the same thing. Quote Link to comment
UnlawfulMind Posted September 20, 2018 Author Share Posted September 20, 2018 Im not sure what the issue was, but i finally got back in. It must have had something to do with the USB drive. I still dont have access to 4 of my drives though. I ran a check in Maintenance mode on one of them and got this. Phase 1 - find and verify superblock... bad primary superblock - bad magic number !!! attempting to find secondary superblock... .found candidate secondary superblock... verified secondary superblock... would write modified primary superblock Primary superblock would have been modified. Cannot proceed further in no_modify mode. Exiting now. I tried to do a repair and got this. Phase 1 - find and verify superblock... bad primary superblock - bad magic number !!! attempting to find secondary superblock... .found candidate secondary superblock... verified secondary superblock... writing modified primary superblock sb realtime bitmap inode 18446744073709551615 (NULLFSINO) inconsistent with calculated value 97 resetting superblock realtime bitmap ino pointer to 97 sb realtime summary inode 18446744073709551615 (NULLFSINO) inconsistent with calculated value 98 resetting superblock realtime summary ino pointer to 98 Phase 2 - using internal log - zero log... Log inconsistent (didn't find previous header) empty log check failed zero_log: cannot find log head/tail (xlog_find_tail=5) ERROR: The log head and/or tail cannot be discovered. Attempt to mount the filesystem to replay the log or use the -L option to destroy the log and attempt a repair. I am also attaching another Diagnostic file. Thanks for trying to get this up for me. It is really appreciated. tower-diagnostics-20180920-1559.zip Quote Link to comment
JorgeB Posted September 20, 2018 Share Posted September 20, 2018 You need to use the -L option. Quote Link to comment
UnlawfulMind Posted September 21, 2018 Author Share Posted September 21, 2018 Phase 1 - find and verify superblock... sb realtime bitmap inode 18446744073709551615 (NULLFSINO) inconsistent with calculated value 97 resetting superblock realtime bitmap ino pointer to 97 sb realtime summary inode 18446744073709551615 (NULLFSINO) inconsistent with calculated value 98 resetting superblock realtime summary ino pointer to 98 Phase 2 - using internal log - zero log... Log inconsistent (didn't find previous header) empty log check failed zero_log: cannot find log head/tail (xlog_find_tail=5) - scan filesystem freespace and inode maps... Metadata CRC error detected at 0x422ace, xfs_agf block 0x1/0x200 Metadata CRC error detected at 0x44ec8e, xfs_agi block 0x2/0x200 bad magic # 0xffffffff for agf 0 bad version # -1 for agf 0 bad sequence # -1 for agf 0 bad length -1 for agf 0, should be 122094660 flfirst -1 in agf 0 too large (max = 118) fllast -1 in agf 0 too large (max = 118) bad uuid ffffffff-ffff-ffff-ffff-ffffffffffff for agf 0 bad magic # 0xffffffff for agi 0 bad version # -1 for agi 0 bad sequence # -1 for agi 0 bad length # -1 for agi 0, should be 122094660 bad uuid ffffffff-ffff-ffff-ffff-ffffffffffff for agi 0 reset bad agf for ag 0 reset bad agi for ag 0 Metadata CRC error detected at 0x422c0c, xfs_agfl block 0x3/0x200 agfl has bad CRC for ag 0 bad agbno 4294967295 in agfl, agno 0 freeblk count 1 != flcount -1 in ag 0 bad agbno 4294967295 for btbno root, agno 0 bad agbno 4294967295 for btbcnt root, agno 0 agf_freeblks 4294967295, counted 0 in ag 0 agf_longest 4294967295, counted 0 in ag 0 agf_btreeblks 4294967295, counted 0 in ag 0 bad agbno 4294967295 for inobt root, agno 0 bad agbno 4294967295 for finobt root, agno 0 agi_count 4294967295, counted 0 in ag 0 agi_freecount 4294967295, counted 0 in ag 0 agi_freecount 4294967295, counted 0 in ag 0 finobt sb_icount 0, counted 832 sb_ifree 0, counted 80 sb_fdblocks 488140152, counted 212472034 root inode chunk not found Phase 3 - for each AG... - scan and clear agi unlinked lists... - process known inodes and perform inode discovery... - agno = 0 correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap correcting imap - agno = 1 - agno = 2 - agno = 3 - process newly discovered inodes... Phase 4 - check for duplicate blocks... - setting up duplicate extent list... - check for inodes claiming duplicate blocks... - agno = 0 - agno = 2 - agno = 3 - agno = 1 entry "Chicago Fire" at block 0 offset 672 in directory inode 2149391456 references non-existent inode 22595334 clearing inode number in entry at offset 672... entry "Young Sheldon" at block 0 offset 840 in directory inode 2149391456 references non-existent inode 22595358 clearing inode number in entry at offset 840... entry "Bleeding Steel (2017).mp4" at block 0 offset 336 in directory inode 1073741920 references non-existent inode 22595366 clearing inode number in entry at offset 336... entry "Roseanne" at block 0 offset 936 in directory inode 2149391456 references non-existent inode 22595363 entry "The Harry Potter Collection" at block 0 offset 448 in directory inode 1073741920 references non-existent inode 22595362 clearing inode number in entry at offset 448... clearing inode number in entry at offset 936... entry "Grey's Anatomy" at block 0 offset 1056 in directory inode 2149391456 references non-existent inode 22595383 entry "Face Off (1997).mp4" at block 0 offset 1736 in directory inode 1073741920 references non-existent inode 65750500 clearing inode number in entry at offset 1736... clearing inode number in entry at offset 1056... entry "The Men Who Built America" at block 0 offset 1088 in directory inode 2149391456 references non-existent inode 22595388 clearing inode number in entry at offset 1088... entry "Band of Brothers" at block 0 offset 1184 in directory inode 2149391456 references non-existent inode 65750466 clearing inode number in entry at offset 1184... entry "Orange Is the New Black" at block 0 offset 1216 in directory inode 2149391456 references non-existent inode 65750472 clearing inode number in entry at offset 1216... entry "Alias" at block 0 offset 1256 in directory inode 2149391456 references non-existent inode 65750479 clearing inode number in entry at offset 1256... entry "Mayans M.C" at block 0 offset 1336 in directory inode 2149391456 references non-existent inode 65750497 clearing inode number in entry at offset 1336... entry "Blade - Trinity (2004).mkv" at block 1 offset 1632 in directory inode 1073741920 references non-existent inode 65750467 clearing inode number in entry at offset 1632... entry "The Big Red One (1980).mp4" at block 1 offset 2528 in directory inode 1073741920 references non-existent inode 65750465 clearing inode number in entry at offset 2528... entry "Annihilation (2018).mp4" at block 1 offset 2976 in directory inode 1073741920 references non-existent inode 22595365 clearing inode number in entry at offset 2976... entry "Season 4" in shortform directory 159 references non-existent inode 22595328 junking entry "Season 4" in directory inode 159 entry "Season 8" in shortform directory 2149391467 references non-existent inode 22595347 junking entry "Season 8" in directory inode 2149391467 entry "Predator 2 (1990).mp4" at block 1 offset 3248 in directory inode 1073741920 references non-existent inode 22595384 clearing inode number in entry at offset 3248... entry "Season 1" in shortform directory 3232513004 references non-existent inode 65750464 entry "Enemy at the Gates (2001).mp4" at block 1 offset 3632 in directory inode 1073741920 references non-existent inode 22595385 clearing inode number in entry at offset 3632... junking entry "Season 1" in directory inode 3232513004 entry "The Jurassic Park Collection" at block 1 offset 3848 in directory inode 1073741920 references non-existent inode 22595367 clearing inode number in entry at offset 3848... entry "Specials" in shortform directory 2149391467 references non-existent inode 22595359 junking entry "Specials" in directory inode 2149391467 entry "Constantine (2005).mp4" at block 1 offset 4048 in directory inode 1073741920 references non-existent inode 22595390 clearing inode number in entry at offset 4048... entry "The Matrix Revolutions (2003).mp4" at block 2 offset 120 in directory inode 1073741920 references non-existent inode 65750469 clearing inode number in entry at offset 120... entry "Honey (2003).mp4" at block 2 offset 760 in directory inode 1073741920 references non-existent inode 65750482 clearing inode number in entry at offset 760... entry "See You In Valhalla (2015).mp4" at block 2 offset 1496 in directory inode 1073741920 references non-existent inode 65750483 clearing inode number in entry at offset 1496... entry "Season 2" in shortform directory 2149391514 references non-existent inode 22595341 junking entry "Season 2" in directory inode 2149391514 entry "Season 5" in shortform directory 2149391514 references non-existent inode 22595364 junking entry "Season 5" in directory inode 2149391514 entry "Season 1" in shortform directory 3256976959 references non-existent inode 22595353 junking entry "Season 1" in directory inode 3256976959 entry ".." at block 0 offset 80 in directory inode 2180290451 references non-existent inode 22595334 entry "Orange Is the New Black - S01E02 - Tit Punch.mkv" in shortform directory 1088388126 references non-existent inode 65750473 junking entry "Orange Is the New Black - S01E02 - Tit Punch.mkv" in directory inode 1088388126 entry "Orange Is the New Black - S01E10 - Bora Bora Bora.mkv" in shortform directory 1088388126 references non-existent inode 65750475 junking entry "Orange Is the New Black - S01E10 - Bora Bora Bora.mkv" in directory inode 1088388126 entry ".." at block 0 offset 80 in directory inode 2180290459 references non-existent inode 22595383 entry "Season 1" in shortform directory 1088388155 references non-existent inode 65750480 junking entry "Season 1" in directory inode 1088388155 entry "Season 5" in shortform directory 1088388155 references non-existent inode 65750485 junking entry "Season 5" in directory inode 1088388155 entry "Season 2" in shortform directory 1088388155 references non-existent inode 65750494 junking entry "Season 2" in directory inode 1088388155 entry "Diamonds Are Forever (1971).mp4" in shortform directory 2253632925 references non-existent inode 65750501 junking entry "Diamonds Are Forever (1971).mp4" in directory inode 2253632925 entry "Quantum of Solace (2008).mp4" in shortform directory 2253632925 references non-existent inode 65750498 junking entry "Quantum of Solace (2008).mp4" in directory inode 2253632925 entry ".." at block 0 offset 80 in directory inode 1116126313 references non-existent inode 22595334 entry ".." at block 0 offset 80 in directory inode 1116126340 references non-existent inode 22595358 entry ".." at block 0 offset 80 in directory inode 1645370087 references non-existent inode 22595383 Phase 5 - rebuild AG headers and trees... - reset superblock... Phase 6 - check inode connectivity... - resetting contents of realtime bitmap and summary inodes - traversing filesystem ... bad hash table for directory inode 1073741920 (no data entry): rebuilding rebuilding directory inode 1073741920 entry ".." in directory inode 1116126313 points to non-existent inode 22595334 bad hash table for directory inode 1116126313 (no data entry): rebuilding rebuilding directory inode 1116126313 entry ".." in directory inode 1116126340 points to non-existent inode 22595358 bad hash table for directory inode 1116126340 (no data entry): rebuilding rebuilding directory inode 1116126340 entry ".." in directory inode 1645370087 points to non-existent inode 22595383 bad hash table for directory inode 1645370087 (no data entry): rebuilding rebuilding directory inode 1645370087 bad hash table for directory inode 2149391456 (no data entry): rebuilding rebuilding directory inode 2149391456 entry ".." in directory inode 2180290451 points to non-existent inode 22595334 bad hash table for directory inode 2180290451 (no data entry): rebuilding rebuilding directory inode 2180290451 entry ".." in directory inode 2180290459 points to non-existent inode 22595383 bad hash table for directory inode 2180290459 (no data entry): rebuilding rebuilding directory inode 2180290459 - traversal finished ... - moving disconnected inodes to lost+found ... disconnected dir inode 1088388107, 14a6893db140: Badness in key lookup (length) bp=(bno 0x158c700, len 4096 bytes) key=(bno 0x158c700, len 16384 bytes) 14a6893db140: Badness in key lookup (length) bp=(bno 0x158c720, len 4096 bytes) key=(bno 0x158c720, len 16384 bytes) moving to lost+found disconnected inode 1088388117, moving to lost+found disconnected inode 1088388118, moving to lost+found disconnected dir inode 1088388124, moving to lost+found disconnected dir inode 1088388126, moving to lost+found disconnected dir inode 1088388128, moving to lost+found disconnected dir inode 1088388132, moving to lost+found disconnected dir inode 1088388159, moving to lost+found disconnected dir inode 1116126313, moving to lost+found disconnected dir inode 1116126323, moving to lost+found disconnected dir inode 1116126340, moving to lost+found disconnected inode 1219053893, moving to lost+found disconnected inode 1219053894, moving to lost+found disconnected dir inode 1645370066, moving to lost+found disconnected inode 1645370080, moving to lost+found disconnected dir inode 1645370081, moving to lost+found disconnected inode 1645370083, moving to lost+found disconnected dir inode 1645370087, moving to lost+found disconnected inode 1645370095, moving to lost+found disconnected dir inode 1645370096, moving to lost+found disconnected dir inode 1645370103, moving to lost+found disconnected inode 1645370105, moving to lost+found disconnected dir inode 2149391508, moving to lost+found disconnected dir inode 2180290451, moving to lost+found disconnected dir inode 2180290459, moving to lost+found disconnected dir inode 2253632866, moving to lost+found disconnected dir inode 2253632872, moving to lost+found disconnected dir inode 2253632892, moving to lost+found disconnected dir inode 2253632903, moving to lost+found disconnected dir inode 2253632913, moving to lost+found disconnected dir inode 3232512992, moving to lost+found disconnected dir inode 3232513009, moving to lost+found disconnected dir inode 3232513018, moving to lost+found disconnected dir inode 3256976941, moving to lost+found disconnected dir inode 3256976974, moving to lost+found disconnected dir inode 3256976982, moving to lost+found disconnected dir inode 3256976988, moving to lost+found Phase 7 - verify and correct link counts... resetting inode 1073741920 nlinks from 10 to 8 resetting inode 1088388155 nlinks from 10 to 7 resetting inode 2149391456 nlinks from 42 to 33 resetting inode 2149391467 nlinks from 4 to 2 resetting inode 2149391514 nlinks from 7 to 5 resetting inode 159 nlinks from 6 to 5 resetting inode 3232513004 nlinks from 3 to 2 resetting inode 22595328 nlinks from 2 to 31 resetting inode 3256976959 nlinks from 4 to 3 Metadata corruption detected at 0x460c82, xfs_dir3_block block 0x7ac3f9e0/0x1000 libxfs_writebufr: write verifer failed on xfs_dir3_block bno 0x7ac3f9e0/0x1000 Metadata corruption detected at 0x460c82, xfs_dir3_block block 0x3f1dbbb0/0x1000 libxfs_writebufr: write verifer failed on xfs_dir3_block bno 0x3f1dbbb0/0x1000 Metadata corruption detected at 0x460c82, xfs_dir3_block block 0x7ac38418/0x1000 libxfs_writebufr: write verifer failed on xfs_dir3_block bno 0x7ac38418/0x1000 Maximum metadata LSN (1:15151) is ahead of log (1:2). Format log to cycle 4. releasing dirty buffer (bulk) to free list!releasing dirty buffer (bulk) to free list!releasing dirty buffer (bulk) to free list!done Quote Link to comment
JorgeB Posted September 21, 2018 Share Posted September 21, 2018 Is this on the older server or the newer, diagnostics appear to be from the original server, and does the disk mount after the repair? Quote Link to comment
UnlawfulMind Posted September 21, 2018 Author Share Posted September 21, 2018 This is now on the new server. I was able to mount them. THANK YOU!!! I do have bout 200 GB of data in a lost+found folder. Do you have any suggestions on how to restore that data or is it pretty much gone? Quote Link to comment
JonathanM Posted September 21, 2018 Share Posted September 21, 2018 20 minutes ago, UnlawfulMind said: I do have bout 200 GB of data in a lost+found folder. Do you have any suggestions on how to restore that data or is it pretty much gone? Not sure what you mean, the data is restored, but the filenames could not be automatically found. If you browse by size and have an idea of what type of files they were, you can manually rename them and they will probably work. Some file browsers will parse files and show content regardless of name. It really depends how valuable the data is to you how much work you want to put into putting a name to each file. Quote Link to comment
JorgeB Posted September 21, 2018 Share Posted September 21, 2018 I'd be concern to keeping using the new server without knowing what caused the corruption, unless the old server was using a RAID controller with a different config, but in that case I would expect the problems to be immediately visible when you changed to the new server. Quote Link to comment
UnlawfulMind Posted September 21, 2018 Author Share Posted September 21, 2018 I do see that there are a number of folders with different files in them that i can recognize. The issue i have is the files that are not in folders. They are just a bunch of random letters and numbers for names and no file extensions, so i dont know what kind of file it is. Was there any software or anything that can look at the info and at least tell me what kind of file it is? I think the issue was the USB and the ports. It seems to not recognize the USB unless it is plugged in with a little force and quickness. I cant just gently put it in the USB. And again, thank you for your help. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.