bwv1058 Posted February 17, 2023 Author Share Posted February 17, 2023 23 minutes ago, itimpi said: check all cabling (power and SATA) Thank you all for your replies. I've checked the cables and everything was absolutely fine in terms of physical connection. However. The SATA power connector was the last of a rail of 4. I'm not sure if this should affect its performance, but I went ahead and used another one from a different cable coming from my power supply. Now (fingers crossed) it seems that data rebuild has started. But the question is: could this really have been the problem? And why would this happen? tower-diagnostics-20230217-2120.zip Quote Link to comment
trurl Posted February 17, 2023 Share Posted February 17, 2023 Looks good so far. 3 minutes ago, bwv1058 said: could this really have been the problem? yes Quote Link to comment
bwv1058 Posted February 18, 2023 Author Share Posted February 18, 2023 Alright, seems that the rebuild finished without problems. After running xfs-repair on disk 7, the lost+found folder was created and, as far as I understand, anything inside of it represents corrupted data on disk 7. Since data rebuild is based on bit patterns of all drives, wouldn't rebuilding disk 2 also be affected by the corruption of disk 7? Would dual parity prevent that from happening? Do you recommend it? I've very frequently had drives getting disabled in the past few months and I'm still not sure what is causing it, but after this experience it might be either the cables coming from the power supply or a pci usb controller card that I removed while replacing the cable. Would it be possible for a pci card to interfere with power delivery to the rest of the system? Are there any recommended reliable psu cables for modular power supplies? Thanks to all the wonderful moderators who assisted! tower-diagnostics-20230218-0830.zip Quote Link to comment
bwv1058 Posted February 20, 2023 Author Share Posted February 20, 2023 Some days have passed and now drive 7 has metadata corruption and is in error state... What is going on? This server feels almost cursed... tower-diagnostics-20230220-1742.zip Quote Link to comment
trurl Posted February 20, 2023 Share Posted February 20, 2023 Connection problems with disk7 resulted in failed write, so it was disabled. SMART for disk7 looks OK, emulated disk7 is mounted and over half full. But, syslog is showing corruption on emulated disk7. Check connections, power and SATA. Do you have power splitters? After fixing connections, check filesystem on (emulated) disk7. Unrelated, your appdata has some files on disk2. Why are you still on 6.9.2? Quote Link to comment
Solution JorgeB Posted February 20, 2023 Solution Share Posted February 20, 2023 It's not logged as a disk problem and SMART looks fine, most likely a power/connection problem, if you have been having multiple issues the PSU would be suspect, or some cable that's common to all affect disks. 1 Quote Link to comment
bwv1058 Posted February 20, 2023 Author Share Posted February 20, 2023 Dear JorgeB, dear trurl, I have again (feels like the 10th time) physically checked the connections. Everything is fine. I'm using a 750W modular psu from Gigabyte that has three sata slots. All three are taken and I've had drives failing on two out of the three... There are no splitters beyond the four connectors on each rail. I've again run xfs-repair, but this time the drive still remains unmountable.... 1 hour ago, trurl said: Unrelated, your appdata has some files on disk2. Why are you still on 6.9.2? I've actually run mover with appdata set to "prefer" after the drive issues seemed fixed... Not sure why there are still some files on disk 2... I'm on 6.9.2 because I was never presented with a prompt to update... Can I update manually? Thank you all! tower-diagnostics-20230220-1953.zip Quote Link to comment
JorgeB Posted February 20, 2023 Share Posted February 20, 2023 23 minutes ago, bwv1058 said: I have again (feels like the 10th time) physically checked the connections. Everything is fine. I'm using a 750W modular psu from Gigabyte that has three sata slots. PSU could be failing, or the HBA, something is making the drives drop, and it's not a software problem. Quote Link to comment
JorgeB Posted February 20, 2023 Share Posted February 20, 2023 24 minutes ago, bwv1058 said: I've again run xfs-repair, but this time the drive still remains unmountable.... Please post the output of xfs_repair. Quote Link to comment
bwv1058 Posted February 20, 2023 Author Share Posted February 20, 2023 8 minutes ago, JorgeB said: PSU could be failing, or the HBA Dear JorgeB, I doubt it is the HBA. At the start of this thread I had disk 7 attached directly to the motherboard, and... it still failed. I bought the PSU two years ago, could it seriously be the culprit? 8 minutes ago, JorgeB said: Please post the output of xfs_repair. Sure, it is long... Phase 1 - find and verify superblock... - block cache size set to 1503416 entries Phase 2 - using internal log - zero log... zero_log: head block 1077 tail block 1077 - scan filesystem freespace and inode maps... agf_freeblks 54907654, counted 54645507 in ag 13 invalid start block 260046872 in record 1 of cnt btree block 15/4 agf_freeblks 61039719, counted 9 in ag 15 agf_longest 61039709, counted 9 in ag 15 inode chunk claims used block, inobt block - agno 15, bno 16, inopb 8 ir_freecount/free mismatch, inode chunk 13/32755392, freecount 2 nfree 4 inode chunk claims used block, finobt block - agno 15, bno 16, inopb 8 agi_freecount 37, counted 43 in ag 15 agi_freecount 37, counted 43 in ag 15 finobt finobt ir_freecount/free mismatch, inode chunk 13/32755392, freecount 2 nfree 4 agi_freecount 29, counted 51 in ag 13 agi_freecount 29, counted 51 in ag 13 finobt agi_freecount 36, counted 34 in ag 12 agi_freecount 36, counted 34 in ag 12 finobt Metadata CRC error detected at 0x46b78d, xfs_finobt block 0x12b4facb8/0x1000 btree block 10/17224543 is suspect, error -74 bad magic # 0xefa7e5ef in finobt block 10/17224543 agi_freecount 27, counted 0 in ag 10 finobt Metadata CRC error detected at 0x46b78d, xfs_finobt block 0x147b81f58/0x1000 btree block 11/15752775 is suspect, error -74 bad magic # 0x3e0d0a3c in finobt block 11/15752775 agi_freecount 23, counted 0 in ag 11 finobt Metadata CRC error detected at 0x43cfad, xfs_bnobt block 0xea41a370/0x1000 btree block 8/2889998 is suspect, error -74 bad magic # 0x32375841 in btbno block 8/2889998 Metadata CRC error detected at 0x43cfad, xfs_cntbt block 0xec9306e0/0x1000 btree block 8/7751036 is suspect, error -74 bad magic # 0x70b021e in btcnt block 8/7751036 agf_freeblks 1514911, counted 0 in ag 8 agf_longest 1508010, counted 0 in ag 8 Metadata CRC error detected at 0x46b78d, xfs_finobt block 0xea41a368/0x1000 btree block 8/2889997 is suspect, error -74 bad magic # 0x14634749 in finobt block 8/2889997 agi_count 4064, counted 3872 in ag 8 agi_freecount 60, counted 6 in ag 8 agi_freecount 60, counted 0 in ag 8 finobt sb_ifree 433, counted 454 sb_fdblocks 355758814, counted 292942049 - found root inode chunk Phase 3 - for each AG... - scan and clear agi unlinked lists... - process known inodes and perform inode discovery... - agno = 0 - agno = 1 - agno = 2 - agno = 3 - agno = 4 - agno = 5 - agno = 6 - agno = 7 Metadata corruption detected at 0x435c43, xfs_inode block 0xec930700/0x4000 - agno = 8 imap claims a free inode 4352548412 is in use, correcting imap and clearing inode cleared inode 4352548412 bad CRC for inode 4356975616 bad magic number 0x8d03 on inode 4356975616 bad version number 0xffffffea on inode 4356975616 inode identifier 10414733055754289 mismatch on inode 4356975616 bad CRC for inode 4356975617 bad magic number 0x8 on inode 4356975617 bad version number 0x0 on inode 4356975617 inode identifier 34058991880437873 mismatch on inode 4356975617 bad CRC for inode 4356975618 bad magic number 0x1 on inode 4356975618 bad version number 0x0 on inode 4356975618 inode identifier 28429462278045744 mismatch on inode 4356975618 bad CRC for inode 4356975619 bad magic number 0xc on inode 4356975619 bad version number 0x77 on inode 4356975619 inode identifier 28710945844953187 mismatch on inode 4356975619 bad CRC for inode 4356975620 bad magic number 0x25 on inode 4356975620 bad version number 0x54 on inode 4356975620 inode identifier 19703596266618962 mismatch on inode 4356975620 bad CRC for inode 4356975621 bad magic number 0x72 on inode 4356975621 bad version number 0x0 on inode 4356975621 inode identifier 2251804192538624 mismatch on inode 4356975621 bad CRC for inode 4356975622 bad magic number 0x2100 on inode 4356975622 bad version number 0x0 on inode 4356975622 inode identifier 32088598324183161 mismatch on inode 4356975622 bad CRC for inode 4356975623 bad magic number 0x800 on inode 4356975623 bad version number 0xa on inode 4356975623 inode identifier 32651548277211239 mismatch on inode 4356975623 bad CRC for inode 4356975624 bad magic number 0x456c on inode 4356975624 bad version number 0x68 on inode 4356975624 bad next_unlinked 0x0 on inode 4356975624 inode identifier 16718487716706123776 mismatch on inode 4356975624 bad CRC for inode 4356975625 bad magic number 0x2a2a on inode 4356975625 bad version number 0x50 on inode 4356975625 inode identifier 7854384404691430912 mismatch on inode 4356975625 bad CRC for inode 4356975626 bad magic number 0x65 on inode 4356975626 bad version number 0x0 on inode 4356975626 inode identifier 23644349022404709 mismatch on inode 4356975626 bad CRC for inode 4356975627 bad magic number 0x65 on inode 4356975627 bad version number 0x0 on inode 4356975627 inode identifier 28429397857206386 mismatch on inode 4356975627 bad CRC for inode 4356975628 bad magic number 0x7400 on inode 4356975628 bad version number 0x61 on inode 4356975628 inode identifier 18446507678709585928 mismatch on inode 4356975628 bad CRC for inode 4356975629 bad magic number 0x0 on inode 4356975629 inode identifier 4378853376 mismatch on inode 4356975629 bad CRC for inode 4356975630 bad magic number 0x72 on inode 4356975630 bad version number 0x0 on inode 4356975630 inode identifier 32370120537931844 mismatch on inode 4356975630 bad CRC for inode 4356975631 bad magic number 0xd901 on inode 4356975631 bad version number 0x73 on inode 4356975631 inode identifier 281612415729692 mismatch on inode 4356975631 bad CRC for inode 4356975632 bad magic number 0x0 on inode 4356975632 bad version number 0x1 on inode 4356975632 inode identifier 5306852512366799043 mismatch on inode 4356975632 bad CRC for inode 4356975633 bad magic number 0x0 on inode 4356975633 bad version number 0x4 on inode 4356975633 bad next_unlinked 0xd90146b6 on inode 4356975633 inode identifier 29555345007575151 mismatch on inode 4356975633 bad CRC for inode 4356975634 bad magic number 0x78 on inode 4356975634 bad version number 0x0 on inode 4356975634 inode identifier 15636857130650990618 mismatch on inode 4356975634 bad CRC for inode 4356975635 bad magic number 0x5c on inode 4356975635 bad version number 0x0 on inode 4356975635 inode identifier 76965830725632 mismatch on inode 4356975635 bad CRC for inode 4356975636 bad magic number 0x50 on inode 4356975636 bad version number 0x0 on inode 4356975636 bad next_unlinked 0x2a2a0000 on inode 4356975636 inode identifier 432347763250825216 mismatch on inode 4356975636 bad CRC for inode 4356975637 bad magic number 0x74 on inode 4356975637 bad version number 0x0 on inode 4356975637 inode identifier 26422638812416 mismatch on inode 4356975637 bad CRC for inode 4356975638 bad magic number 0x10f on inode 4356975638 bad version number 0x0 on inode 4356975638 inode identifier 22799769471680512 mismatch on inode 4356975638 bad CRC for inode 4356975639 bad magic number 0x69 on inode 4356975639 bad version number 0x0 on inode 4356975639 inode identifier 292062298195 mismatch on inode 4356975639 bad CRC for inode 4356975640 bad magic number 0x0 on inode 4356975640 bad version number 0x6 on inode 4356975640 inode identifier 2251859943292932 mismatch on inode 4356975640 bad CRC for inode 4356975641 bad magic number 0xf00 on inode 4356975641 bad version number 0x1 on inode 4356975641 inode identifier 960111579358232693 mismatch on inode 4356975641 bad CRC for inode 4356975642 bad magic number 0x13 on inode 4356975642 bad version number 0xffffffff on inode 4356975642 inode identifier 28992356400496716 mismatch on inode 4356975642 bad CRC for inode 4356975643 bad magic number 0x69 on inode 4356975643 bad version number 0x0 on inode 4356975643 inode identifier 449518836342128905 mismatch on inode 4356975643 bad CRC for inode 4356975644 bad magic number 0x55 on inode 4356975644 bad version number 0x0 on inode 4356975644 inode identifier 577346683864129 mismatch on inode 4356975644 bad CRC for inode 4356975645 bad magic number 0x52 on inode 4356975645 bad version number 0x0 on inode 4356975645 bad next_unlinked 0x0 on inode 4356975645 inode identifier 28429466572030053 mismatch on inode 4356975645 bad CRC for inode 4356975646 bad magic number 0x72 on inode 4356975646 bad version number 0x0 on inode 4356975646 inode identifier 32651462378192997 mismatch on inode 4356975646 bad CRC for inode 4356975647 bad magic number 0x54 on inode 4356975647 bad version number 0x0 on inode 4356975647 inode identifier 19140788049477750 mismatch on inode 4356975647 - agno = 9 - agno = 10 - agno = 11 imap claims a free inode 6030170295 is in use, correcting imap and clearing inode cleared inode 6030170295 imap claims a free inode 6030170296 is in use, correcting imap and clearing inode cleared inode 6030170296 - agno = 12 imap claims a free inode 6494002155 is in use, correcting imap and clearing inode cleared inode 6494002155 - agno = 13 imap claims in-use inode 7012077283 is free, correcting imap imap claims in-use inode 7012077301 is free, correcting imap imap claims in-use inode 7012077302 is free, correcting imap imap claims in-use inode 7012077303 is free, correcting imap imap claims a free inode 7018071948 is in use, correcting imap and clearing inode cleared inode 7018071948 imap claims in-use inode 7018071951 is free, correcting imap imap claims in-use inode 7018071952 is free, correcting imap imap claims in-use inode 7018071953 is free, correcting imap imap claims in-use inode 7018071954 is free, correcting imap imap claims in-use inode 7018071955 is free, correcting imap imap claims in-use inode 7018071956 is free, correcting imap imap claims in-use inode 7018071957 is free, correcting imap imap claims in-use inode 7018071958 is free, correcting imap imap claims in-use inode 7018071959 is free, correcting imap imap claims in-use inode 7018071960 is free, correcting imap imap claims in-use inode 7018071961 is free, correcting imap imap claims in-use inode 7018071962 is free, correcting imap imap claims in-use inode 7018071963 is free, correcting imap imap claims in-use inode 7018071964 is free, correcting imap imap claims in-use inode 7018071965 is free, correcting imap imap claims in-use inode 7018071966 is free, correcting imap imap claims in-use inode 7018071967 is free, correcting imap imap claims in-use inode 7018071968 is free, correcting imap imap claims in-use inode 7018071969 is free, correcting imap imap claims in-use inode 7018071970 is free, correcting imap - agno = 14 - agno = 15 - process newly discovered inodes... 14793d2a5700: Badness in key lookup (length) bp=(bno 0xec930700, len 16384 bytes) key=(bno 0xec930700, len 4096 bytes) Phase 4 - check for duplicate blocks... - setting up duplicate extent list... - check for inodes claiming duplicate blocks... - agno = 1 - agno = 3 - agno = 0 - agno = 4 - agno = 5 - agno = 7 - agno = 6 entry "5" in shortform directory 2147483828 references non-existent inode 8053063823 junking entry "5" in directory inode 2147483828 corrected i8 count in directory 2147483828, was 2, now 1 - agno = 2 entry "artwork" at block 0 offset 96 in directory inode 3804986635 references non-existent inode 4356975621 clearing inode number in entry at offset 96... entry "Lasso Stilkopien" in shortform directory 3804986656 references non-existent inode 4356975631 junking entry "Lasso Stilkopien" in directory inode 3804986656 corrected i8 count in directory 3804986656, was 1, now 0 corrected directory 3804986656 size, was 56, now 48 entry "3" in shortform directory 3804986658 references non-existent inode 4356975634 junking entry "3" in directory inode 3804986658 corrected i8 count in directory 3804986658, was 1, now 0 corrected directory 3804986658 size, was 10, now 6 entry "c" in shortform directory 3804986666 references non-existent inode 4356975635 junking entry "c" in directory inode 3804986666 corrected i8 count in directory 3804986666, was 1, now 0 corrected directory 3804986666 size, was 10, now 6 entry "c" in shortform directory 3804986668 references non-existent inode 4356975637 junking entry "c" in directory inode 3804986668 corrected i8 count in directory 3804986668, was 1, now 0 corrected directory 3804986668 size, was 10, now 6 entry "624176" in shortform directory 3804986669 references non-existent inode 4356975638 junking entry "624176" in directory inode 3804986669 corrected i8 count in directory 3804986669, was 1, now 0 corrected directory 3804986669 size, was 10, now 6 entry "2" in shortform directory 3804986670 references non-existent inode 4356975639 junking entry "2" in directory inode 3804986670 corrected i8 count in directory 3804986670, was 1, now 0 corrected directory 3804986670 size, was 10, now 6 entry "e" in shortform directory 3804986674 references non-existent inode 4356975641 junking entry "e" in directory inode 3804986674 corrected i8 count in directory 3804986674, was 1, now 0 corrected directory 3804986674 size, was 10, now 6 - agno = 8 entry "7" in shortform directory 4315102411 references non-existent inode 8053063811 junking entry "7" in directory inode 4315102411 corrected i8 count in directory 4315102411, was 3, now 2 - agno = 9 - agno = 10 - agno = 11 - agno = 12 entry "b" in shortform directory 6442451092 references non-existent inode 4356975636 junking entry "b" in directory inode 6442451092 corrected i8 count in directory 6442451092, was 5, now 4 - agno = 13 entry "Bounces" at block 0 offset 96 in directory inode 6030170294 references free inode 6494002155 clearing inode number in entry at offset 96... entry "Mosaic Teaser.mov" at block 0 offset 176 in directory inode 6030170294 references free inode 6030170295 clearing inode number in entry at offset 176... entry "Mosaic Teaser.vcache" at block 0 offset 208 in directory inode 6030170294 references free inode 6030170296 clearing inode number in entry at offset 208... - agno = 14 entry "4" in shortform directory 7516192896 references non-existent inode 8053063808 junking entry "4" in directory inode 7516192896 corrected i8 count in directory 7516192896, was 2, now 1 entry "1" in shortform directory 7516192897 references non-existent inode 8053063809 junking entry "1" in directory inode 7516192897 corrected i8 count in directory 7516192897, was 2, now 1 entry "d" in shortform directory 7516192898 references non-existent inode 8053063810 junking entry "d" in directory inode 7516192898 corrected i8 count in directory 7516192898, was 2, now 1 entry "9" in shortform directory 7516192900 references non-existent inode 8053063812 junking entry "9" in directory inode 7516192900 corrected i8 count in directory 7516192900, was 2, now 1 entry "625121" in shortform directory 7516192901 references non-existent inode 8053063813 junking entry "625121" in directory inode 7516192901 corrected i8 count in directory 7516192901, was 2, now 1 entry "9" in shortform directory 7516192902 references non-existent inode 8053063814 junking entry "9" in directory inode 7516192902 corrected i8 count in directory 7516192902, was 1, now 0 corrected directory 7516192902 size, was 10, now 6 entry "625343" in shortform directory 7516192903 references non-existent inode 8053063815 junking entry "625343" in directory inode 7516192903 corrected i8 count in directory 7516192903, was 2, now 1 entry "e" in shortform directory 7516192904 references non-existent inode 8053063816 junking entry "e" in directory inode 7516192904 corrected i8 count in directory 7516192904, was 1, now 0 corrected directory 7516192904 size, was 23, now 15 entry "a" in shortform directory 7516192905 references non-existent inode 8053063817 junking entry "a" in directory inode 7516192905 corrected i8 count in directory 7516192905, was 2, now 1 entry "6" in shortform directory 7516192906 references non-existent inode 8053063818 junking entry "6" in directory inode 7516192906 corrected i8 count in directory 7516192906, was 1, now 0 corrected directory 7516192906 size, was 10, now 6 entry "c" in shortform directory 7516192907 references non-existent inode 8053063819 junking entry "c" in directory inode 7516192907 corrected i8 count in directory 7516192907, was 2, now 1 entry "e" in shortform directory 7516192908 references non-existent inode 8053063820 junking entry "e" in directory inode 7516192908 corrected i8 count in directory 7516192908, was 2, now 1 entry "6" in shortform directory 7516192909 references non-existent inode 8053063821 junking entry "6" in directory inode 7516192909 corrected i8 count in directory 7516192909, was 1, now 0 corrected directory 7516192909 size, was 10, now 6 entry "c" in shortform directory 7516192910 references non-existent inode 8053063822 junking entry "c" in directory inode 7516192910 corrected i8 count in directory 7516192910, was 2, now 1 entry "6" in shortform directory 7516192912 references non-existent inode 8053063824 junking entry "6" in directory inode 7516192912 corrected i8 count in directory 7516192912, was 2, now 1 entry "625893" in shortform directory 7516192913 references non-existent inode 8053063825 junking entry "625893" in directory inode 7516192913 corrected i8 count in directory 7516192913, was 2, now 1 entry "7" in shortform directory 7516192914 references non-existent inode 8053063826 junking entry "7" in directory inode 7516192914 corrected i8 count in directory 7516192914, was 2, now 1 entry "8" in shortform directory 7516192915 references non-existent inode 8053063827 junking entry "8" in directory inode 7516192915 corrected i8 count in directory 7516192915, was 1, now 0 corrected directory 7516192915 size, was 10, now 6 entry "d" in shortform directory 7516192916 references non-existent inode 8053063828 junking entry "d" in directory inode 7516192916 corrected i8 count in directory 7516192916, was 2, now 1 - agno = 15 entry "4352548412" at block 4 offset 3112 in directory inode 118303122 references free inode 4352548412 clearing inode number in entry at offset 3112... entry "4356975628" at block 4 offset 3136 in directory inode 118303122 references non-existent inode 4356975628 clearing inode number in entry at offset 3136... entry "d" in shortform directory 2237215510 references non-existent inode 4356975640 junking entry "d" in directory inode 2237215510 corrected i8 count in directory 2237215510, was 1, now 0 corrected directory 2237215510 size, was 36, now 24 entry "Michael Lauterbach" in shortform directory 2249864432 references non-existent inode 4356975618 junking entry "Michael Lauterbach" in directory inode 2249864432 corrected i8 count in directory 2249864432, was 4, now 3 Phase 5 - rebuild AG headers and trees... - agno = 0 - agno = 1 - agno = 2 - agno = 3 - agno = 4 - agno = 5 - agno = 6 - agno = 7 - agno = 8 - agno = 9 - agno = 10 - agno = 11 - agno = 12 - agno = 13 - agno = 14 - agno = 15 - reset superblock... Phase 6 - check inode connectivity... - resetting contents of realtime bitmap and summary inodes - traversing filesystem ... - agno = 0 entry "6488906477" in dir inode 118303122 inconsistent with .. value (3221225601) in ino 6488906477 will clear entry "6488906477" entry "6488906487" in dir inode 118303122 inconsistent with .. value (4345579226) in ino 6488906487 will clear entry "6488906487" entry "6488906488" in dir inode 118303122 inconsistent with .. value (4345579226) in ino 6488906488 will clear entry "6488906488" entry "6488906495" in dir inode 118303122 inconsistent with .. value (3804780544) in ino 6488906495 will clear entry "6488906495" rebuilding directory inode 118303122 - agno = 1 - agno = 2 - agno = 3 - agno = 4 fixing ftype mismatch (1/2) in directory/child inode 2237215510/2692158256 fixing ftype mismatch (0/2) in directory/child inode 2237215510/2274165027 - agno = 5 - agno = 6 - agno = 7 bad hash table for directory inode 3804986635 (no data entry): rebuilding rebuilding directory inode 3804986635 fixing ftype mismatch (0/1) in directory/child inode 3804986656/3804986657 - agno = 8 bad hash table for directory inode 4328950968 (no data entry): rebuilding rebuilding directory inode 4328950968 - agno = 9 - agno = 10 - agno = 11 bad hash table for directory inode 6030170294 (no data entry): rebuilding rebuilding directory inode 6030170294 - agno = 12 - agno = 13 - agno = 14 fixing ftype mismatch (1/2) in directory/child inode 7516192904/2692194663 - agno = 15 - traversal finished ... - moving disconnected inodes to lost+found ... disconnected dir inode 119649557, moving to lost+found disconnected dir inode 119649558, moving to lost+found disconnected dir inode 119649559, moving to lost+found disconnected dir inode 119649560, moving to lost+found disconnected dir inode 119649561, moving to lost+found disconnected dir inode 119649563, moving to lost+found disconnected dir inode 119649565, moving to lost+found disconnected dir inode 119649566, moving to lost+found disconnected dir inode 119649567, moving to lost+found disconnected dir inode 119649568, moving to lost+found disconnected dir inode 119649569, moving to lost+found disconnected dir inode 119649570, moving to lost+found disconnected dir inode 119649571, moving to lost+found disconnected dir inode 119649572, moving to lost+found disconnected dir inode 119649573, moving to lost+found disconnected dir inode 119649575, moving to lost+found disconnected dir inode 119649576, moving to lost+found disconnected dir inode 119649577, moving to lost+found disconnected inode 4352548413, moving to lost+found disconnected inode 4352548414, moving to lost+found disconnected inode 4352548415, moving to lost+found disconnected dir inode 4868724854, moving to lost+found disconnected dir inode 4868724857, moving to lost+found disconnected dir inode 4868731400, moving to lost+found disconnected dir inode 4868731401, moving to lost+found disconnected dir inode 4868731402, moving to lost+found disconnected dir inode 4868731404, moving to lost+found disconnected dir inode 4868731405, moving to lost+found disconnected dir inode 4868731406, moving to lost+found disconnected dir inode 6488906477, moving to lost+found disconnected dir inode 6488906487, moving to lost+found disconnected dir inode 6488906488, moving to lost+found disconnected dir inode 6488906495, moving to lost+found disconnected inode 6494002156, moving to lost+found Phase 7 - verify and correct link counts... resetting inode 2147483828 nlinks from 6 to 5 resetting inode 4315102411 nlinks from 4 to 3 resetting inode 3804986635 nlinks from 3 to 2 resetting inode 3804986656 nlinks from 3 to 2 resetting inode 3804986658 nlinks from 3 to 2 resetting inode 3804986666 nlinks from 3 to 2 resetting inode 3804986668 nlinks from 3 to 2 resetting inode 3804986669 nlinks from 3 to 2 resetting inode 3804986670 nlinks from 3 to 2 resetting inode 3804986674 nlinks from 3 to 2 resetting inode 6442451092 nlinks from 10 to 9 resetting inode 7516192896 nlinks from 6 to 5 resetting inode 7516192897 nlinks from 3 to 2 resetting inode 7516192898 nlinks from 3 to 2 resetting inode 7516192900 nlinks from 3 to 2 resetting inode 7516192901 nlinks from 3 to 2 resetting inode 7516192902 nlinks from 3 to 2 resetting inode 7516192903 nlinks from 3 to 2 resetting inode 7516192904 nlinks from 4 to 3 resetting inode 7516192905 nlinks from 3 to 2 resetting inode 7516192906 nlinks from 3 to 2 resetting inode 7516192907 nlinks from 3 to 2 resetting inode 7516192908 nlinks from 3 to 2 resetting inode 7516192909 nlinks from 3 to 2 resetting inode 7516192910 nlinks from 3 to 2 resetting inode 7516192912 nlinks from 3 to 2 resetting inode 7516192913 nlinks from 3 to 2 resetting inode 7516192914 nlinks from 3 to 2 resetting inode 7516192915 nlinks from 3 to 2 resetting inode 7516192916 nlinks from 3 to 2 resetting inode 6030170294 nlinks from 5 to 4 resetting inode 2237215510 nlinks from 5 to 4 resetting inode 2249864432 nlinks from 8 to 7 resetting inode 118303122 nlinks from 594 to 618 Maximum metadata LSN (1643860431:58251) is ahead of log (1643860431:1077). Format log to cycle 1643860434. XFS_REPAIR Summary Mon Feb 20 19:42:37 2023 Phase Start End Duration Phase 1: 02/20 19:41:06 02/20 19:41:06 Phase 2: 02/20 19:41:06 02/20 19:41:09 3 seconds Phase 3: 02/20 19:41:09 02/20 19:41:55 46 seconds Phase 4: 02/20 19:41:55 02/20 19:41:55 Phase 5: 02/20 19:41:55 02/20 19:41:57 2 seconds Phase 6: 02/20 19:41:57 02/20 19:42:12 15 seconds Phase 7: 02/20 19:42:12 02/20 19:42:12 Total run time: 1 minute, 6 seconds done Quote Link to comment
trurl Posted February 20, 2023 Share Posted February 20, 2023 1 hour ago, bwv1058 said: drive still remains unmountable Did you do the repair from the webUI or the command line? Easy to get the command wrong. Start the array in normal (not maintenance) mode 1 hour ago, bwv1058 said: run mover with appdata set to "prefer" after the drive issues seemed fixed... Not sure why there are still some files on disk 2... Nothing can move open files. You have to disable Docker and VM Manager in Settings to get the "default" shares moved. 1 hour ago, bwv1058 said: on 6.9.2 because I was never presented with a prompt to update Tools - Update OS Quote Link to comment
bwv1058 Posted February 20, 2023 Author Share Posted February 20, 2023 2 minutes ago, trurl said: Did you do the repair from the webUI or the command line? Easy to get the command wrong. I did it from the webUI, first with the -nv, then the -v flag. 2 minutes ago, trurl said: You have to disable Docker and VM Manager in Settings to get the "default" shares moved. I did just that, as you suggested in your previous post: disabled vm and docker and ran mover, then waited until mover was done. Anyway, will try again. I updated the OS and am sharing the diagnostics after the reboot. tower-diagnostics-20230220-2119.zip Quote Link to comment
trurl Posted February 21, 2023 Share Posted February 21, 2023 Mover won't replace files, so if some appdata files exist on cache and array you will have to clean that up yourself. Install Dynamix File Manager plugin. Disk7 is mounted now and over half full. Check the contents of your lost+found share for things repair couldn't figure out. Quote Link to comment
bwv1058 Posted February 21, 2023 Author Share Posted February 21, 2023 5 hours ago, trurl said: Mover won't replace files, so if some appdata files exist on cache and array you will have to clean that up yourself. Install Dynamix File Manager plugin. Understood! Thank you for pointing it out! 5 hours ago, trurl said: Disk7 is mounted now and over half full. Check the contents of your lost+found share for things repair couldn't figure out. Yes, but it is emulated. Should I rebuild it onto itself (as I did before with disk 2)? The fact that it would be the second time in a week (plus the filesystem corruption on the same disk) is not very confidence-inspiring. Should I wait and replace the power supply first? tower-diagnostics-20230221-0904.zip Quote Link to comment
JorgeB Posted February 21, 2023 Share Posted February 21, 2023 It would be better to try and fix the problem before doing anymore rebuilding, if you can use a different PSU do it, and if you have a spare disk use it for the rebuild, so that the old disk will still be there if needed. Quote Link to comment
bwv1058 Posted April 3, 2023 Author Share Posted April 3, 2023 Dear moderators, I've finally replaced the psu and cables (apparently shipments to my region take a while). However, following the procedure to rebuild data on drive 7, I've found that the array won't start up but the data rebuild seems to be proceeding anyway. Is this behaviour normal? I remember that on my old Unraid version the data rebuild would begin immediately upon array start... Now I'm really confused. tower-diagnostics-20230403-2300.zip Quote Link to comment
trurl Posted April 3, 2023 Share Posted April 3, 2023 Diagnostics seems to say array is started. Your automount Unassigned Device sdb is corrupt, don't know if eliminating that would help or not. You should at least set it to not automount until you fix its filesystem. Close all tabs and browsers to your Unraid webUI on all devices, then open a new browser to it and see if it displays differently. What browser are your using? Quote Link to comment
bwv1058 Posted April 4, 2023 Author Share Posted April 4, 2023 8 hours ago, trurl said: Your automount Unassigned Device sdb is corrupt I see, how could I repair it? I don't see any xfs_repair option when I click on the device name (as would be the case for disk within the array). 8 hours ago, trurl said: Close all tabs and browsers to your Unraid webUI on all devices Apparently, one restart later, the interface shows up correctly... tower-diagnostics-20230404-0906.zip Quote Link to comment
JorgeB Posted April 4, 2023 Share Posted April 4, 2023 Are you using FIrefox? If yes use a different browser. Quote Link to comment
bwv1058 Posted April 4, 2023 Author Share Posted April 4, 2023 9 hours ago, JorgeB said: Are you using FIrefox? If yes use a different browser. Dear JorgeB, yes, I am using Firefox. I thought it would be the closest match to the browser Unraid's own GUI uses... How can I repair the filesystem on my unassigned drive? Should I follow the instructions to execute xfs_repair in the console? If so, is it enough to run xfs_repair -v /dev/sdb ? Thank you all again Quote Link to comment
JorgeB Posted April 4, 2023 Share Posted April 4, 2023 17 minutes ago, bwv1058 said: How can I repair the filesystem on my unassigned drive? The UD plugin has a filesystem repair option, IIRC it looks like a little flash. Quote Link to comment
bwv1058 Posted April 5, 2023 Author Share Posted April 5, 2023 14 hours ago, JorgeB said: The UD plugin has a filesystem repair option, IIRC it looks like a little flash. Many thanks, I found it. Alright, seems that at last everything has returned to normality. Let's hope it stays that way... Many thanks to all moderators who provided support. To anyone interested: the unreliable behaviour referenced in this thread might have been caused by a faulty PSU and/or cables. I have now replaced everything in the hope that no more drives will randomly disconnect or experience file system corruption. tower-diagnostics-20230405-1046.zip 1 Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.