XFS File system corruption


Recommended Posts

I can't find any relevant log data, but I'm worried I'm looking in the wrong place. Instead, I hooked up a VGA monitor to the server and took a photo (below).

 

  • The symptoms are benign mostly, but can actually take down my home network in some rare cases. 
  • System boots well. Runs flawlessly for 1-2 days. But, eventually, something like this appears on the monitor. More rarely, it generates HUGE amounts of network traffic, and grinds everything to a halt.
  • I'm considering running a repair on the xfs filesystem on disc1 (md1). But I also understand that can come with risks.
  • To date, I've not lost any data that I know of. However, I believe this issue has randomly claimed some of my Dockers in the past.

 

Happy to provide any/all other info if someone could provide some guidance.

 

EDIT: was wrong... evidence is in the log file. See attached.

 

PXL_20210202_224215617.thumb.jpg.4d0e49cda97491db8986d988bee9bbb3.jpg

 

 

athena_log_jan29.txt

Edited by FlexGunship
Link to comment

Repair filesystem on disk1, be sure to capture the output so you can post it.

 

Also corruption on docker.img. You need to delete and recreate that anyway because it is ridiculously large. 20G is more than enough. The Previous Apps feature on the Apps page will reinstall your dockers just as they were.

 

 

Link to comment
On 2/2/2021 at 11:07 PM, trurl said:

Repair filesystem on disk1, be sure to capture the output so you can post it.

 

Thank you. After taking proper precautions, I'm running it now. Will update when complete.

 

On 2/2/2021 at 11:07 PM, trurl said:

Also corruption on docker.img. You need to delete and recreate that anyway because it is ridiculously large. 20G is more than enough. The Previous Apps feature on the Apps page will reinstall your dockers just as they were.

 

 

 

I'll research this. But I believe I've done it before. The large docker.img size is likely due to album art, etc. for Plex. 

Link to comment
15 hours ago, FlexGunship said:

The large docker.img size is likely due to album art, etc. for Plex.

I have plex and 17 other dockers and they take less than half of 20G docker.img. All that plex stuff is in appdata and the plex templates have it that way by default. 

 

14 hours ago, jonathanm said:

None of that should be in the docker.img if things are configured correctly.

20G should be plenty. Making it larger won't fix anything it will only make it take longer to fill. The usual cause of filling docker.img is an application writing to a path that isn't mapped. Linux is case-sensitive.

 

Link to comment
13 minutes ago, JorgeB said:

There are some xfs related crashes, run a filesystem check (without -n) on disk2.

 

 

Put it in maintenance mode, and run on disk2 (removed the -n argument). Results below:

 

 

Phase 1 - find and verify superblock...
Phase 2 - using internal log
        - zero log...
        - scan filesystem freespace and inode maps...
        - found root inode chunk
Phase 3 - for each AG...
        - scan and clear agi unlinked lists...
        - process known inodes and perform inode discovery...
        - agno = 0
        - agno = 1
        - agno = 2
        - agno = 3
        - process newly discovered inodes...
Phase 4 - check for duplicate blocks...
        - setting up duplicate extent list...
        - check for inodes claiming duplicate blocks...
        - agno = 2
        - agno = 0
        - agno = 1
        - agno = 3
Phase 5 - rebuild AG headers and trees...
        - reset superblock...
Phase 6 - check inode connectivity...
        - resetting contents of realtime bitmap and summary inodes
        - traversing filesystem ...
        - traversal finished ...
        - moving disconnected inodes to lost+found ...
Phase 7 - verify and correct link counts...
done

 

Link to comment
  • 3 months later...

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.