Hi,

 

I am facing some issues since last Sunday, when my server had an unplanned power loss.

Since bootup, my cache disk is having issues, and what seems like, it is stuck in read-only mode (my guess based on its behaviour).

My dockers could not write to appdata folder (hosted on cache disk), and upon enabling/disabling the dockers, most of the dockers are now unable to even start. Same for the VM.

 

Please advise, how to fix this issue.

 

I am attaching 4 recent diagnostics files, if that helps. Cheers.

 

This is the new thread for the error initially posted here.

mug-fs-001-diagnostics-20231103-1639.zip mug-fs-001-diagnostics-20231102-0912.zip mug-fs-001-diagnostics-20231101-2143.zip mug-fs-001-diagnostics-20231101-2114.zip

Various dockers exit with this sort of errors. 

 

 

[cont-init   ] 55-nginx-proxy-manager.sh: ln: /config/logs: Read-only file system

 

chown: changing ownership of '/config/home/.cache': Read-only file system
chown: changing ownership of '/config/home': Read-only file system

 

Edited November 3, 20232 yr by Babar

Cache filesystem is corrupt, suggest to backup and reformat.

Would it be better to reformat it with zfs ?

You can try, if later you also have issues with the filesystem, it would suggest a hardware problem.

Tried to format the cache disk multiple times, but facing some errors. Attaching diagnostics file, if someone can have a look please.

mug-fs-001-diagnostics-20231104-0812.zip

Edited November 4, 20232 yr by Babar

mug-fs-001-diagnostics-20231104-0812.zip

Since the time of last post, I have tried to format the SSD disk and have not been successful. So I swapped the SATA cable, which still did not allow me to format the cache disk. 

 

I also deleted the existing cache pool, and recreated a new pool from scratch. It did not allow me to format the disk.

I have tried to format the disk in xfs, btfrs, and zfs, all without any joy.

 

I also swapped the SATA disk itself with a brand new SSD disk, which also gives the same error, and cannot be formatted and added to the cache pool.

I am once again attaching diagnostics files for reference here.

 

Can you please check and advise.

Thanks.

mug-fs-001-diagnostics-20231104-1418.zip mug-fs-001-diagnostics-20231104-1436.zip

I don't see any attempt to format the device, reboot to clear the logs and after array start click the format button, next to array start/stop buttons, then post new diags.

Never mind, I finally got round to be able to format my Samsung SSD as xfs cache disk. Thanks.