clambake-stolid

Hi guys, I'm having some trouble recently due to my Jellyfin docker being unable to start up, and the logs show that [14:49:09] [FTL] [1] Main: Unhandled Exception Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 14: 'unable to open database file'. seems to be the most likely culprit why it isn't able to start up. It seems most likely that some kind of file permissions went wrong, and since this isn't the first time nor the only docker I have an issue with (can't use some SMB over Windows, have to use CLI to copy/ move stuff, Syncthing also refuses to work sometimes, etc), I figured I could ask for some help in managing file permissions here generally, and what the best practices are. Any help would be appreciated!

Well, by forced shutdowns I mean yanking the power cable lol How would I delete said metadata corruption or snapshot artifacts? Also, I do believe I have found the cause of the problem... Which is sad as this stick is less than a year old... [27.10.2024 15:15:20 CET] /usr/bin/memtester 12G 5 ============================================================================================= memtester version 4.6.0 (64-bit) adapted for use on Unraid installations Copyright (C) 2001-2020 Charles Cazabon Copyright (C) 2024 desertwitch (modifications for Unraid) THIS PROGRAM IS PROVIDED AS IS AND WITHOUT ANY WARRANTIES It is licensed under GNU General Public License Version 2 pagesize is 4096 pagesizemask is 0xfffffffffffff000 want 12288MB (12884901888 bytes) got 12288MB (12884901888 bytes), trying mlock ...locked. Loop 1/5: Stuck Address : Testing... failed Random Value : Testing... failed Compare XOR : Testing... failed Compare SUB : Testing... failed Compare MUL : Testing... failed Compare DIV : Testing... failed Compare OR : Testing... failed Compare AND : Testing... failed Sequential Increment : Testing... failed Solid Bits : Testing... failed Block Sequential : Testing... failed Checkerboard : Testing... failed Bit Spread : Testing... failed Bit Flip : Testing... failed Walking Ones : Testing... failed Walking Zeroes : Testing... failed 8-bit Writes : Testing... failed 16-bit Writes : Testing... failed Loop 2/5: Stuck Address : Testing... failed Random Value : Testing... ============================================================================================= [27.10.2024 15:18:49 CET] The operation was interrupted and has not finished. [27.10.2024 15:18:49 CET] Code: SIGTERM - Program Interrupt.

Hi, I was running some disk parity checks and a new found disk scrub, when I found that I had couple corrupted files in the pool, most likely from forced shutdowns. I haven't lost any critical data, but I would like the corrupted files to be removed so I can restore the files properly. I've went into the web terminal and used zpool status -xv to find out which files were corrupted, and removed them via terminal. However, there are couple of files that does not have directories, such as /mnt/cache/blahblahblah, but is instead formatted as such; cache/appdata:<0x3c324> I'm assuming this is a bad sector or something on the drive itself? If not what is it? And are there any guidelines on removing this? I looked at https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-8A/ to find out what I can do, but it says if the file metadata is corrupt, it cannot be removed. Is this what this is? Any insight would be helpful. Thanks! P.S. The result of zpool stat -xv after removing valid directories/ files; zpool status -xv pool: cache state: ONLINE status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in question if possible. Otherwise restore the entire pool from backup. see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-8A scan: scrub repaired 0B in 00:08:57 with 16 errors on Thu Oct 24 02:52:31 2024 config: NAME STATE READ WRITE CKSUM cache ONLINE 0 0 0 nvme0n1p1 ONLINE 0 0 16 nvme1n1p1 ONLINE 0 0 2 errors: Permanent errors have been detected in the following files: cache/appdata:<0x3c324> cache/appdata:<0x3d2c0> cache/system:<0x80> cache/Backups:<0x3bf00> cache/Backups:<0x48902> cache/Backups:<0x37704> cache/Backups:<0x4df0a> cache/Backups:<0x3770c> cache/Backups:<0x4860c> cache/Backups:<0x3bd0c> cache/Backups:<0x4df0c> cache/Backups:<0x37712> cache/Backups:<0x37714> cache/Backups:<0x37716> cache/Backups:<0x3761e> cache/Backups:<0x37622> cache/Backups:<0x3bc32> cache/Backups:<0x3bd3c> cache/Backups:<0x3753e> cache/Backups:<0x44a44> cache/Backups:<0x3bc56> cache/Backups:<0x37462> cache/Backups:<0x3bc62> cache/Backups:<0x48a6e> cache/Backups:<0x3ba70> cache/Backups:<0x43172> cache/Backups:<0x48572> cache/Backups:<0x3b87c> cache/Backups:<0x37686> cache/Backups:<0x3be88> cache/Backups:<0x3be8e> cache/Backups:<0x44b92> cache/Backups:<0x4dd9e> cache/Backups:<0x3bda0> cache/Backups:<0x373a2> cache/Backups:<0x3bfa2> cache/Backups:<0x373a6> cache/Backups:<0x3bcaa> cache/Backups:<0x4dcac> cache/Backups:<0x3bcae> cache/Backups:<0x48cb2> cache/Backups:<0x375c0> cache/Backups:<0x434ce> cache/Backups:<0x374dc> cache/Backups:<0x485e2> cache/Backups:<0x373e8> cache/Backups:<0x48bea> cache/Backups:<0x3bbec> cache/Backups:<0x45af0> cache/Media:<0x358> cache/Downloads:<0x500> cache/Downloads:<0x910> cache/Downloads:<0x214> cache/Downloads:<0x42a> cache/Downloads:<0x33e> cache/Downloads:<0x25c> cache/Downloads:<0x662> cache/Downloads:<0x58a> cache/Downloads:<0x89c> cache/Downloads:<0x8a0> cache/Downloads:<0x8ac> cache/Downloads:<0x2da> cache/Downloads:<0x5e0> cache/Downloads:<0x5ec> pool: disk2 state: ONLINE status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in question if possible. Otherwise restore the entire pool from backup. see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-8A scan: scrub repaired 0B in 23:17:31 with 13 errors on Fri Oct 25 01:59:28 2024 config: NAME STATE READ WRITE CKSUM disk2 ONLINE 0 0 0 md2p1 ONLINE 0 0 0 errors: Permanent errors have been detected in the following files: disk2/Backups:<0x1c00a> disk2/Backups:<0x1bf1a> disk2/Backups:<0x1bf24> disk2/Backups:<0x1c084> disk2/Backups:<0x1e4e4> disk2:<0x3e90> disk2:<0x3db2>

After a bit of finagling, managed to nuke the 2 pool NVMes, and after checking /mnt/user, there is no /appdata dir anymore. It seemed to have a little problem mounting, with an LUKS error 5? and system was hung up again while formatting. But I've restarted, nuked the SSDs again, and it mounted and formatted successfully. Any clue what the source of the problem was? Probably the SSD having a bad... sector? or something between power cycles? Thanks.

Managed to back up any relevant data (although nuking them all is also fine), how do I recreate pool? Is there data loss (apart from the /mnt/cache)? Should I disable encryption for all before attempting this?

So I have no clue what I'm doing, but Started system (first without the boot USB and was wondering what now), gave password and started in maintenance mode, then in web terminal gave in the command. It didn't return any error, so I'm assuming that it worked. Then the following; root@ZuluAlpha:~# cp -r /mnt/cache/ /boot/cachebackup/ which gave cp: cannot create special file '/boot/cachebackup/cache/appdata/binhex-qbittorrentvpn/qBittorrent/config/ipc-socket': Operation not permitted I then tried to move individual dirs, but I'm not sure if it froze or just my USB is slow as shit (USB 2.0) and isn't responding in time. Next steps? It's just slow, manually moving other files now.

The syslogs when I tried mounting it after force reboot, normal mode. syslog.txt syslog1.txt

Hi, TL,DR; Fucked the system even more (system hangs now while mounting disks) while trying to reproduce error, but plenty of diag after reboots and dialogue on diag capture while system is hanging. Timeline after trying to gather diag after delete attempt. Booting up the system as I usually do ended up in system hang, after inputting encryption key and mounting disks. I suspect due to me cycling power after another deletion attempt yesterday, while the parity check was ongoing (and I didn't abort it before attempting deletion). Had to cycle power (by turning off/ on PSU), then immediately captured diagnostics before mounting disks. (Included, 1320) Then I tried mounting disks again, but it hanged in the exact same way. Attempted to capture diag, but it hung as well. (Screenshot + dialogue? pasted) mkdir -p /boot/logs mkdir -p '/zulualpha-diagnostics-20241015-1326/system' '/zulualpha-diagnostics-20241015-1326/config' '/zulualpha-diagnostics-20241015-1326/logs' '/zulualpha-diagnostics-20241015-1326/shares' '/zulualpha-diagnostics-20241015-1326/smart' '/zulualpha-diagnostics-20241015-1326/qemu' '/zulualpha-diagnostics-20241015-1326/xml' top -bn1 -o%CPU 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/system/top.txt' tail /boot/bz*.sha256 >> '/zulualpha-diagnostics-20241015-1326/unraid-6.12.13.txt' uptime nproc lscpu 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/system/lscpu.txt' lsscsi -vgl 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/system/lsscsi.txt' lspci -knn 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/system/lspci.txt' lsusb 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/system/lsusb.txt' free -mth 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/system/memory.txt' ps -auxf --sort=-pcpu 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/system/ps.txt' lsof -Pni 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/system/lsof.txt' lsmod|sort 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/system/lsmod.txt' df -h 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/system/df.txt' ip -br a|awk '/^(eth|bond)[0-9]+ /{print $1}'|sort dmidecode -qt2|awk -F: '/^ Manufacturer:/{m=$2};/^ Product Name:/{p=$2} END{print m" -"p}' 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/system/motherboard.txt' dmidecode -qt0 2>/dev/null|todos >>'/zulualpha-diagnostics-20241015-1326/system/motherboard.txt' cat /proc/meminfo 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/system/meminfo.txt' dmidecode --type 17 2>/dev/null|todos >>'/zulualpha-diagnostics-20241015-1326/system/meminfo.txt' ethtool 'bond0' 2>/dev/null|todos >>'/zulualpha-diagnostics-20241015-1326/system/ethtool.txt' ethtool -i 'bond0' 2>/dev/null|todos >>'/zulualpha-diagnostics-20241015-1326/system/ethtool.txt' ethtool 'eth0' 2>/dev/null|todos >>'/zulualpha-diagnostics-20241015-1326/system/ethtool.txt' ethtool -i 'eth0' 2>/dev/null|todos >>'/zulualpha-diagnostics-20241015-1326/system/ethtool.txt' ip -br a|todos >'/zulualpha-diagnostics-20241015-1326/system/ifconfig.txt' sed -ri 's/(["\[ ])(127|10|172\.1[6-9]|172\.2[0-9]|172\.3[0-1]|192\.168)((\.[0-9]{1,3}){2,3}([/" .]|$))/\1@@@\2\3/g; s/(["\[ ][0-9]{1,3}\.)([0-9]{1,3}\.){2}([0-9]{1,3})([/" .]|$)/\1XXX.XXX.\3\4/g; s/@@@//g' '/zulualpha-diagnostics-20241015-1326/system/ifconfig.txt' 2>/dev/null sed -ri 's/(([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\6/g' '/zulualpha-diagnostics-20241015-1326/system/ifconfig.txt' 2>/dev/null sed -ri 's/(\[([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})(\])([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\6/g' '/zulualpha-diagnostics-20241015-1326/system/ifconfig.txt' 2>/dev/null sed -ri 's/(([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})(\/[0-9]{1,3})([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\7/g' '/zulualpha-diagnostics-20241015-1326/system/ifconfig.txt' 2>/dev/null find /sys/kernel/iommu_groups/ -type l 2>/dev/null|sort -V|todos >'/zulualpha-diagnostics-20241015-1326/system/iommu_groups.txt' todos '/zulualpha-diagnostics-20241015-1326/system/cmdline.txt' echo -ne ' /boot ' >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt';ls -l '/boot'|todos >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt' echo -ne ' /boot/config ' >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt';ls -l '/boot/config'|todos >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt' echo -ne ' /boot/config/plugins ' >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt';ls -l '/boot/config/plugins'|todos >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt' echo -ne ' /boot/syslinux ' >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt';ls -l '/boot/syslinux'|todos >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt' echo -ne ' /var/log ' >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt';ls -l '/var/log'|todos >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt' echo -ne ' /var/log/plugins ' >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt';ls -l '/var/log/plugins'|todos >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt' echo -ne ' /boot/extra folder does not exist ' >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt' echo -ne ' /var/log/packages ' >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt';ls -l '/var/log/packages'|todos >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt' echo -ne ' /var/lib/pkgtools/packages ' >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt';ls -l '/var/lib/pkgtools/packages'|todos >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt' echo -ne ' /tmp ' >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt';ls -l '/tmp'|todos >>'/zulualpha-diagnostics-20241015-1326/system/folders.txt' cp /boot/config/*.{cfg,conf,dat} '/zulualpha-diagnostics-20241015-1326/config' 2>/dev/null cp /boot/config/go '/zulualpha-diagnostics-20241015-1326/config/go.txt' 2>/dev/null sed -i -e '/password/c ***line removed***' -e '/user/c ***line removed***' -e '/pass/c ***line removed***' '/zulualpha-diagnostics-20241015-1326/config/go.txt' sed -ri 's/^((disk|flash)(Read|Write)List.*=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1326/config/*.cfg' 2>/dev/null sed -ri 's/(["\[ ])(127|10|172\.1[6-9]|172\.2[0-9]|172\.3[0-1]|192\.168)((\.[0-9]{1,3}){2,3}([/" .]|$))/\1@@@\2\3/g; s/(["\[ ][0-9]{1,3}\.)([0-9]{1,3}\.){2}([0-9]{1,3})([/" .]|$)/\1XXX.XXX.\3\4/g; s/@@@//g' '/zulualpha-diagnostics-20241015-1326/config/network.cfg' 2>/dev/null sed -ri 's/(([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\6/g' '/zulualpha-diagnostics-20241015-1326/config/network.cfg' 2>/dev/null sed -ri 's/(\[([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})(\])([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\6/g' '/zulualpha-diagnostics-20241015-1326/config/network.cfg' 2>/dev/null sed -ri 's/(([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})(\/[0-9]{1,3})([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\7/g' '/zulualpha-diagnostics-20241015-1326/config/network.cfg' 2>/dev/null /usr/local/emhttp/webGui/scripts/show_interfaces ip|tr -d ' '|tr '#' ' '|tr ',' ' ' >'/zulualpha-diagnostics-20241015-1326/config/listen.txt' /usr/local/emhttp/webGui/scripts/error_interfaces|sed 's///' >>'/zulualpha-diagnostics-20241015-1326/config/listen.txt' sed -ri 's/(["\[ ])(127|10|172\.1[6-9]|172\.2[0-9]|172\.3[0-1]|192\.168)((\.[0-9]{1,3}){2,3}([/" .]|$))/\1@@@\2\3/g; s/(["\[ ][0-9]{1,3}\.)([0-9]{1,3}\.){2}([0-9]{1,3})([/" .]|$)/\1XXX.XXX.\3\4/g; s/@@@//g' '/zulualpha-diagnostics-20241015-1326/config/listen.txt' 2>/dev/null sed -ri 's/(([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\6/g' '/zulualpha-diagnostics-20241015-1326/config/listen.txt' 2>/dev/null sed -ri 's/(\[([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})(\])([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\6/g' '/zulualpha-diagnostics-20241015-1326/config/listen.txt' 2>/dev/null sed -ri 's/(([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})(\/[0-9]{1,3})([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\7/g' '/zulualpha-diagnostics-20241015-1326/config/listen.txt' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1326/shares/appdata.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1326/shares/A-----e.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1326/shares/B-----s.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1326/shares/domains.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1326/shares/D-------s.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1326/shares/G---s.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1326/shares/isos.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1326/shares/M---a.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1326/shares/system.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1326/shares/VM.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1326/shares/Z---------------y.cfg' 2>/dev/null ls -l /dev/disk/by-id/[asun]* 2>/dev/null|sed '/-part/d;s|^.*/by-id/[^-]*-||;s|-> ../../||;s|:|-|' smartctl -x '/dev/sdd' 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/smart/HUH721010ALE601_2YGA4JMD-2024-07-16 disk1 (sdd).txt' smartctl -x '/dev/sdb' 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/smart/ST16000NM000D-3PC101_ZVTBE47N-2024-07-16 parity (sdb).txt' smartctl -x '/dev/sdc' 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/smart/ST16000NM000D-3PC101_ZVTBJQK2-2024-07-16 disk2 (sdc).txt' smartctl -x '/dev/nvme1' 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/smart/PC601_NVMe_SK_hynix_512GB_SN94N235312604R21-2024-07-16 cache (nvme1).txt' smartctl -x '/dev/nvme0' 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/smart/Seagate_FireCuda_530_ZP2000GM30013_7VR0086Q-2024-07-16 cache2 (nvme0).txt' smartctl -x '/dev/nvme0' 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/smart/eui.6479a74f7f00124c-2024-07-16 cache2 (nvme0).txt' smartctl -x '/dev/nvme1' 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/smart/eui.ace42e00901df3522ee4ac0000000001-2024-07-16 cache (nvme1).txt' smartctl -x '/dev/sda' 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1326/smart/Flash_USB_Disk_3727023E4182456931317-0-0-2024-07-16 flash (sda).txt' /usr/sbin/zpool status 2>/dev/null|todos >>'/zulualpha-diagnostics-20241015-1326/system/zfs-info.txt' Cycled power again, another diag. capture before mounting (1334). Did not mount disks, used GUI for safe reboot, as this has fixed the problem before while it hanged due to parity check (suspected). Another diag captured, before mounting, in safe mode (1337). System hung again, after attempting to mount. Same dialogue as above, with last entry being /usr/sbin/zpool status 2>/dev/null|todos >>'/zulualpha-diagnostics-20241015-1340/system/zfs-info.txt' Restarted (by long pressing power button), attempted diag capture before mounting. Dialogue; mkdir -p /boot/logs /usr/local/emhttp/plugins/fix.common.problems/scripts/scan.php diagnostics Fix Common Problems Scan: Downloading Support Files Fix Common Problems Scan: 1% HPApresent Fix Common Problems Scan: 2% checkServerDate Fix Common Problems Scan: 3% eth0NoIP Fix Common Problems Scan: 4% isArrayStarted Fix Common Problems Scan: 6% impliedArrayFilesOnCache Fix Common Problems Scan: 7% cacheOnlyFilesOnArray Fix Common Problems Scan: 8% arrayOnlyFilesOnCache Fix Common Problems Scan: 9% pluginUpdateCheck Fix Common Problems Scan: 11% dockerUpdateCheck Fix Common Problems Scan: 12% autoUpdateCheck Fix Common Problems Scan: 13% sameShareDifferentCase Fix Common Problems Scan: 14% outsideCommunication Fix Common Problems Scan: 16% dockerAppdataCacheOnly Fix Common Problems Scan: 17% disabledDisksPresent Fix Common Problems Scan: 18% missingDisksPresent Fix Common Problems Scan: 19% readErrorsPresent Fix Common Problems Scan: 20% fileSystemErrors Fix Common Problems Scan: 22% pluginsUpToDate Fix Common Problems Scan: 23% dockerUpToDate Fix Common Problems Scan: 24% dockerConfigUserShare Fix Common Problems Scan: 25% varLogFilled Fix Common Problems Scan: 27% dockerImageFull Fix Common Problems Scan: 28% rootfsFull Fix Common Problems Scan: 29% scheduledParityChecks Fix Common Problems Scan: 30% shareIncludeExcludeSet Fix Common Problems Scan: 32% shareIncludeExcludeSameDisk Fix Common Problems Scan: 33% UDmountedSlaveMode Fix Common Problems Scan: 34% checkNotifications Fix Common Problems Scan: 35% blacklistedPluginsInstalled Fix Common Problems Scan: 37% illegalShareName Fix Common Problems Scan: 38% writeToDriveTest Fix Common Problems Scan: 39% flashDriveFull Fix Common Problems Scan: 40% checkForHack Fix Common Problems Scan: 41% checkForModeration Fix Common Problems Scan: 43% pluginNotCompatible Fix Common Problems Scan: 44% cacheOnlyNoCache Fix Common Problems Scan: 45% shareNameSameAsDiskName Fix Common Problems Scan: 46% extraParamInRepository Fix Common Problems Scan: 48% outOfMemory Fix Common Problems Scan: 49% mceCheck Fix Common Problems Scan: 50% inotifyExhausted Fix Common Problems Scan: 51% reiserCache Fix Common Problems Scan: 53% SSDcacheNoTrim Fix Common Problems Scan: 54% marvelControllerTest Fix Common Problems Scan: 55% breadTest Fix Common Problems Scan: 56% lessThan2G Fix Common Problems Scan: 58% checkDockerCompatible Fix Common Problems Scan: 59% CPUoverheat Fix Common Problems Scan: 60% statsButNoPreclear Fix Common Problems Scan: 61% moverLogging Fix Common Problems Scan: 62% phpWarnings Fix Common Problems Scan: 64% invalidIncludedDisk Fix Common Problems Scan: 65% CPUSet Fix Common Problems Scan: 66% isolatedCPUdockerCollision Fix Common Problems Scan: 67% testXML Fix Common Problems Scan: 69% writeCacheDisabled Fix Common Problems Scan: 70% updatePluginSupport Fix Common Problems Scan: 71% flashSyslog Fix Common Problems Scan: 72% unassignedDevicesPlus Fix Common Problems Scan: 74% sysdream Fix Common Problems Scan: 75% caNotifications Fix Common Problems Scan: 76% legacyVFIO Fix Common Problems Scan: 77% checkBonding Fix Common Problems Scan: 79% checkSameNetwork Fix Common Problems Scan: 80% jumboFrames Fix Common Problems Scan: 81% authorizedKeysInGo Fix Common Problems Scan: 82% reservedUserName Fix Common Problems Scan: 83% rootPassword Fix Common Problems Scan: 85% xmrig Fix Common Problems Scan: 86% shareSpace69 Fix Common Problems Scan: 87% testTLD Fix Common Problems Scan: 88% testDockerOptsIp Fix Common Problems Scan: 90% wrongCachePoolFiles Fix Common Problems Scan: 91% corruptFlash Fix Common Problems Scan: 92% dockerUpdatePatch Fix Common Problems Scan: 93% macvlan Fix Common Problems Scan: 95% legacyMyServers Fix Common Problems Scan: 96% macvlanfix Fix Common Problems Scan: 97% dockerPatch6812 Fix Common Problems Scan: 98% oldStyleSSDTrim Fix Common Problems Scan: 100% syslinuxRoot mkdir -p '/zulualpha-diagnostics-20241015-1343/system' '/zulualpha-diagnostics-20241015-1343/config' '/zulualpha-diagnostics-20241015-1343/logs' '/zulualpha-diagnostics-20241015-1343/shares' '/zulualpha-diagnostics-20241015-1343/smart' '/zulualpha-diagnostics-20241015-1343/qemu' '/zulualpha-diagnostics-20241015-1343/xml' top -bn1 -o%CPU 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/system/top.txt' tail /boot/bz*.sha256 >> '/zulualpha-diagnostics-20241015-1343/unraid-6.12.13.txt' uptime nproc lscpu 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/system/lscpu.txt' lsscsi -vgl 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/system/lsscsi.txt' lspci -knn 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/system/lspci.txt' lsusb 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/system/lsusb.txt' free -mth 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/system/memory.txt' ps -auxf --sort=-pcpu 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/system/ps.txt' lsof -Pni 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/system/lsof.txt' lsmod|sort 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/system/lsmod.txt' df -h 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/system/df.txt' ip -br a|awk '/^(eth|bond)[0-9]+ /{print $1}'|sort dmidecode -qt2|awk -F: '/^ Manufacturer:/{m=$2};/^ Product Name:/{p=$2} END{print m" -"p}' 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/system/motherboard.txt' dmidecode -qt0 2>/dev/null|todos >>'/zulualpha-diagnostics-20241015-1343/system/motherboard.txt' cat /proc/meminfo 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/system/meminfo.txt' dmidecode --type 17 2>/dev/null|todos >>'/zulualpha-diagnostics-20241015-1343/system/meminfo.txt' ethtool 'bond0' 2>/dev/null|todos >>'/zulualpha-diagnostics-20241015-1343/system/ethtool.txt' ethtool -i 'bond0' 2>/dev/null|todos >>'/zulualpha-diagnostics-20241015-1343/system/ethtool.txt' ethtool 'eth0' 2>/dev/null|todos >>'/zulualpha-diagnostics-20241015-1343/system/ethtool.txt' ethtool -i 'eth0' 2>/dev/null|todos >>'/zulualpha-diagnostics-20241015-1343/system/ethtool.txt' ip -br a|todos >'/zulualpha-diagnostics-20241015-1343/system/ifconfig.txt' sed -ri 's/(["\[ ])(127|10|172\.1[6-9]|172\.2[0-9]|172\.3[0-1]|192\.168)((\.[0-9]{1,3}){2,3}([/" .]|$))/\1@@@\2\3/g; s/(["\[ ][0-9]{1,3}\.)([0-9]{1,3}\.){2}([0-9]{1,3})([/" .]|$)/\1XXX.XXX.\3\4/g; s/@@@//g' '/zulualpha-diagnostics-20241015-1343/system/ifconfig.txt' 2>/dev/null sed -ri 's/(([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\6/g' '/zulualpha-diagnostics-20241015-1343/system/ifconfig.txt' 2>/dev/null sed -ri 's/(\[([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})(\])([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\6/g' '/zulualpha-diagnostics-20241015-1343/system/ifconfig.txt' 2>/dev/null sed -ri 's/(([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})(\/[0-9]{1,3})([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\7/g' '/zulualpha-diagnostics-20241015-1343/system/ifconfig.txt' 2>/dev/null find /sys/kernel/iommu_groups/ -type l 2>/dev/null|sort -V|todos >'/zulualpha-diagnostics-20241015-1343/system/iommu_groups.txt' todos '/zulualpha-diagnostics-20241015-1343/system/cmdline.txt' echo -ne ' /boot ' >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt';ls -l '/boot'|todos >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt' echo -ne ' /boot/config ' >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt';ls -l '/boot/config'|todos >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt' echo -ne ' /boot/config/plugins ' >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt';ls -l '/boot/config/plugins'|todos >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt' echo -ne ' /boot/syslinux ' >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt';ls -l '/boot/syslinux'|todos >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt' echo -ne ' /var/log ' >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt';ls -l '/var/log'|todos >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt' echo -ne ' /var/log/plugins ' >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt';ls -l '/var/log/plugins'|todos >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt' echo -ne ' /boot/extra folder does not exist ' >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt' echo -ne ' /var/log/packages ' >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt';ls -l '/var/log/packages'|todos >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt' echo -ne ' /var/lib/pkgtools/packages ' >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt';ls -l '/var/lib/pkgtools/packages'|todos >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt' echo -ne ' /tmp ' >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt';ls -l '/tmp'|todos >>'/zulualpha-diagnostics-20241015-1343/system/folders.txt' cp /boot/config/*.{cfg,conf,dat} '/zulualpha-diagnostics-20241015-1343/config' 2>/dev/null cp /boot/config/go '/zulualpha-diagnostics-20241015-1343/config/go.txt' 2>/dev/null sed -i -e '/password/c ***line removed***' -e '/user/c ***line removed***' -e '/pass/c ***line removed***' '/zulualpha-diagnostics-20241015-1343/config/go.txt' sed -ri 's/^((disk|flash)(Read|Write)List.*=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1343/config/*.cfg' 2>/dev/null sed -ri 's/(["\[ ])(127|10|172\.1[6-9]|172\.2[0-9]|172\.3[0-1]|192\.168)((\.[0-9]{1,3}){2,3}([/" .]|$))/\1@@@\2\3/g; s/(["\[ ][0-9]{1,3}\.)([0-9]{1,3}\.){2}([0-9]{1,3})([/" .]|$)/\1XXX.XXX.\3\4/g; s/@@@//g' '/zulualpha-diagnostics-20241015-1343/config/network.cfg' 2>/dev/null sed -ri 's/(([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\6/g' '/zulualpha-diagnostics-20241015-1343/config/network.cfg' 2>/dev/null sed -ri 's/(\[([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})(\])([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\6/g' '/zulualpha-diagnostics-20241015-1343/config/network.cfg' 2>/dev/null sed -ri 's/(([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})(\/[0-9]{1,3})([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\7/g' '/zulualpha-diagnostics-20241015-1343/config/network.cfg' 2>/dev/null /usr/local/emhttp/webGui/scripts/show_interfaces ip|tr -d ' '|tr '#' ' '|tr ',' ' ' >'/zulualpha-diagnostics-20241015-1343/config/listen.txt' /usr/local/emhttp/webGui/scripts/error_interfaces|sed 's///' >>'/zulualpha-diagnostics-20241015-1343/config/listen.txt' sed -ri 's/(["\[ ])(127|10|172\.1[6-9]|172\.2[0-9]|172\.3[0-1]|192\.168)((\.[0-9]{1,3}){2,3}([/" .]|$))/\1@@@\2\3/g; s/(["\[ ][0-9]{1,3}\.)([0-9]{1,3}\.){2}([0-9]{1,3})([/" .]|$)/\1XXX.XXX.\3\4/g; s/@@@//g' '/zulualpha-diagnostics-20241015-1343/config/listen.txt' 2>/dev/null sed -ri 's/(([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\6/g' '/zulualpha-diagnostics-20241015-1343/config/listen.txt' 2>/dev/null sed -ri 's/(\[([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})(\])([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\6/g' '/zulualpha-diagnostics-20241015-1343/config/listen.txt' 2>/dev/null sed -ri 's/(([0-9a-f]{1,4}:){4})(([0-9a-f]{1,4}:){3}|:)([0-9a-f]{1,4})(\/[0-9]{1,3})([ .:/]|$)/\1XXXX:XXXX:XXXX:\5\7/g' '/zulualpha-diagnostics-20241015-1343/config/listen.txt' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1343/shares/appdata.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1343/shares/A-----e.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1343/shares/B-----s.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1343/shares/domains.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1343/shares/D-------s.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1343/shares/G---s.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1343/shares/isos.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1343/shares/M---a.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1343/shares/system.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1343/shares/VM.cfg' 2>/dev/null sed -ri 's/^(share(Comment|ReadList|WriteList)=")[^"]+/\1.../' '/zulualpha-diagnostics-20241015-1343/shares/Z---------------y.cfg' 2>/dev/null ls -l /dev/disk/by-id/[asun]* 2>/dev/null|sed '/-part/d;s|^.*/by-id/[^-]*-||;s|-> ../../||;s|:|-|' smartctl -x '/dev/sdd' 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/smart/HUH721010ALE601_2YGA4JMD-2024-07-16 disk1 (sdd).txt' smartctl -x '/dev/sdb' 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/smart/ST16000NM000D-3PC101_ZVTBE47N-2024-07-16 parity (sdb).txt' smartctl -x '/dev/sdc' 2>/dev/null|todos >'/zulualpha-diagnostics-20241015-1343/smart/ST16000NM000D-3PC101_ZVTBJQK2-2024-07-16 disk2 (sdc).txt' Force restart (power button again), then immediately went for GUI safe restart. Captured diag before mounting. (1350) System hangs while mounting. Force restart - GUI safe reboot - maintenance mode - diag. (1407) GUI reboot, normal. Tried mounting, system hang. Gave up. zulualpha-diagnostics-20241015-1320.zip zulualpha-diagnostics-20241015-1334.zip zulualpha-diagnostics-20241015-1337.zip zulualpha-diagnostics-20241015-1350.zip zulualpha-diagnostics-20241015-1407.zip

Hi all, I have a problem currently that prevents me from removing certain directories/ files in my appdata directory for my dockers. In particular, I have a problem in removing this specific dir; "/mnt/user/appdata/bbergle-jellyfin/metadata/library". I first noticed a problem when doing anything with docker after power loss (I turned my house breaker off installing some lights... multiple times... without UPS... oops), then confirmed it was a problem after disabling docker. I tried fixing it by deleting docker .img file, and then restoring from my appdata backup plugin. It always hanged up the entire system, so I decided to clean it all. I tried rm -rf /mnt/user/appdata, but it hanged the same way as if I tried to restore. I then tried rm -rf --verbose and individually removed each docker dir, then found out it always hung on that specific jellyfin dir. Is there a way to forcibly remove this appdata share or this problematic dir? Currently when it hangs, I cannot even kill the rm -rf process via open files. /mnt/user/appdata (working directory) /mnt/user/appdata/bbergle-jellyfin/metadata/library/0f /mnt/user/appdata/bbergle-jellyfin/metadata /mnt/user/appdata/bbergle-jellyfin/metadata/library /mnt/user/appdata/bbergle-jellyfin/metad...rary/0f/0f206794f8026ce960d2a1ef94b57379 /mnt/user/appdata/bbergle-jellyfin/metad...f206794f8026ce960d2a1ef94b57379/chapters Ending process 4171... Checking... Process 4171 could not be gently killed... will use SIGKILL... Process 4171 ()... FAILED.... I cannot even shut down system with the shutdown command/ button, and must cycle power to restart. Thanks. System specs if it helps; Unraid OS Starter 6.12.13 ASRock B760M PG Lightning/D4, 12th Gen Intel® Core™ i3-12100 @ 4059 MHz, 16 GiB DDR4 Array in hybrid ZFS Parity - 16TB Re-certified Seagate Exos X20 Disk 1 - 10TB Re-certified HGST Ultrastar He10 Disk 2 - 16TB Re-certified Seagate Exos X20 Pool in RAID 0 ZFS Cache 1 - 512GB SK PC601 Cache 2 - 2TB Seagate Firecuda 530