FTW

ok thanks a lot!! and if that happen to me again, is that mean the NVME are dead/faulty and need replacement or its because the server crashed during a write on the cache pool and should be fix with a backup?

thanks a lot for your help JorgeB

nope, failed again 😪

okay, let me reboot and try again if fails, to destroy I need to decrypt, and then zpool destroy cache ??

root@Tower:~# cryptsetup luksOpen /dev/nvme0n1p1 nvme0n1p1 --allow-discards Enter passphrase for /dev/nvme0n1p1: root@Tower:~# zpool import pool: cache id: 13452574719722492999 state: ONLINE action: The pool can be imported using its name or numeric identifier. config: cache ONLINE nvme0n1p1 ONLINE root@Tower:~# zpool import -F cache it work but stuck after the import -F cache... syslog: Feb 22 06:26:35 Tower kernel: WARNING: Pool 'cache' has encountered an uncorrectable I/O failure and has been suspended. Feb 22 06:26:35 Tower kernel:

so what would be my best option to format my cache pool? Start Array with 'No Device' in my cache pool? or there a special way to format it?

here the syslog and I do understand it know why you don't recommend using encryption uhuh 😪😅

syslog.txt

okay, but starting my array, make it get stuck at mounting my Cache Pools because of the suspend my whole array still offline and at the moment in terminal, zpool import -F cache seem to get stuck, no answer and nothing in logs

root@Tower:~# zpool import no pools available to import root@Tower:~# zpool import -F cache cannot import 'cache': no such pool available root@Tower:~# zpool import -D cache cannot import 'cache': no such pool available root@Tower:~# zpool destroy -f Cache cannot open 'Cache': no such pool root@Tower:~# zpool destroy -f cache cannot open 'cache': no such pool that's before I click on Array Start

damn okk so what the correct command to try with the -F?? zpool import -F my-nvme-id. ? and to destroy? zpool import -D my-nvme-id or /mnt/cache?

same thing Before and After

here my diagnostics before start the Array the diagnostics after trying to start the Array seem to get stuck at /usr/sbin/zpool status 2>/dev/null|todos >>'/tower-diagnostics-20240221-0302/system/zfs-info.txt' so I am unable to get a better diagn after Start of the Array unable also to attach my syslog.txt... upload failed but every drives are mounted successfully except the Cache drive + that Feb 21 02:29:20 Tower ntpd[1818]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized that I don't know how to fix it.... zpool import output = no pools available to import for both before and after Starting the Array as a resume: Array failed to start because it get stuck at mounting the Cache (NVME) which is suspended Feb 21 02:58:43 Tower kernel: WARNING: Pool 'cache' has encountered an uncorrectable I/O failure and has been suspended. oh and my cache pool are ZFS tower-diagnostics-20240221-0229.zip

it said this after I start the Array no pools available to import

yes I did and it was stable (see to be a temperature issue or CPU from what I found on google) but now, I got a bigger issue unraid Pool 'cache' has encountered an uncorrectable I/O failure and has been suspended. unable to mount my cache pool after a crash... - switch nvme slot and same issue the nvme is a brand new from less than 1 month ago what's should I do to fix? cannot scrub since the Array don't want to start, get stuck at cache pool. all others hdd are mounted I even tried to downgrade OS version (6.12.4 been stable on my other server) to since I did the upgrade yesterday to the newer one (6.12.8). Unsuccessful Feb 20 03:21:17 Tower emhttpd: mounting /mnt/cache Feb 20 03:21:17 Tower emhttpd: shcmd (256): mkdir -p /mnt/cache Feb 20 03:21:17 Tower emhttpd: /usr/sbin/zpool import -d /dev/mapper/nvme0n1p1 2>&1 Feb 20 03:21:17 Tower emhttpd: pool: cache Feb 20 03:21:17 Tower emhttpd: id: 13452574719722492999 Feb 20 03:21:17 Tower emhttpd: shcmd (257): /usr/sbin/zpool import -N -o autoexpand=on -d /dev/mapper/nvme0n1p1 13452574719722492999 cache Feb 20 03:21:17 Tower kernel: WARNING: Pool 'cache' has encountered an uncorrectable I/O failure and has been suspended. Feb 20 03:21:17 Tower kernel: Feb 20 03:23:22 Tower shutdown[26121]: shutting down for system halt Feb 20 03:23:22 Tower init: Switching to runlevel: 0 Feb 20 03:23:22 Tower init: Trying to re-exec init Feb 20 03:23:28 Tower monitor: Stop running nchan processes Feb 20 03:23:42 Tower ntpd[1803]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized better format the nvme from the cache pool? if yes, how do I do this? I got only 1 nvme in the cache pool at the moment didnt make it on raid yet, was testing the new GEN 5 NVME from Crucial... thanks if need, diag and whole syslog can be post later after work