December 20, 2025Dec 20 Hi All,Having an issue with a ZFS pool of 3 SSDs. I upgraded from 7.1.4 to 7.2.3 and had the issue but it occurs after reverting so I assume it was after the reboot rather than an issue with the upgrade.It seemed to work fine previous to the update/reboot and now just shows as unmountable: wrong or no file system.zpool status gives "no pools available"zpool import gives output: pool: mainssdpool id: 12816103719016567963 state: FAULTEDstatus: One or more devices contains corrupted data.action: The pool cannot be imported due to damaged devices or data. The pool may be active on another system, but can be imported using the '-f' flag. see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-5Econfig: mainssdpool FAULTED corrupted data raidz1-0 DEGRADED sdo1 ONLINE sdp1 ONLINE sdq1 UNAVAIL invalid labelAfter some looking around also attempted zdb -lu /dev/sdq:failed to unpack label 0failed to unpack label 1failed to unpack label 2------------------------------------LABEL 2 (Bad label cksum)------------------------------------ Uberblock[0] magic = 0000000000bab10c version = 5000 txg = 33354688 guid_sum = 17243354706007581016 timestamp = 1766198021 UTC = Sat Dec 20 13:33:41 2025 bp = DVA[0]=<0:4d7fba22000:2000> DVA[1]=<0:4dbbbd30000:2000> DVA[2]=<0:4df5c8b0000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354688L/33354688P fill=451 cksum=00000004742a6281:00001132d2320f85:00213e5d24dd4547:2ae2dea44a39d8ca mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[4] magic = 0000000000bab10c version = 5000 txg = 33354689 guid_sum = 17243354706007581016 timestamp = 1766198026 UTC = Sat Dec 20 13:33:46 2025 bp = DVA[0]=<0:4f102210000:2000> DVA[1]=<0:4ee388a0000:2000> DVA[2]=<0:4df5c8e8000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354689L/33354689P fill=450 cksum=0000000347c7a5f5:00000cb2ecf16849:00189b81824268e0:1fd314da408d2d0a mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[8] magic = 0000000000bab10c version = 5000 txg = 33354690 guid_sum = 17243354706007581016 timestamp = 1766198032 UTC = Sat Dec 20 13:33:52 2025 bp = DVA[0]=<0:4f102220000:2000> DVA[1]=<0:4ee388b0000:2000> DVA[2]=<0:4df5c920000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354690L/33354690P fill=450 cksum=0000000336e61218:00000c735ad012da:001823b9e821492d:1f3c85555a416422 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[12] magic = 0000000000bab10c version = 5000 txg = 33354691 guid_sum = 17243354706007581016 timestamp = 1766198037 UTC = Sat Dec 20 13:33:57 2025 bp = DVA[0]=<0:4eb908dc000:2000> DVA[1]=<0:4aa7c788000:2000> DVA[2]=<0:4df5c956000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354691L/33354691P fill=449 cksum=000000031f2a71c3:00000c159b7a5936:00176a8d56f9f6c9:1e48a42160913438 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[16] magic = 0000000000bab10c version = 5000 txg = 33354692 guid_sum = 17243354706007581016 timestamp = 1766198042 UTC = Sat Dec 20 13:34:02 2025 bp = DVA[0]=<0:4d7fbab8000:2000> DVA[1]=<0:4dbbbdc6000:2000> DVA[2]=<0:4df5c98c000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354692L/33354692P fill=450 cksum=00000004c4f33180:00001269368ddc4d:002393462b2be923:2de0ed4d5a05764c mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[20] magic = 0000000000bab10c version = 5000 txg = 33354693 guid_sum = 17243354706007581016 timestamp = 1766198047 UTC = Sat Dec 20 13:34:07 2025 bp = DVA[0]=<0:4eb9098e000:2000> DVA[1]=<0:4aa7c7e8000:2000> DVA[2]=<0:4df5c9d6000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354693L/33354693P fill=451 cksum=000000042692e1bd:00001006a18dfaa7:001ef923f726494e:27f3f24003aebad7 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[24] magic = 0000000000bab10c version = 5000 txg = 33354694 guid_sum = 17243354706007581016 timestamp = 1766198052 UTC = Sat Dec 20 13:34:12 2025 bp = DVA[0]=<0:4d7fbb00000:2000> DVA[1]=<0:4dbbbe0e000:2000> DVA[2]=<0:4df5ca0c000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354694L/33354694P fill=451 cksum=00000004e97c0ec1:000012f394cd2127:002499881755dc76:2f2c9af4cd2edc30 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[28] magic = 0000000000bab10c version = 5000 txg = 33354695 guid_sum = 17243354706007581016 timestamp = 1766198057 UTC = Sat Dec 20 13:34:17 2025 bp = DVA[0]=<0:4f102286000:2000> DVA[1]=<0:4ee38916000:2000> DVA[2]=<0:4af8abfe000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354695L/33354695P fill=451 cksum=0000000425b912da:00001002f61919ee:001ef141695c9efa:27e8b0d6f75a356b mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[32] magic = 0000000000bab10c version = 5000 txg = 33354696 guid_sum = 17243354706007581016 timestamp = 1766198062 UTC = Sat Dec 20 13:34:22 2025 bp = DVA[0]=<0:4eb90a76000:2000> DVA[1]=<0:4a29e402000:2000> DVA[2]=<0:4af8ac36000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354696L/33354696P fill=451 cksum=00000003983a86dc:00000de7724ad50a:001aeba3981a08b6:22c96ab203e58e57 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[36] magic = 0000000000bab10c version = 5000 txg = 33354697 guid_sum = 17243354706007581016 timestamp = 1766198067 UTC = Sat Dec 20 13:34:27 2025 bp = DVA[0]=<0:4d7fbc02000:2000> DVA[1]=<0:4dbbbebe000:2000> DVA[2]=<0:4af8ac72000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354697L/33354697P fill=452 cksum=000000037d8b24c3:00000d80f33415da:001a269a69a1def5:21cca6e71986854f mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[40] magic = 0000000000bab10c version = 5000 txg = 33354698 guid_sum = 17243354706007581016 timestamp = 1766198073 UTC = Sat Dec 20 13:34:33 2025 bp = DVA[0]=<0:4f1022e0000:2000> DVA[1]=<0:4ee38942000:2000> DVA[2]=<0:4af8aca8000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354698L/33354698P fill=452 cksum=000000041321be2b:00000fbd7aac431f:001e6f5ba3ab8f63:2746ba6540c702b3 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[44] magic = 0000000000bab10c version = 5000 txg = 33354699 guid_sum = 17243354706007581016 timestamp = 1766198078 UTC = Sat Dec 20 13:34:38 2025 bp = DVA[0]=<0:4eb90b2a000:2000> DVA[1]=<0:4a29e484000:2000> DVA[2]=<0:4af8ace0000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354699L/33354699P fill=450 cksum=000000047f695916:0000115beafde149:0021894d5c8ccc21:2b3dbf52b46f61b2 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[48] magic = 0000000000bab10c version = 5000 txg = 33354700 guid_sum = 17243354706007581016 timestamp = 1766198083 UTC = Sat Dec 20 13:34:43 2025 bp = DVA[0]=<0:4eb90b8e000:2000> DVA[1]=<0:4a29e4b8000:2000> DVA[2]=<0:4af8ad16000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354700L/33354700P fill=450 cksum=000000043aff83e7:00001053cc9b93b0:001f8afa89da63fa:28abc1e4c811a461 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[52] magic = 0000000000bab10c version = 5000 txg = 33354701 guid_sum = 17243354706007581016 timestamp = 1766198088 UTC = Sat Dec 20 13:34:48 2025 bp = DVA[0]=<0:4f466368000:2000> DVA[1]=<0:4e00f43e000:2000> DVA[2]=<0:4aa7c834000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354701L/33354701P fill=450 cksum=00000003b8d384ce:00000e601474b7aa:001bcacdb1947f48:23dc8ee012e1571d mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[56] magic = 0000000000bab10c version = 5000 txg = 33354702 guid_sum = 17243354706007581016 timestamp = 1766198093 UTC = Sat Dec 20 13:34:53 2025 bp = DVA[0]=<0:4eb90c38000:2000> DVA[1]=<0:4a29e532000:2000> DVA[2]=<0:4aa7c870000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354702L/33354702P fill=451 cksum=00000003452b5aa4:00000ca55790921c:00187a861ae645b3:1f9fea2b9a283a83 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[60] magic = 0000000000bab10c version = 5000 txg = 33354703 guid_sum = 17243354706007581016 timestamp = 1766198098 UTC = Sat Dec 20 13:34:58 2025 bp = DVA[0]=<0:4eb90c80000:2000> DVA[1]=<0:4a29e54a000:2000> DVA[2]=<0:4aa7c8b6000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354703L/33354703P fill=450 cksum=00000004da561738:000012b5428bdb5d:002419bf4a8f3b15:2e7e67d493c898ed mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[64] magic = 0000000000bab10c version = 5000 txg = 33354704 guid_sum = 17243354706007581016 timestamp = 1766198103 UTC = Sat Dec 20 13:35:03 2025 bp = DVA[0]=<0:4d7fbe42000:2000> DVA[1]=<0:4dbbc06e000:2000> DVA[2]=<0:4aa7c8f0000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354704L/33354704P fill=449 cksum=000000046426f91f:000010f166df9215:0020b90e9ee3ce98:2a2e248d8a7f54d2 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[68] magic = 0000000000bab10c version = 5000 txg = 33354705 guid_sum = 17243354706007581016 timestamp = 1766198108 UTC = Sat Dec 20 13:35:08 2025 bp = DVA[0]=<0:4f4663de000:2000> DVA[1]=<0:4e00f47c000:2000> DVA[2]=<0:4aa7c92e000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354705L/33354705P fill=449 cksum=000000046e8ed3e5:0000111a85992127:00210a4bcbb1093c:2a9923db973c7828 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[72] magic = 0000000000bab10c version = 5000 txg = 33354706 guid_sum = 17243354706007581016 timestamp = 1766198114 UTC = Sat Dec 20 13:35:14 2025 bp = DVA[0]=<0:4f1023be000:2000> DVA[1]=<0:4ee389e0000:2000> DVA[2]=<0:4aa7c962000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354706L/33354706P fill=449 cksum=00000003110f915c:00000bdda286af34:0016fb70ed8b3e5d:1db585afcecb1f9b mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[76] magic = 0000000000bab10c version = 5000 txg = 33354707 guid_sum = 17243354706007581016 timestamp = 1766198119 UTC = Sat Dec 20 13:35:19 2025 bp = DVA[0]=<0:4f466496000:2000> DVA[1]=<0:4e00f4a4000:2000> DVA[2]=<0:4aa7c998000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354707L/33354707P fill=449 cksum=000000050219cf00:0000134fd6e9220c:0025466e59f4df7c:3004a0a6098f22c8 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[80] magic = 0000000000bab10c version = 5000 txg = 33354676 guid_sum = 17243354706007581016 timestamp = 1766197960 UTC = Sat Dec 20 13:32:40 2025 bp = DVA[0]=<0:4d7fb6f4000:2000> DVA[1]=<0:4dbbbad8000:2000> DVA[2]=<0:4af8aa82000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354676L/33354676P fill=449 cksum=00000004407ec74d:00001068908e2432:001fb23d3e23c29b:28dd4b3bf501eced mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[84] magic = 0000000000bab10c version = 5000 txg = 33354677 guid_sum = 17243354706007581016 timestamp = 1766197965 UTC = Sat Dec 20 13:32:45 2025 bp = DVA[0]=<0:4d7fb75c000:2000> DVA[1]=<0:4dbbbb10000:2000> DVA[2]=<0:4af8aaba000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354677L/33354677P fill=449 cksum=0000000445344fe7:0000107d215ec948:001fde81d2a935c4:291c1d919e1761b5 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[88] magic = 0000000000bab10c version = 5000 txg = 33354678 guid_sum = 17243354706007581016 timestamp = 1766197970 UTC = Sat Dec 20 13:32:50 2025 bp = DVA[0]=<0:4d7fb7ca000:2000> DVA[1]=<0:4dbbbb4e000:2000> DVA[2]=<0:4af8aaf0000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354678L/33354678P fill=449 cksum=00000003f13bff5b:00000f3c33ba8944:001d7898d672d006:260c69119d92525f mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[92] magic = 0000000000bab10c version = 5000 txg = 33354679 guid_sum = 17243354706007581016 timestamp = 1766197975 UTC = Sat Dec 20 13:32:55 2025 bp = DVA[0]=<0:4f102120000:2000> DVA[1]=<0:4ee387b0000:2000> DVA[2]=<0:4af8ab28000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354679L/33354679P fill=449 cksum=00000004a2e867b8:000011e3cb99c88a:00228da344d1d459:2c8a9f501cb86f9f mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[96] magic = 0000000000bab10c version = 5000 txg = 33354680 guid_sum = 17243354706007581016 timestamp = 1766197980 UTC = Sat Dec 20 13:33:00 2025 bp = DVA[0]=<0:4eb90558000:2000> DVA[1]=<0:4aa7c606000:2000> DVA[2]=<0:4af8ab60000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354680L/33354680P fill=449 cksum=000000046e8b5c1d:000011172beee6fe:0020fd93deaea480:2a80d98138c6211e mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[100] magic = 0000000000bab10c version = 5000 txg = 33354681 guid_sum = 17243354706007581016 timestamp = 1766197985 UTC = Sat Dec 20 13:33:05 2025 bp = DVA[0]=<0:4eb90574000:2000> DVA[1]=<0:4aa7c622000:2000> DVA[2]=<0:4af8ab98000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354681L/33354681P fill=449 cksum=000000038c436024:00000db7697bfa3f:001a8b56078254c5:2248d3652d83cb82 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[104] magic = 0000000000bab10c version = 5000 txg = 33354682 guid_sum = 17243354706007581016 timestamp = 1766197991 UTC = Sat Dec 20 13:33:11 2025 bp = DVA[0]=<0:4a29e3b4000:2000> DVA[1]=<0:4e00f2ec000:2000> DVA[2]=<0:4af8abce000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354682L/33354682P fill=449 cksum=0000000358f58c8c:00000cf461fccae1:00191847f126eddf:2071bc1eb4cf5d02 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[108] magic = 0000000000bab10c version = 5000 txg = 33354683 guid_sum = 17243354706007581016 timestamp = 1766197996 UTC = Sat Dec 20 13:33:16 2025 bp = DVA[0]=<0:4f466194000:2000> DVA[1]=<0:4e00f2f8000:2000> DVA[2]=<0:4df5c798000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354683L/33354683P fill=450 cksum=000000045a6cb343:000010cc1fc8bc7a:002071a1235917c7:29d2e6d9dd7e0e3c mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[112] magic = 0000000000bab10c version = 5000 txg = 33354684 guid_sum = 17243354706007581016 timestamp = 1766198001 UTC = Sat Dec 20 13:33:21 2025 bp = DVA[0]=<0:4f10218e000:2000> DVA[1]=<0:4ee3881e000:2000> DVA[2]=<0:4df5c7d4000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354684L/33354684P fill=451 cksum=00000004d0b80810:0000129197e66a6d:0023d7ae35d0a59d:2e2cebda41f12cd8 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[116] magic = 0000000000bab10c version = 5000 txg = 33354685 guid_sum = 17243354706007581016 timestamp = 1766198006 UTC = Sat Dec 20 13:33:26 2025 bp = DVA[0]=<0:4f4661d2000:2000> DVA[1]=<0:4e00f336000:2000> DVA[2]=<0:4df5c80c000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354685L/33354685P fill=452 cksum=00000004d28fd13b:0000129dbc122c15:0023f8b1a7dd8673:2e639b960066a40a mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[120] magic = 0000000000bab10c version = 5000 txg = 33354686 guid_sum = 17243354706007581016 timestamp = 1766198011 UTC = Sat Dec 20 13:33:31 2025 bp = DVA[0]=<0:4d7fb964000:2000> DVA[1]=<0:4dbbbcd4000:2000> DVA[2]=<0:4df5c842000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354686L/33354686P fill=452 cksum=00000003d32ced97:00000ec6a265b7d0:001c9298bcf9913a:24e053439143e2be mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 Uberblock[124] magic = 0000000000bab10c version = 5000 txg = 33354687 guid_sum = 17243354706007581016 timestamp = 1766198016 UTC = Sat Dec 20 13:33:36 2025 bp = DVA[0]=<0:4d7fb996000:2000> DVA[1]=<0:4dbbbd06000:2000> DVA[2]=<0:4df5c87a000:2000> [L0 DMU objset] fletcher4 uncompressed unencrypted LE contiguous unique triple size=1000L/1000P birth=33354687L/33354687P fill=452 cksum=000000033a4c7a53:00000c7d58b0a814:00183111cc0c68b4:1f4627ef96ed4ec0 mmp_magic = 00000000a11cea11 mmp_delay = 0 mmp_valid = 0 checkpoint_txg = 0 raidz_reflow state=0 off=0 labels = 2 3 failed to unpack label 3Any solution to this or do I have to restore from backups? Pain in the ass otherwise, was under the impression that having 1 disk redundancy would cover disk failure if that is what this is.Diagnostics attachedThanks! licenas-diagnostics-20251220-1458.zip
December 20, 2025Dec 20 Community Expert The pool may have other issues, if it was just an issue with sdq it should still import, but try this type echo 1 > /sys/block/sdq/device/deleteThis will drop that disk offline (until a reboot), wait a few seconds, and post the output from zpool import -f mainssdpool
December 20, 2025Dec 20 Author 59 minutes ago, JorgeB said:The pool may have other issues, if it was just an issue with sdq it should still import, but try this type echo 1 > /sys/block/sdq/device/deleteThis will drop that disk offline (until a reboot), wait a few seconds, and post the output fromzpool import -f mainssdpoolThanks for the response! output:cannot import 'mainssdpool': I/O errorDestroy and re-create the pool froma backup source. Edited December 20, 2025Dec 20 by lbrwnie
December 20, 2025Dec 20 Community Expert That confirms the pool has other issues, post the output fromtail -n 100 /proc/spl/kstat/zfs/dbgmsgand also the output of zdb -l /dev/sdX1 | grep txg | head -n 1for remaining two pool devices, replace X with the correct letter, and note the 1 at the end
December 20, 2025Dec 20 Author First command:1766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load($import-ffff888108974200-mainssdpool, config untrusted): UNLOADING1766202600 ffff888108974200 metaslab.c:1689:spa_set_allocator(): spa allocator: dynamic1766202600 ffff888108974200 spa.c:6773:spa_import(): spa_import: importing mainssdpool1766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config trusted): LOADING1766202600 ffff88827d702100 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdp1': probe done, cant_read=0 cant_write=11766202600 ffff88827d702100 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': probe done, cant_read=0 cant_write=11766202600 ffff88827d702100 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': probe done, cant_read=0 cant_write=11766202600 ffff8882596d9080 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': vdev_validate: failed reading config for txg 184467440737095516151766202600 ffff888108974200 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': best uberblock found for spa mainssdpool. txg 333547071766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): using uberblock with txg=333547071766202600 ffff888108974200 spa_misc.c:415:spa_load_failed(): spa_load(mainssdpool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]1766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): UNLOADING1766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): spa_load_retry: rewind, max txg: 333547061766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): LOADING1766202600 ffff888254445280 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdp1': probe done, cant_read=0 cant_write=11766202600 ffff888254445280 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': probe done, cant_read=0 cant_write=11766202600 ffff888254445280 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': probe done, cant_read=0 cant_write=11766202600 ffff888207b92100 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': vdev_validate: failed reading config for txg 184467440737095516151766202600 ffff888108974200 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': best uberblock found for spa mainssdpool. txg 333547061766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): using uberblock with txg=333547061766202600 ffff888108974200 spa_misc.c:415:spa_load_failed(): spa_load(mainssdpool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]1766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): UNLOADING1766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): spa_load_retry: rewind, max txg: 333547051766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): LOADING1766202600 ffff8882778ec200 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': probe done, cant_read=0 cant_write=11766202600 ffff8882778ec200 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdp1': probe done, cant_read=0 cant_write=11766202600 ffff8882778ec200 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': probe done, cant_read=0 cant_write=11766202600 ffff88827d704200 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': vdev_validate: failed reading config for txg 184467440737095516151766202600 ffff888108974200 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': best uberblock found for spa mainssdpool. txg 333547051766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): using uberblock with txg=333547051766202600 ffff888108974200 spa_misc.c:415:spa_load_failed(): spa_load(mainssdpool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]1766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): UNLOADING1766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): spa_load_retry: rewind, max txg: 333547041766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): LOADING1766202600 ffff888225770000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': probe done, cant_read=0 cant_write=11766202600 ffff888225770000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdp1': probe done, cant_read=0 cant_write=11766202600 ffff888225770000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': probe done, cant_read=0 cant_write=11766202600 ffff8881054dd280 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': vdev_validate: failed reading config for txg 184467440737095516151766202600 ffff888108974200 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': best uberblock found for spa mainssdpool. txg 333547041766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): using uberblock with txg=333547041766202600 ffff888108974200 spa_misc.c:415:spa_load_failed(): spa_load(mainssdpool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]1766202600 ffff888108974200 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): UNLOADING1766203203 ffff8881f9e60000 metaslab.c:1689:spa_set_allocator(): spa allocator: dynamic1766203203 ffff8881f9e60000 spa.c:6928:spa_tryimport(): spa_tryimport: importing mainssdpool1766203203 ffff8881f9e60000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff8881f9e60000-mainssdpool, config trusted): LOADING1766203203 ffff888219d3a100 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdp1': probe done, cant_read=0 cant_write=11766203203 ffff888219d3a100 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': probe done, cant_read=0 cant_write=11766203203 ffff888219d3a100 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': probe done, cant_read=0 cant_write=11766203203 ffff88821dd40000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': vdev_validate: failed reading config for txg 184467440737095516151766203203 ffff8881f9e60000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': best uberblock found for spa $import-ffff8881f9e60000-mainssdpool. txg 333547071766203203 ffff8881f9e60000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff8881f9e60000-mainssdpool, config untrusted): using uberblock with txg=333547071766203203 ffff8881f9e60000 spa_misc.c:415:spa_load_failed(): spa_load($import-ffff8881f9e60000-mainssdpool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]1766203203 ffff8881f9e60000 spa_misc.c:429:spa_load_note(): spa_load($import-ffff8881f9e60000-mainssdpool, config untrusted): UNLOADING1766221144 ffff888223c03180 metaslab.c:1689:spa_set_allocator(): spa allocator: dynamic1766221144 ffff888223c03180 spa.c:6928:spa_tryimport(): spa_tryimport: importing mainssdpool1766221144 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load($import-ffff888223c03180-mainssdpool, config trusted): LOADING1766221144 ffff888612c85280 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdp1': probe done, cant_read=0 cant_write=11766221144 ffff888612c85280 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': probe done, cant_read=0 cant_write=11766221145 ffff888616abc200 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': open error=2 timeout=1009314682/10000000001766221145 ffff888223c03180 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': best uberblock found for spa $import-ffff888223c03180-mainssdpool. txg 333547071766221145 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load($import-ffff888223c03180-mainssdpool, config untrusted): using uberblock with txg=333547071766221145 ffff888223c03180 spa_misc.c:415:spa_load_failed(): spa_load($import-ffff888223c03180-mainssdpool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]1766221145 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load($import-ffff888223c03180-mainssdpool, config untrusted): UNLOADING1766221145 ffff888223c03180 metaslab.c:1689:spa_set_allocator(): spa allocator: dynamic1766221145 ffff888223c03180 spa.c:6773:spa_import(): spa_import: importing mainssdpool1766221145 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config trusted): LOADING1766221145 ffff88813bdee300 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdp1': probe done, cant_read=0 cant_write=11766221145 ffff88813bdee300 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': probe done, cant_read=0 cant_write=11766221146 ffff888612cc5280 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': open error=2 timeout=1003634980/10000000001766221146 ffff888223c03180 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': best uberblock found for spa mainssdpool. txg 333547071766221146 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): using uberblock with txg=333547071766221146 ffff888223c03180 spa_misc.c:415:spa_load_failed(): spa_load(mainssdpool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]1766221146 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): UNLOADING1766221146 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): spa_load_retry: rewind, max txg: 333547061766221146 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): LOADING1766221146 ffff8882c7513180 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdp1': probe done, cant_read=0 cant_write=11766221146 ffff8882c7513180 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': probe done, cant_read=0 cant_write=11766221147 ffff8882d0deb180 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': open error=2 timeout=1007270919/10000000001766221147 ffff888223c03180 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': best uberblock found for spa mainssdpool. txg 333547061766221147 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): using uberblock with txg=333547061766221147 ffff888223c03180 spa_misc.c:415:spa_load_failed(): spa_load(mainssdpool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]1766221147 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): UNLOADING1766221147 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): spa_load_retry: rewind, max txg: 333547051766221147 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): LOADING1766221147 ffff88827d3ca100 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdp1': probe done, cant_read=0 cant_write=11766221147 ffff88827d3ca100 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': probe done, cant_read=0 cant_write=11766221148 ffff88861501e300 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': open error=2 timeout=1011007306/10000000001766221148 ffff888223c03180 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': best uberblock found for spa mainssdpool. txg 333547051766221148 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): using uberblock with txg=333547051766221148 ffff888223c03180 spa_misc.c:415:spa_load_failed(): spa_load(mainssdpool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]1766221148 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): UNLOADING1766221148 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): spa_load_retry: rewind, max txg: 333547041766221148 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): LOADING1766221148 ffff88813bdee300 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdp1': probe done, cant_read=0 cant_write=11766221148 ffff88813bdee300 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': probe done, cant_read=0 cant_write=11766221149 ffff888253868000 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdq1': open error=2 timeout=1007504317/10000000001766221149 ffff888223c03180 vdev.c:183:vdev_dbgmsg(): disk vdev '/dev/sdo1': best uberblock found for spa mainssdpool. txg 333547041766221150 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): using uberblock with txg=333547041766221150 ffff888223c03180 spa_misc.c:415:spa_load_failed(): spa_load(mainssdpool, config untrusted): FAILED: couldn't get 'config' value in MOS directory [error=5]1766221150 ffff888223c03180 spa_misc.c:429:spa_load_note(): spa_load(mainssdpool, config untrusted): UNLOADINGSecond command:First drive: txg: 31834836Second Drive: txg: 31834836
December 20, 2025Dec 20 Author 1 hour ago, JorgeB said:That confirms the pool has other issues, post the output fromtail -n 100 /proc/spl/kstat/zfs/dbgmsgand also the output ofzdb -l /dev/sdX1 | grep txg | head -n 1for remaining two pool devices, replace X with the correct letter, and note the 1 at the endForgot to quote you in the above so you didn't get a notif, sorry.
December 20, 2025Dec 20 Community Expert Doesn't look good. The metadata on the other pool devices is also corrupt and unable to reconstruct the MOS, and without that, the pool cannot be importedI would suspect some hardware issue, like bad RAM that corrupted the pool metadata, as a last resort, you can try:zpool import -f -F -X -o readonly=on mainssdpoolBut most likely it will also fail.P.S. Recommend running memtest on the server when possible
December 28, 2025Dec 28 Author On 12/20/2025 at 10:21 PM, JorgeB said:Doesn't look good. The metadata on the other pool devices is also corrupt and unable to reconstruct the MOS, and without that, the pool cannot be importedI would suspect some hardware issue, like bad RAM that corrupted the pool metadata, as a last resort, you can try:zpool import -f -F -X -o readonly=on mainssdpoolBut most likely it will also fail.P.S. Recommend running memtest on the server when possibleSorry for late reply, left for xmas and relaxed a bit haha.Looks like getting:cannot import 'mainssdpool': one or more devices is currently unavailableThat what you would expect in the failure?
December 28, 2025Dec 28 Community Expert Yep, I'm afraid you will likely need to recreate the pool. As a last resort, you can try again after disabling ZFS data and metadata verification. Flags will be reset after rebootecho 0 >/sys/module/zfs/parameters/spa_load_verify_dataecho 0 >/sys/module/zfs/parameters/spa_load_verify_metadataThen try reimporting the pool read-only again.
December 28, 2025Dec 28 Author 1 hour ago, JorgeB said:Yep, I'm afraid you will likely need to recreate the pool. As a last resort, you can try again after disabling ZFS data and metadata verification. Flags will be reset after rebootecho 0 >/sys/module/zfs/parameters/spa_load_verify_dataecho 0 >/sys/module/zfs/parameters/spa_load_verify_metadataThen try reimporting the pool read-only again.Yeah same error Thanks for your help looking at this anyways mate.
December 28, 2025Dec 28 Community Expert Don't have more suggestions, sorry. I think you'll need to recreate the pool and restore the data
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.