ZFS has invalid COMPRESS 24

[sgaert]

Hey,

 

today my server stopped working. 

Error is: 

PANIC: cache: blkptr at 000000009b7d17f2 has invalid COMPRESS 24

 

After a reboot the error stay and I seen that it happend when the cache get's mounted. 

Oct 25 20:09:27 Zuhause emhttpd: mounting /mnt/cache
Oct 25 20:09:27 Zuhause emhttpd: shcmd (133): mkdir -p /mnt/cache
Oct 25 20:09:27 Zuhause emhttpd: shcmd (134): /usr/sbin/zpool import -N -o autoexpand=on  -d /dev/nvme0n1p1 -d /dev/nvme1n1p1 10906228358673942235 cache
Oct 25 20:09:42 Zuhause emhttpd: shcmd (135): /usr/sbin/zfs set mountpoint=/mnt/cache cache
Oct 25 20:09:43 Zuhause emhttpd: shcmd (136): /usr/sbin/zfs set atime=off cache
Oct 25 20:09:43 Zuhause emhttpd: shcmd (137): /usr/sbin/zfs mount cache
Oct 25 20:09:47 Zuhause kernel: PANIC: cache: blkptr at 000000009b7d17f2 has invalid COMPRESS 24
Oct 25 20:09:47 Zuhause kernel: Showing stack for process 19697
Oct 25 20:09:47 Zuhause kernel: CPU: 7 PID: 19697 Comm: dp_sync_taskq Tainted: P           O       6.1.49-Unraid #1
Oct 25 20:09:47 Zuhause kernel: Hardware name: ASUS System Product Name/ROG STRIX B550-E GAMING, BIOS 3002 02/23/2023
Oct 25 20:09:47 Zuhause kernel: Call Trace:
Oct 25 20:09:47 Zuhause kernel: <TASK>
Oct 25 20:09:47 Zuhause kernel: dump_stack_lvl+0x44/0x5c
Oct 25 20:09:47 Zuhause kernel: vcmn_err+0x86/0xc3 [spl]
Oct 25 20:09:47 Zuhause kernel: ? __entry_text_start+0x24/0x30
Oct 25 20:09:47 Zuhause kernel: ? pn_free+0x24/0x24 [zfs]
Oct 25 20:09:47 Zuhause kernel: ? number+0x195/0x311
Oct 25 20:09:47 Zuhause kernel: zfs_panic_recover+0x6b/0x86 [zfs]
Oct 25 20:09:47 Zuhause kernel: zfs_blkptr_verify_log+0x98/0xfc [zfs]
Oct 25 20:09:47 Zuhause kernel: ? _raw_spin_unlock+0x14/0x29
Oct 25 20:09:47 Zuhause kernel: ? raw_spin_rq_unlock_irq+0x5/0x10
Oct 25 20:09:47 Zuhause kernel: ? preempt_latency_start+0x2b/0x46
Oct 25 20:09:47 Zuhause kernel: ? _raw_spin_lock+0x13/0x1c
Oct 25 20:09:47 Zuhause kernel: ? metaslab_free_concrete+0x1c9/0x1db [zfs]
Oct 25 20:09:47 Zuhause kernel: ? _raw_spin_unlock+0x14/0x29
Oct 25 20:09:47 Zuhause kernel: ? metaslab_free_impl+0xb7/0xc5 [zfs]
Oct 25 20:09:47 Zuhause kernel: ? dbuf_find_dirty_lte+0x14/0x44 [zfs]
Oct 25 20:09:47 Zuhause kernel: ? preempt_latency_start+0x2b/0x46
Oct 25 20:09:47 Zuhause kernel: zfs_blkptr_verify+0xd0/0x380 [zfs]
Oct 25 20:09:47 Zuhause kernel: ? dsl_dir_diduse_transfer_space+0xee/0x120 [zfs]
Oct 25 20:09:47 Zuhause kernel: zio_free+0x21/0xe9 [zfs]
Oct 25 20:09:47 Zuhause kernel: dsl_dataset_block_kill+0x1da/0x42e [zfs]
Oct 25 20:09:47 Zuhause kernel: free_blocks+0x65/0x183 [zfs]
Oct 25 20:09:47 Zuhause kernel: free_children+0x1ca/0x36b [zfs]
Oct 25 20:09:47 Zuhause kernel: free_children+0x2b0/0x36b [zfs]
Oct 25 20:09:47 Zuhause kernel: dnode_sync_free_range+0x1d1/0x254 [zfs]
Oct 25 20:09:47 Zuhause kernel: ? free_children+0x36b/0x36b [zfs]
Oct 25 20:09:47 Zuhause kernel: range_tree_walk+0x70/0xa6 [zfs]
Oct 25 20:09:47 Zuhause kernel: dnode_sync+0x367/0x8ef [zfs]
Oct 25 20:09:47 Zuhause kernel: ? raw_spin_rq_unlock_irq+0x5/0x10
Oct 25 20:09:47 Zuhause kernel: ? finish_task_switch.isra.0+0x140/0x218
Oct 25 20:09:47 Zuhause kernel: ? __schedule+0x5ba/0x612
Oct 25 20:09:47 Zuhause kernel: ? preempt_latency_start+0x2b/0x46
Oct 25 20:09:47 Zuhause kernel: sync_dnodes_task+0x7f/0x9e [zfs]
Oct 25 20:09:47 Zuhause kernel: taskq_thread+0x269/0x38a [spl]
Oct 25 20:09:47 Zuhause kernel: ? wake_up_q+0x44/0x44
Oct 25 20:09:47 Zuhause kernel: ? taskq_dispatch_delay+0x106/0x106 [spl]
Oct 25 20:09:47 Zuhause kernel: kthread+0xe7/0xef
Oct 25 20:09:47 Zuhause kernel: ? kthread_complete_and_exit+0x1b/0x1b
Oct 25 20:09:47 Zuhause kernel: ret_from_fork+0x22/0x30
Oct 25 20:09:47 Zuhause kernel: </TASK>

 

i tried a zpool status cache -v.

  pool: cache
 state: ONLINE
status: One or more devices has experienced an error resulting in data
        corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
        entire pool from backup.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-8A
  scan: resilvered 3.90M in 00:00:00 with 0 errors on Wed Oct 25 18:38:38 2023
config:

        NAME           STATE     READ WRITE CKSUM
        cache          ONLINE       0     0     0
          mirror-0     ONLINE       0     0     0
            nvme0n1p1  ONLINE       0     0     0
            nvme1n1p1  ONLINE       0     0     0

errors: Permanent errors have been detected in the following files:

        cache:/system/docker/docker.img

 

could be the demage on the docker.img be the source for the mount error?

How can I delete the docker.img from the pool without mount?

 

 

zuhause-diagnostics-20231025-2013.zip

[JorgeB]

See if it mounts read only, and if yes backup and re-format:

 

zpool import -o readonly=on cache