Was doing a standard restart of my system. Clean spindown, reboot, etc. Upon restart, it appeared that one of my RAID1 cache drives had died, ah bugger!

I have had issues with my HBA sometimes not coming online after a reboot, a simple reboot has sorted that, so I let the cache rebuild whatever it was rebuilding (scrubbing?) then I rebooted away.

This brought the second SSD back up and I assumed happy days, but it appears that the SSD that remained in the pool has somehow wiped. No docker, VMs, nothing.

I immediately stopped everything, I've taken ddrescue imgs of both cache drives. Have had a look around, and especially https://forums.unraid.net/topic/155716-data-loss-on-cache-devices-btrfs-commands-complain-warning-device-2-is-missing/ but it appears that checking btrfs still shows both drives fine? (nvme1n1p1 and nvme2n1p1)

root@Jupiter:~# btrfs fi sh -d

Label: none uuid: c4fcab53-7205-4176-b3aa-c938d2c06f06

Total devices 1 FS bytes used 35.33GiB

devid 1 size 3.49TiB used 40.02GiB path /dev/nvme0n1p1

Label: none uuid: b176ff8c-711f-4d1d-8bc3-fc708433a191

Total devices 2 FS bytes used 586.82GiB

devid 1 size 953.87GiB used 781.03GiB path /dev/nvme2n1p1

devid 2 size 953.87GiB used 640.06GiB path /dev/nvme1n1p1

The cache UI is only showing one disk, and if I try to add the correct disk to the pool, it complains (I HAVE NOT ADDED+STARTED this back!)

So, in my non existent understanding of btrfs - I assume it's somehow wiped the drive it still thinks is in the pool, serial ending 8T2R, I am hoping there is still data on the other disk? Does unraid still think pool b176ff8c-711f-4d1d-8bc3-fc708433a191 exists?

I honestly have no idea how the pool (which even when degraded had my data on), scrubbed then wiped itself.

Any advice very appreciated - diagnostics attached but as I say, system has been rebooted

jupiter-diagnostics-20260923-0155.zip

You can try and reimport the pool as a whole.

Click the pool name, click “remove” button (not erase) then click add pool, assign the exact same name, assign both disks and start array.

Or

You can balance it back to SINGLE profile from RAID1 and have a single driven pool to which you can then expand to two disks and rebalance to RAID1

Edited 18 hours ago18 hr by MowMdown

Presumably the second option is the same method, remove pool, create pool with same name, add single (suspect good) drive, start array, then add the second one in after?

Will give it a try after work, cheers

Edited 15 hours ago15 hr by ottermanuk
clarity

You can try importing with both members; it won't import with a member misplaced, then scrub the pool (note that if the remaining device was written to after the other one dropped, it may contain single chunks, and in that case the import will fail; manual/CLI intervention will be required).

1 hour ago, JorgeB said:

note that if the remaining device was written to after the other one dropped,

I'm pretty sure this has happened. Is there a way to mount the single (other) drive, even degraded, so I can pull data off?

Yes, you should be able to import with only that device, but you must disconnect or drop the other one offline. To avoid opening the server, you can use

echo 1 > /sys/block/nvmeXn1/device/device/remove

Post the diags after array start when trying to import the pool with just that device.

A reboot will bring the dropped device back.

11 hours ago, JorgeB said:

Yes, you should be able to import with only that device, but you must disconnect or drop the other one offline. To avoid opening the server, you can use

echo 1 > /sys/block/nvmeXn1/device/device/remove

Post the diags after array start when trying to import the pool with just that device.

A reboot will bring the dropped device back.

Just to clarify, remove pool, add pool back with existing name, drop the device that was suspected cleared (nvme1n1 in this case) using the above command, then add nvme2n1 ONLY to the recreated pool of 1 disk, and start it?

Or recreate the pool of 2, add both devices, drop nvme1n1 using command, and start the pool of 2 devices with nvme1n1 dropped and nvme2n1up? Just wanna be sure, TIA