JorgeB

Please post the diagnostics: Tools -> Diagnostics

Problem on disk1 appears to be a disk issue, run an extended SMART test, disk2 looks like a connection problem replace SATA cable (also check power one).

Most likely just garden-variety filesystem corruption, if it happens again soon re-format the flash drive, and if it still happens after that then replace.

That's one of the strange things about this, if previously the 10TB disk was precleared it would be all zeros, so after the parity swap the new extra parity section would still be correct, i.e., all zeros, even if for some reason Unraid was failing to zero the extra space when it did the parity copy.

Yep.

We converted only the metadata to single profile because the other device was already missing (despite still being assigned) but Unraid couldn't finish deleting it because of the dual metada profiles.

Usually you just need to do this, but for some reason there were dual metadata profiles.

That's normal. There's a checkbox you must click to allow array start with a missing cache device.

My main suspect would be that specific Seagate model (or that disk together with an LSI, it might spindown on a different controller): Model Family: Seagate IronWolf Device Model: ST12000VN0007-2GS116 It appears only disks from that model had issues, at least this time, also I have multiple LSIs from same/similar models and also use that same Intel expander and there are no spindown issues, you can look for a firmware update for those disks, IIRC Seagate release a new firmware for the 10TB IronWolf model because it had issues with LSI controllers, not sure they apply to the 12TB model.

After all is done you can do a complete device trim on the 2TB SSD to completely wipe it, use: blkdiscard /dev/sdX

It's already removed from the pool, I didn't noticed it was still assigned, it should be OK to just unassign it, but to play it safer do this: Stop the array, if Docker/VM services are using the cache pool disable them, unassign all cache devices, start array to make Unraid "forget" current cache config, stop array, reassign the smaller cache device only (there can't be an "All existing data on this device will be OVERWRITTEN when array is Started" warning), re-enable Docker/VMs if needed, start array.

Thanks for doing this, just hope the issue happens again, or it will be all for nothing.

That's what we want. With array started type on the console: btrfs balance start -f -mconvert=single /mnt/cache When done, it should only be a few seconds, stop and re-start array, then after a few minutes check to see if the missing device was deleted, if not post new diags.

Use the current one, but it should be the same with the new beta since AFAIK there aren't any changes that would affect a parity swap.

Locking since OP reposted in the plugin thread.

If the 1TB is marginal/failing it's best to use the parity swap procedure.

You just need to move the vdisk and also need to update the paths in the VM XML.

Sorry, no idea what this error means, you can try again after booting in safe mode.

Mover logging is disable, enable and run again. Also if possible stop dropbox from spamming the log with errors.

Memtest can still work if there's an option on your BIOS to disable ECC.

Just repeat the procedure exactly like the last time, run a parity check after it's done and post new diags, all without rebooting (or if you need to reboot at any point save diags before doing it)

Problems appear to start after the spindown command, try temporarily disabling spindown to see if it makes any difference.

Jun 29 21:47:36 RIAAHQ kernel: FAT-fs (sda1): error, corrupted directory (invalid entries) Run chkdsk on your flash drive.

Crash appears to be network related, try simplifying your network as much as possible to test, remove any bonding if enable, also any dockers with custom IP addresses.

Please post the diagnostics: Tools -> Diagnostics