A couple days ago Plex and some other dockers I had running became sluggish and unresponsive. I went to stop and restart the docker service but was unable to get it to stop. I didn't think much about it and went to stop the array which got stuck hung up trying to unmount the cache drive. The diagnostics show the following 5 lines repeating.

 

May 20 22:51:06 DefineR5 emhttpd: Retry unmounting disk share(s)...
May 20 22:51:11 DefineR5 emhttpd: Unmounting disks...
May 20 22:51:11 DefineR5 emhttpd: shcmd (94604): umount /mnt/cache
May 20 22:51:11 DefineR5 root: umount: /mnt/cache: target is busy.
May 20 22:51:11 DefineR5 emhttpd: shcmd (94604): exit status: 32

At this point I opted to reboot the system. I've attached the diagnostics from that shutdown.

 

Upon rebooting, my cache drive--a 1TB sandisk ssd--was missing. Taking a trip to the bios I see that the SSD is indeed missing, sort of... 

 

https://imgur.com/DdHYURN.jpg

 

You can see that it does not show up in the storage config (it is the only device plugged into the mobo sata) but interestingly does show up as a boot device. 

 

Since it is still sort of recognized I am not sure it is dead-dead. It seems mostly dead, but mostly dead is slightly alive.

 

I pulled the drive and put it into a USB enclosure and hooked it back into my server. From the system log on plugging it in:

 

May 23 11:04:38 DefineR5 kernel: usb 2-6: new SuperSpeed Gen 1 USB device number 26 using xhci_hcd
May 23 11:04:38 DefineR5 kernel: usb-storage 2-6:1.0: USB Mass Storage device detected
May 23 11:04:38 DefineR5 kernel: scsi host11: usb-storage 2-6:1.0
May 23 11:04:39 DefineR5 kernel: scsi 11:0:0:0: Direct-Access TO Exter nal USB 3.0 6101 PQ: 0 ANSI: 6
May 23 11:04:39 DefineR5 kernel: sd 11:0:0:0: Attached scsi generic sg18 type 0
May 23 11:04:49 DefineR5 kernel: sd 11:0:0:0: [sds] Spinning up disk...
May 23 11:05:16 DefineR5 kernel: ....ready
May 23 11:05:16 DefineR5 kernel: sd 11:0:0:0: [sds] 1875385008 512-byte logical blocks: (960 GB/894 GiB)
May 23 11:05:16 DefineR5 kernel: sd 11:0:0:0: [sds] Write Protect is off
May 23 11:05:16 DefineR5 kernel: sd 11:0:0:0: [sds] Mode Sense: 47 00 00 08
May 23 11:05:16 DefineR5 kernel: sd 11:0:0:0: [sds] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
May 23 11:08:17 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
May 23 11:08:17 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 Sense Key : 0x2 [current]
May 23 11:08:17 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 ASC=0x4 ASCQ=0x1
May 23 11:08:17 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 CDB: opcode=0x28 28 00 00 00 00 00 00 00 08 00
May 23 11:08:17 DefineR5 kernel: print_req_error: I/O error, dev sds, sector 0
May 23 11:08:17 DefineR5 kernel: Buffer I/O error on dev sds, logical block 0, async page read
May 23 11:11:17 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
May 23 11:11:17 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 Sense Key : 0x2 [current]
May 23 11:11:17 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 ASC=0x4 ASCQ=0x1
May 23 11:11:17 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 CDB: opcode=0x28 28 00 00 00 00 00 00 00 08 00
May 23 11:11:17 DefineR5 kernel: print_req_error: I/O error, dev sds, sector 0
May 23 11:11:17 DefineR5 kernel: Buffer I/O error on dev sds, logical block 0, async page read
May 23 11:11:17 DefineR5 kernel: ldm_validate_partition_table(): Disk read failed.
May 23 11:14:18 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
May 23 11:14:18 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 Sense Key : 0x2 [current]
May 23 11:14:18 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 ASC=0x4 ASCQ=0x1
May 23 11:14:18 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 CDB: opcode=0x28 28 00 00 00 00 00 00 00 08 00
May 23 11:14:18 DefineR5 kernel: print_req_error: I/O error, dev sds, sector 0
May 23 11:14:18 DefineR5 kernel: Buffer I/O error on dev sds, logical block 0, async page read
May 23 11:14:18 DefineR5 kernel: sds: unable to read partition table
May 23 11:14:18 DefineR5 rc.diskinfo[10409]: SIGHUP received, forcing refresh of disks info.
May 23 11:14:18 DefineR5 kernel: sd 11:0:0:0: [sds] Spinning up disk...
May 23 11:17:18 DefineR5 kernel: ..
May 23 11:17:21 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08
May 23 11:17:21 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 Sense Key : 0x2 [current]
May 23 11:17:21 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 ASC=0x4 ASCQ=0x1
May 23 11:17:21 DefineR5 kernel: sd 11:0:0:0: [sds] tag#0 CDB: opcode=0x28 28 00 6f c8 1a 00 00 00 08 00
May 23 11:17:21 DefineR5 kernel: print_req_error: I/O error, dev sds, sector 1875384832
May 23 11:17:22 DefineR5 kernel: .not responding...
May 23 11:17:25 DefineR5 kernel: sd 11:0:0:0: [sds] Attached SCSI disk

Is there anything I can do to potentially recover the data off this drive? It is, stupidly, not backed-up. Losing the data wouldn't be the end of the world, but I'd rather not have to reconfigure all of my dockers and lose my plex logs and torrent client state if possible. 

 

definer5-diagnostics-20200520-2251.zip

That looks dead, likely impossible to recover anything without using a data recovery service, and even with those it might not be possible.