June 6Jun 6 I recently changed my NVMe cache drive thinking it was failing due to BTRFS errors and a few power outages. But now on the replacement ssd NVMe drive, those same errors started again. I can't scrub nor go in the cache settings as it just displays a blank page. Lost on what to do next. Diagnostics are attached, any help is greatly appreciated. endurance-diagnostics-20260606-1051.zip
June 7Jun 7 Community Expert Apparently NVMe device dropped offline; power off the server, not just reboot, then post new diagnostics after the array starts.
June 7Jun 7 Author shut down the server. When I turned it back on, array can't start due to missing cache driveendurance-diagnostics-20260607-1001.zip
June 7Jun 7 Community Expert Looks like the cache drive may have failed if it is not being seen after power cycling the server. It just might be worth plugging/unplugging the drive in case a connection was disturbed somehow.
June 8Jun 8 Community Expert Jun 7 10:00:21 Endurance kernel: nvme nvme0: controller is down; will reset: CSTS=0xffffffff, PCI_STATUS=0x10Jun 7 10:00:21 Endurance kernel: nvme nvme0: Does your device have a faulty power saving mode enabled?Jun 7 10:00:21 Endurance kernel: nvme nvme0: Try "nvme_core.default_ps_max_latency_us=0 pcie_aspm=off pcie_port_pm=off" and report a bugJun 7 10:00:21 Endurance kernel: nvme0n1: I/O Cmd(0x2) @ LBA 2048, 8 blocks, I/O Error (sct 0x3 / sc 0x71) Jun 7 10:00:21 Endurance kernel: I/O error, dev nvme0n1, sector 2048 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 2Jun 7 10:00:21 Endurance kernel: nvme 0000:03:00.0: enabling device (0000 -> 0002)Jun 7 10:00:21 Endurance kernel: nvme nvme0: Disabling device after reset failure: -19Device is still dropping. Since you are already using the optional kernel parameters, my recommendation would be to try a different brand/model one, it may also be worth trying a different m.2 slot if available.
June 10Jun 10 Author I unplugged it and put it in the second nvme slot. On the old ssd I had already unplugged it as well but not changed it to the secondary. Diagnostics attached after putting the ssd in the second slotendurance-diagnostics-20260609-1721.zip
June 15Jun 15 Author same thing now. cache drive shows errors but the screen is blank endurance-diagnostics-20260614-1952.zip
June 15Jun 15 Community Expert Device is still dropping. If it still happens on a different m.2 slot, best bet it to use a different brand/model device (or a different board if that's easier)
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.