January 19Jan 19 Hello together,i got a LSI 9500-8i HBA card connected to two SAS drives. Both /dev/sdi and /dev/sdj get recognize at first start up without any issue. But after putting the system to sleep and wake it up again, the same drive /dev/sdi keeps disappearing from the system. Preclearing it, or LSI 9500-8i detailsstorcli64 /c0 showCLI Version = 007.3603.0000.0000 Oct 30, 2025Operating system = Linux 6.12.54-UnraidController = 0Status = SuccessDescription = NoneProduct Name = HBA 9500-8iSerial Number = xxxSAS Address = 500062b20f06df80PCI Address = 00:03:00:00System Time = 01/19/2026 19:43:30FW Package Build = 37.00.00.00FW Version = 37.00.00.00BIOS Version = 09.27.00.00_14.00.00.00NVDATA Version = 37.00.00.10PSOC FW Version = 0x003DPSOC Part Number = 14790Driver Name = mpt3sasDriver Version = 48.100.00.00Bus Number = 3Device Number = 0Function Number = 0Domain ID = 0Vendor Id = 0x1000Device Id = 0xE6SubVendor Id = 0x1000SubDevice Id = 0x4060Board Name = HBA 9500-8iBoard Assembly = 03-50077-03002Board Tracer Number = xxxSecurity Protocol = NonePackage Stamp Mismatch = YesPhysical Drives = 1PD LIST :=======------------------------------------------------------------------------EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp ------------------------------------------------------------------------0:3 1 JBOD - 10.837 TB SAS HDD - - 4 KB HUH721212AL4200 - ------------------------------------------------------------------------EID-Enclosure Device ID|Slt-Slot No|DID-Device ID|DG-DriveGroupUGood-Unconfigured Good|UBad-Unconfigured Bad|Intf-InterfaceMed-Media Type|SED-Self Encryptive Drive|PI-Protection InfoSeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-TransitionRequested Boot Drive = Not SetHere my drives after start uplsscsi [0:0:0:0] disk ATA ST20000NM007D-3D SN03 /dev/sdb [1:0:0:0] disk ATA ST20000NM007D-3D SN03 /dev/sdc [2:0:0:0] disk ATA ST20000NM007D-3D SN01 /dev/sdd [3:0:0:0] disk ATA ST20000NM007D-3D SN01 /dev/sde [4:0:0:0] disk ATA ST20000NM007D-3D SN01 /dev/sdf [5:0:0:0] disk ATA ST20000NM007D-3D SN01 /dev/sdg [7:0:0:0] disk ATA WDC WD5000LPVT-0 1A01 /dev/sdh [8:0:0:0] disk Kingston DataTraveler 3.0 PMAP /dev/sda [9:0:0:0] disk WDC WUH722020BL5204 C5C0 /dev/sdi [9:0:1:0] disk HGST HUH721212AL4200 DD08 /dev/sdj [9:0:2:0] enclosu BROADCOM VirtualSES 03 - [N:0:0:1] disk CT1000P310SSD8__1 /dev/nvme0n1 [N:1:0:1] disk CT2000P310SSD8__1 /dev/nvme1nsyslogJan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000Jan 19 06:11:55 Tower kernel: resource: resource sanity check: requesting [mem 0x00000000fedc0000-0x00000000fedcffff], which spans more than pnp 00:03 [mem 0xfedc0000-0xfedc7fff]Jan 19 06:11:55 Tower kernel: caller Router+0xac/0xf0 [corefreqk] mapping multiple BARsJan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000Jan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000Jan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000Jan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000Jan 19 06:11:55 Tower kernel: resource: resource sanity check: requesting [mem 0x00000000fee00000-0x00000000fee0ffff], which spans more than Reserved [mem 0xfee00000-0xfee00fff]Jan 19 06:11:55 Tower kernel: caller Router+0xac/0xf0 [corefreqk] mapping multiple BARsJan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000Jan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000Jan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000Jan 19 06:11:55 Tower kernel: CoreFreq: Resume(6:7:19)Jan 19 06:11:55 Tower kernel: mei_hdcp 0000:00:16.0-b638ab7e-94e2-4ea2-a552-d1c54b627f04: bound 0000:00:02.0 (ops i915_hdcp_ops [i915])Jan 19 06:11:55 Tower kernel: OOM killer enabled.Jan 19 06:11:55 Tower kernel: Restarting tasks ... Jan 19 06:11:55 Tower kernel: mei_pxp 0000:00:16.0-fbf6fcf1-96cf-4e2e-a6a6-1bab8cbe36b1: bound 0000:00:02.0 (ops i915_pxp_tee_component_ops [i915])Jan 19 06:11:55 Tower crond[2234]: time disparity of 456 minutes detectedJan 19 06:11:55 Tower kernel: done.Jan 19 06:11:55 Tower kernel: random: crng reseeded on system resumptionJan 19 06:11:55 Tower kernel: PM: suspend exitJan 19 06:11:55 Tower s3_sleep: Wake-up from sleep modeJan 19 06:11:56 Tower kernel: sd 9:0:0:0: device_block, handle(0x0026)Jan 19 06:11:58 Tower kernel: sd 9:0:0:0: device_unblock and setting to running, handle(0x0026)Jan 19 06:11:58 Tower kernel: sd 9:0:0:0: Power-on or device reset occurredJan 19 06:11:58 Tower kernel: sd 9:0:0:0: device_block, handle(0x0026)Jan 19 06:11:59 Tower kernel: ata6: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 06:11:59 Tower kernel: ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 06:11:59 Tower kernel: sd 5:0:0:0: [sdg] Starting diskJan 19 06:11:59 Tower kernel: sd 4:0:0:0: [sdf] Starting diskJan 19 06:11:59 Tower kernel: ata6.00: configured for UDMA/133Jan 19 06:11:59 Tower kernel: ata5.00: configured for UDMA/133Jan 19 06:11:59 Tower kernel: ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 06:11:59 Tower kernel: sd 1:0:0:0: [sdc] Starting diskJan 19 06:11:59 Tower kernel: ata2.00: configured for UDMA/133Jan 19 06:12:00 Tower kernel: ata3: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 06:12:00 Tower kernel: ata4: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 06:12:00 Tower kernel: sd 2:0:0:0: [sdd] Starting diskJan 19 06:12:00 Tower kernel: ata3.00: configured for UDMA/133Jan 19 06:12:00 Tower kernel: sd 3:0:0:0: [sde] Starting diskJan 19 06:12:00 Tower kernel: ata4.00: configured for UDMA/133Jan 19 06:12:00 Tower kernel: ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 06:12:00 Tower kernel: sd 0:0:0:0: [sdb] Starting diskJan 19 06:12:00 Tower kernel: ata1.00: configured for UDMA/133Jan 19 06:12:01 Tower kernel: sd 9:0:0:0: device_unblock and setting to running, handle(0x0026)Jan 19 06:12:01 Tower kernel: sd 9:0:0:0: [sdi] tag#1781 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=2sJan 19 06:12:01 Tower kernel: sd 9:0:0:0: [sdi] tag#1781 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00Jan 19 06:12:01 Tower kernel: I/O error, dev sdi, sector 0 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 2Jan 19 06:12:01 Tower kernel: sd 9:0:0:0: [sdi] tag#1782 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=0sJan 19 06:12:01 Tower kernel: sd 9:0:0:0: [sdi] tag#1782 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00Jan 19 06:12:01 Tower kernel: I/O error, dev sdi, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2Jan 19 06:12:01 Tower kernel: Buffer I/O error on dev sdi, logical block 0, async page readJan 19 06:12:01 Tower kernel: mpt3sas_cm0: remove hba_port entry: 000000006b465d84 port: 1 from hba_port listJan 19 06:12:01 Tower emhttpd: read SMART /dev/sdhJan 19 06:12:01 Tower emhttpd: read SMART /dev/sdgJan 19 06:12:01 Tower emhttpd: read SMART /dev/sddJan 19 06:12:01 Tower emhttpd: read SMART /dev/sdeJan 19 06:12:01 Tower emhttpd: read SMART /dev/sdbJan 19 06:12:01 Tower emhttpd: read SMART /dev/sdfJan 19 06:12:01 Tower emhttpd: read SMART /dev/sdcJan 19 06:12:01 Tower emhttpd: read SMART /dev/sdiJan 19 06:12:01 Tower kernel: sd 9:0:0:0: [sdi] Synchronizing SCSI cacheJan 19 06:12:01 Tower kernel: sd 9:0:0:0: [sdi] Synchronize Cache(10) failed: Result: hostbyte=0x01 driverbyte=DRIVER_OKJan 19 06:12:01 Tower kernel: mpt3sas_cm0: mpt3sas_transport_port_remove: removed: sas_addr(0x5000cca2c7031e5d)Jan 19 06:12:01 Tower kernel: mpt3sas_cm0: removing handle(0x0026), sas_addr(0x5000cca2c7031e5d)Jan 19 06:12:01 Tower kernel: mpt3sas_cm0: enclosure logical id(0x300062b20f09df80), slot(1)Jan 19 06:12:01 Tower kernel: mpt3sas_cm0: enclosure level(0x0000), connector name( C0.0)Jan 19 06:12:01 Tower webgui: Successful login user root from 192.xxx.xxx.xxxJan 19 06:12:02 Tower emhttpd: read SMART /dev/sdjJan 19 06:12:02 Tower emhttpd: spinning down /dev/sdhJan 19 06:12:02 Tower emhttpd: spinning down /dev/sdgJan 19 06:12:02 Tower emhttpd: spinning down /dev/sddJan 19 06:12:02 Tower emhttpd: spinning down /dev/sdeJan 19 06:12:02 Tower emhttpd: spinning down /dev/sdbJan 19 06:12:02 Tower emhttpd: spinning down /dev/sdfJan 19 06:12:02 Tower emhttpd: spinning down /dev/sdcJan 19 06:12:03 Tower emhttpd: offline: WUH722020BL5204_xxxxxxxx_35000cca2c7031e5c (sdi) 4096 4882956288Jan 19 06:12:14 Tower sshd-session[1110560]: Connection from 192.xxx.xxx.xxx port 47670 on 192.xxx.xxx.xxx port 22 rdomain ""Jan 19 06:12:14 Tower sshd-session[1110560]: Accepted key ED25519 SHA256:XXX found at /root/.ssh/authorized_keys:1Jan 19 06:12:14 Tower sshd-session[1110560]: Postponed publickey for root from 192.xxx.xxx.xxx port 47670 ssh2 [preauth]Jan 19 06:12:14 Tower fanctrlplus: [HDDBay_oben] Temp=*°C (Idle) → PWM=0 → RPM=0Jan 19 06:12:16 Tower sshd-session[1110560]: Accepted key ED25519 SHA256:xxx found at /root/.ssh/authorized_keys:1Jan 19 06:12:16 Tower sshd-session[1110560]: Accepted publickey for root from 192.xxx.xxx.xxx port 47670 ssh2: ED25519 SHA256:xxxJan 19 06:12:16 Tower sshd-session[1110560]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0)Jan 19 06:12:16 Tower elogind-daemon[2044]: New session 2 of user root.Jan 19 06:12:16 Tower sshd-session[1110560]: User child is on pid 1110878Jan 19 06:12:16 Tower sshd-session[1110878]: Starting session: shell on pts/0 for root from 192.xxx.xxx.xxx port 47670 id 0Jan 19 09:21:52 Tower s3_sleep: Wake-up from sleep modeJan 19 09:21:52 Tower sshd-session[46812]: Connection from 192.xxx.xxx.xxx port 54340 on 192.xxx.xxx.xxx port 22 rdomain ""Jan 19 09:21:52 Tower sshd-session[46812]: Accepted key ED25519 SHA256:XXX found at /root/.ssh/authorized_keys:1Jan 19 09:21:52 Tower sshd-session[46812]: Postponed publickey for root from 192.xxx.xxx.xxx port 54340 ssh2 [preauth]Jan 19 09:21:55 Tower sshd-session[46812]: Accepted key ED25519 SHA256:XXX found at /root/.ssh/authorized_keys:1Jan 19 09:21:55 Tower sshd-session[46812]: Accepted publickey for root from 192.xxx.xxx.xxx port 54340 ssh2: ED25519 SHA256:XXXJan 19 09:21:55 Tower sshd-session[46812]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0)Jan 19 09:21:55 Tower elogind-daemon[2043]: New session 2 of user root.Jan 19 09:21:55 Tower sshd-session[46812]: User child is on pid 47346Jan 19 09:21:55 Tower sshd-session[47346]: Starting session: shell on pts/0 for root from 192.xxx.xxx.xxx port 54340 id 0Jan 19 09:21:56 Tower kernel: ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 09:21:56 Tower kernel: sd 4:0:0:0: [sdf] Starting diskJan 19 09:21:56 Tower kernel: ata5.00: configured for UDMA/133Jan 19 09:21:56 Tower kernel: ata6: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 09:21:56 Tower kernel: sd 5:0:0:0: [sdg] Starting diskJan 19 09:21:56 Tower kernel: ata6.00: configured for UDMA/133Jan 19 09:21:56 Tower kernel: ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 09:21:56 Tower kernel: sd 1:0:0:0: [sdc] Starting diskJan 19 09:21:56 Tower kernel: ata2.00: configured for UDMA/133Jan 19 09:21:57 Tower kernel: ata3: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 09:21:57 Tower kernel: ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 09:21:57 Tower kernel: sd 2:0:0:0: [sdd] Starting diskJan 19 09:21:57 Tower kernel: sd 0:0:0:0: [sdb] Starting diskJan 19 09:21:57 Tower kernel: ata3.00: configured for UDMA/133Jan 19 09:21:57 Tower kernel: ata1.00: configured for UDMA/133Jan 19 09:21:57 Tower kernel: ata4: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 09:21:57 Tower kernel: sd 3:0:0:0: [sde] Starting diskJan 19 09:21:57 Tower kernel: ata4.00: configured for UDMA/133Jan 19 09:22:02 Tower kernel: sd 9:0:1:0: Power-on or device reset occurredJan 19 09:22:08 Tower kernel: sd 9:0:0:0: Power-on or device reset occurredJan 19 18:54:04 Tower s3_sleep: Wake-up from sleep modeJan 19 18:54:08 Tower kernel: ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 18:54:08 Tower kernel: sd 4:0:0:0: [sdf] Starting diskJan 19 18:54:08 Tower kernel: ata5.00: configured for UDMA/133Jan 19 18:54:08 Tower kernel: ata6: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 18:54:08 Tower kernel: sd 5:0:0:0: [sdg] Starting diskJan 19 18:54:08 Tower kernel: ata6.00: configured for UDMA/133Jan 19 18:54:08 Tower kernel: ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 18:54:08 Tower kernel: sd 1:0:0:0: [sdc] Starting diskJan 19 18:54:08 Tower kernel: ata2.00: configured for UDMA/133Jan 19 18:54:09 Tower kernel: ata4: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 18:54:09 Tower kernel: ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 18:54:09 Tower kernel: sd 0:0:0:0: [sdb] Starting diskJan 19 18:54:09 Tower kernel: sd 3:0:0:0: [sde] Starting diskJan 19 18:54:09 Tower kernel: ata1.00: configured for UDMA/133Jan 19 18:54:09 Tower kernel: ata4.00: configured for UDMA/133Jan 19 18:54:09 Tower kernel: ata3: SATA link up 6.0 Gbps (SStatus 133 SControl 300)Jan 19 18:54:09 Tower kernel: sd 2:0:0:0: [sdd] Starting diskJan 19 18:54:09 Tower kernel: ata3.00: configured for UDMA/133Jan 19 18:54:09 Tower emhttpd: read SMART /dev/sdjJan 19 18:54:09 Tower emhttpd: read SMART /dev/sdhJan 19 18:54:09 Tower emhttpd: read SMART /dev/sdgJan 19 18:54:09 Tower emhttpd: read SMART /dev/sddJan 19 18:54:09 Tower emhttpd: read SMART /dev/sdeJan 19 18:54:09 Tower emhttpd: read SMART /dev/sdbJan 19 18:54:09 Tower emhttpd: read SMART /dev/sdfJan 19 18:54:09 Tower emhttpd: read SMART /dev/sdcJan 19 18:54:09 Tower emhttpd: read SMART /dev/sdiJan 19 18:54:10 Tower kernel: sd 9:0:0:0: device_block, handle(0x0026)Jan 19 18:54:12 Tower kernel: sd 9:0:0:0: device_unblock and setting to running, handle(0x0026)Jan 19 18:54:12 Tower kernel: sd 9:0:0:0: Power-on or device reset occurredJan 19 18:54:14 Tower kernel: sd 9:0:0:0: device_block, handle(0x0026)Jan 19 18:54:17 Tower kernel: sd 9:0:0:0: device_unblock and setting to running, handle(0x0026)Jan 19 18:54:17 Tower kernel: sd 9:0:0:0: [sdi] tag#1679 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=4sJan 19 18:54:17 Tower kernel: sd 9:0:0:0: [sdi] tag#1679 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00Jan 19 18:54:17 Tower kernel: I/O error, dev sdi, sector 0 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 2Jan 19 18:54:17 Tower kernel: sd 9:0:0:0: [sdi] tag#1680 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=0sJan 19 18:54:17 Tower kernel: sd 9:0:0:0: [sdi] tag#1680 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00Jan 19 18:54:17 Tower kernel: I/O error, dev sdi, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2Jan 19 18:54:17 Tower kernel: Buffer I/O error on dev sdi, logical block 0, async page readJan 19 18:54:17 Tower kernel: mpt3sas_cm0: remove hba_port entry: 0000000082b727e1 port: 1 from hba_port listJan 19 18:54:17 Tower kernel: mpt3sas_cm0: mpt3sas_transport_port_remove: removed: sas_addr(0x5000cca2c7031e5d)Jan 19 18:54:17 Tower kernel: mpt3sas_cm0: removing handle(0x0026), sas_addr(0x5000cca2c7031e5d)Jan 19 18:54:17 Tower kernel: mpt3sas_cm0: enclosure logical id(0x300062b20f09df80), slot(1)Jan 19 18:54:17 Tower kernel: mpt3sas_cm0: enclosure level(0x0000), connector name( C0.0)Jan 19 18:54:36 Tower crond[2232]: time disparity of 94 minutes detectedJan 19 18:55:04 Tower emhttpd: offline: WUH722020BL5204_XXX_35000cca2c7031e5c (sdi) 4096 4882956288Jan 19 19:00:02 Tower move: mover: startedJan 19 19:00:02 Tower move: mover: finishedJan 19 19:24:06 Tower emhttpd: spinning down /dev/sdjJan 19 19:24:06 Tower SAS Assist v2024.11.25: Spinning down device /dev/sdjJan 19 19:24:06 Tower emhttpd: spinning down /dev/sdhJan 19 19:24:06 Tower emhttpd: spinning down /dev/sdgJan 19 19:24:06 Tower emhttpd: spinning down /dev/sddJan 19 19:24:06 Tower emhttpd: spinning down /dev/sdeJan 19 19:24:06 Tower emhttpd: spinning down /dev/sdbJan 19 19:24:06 Tower emhttpd: spinning down /dev/sdfJan 19 19:24:06 Tower emhttpd: spinning down /dev/sdcdmesg -w | grep -E "(mpt|scsi| sd )"[ 0.007434] Device empty[ 0.111408] Dynamic Preempt: voluntary[ 0.111472] rcu: Preemptible hierarchical RCU implementation.[ 3.760974] scsi host0: ahci[ 3.761064] scsi host1: ahci[ 3.761142] scsi host2: ahci[ 3.761220] scsi host3: ahci[ 3.761295] scsi host4: ahci[ 3.761370] scsi host5: ahci[ 3.761444] scsi host6: ahci[ 3.761523] scsi host7: ahci[ 4.571641] scsi host8: usb-storage 1-10:1.0[ 5.591508] scsi 8:0:0:0: Direct-Access Kingston DataTraveler 3.0 PMAP PQ: 0 ANSI: 6[ 5.592317] sd 8:0:0:0: Attached scsi generic sg0 type 0[ 5.762848] sd 8:0:0:0: [sda] 121096320 512-byte logical blocks: (62.0 GB/57.7 GiB)[ 5.764493] sd 8:0:0:0: [sda] Write Protect is off[ 5.764515] sd 8:0:0:0: [sda] Mode Sense: 45 00 00 00[ 5.765475] sd 8:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA[ 5.780321] sd 8:0:0:0: [sda] Attached SCSI removable disk[ 6.804763] scsi 0:0:0:0: Direct-Access ATA ST20000NM007D-3D SN03 PQ: 0 ANSI: 5[ 6.805556] sd 0:0:0:0: [sdb] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)[ 6.805581] sd 0:0:0:0: [sdb] 4096-byte physical blocks[ 6.805629] sd 0:0:0:0: [sdb] Write Protect is off[ 6.805636] sd 0:0:0:0: [sdb] Mode Sense: 00 3a 00 00[ 6.805658] sd 0:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA[ 6.805667] sd 0:0:0:0: Attached scsi generic sg1 type 0[ 6.805722] sd 0:0:0:0: [sdb] Preferred minimum I/O size 4096 bytes[ 6.806275] scsi 1:0:0:0: Direct-Access ATA ST20000NM007D-3D SN03 PQ: 0 ANSI: 5[ 6.807172] sd 1:0:0:0: [sdc] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)[ 6.807198] sd 1:0:0:0: [sdc] 4096-byte physical blocks[ 6.807225] sd 1:0:0:0: [sdc] Write Protect is off[ 6.807237] sd 1:0:0:0: [sdc] Mode Sense: 00 3a 00 00[ 6.807238] sd 1:0:0:0: Attached scsi generic sg2 type 0[ 6.807270] sd 1:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA[ 6.807342] sd 1:0:0:0: [sdc] Preferred minimum I/O size 4096 bytes[ 6.807700] scsi 2:0:0:0: Direct-Access ATA ST20000NM007D-3D SN01 PQ: 0 ANSI: 5[ 6.808095] sd 2:0:0:0: Attached scsi generic sg3 type 0[ 6.808184] sd 2:0:0:0: [sdd] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)[ 6.808199] sd 2:0:0:0: [sdd] 4096-byte physical blocks[ 6.808215] sd 2:0:0:0: [sdd] Write Protect is off[ 6.808221] sd 2:0:0:0: [sdd] Mode Sense: 00 3a 00 00[ 6.808238] sd 2:0:0:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA[ 6.808272] sd 2:0:0:0: [sdd] Preferred minimum I/O size 4096 bytes[ 6.808546] scsi 3:0:0:0: Direct-Access ATA ST20000NM007D-3D SN01 PQ: 0 ANSI: 5[ 6.809418] sd 3:0:0:0: Attached scsi generic sg4 type 0[ 6.809551] sd 3:0:0:0: [sde] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)[ 6.809566] sd 3:0:0:0: [sde] 4096-byte physical blocks[ 6.809581] sd 3:0:0:0: [sde] Write Protect is off[ 6.809593] sd 3:0:0:0: [sde] Mode Sense: 00 3a 00 00[ 6.809612] sd 3:0:0:0: [sde] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA[ 6.809647] sd 3:0:0:0: [sde] Preferred minimum I/O size 4096 bytes[ 6.809691] scsi 4:0:0:0: Direct-Access ATA ST20000NM007D-3D SN01 PQ: 0 ANSI: 5[ 6.810257] sd 4:0:0:0: Attached scsi generic sg5 type 0[ 6.810293] sd 4:0:0:0: [sdf] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)[ 6.810301] sd 4:0:0:0: [sdf] 4096-byte physical blocks[ 6.810313] sd 4:0:0:0: [sdf] Write Protect is off[ 6.810318] sd 4:0:0:0: [sdf] Mode Sense: 00 3a 00 00[ 6.810336] sd 4:0:0:0: [sdf] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA[ 6.810367] sd 4:0:0:0: [sdf] Preferred minimum I/O size 4096 bytes[ 6.810609] scsi 5:0:0:0: Direct-Access ATA ST20000NM007D-3D SN01 PQ: 0 ANSI: 5[ 6.810971] sd 5:0:0:0: Attached scsi generic sg6 type 0[ 6.811098] sd 5:0:0:0: [sdg] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)[ 6.811115] sd 5:0:0:0: [sdg] 4096-byte physical blocks[ 6.811132] sd 5:0:0:0: [sdg] Write Protect is off[ 6.811137] sd 5:0:0:0: [sdg] Mode Sense: 00 3a 00 00[ 6.811155] sd 5:0:0:0: [sdg] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA[ 6.811189] sd 5:0:0:0: [sdg] Preferred minimum I/O size 4096 bytes[ 6.811227] scsi 7:0:0:0: Direct-Access ATA WDC WD5000LPVT-0 1A01 PQ: 0 ANSI: 5[ 6.811556] sd 7:0:0:0: Attached scsi generic sg7 type 0[ 6.811621] sd 7:0:0:0: [sdh] 976773168 512-byte logical blocks: (500 GB/466 GiB)[ 6.811630] sd 7:0:0:0: [sdh] 4096-byte physical blocks[ 6.811646] sd 7:0:0:0: [sdh] Write Protect is off[ 6.811652] sd 7:0:0:0: [sdh] Mode Sense: 00 3a 00 00[ 6.811669] sd 7:0:0:0: [sdh] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA[ 6.811709] sd 7:0:0:0: [sdh] Preferred minimum I/O size 4096 bytes[ 6.863791] sd 0:0:0:0: [sdb] Attached SCSI disk[ 6.865330] sd 3:0:0:0: [sde] Attached SCSI disk[ 6.871848] sd 4:0:0:0: [sdf] Attached SCSI disk[ 6.873275] sd 5:0:0:0: [sdg] Attached SCSI disk[ 6.875678] sd 1:0:0:0: [sdc] Attached SCSI disk[ 6.877669] sd 2:0:0:0: [sdd] Attached SCSI disk[ 7.647571] sd 7:0:0:0: [sdh] Attached SCSI disk[ 33.881782] mpt3sas version 48.100.00.00 loaded[ 33.881927] mpt3sas_cm0: 63 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32626328 kB)[ 33.938607] mpt3sas_cm0: MSI-X vectors supported: 128[ 33.938614] mpt3sas_cm0: 8 28 28[ 33.939062] mpt3sas_cm0: High IOPs queues : enabled[ 33.939064] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 180[ 33.939065] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 181[ 33.939066] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 182[ 33.939066] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 183[ 33.939067] mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 184[ 33.939068] mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 185[ 33.939069] mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 186[ 33.939069] mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 187[ 33.939070] mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 188[ 33.939071] mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 189[ 33.939072] mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 190[ 33.939073] mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 191[ 33.939074] mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 192[ 33.939074] mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 193[ 33.939075] mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 194[ 33.939076] mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 195[ 33.939077] mpt3sas0-msix16: PCI-MSI-X enabled: IRQ 196[ 33.939078] mpt3sas0-msix17: PCI-MSI-X enabled: IRQ 197[ 33.939078] mpt3sas0-msix18: PCI-MSI-X enabled: IRQ 198[ 33.939079] mpt3sas0-msix19: PCI-MSI-X enabled: IRQ 199[ 33.939080] mpt3sas0-msix20: PCI-MSI-X enabled: IRQ 200[ 33.939081] mpt3sas0-msix21: PCI-MSI-X enabled: IRQ 201[ 33.939081] mpt3sas0-msix22: PCI-MSI-X enabled: IRQ 202[ 33.939082] mpt3sas0-msix23: PCI-MSI-X enabled: IRQ 203[ 33.939083] mpt3sas0-msix24: PCI-MSI-X enabled: IRQ 204[ 33.939084] mpt3sas0-msix25: PCI-MSI-X enabled: IRQ 205[ 33.939085] mpt3sas0-msix26: PCI-MSI-X enabled: IRQ 206[ 33.939085] mpt3sas0-msix27: PCI-MSI-X enabled: IRQ 207[ 33.939086] mpt3sas_cm0: iomem(0x0000006000100000), mapped(0x00000000b25b5b80), size(1048576)[ 33.939088] mpt3sas_cm0: ioport(0x0000000000004000), size(256)[ 33.996605] mpt3sas_cm0: sending message unit reset !![ 33.998137] mpt3sas_cm0: message unit reset: SUCCESS[ 34.024110] mpt3sas_cm0: scatter gather: sge_in_main_msg(1), sge_per_chain(7), sge_per_io(128), chains_per_io(19)[ 34.024290] mpt3sas_cm0: request pool(0x000000005df14a55) - dma(0x158800000): depth(4872), frame_size(128), pool_size(609 kB)[ 34.026227] mpt3sas_cm0: sense pool(0x00000000a818c509) - dma(0x15a280000): depth(4851), element_size(96), pool_size (454 kB)[ 34.026264] mpt3sas_cm0: reply pool(0x00000000784cc4b8) - dma(0x15a300000): depth(4936), frame_size(128), pool_size(617 kB)[ 34.026268] mpt3sas_cm0: config page(0x000000008de2fa43) - dma(0x159ccb000): size(512)[ 34.026269] mpt3sas_cm0: Allocated physical memory: size(23560 kB)[ 34.026270] mpt3sas_cm0: Current Controller Queue Depth(4848),Max Controller Queue Depth(4864)[ 34.026271] mpt3sas_cm0: Scatter Gather Elements per IO(128)[ 34.351461] mpt3sas_cm0: basedisplay_fwpkg_version: complete[ 34.351465] mpt3sas_cm0: FW Package Ver(37.00.00.00)[ 34.352118] mpt3sas_cm0: SAS3808: FWVersion(37.00.00.00), ChipRevision(0x00)[ 34.352120] mpt3sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ)[ 34.352248] mpt3sas_cm0: Enable interrupt coalescing only for first 8 reply queues[ 34.352335] mpt3sas_cm0: performance mode: balanced[ 34.352383] mpt3sas 0000:03:00.0: Max SCSIIO MPT commands: 4848 shared with nr_hw_queues = 20[ 34.352385] scsi host9: Fusion MPT SAS Host[ 34.352896] mpt3sas_cm0: registering trace buffer support[ 34.356382] mpt3sas_cm0: Trace buffer memory 2048 KB allocated[ 34.356384] mpt3sas_cm0: sending port enable !![ 34.356754] mpt3sas_cm0: hba_port entry: 000000005f10e3d4, port: 0 is added to hba_port list[ 34.356853] mpt3sas_cm0: hba_port entry: 000000006b465d84, port: 1 is added to hba_port list[ 34.357386] mpt3sas_cm0: vphy entry: 0000000090a6f384, port id: 0, phy:8 is added to port's vphys_list[ 34.357627] mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x500062b20f06df80), phys(11)[ 34.357864] mpt3sas_cm0: handle(0x26) sas_address(0x5000cca2c7031e5d) port_type(0x1)[ 34.358377] scsi 9:0:0:0: Direct-Access WDC WUH722020BL5204 C5C0 PQ: 0 ANSI: 7[ 34.358382] scsi 9:0:0:0: SSP: handle(0x0026), sas_addr(0x5000cca2c7031e5d), phy(1), device_name(0x5000cca2c7031e5f)[ 34.358384] scsi 9:0:0:0: enclosure logical id (0x300062b20f09df80), slot(1) [ 34.358386] scsi 9:0:0:0: enclosure level(0x0000), connector name( C0.0)[ 34.358388] scsi 9:0:0:0: qdepth(64), tagged(1), scsi_level(8), cmd_que(1)[ 34.362199] sd 9:0:0:0: Attached scsi generic sg8 type 0[ 34.362450] mpt3sas_cm0: handle(0x25) sas_address(0x5000cca2b03734b1) port_type(0x1)[ 34.362727] sd 9:0:0:0: [sdi] 4882956288 4096-byte logical blocks: (20.0 TB/18.2 TiB)[ 34.362961] scsi 9:0:1:0: Direct-Access HGST HUH721212AL4200 DD08 PQ: 0 ANSI: 6[ 34.362965] scsi 9:0:1:0: SSP: handle(0x0025), sas_addr(0x5000cca2b03734b1), phy(3), device_name(0x5000cca2b03734b3)[ 34.362968] scsi 9:0:1:0: enclosure logical id (0x300062b20f09df80), slot(3) [ 34.362969] scsi 9:0:1:0: enclosure level(0x0000), connector name( C0.0)[ 34.362971] scsi 9:0:1:0: qdepth(64), tagged(1), scsi_level(7), cmd_que(1)[ 34.363128] sd 9:0:0:0: [sdi] Write Protect is off[ 34.363130] sd 9:0:0:0: [sdi] Mode Sense: f7 00 10 08[ 34.363789] sd 9:0:0:0: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA[ 34.365950] sd 9:0:1:0: Attached scsi generic sg9 type 0[ 34.366305] sd 9:0:1:0: [sdj] 2909274112 4096-byte logical blocks: (11.9 TB/10.8 TiB)[ 34.366369] mpt3sas_cm0: handle(0x9) sas_address(0x300162b20f06df80) port_type(0x0)[ 34.366541] scsi 9:0:2:0: Enclosure BROADCOM VirtualSES 03 PQ: 0 ANSI: 7[ 34.366544] scsi 9:0:2:0: set ignore_delay_remove for handle(0x0009)[ 34.366546] scsi 9:0:2:0: SES: handle(0x0009), sas_addr(0x300162b20f06df80), phy(8), device_name(0x300162b20f06df80)[ 34.366548] scsi 9:0:2:0: enclosure logical id (0x300062b20f09df80), slot(8) [ 34.366550] scsi 9:0:2:0: enclosure level(0x0000), connector name( C0.1)[ 34.366552] scsi 9:0:2:0: qdepth(1), tagged(0), scsi_level(8), cmd_que(0)[ 34.366821] scsi 9:0:2:0: Attached scsi generic sg10 type 13[ 34.367369] sd 9:0:1:0: [sdj] Write Protect is off[ 34.367372] sd 9:0:1:0: [sdj] Mode Sense: f7 00 10 08[ 34.369290] sd 9:0:1:0: [sdj] Write cache: disabled, read cache: enabled, supports DPO and FUA[ 34.377596] mpt3sas_cm0: port enable: SUCCESS[ 34.496022] sd 9:0:0:0: [sdi] Attached SCSI disk[ 34.499614] sd 9:0:1:0: [sdj] Attached SCSI disk[ 83.338988] md: import_slot: 29 empty[ 96.769111] md: import_slot: 29 empty[10234.184498] sd 9:0:0:0: [sdi] Synchronizing SCSI cache[10242.376661] mpt3sas_cm0: pdev=0x0000000071dc58e5, slot=0000:03:00.0, entering operating state[10242.376689] mpt3sas_cm0: sending message unit reset !![10242.378202] mpt3sas_cm0: message unit reset: SUCCESS[10242.378424] sd 5:0:0:0: [sdg] Synchronizing SCSI cache[10242.379326] sd 7:0:0:0: [sdh] Synchronizing SCSI cache[10242.383324] sd 4:0:0:0: [sdf] Synchronizing SCSI cache[10242.383384] sd 3:0:0:0: [sde] Synchronizing SCSI cache[10242.383394] sd 2:0:0:0: [sdd] Synchronizing SCSI cache[10242.383458] sd 1:0:0:0: [sdc] Synchronizing SCSI cache[10242.383462] sd 0:0:0:0: [sdb] Synchronizing SCSI cache[10243.023097] mpt3sas_cm0: pdev=0x0000000071dc58e5, slot=0000:03:00.0, previous operating state [D0][10243.023162] mpt3sas_cm0: 63 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32626328 kB)[10243.092932] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k[10243.092943] mpt3sas_cm0: MSI-X vectors supported: 128[10243.092945] mpt3sas_cm0: 8 28 28[10243.093399] mpt3sas_cm0: High IOPs queues : enabled[10243.093400] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 179[10243.093401] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 180[10243.093401] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 181[10243.093401] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 182[10243.093402] mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 183[10243.093402] mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 184[10243.093402] mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 185[10243.093403] mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 186[10243.093403] mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 187[10243.093403] mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 188[10243.093404] mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 189[10243.093404] mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 190[10243.093404] mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 191[10243.093405] mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 192[10243.093405] mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 193[10243.093405] mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 194[10243.093406] mpt3sas0-msix16: PCI-MSI-X enabled: IRQ 195[10243.093406] mpt3sas0-msix17: PCI-MSI-X enabled: IRQ 196[10243.093406] mpt3sas0-msix18: PCI-MSI-X enabled: IRQ 197[10243.093407] mpt3sas0-msix19: PCI-MSI-X enabled: IRQ 198[10243.093407] mpt3sas0-msix20: PCI-MSI-X enabled: IRQ 199[10243.093407] mpt3sas0-msix21: PCI-MSI-X enabled: IRQ 200[10243.093408] mpt3sas0-msix22: PCI-MSI-X enabled: IRQ 201[10243.093408] mpt3sas0-msix23: PCI-MSI-X enabled: IRQ 202[10243.093408] mpt3sas0-msix24: PCI-MSI-X enabled: IRQ 203[10243.093409] mpt3sas0-msix25: PCI-MSI-X enabled: IRQ 204[10243.093409] mpt3sas0-msix26: PCI-MSI-X enabled: IRQ 205[10243.093409] mpt3sas0-msix27: PCI-MSI-X enabled: IRQ 206[10243.093410] mpt3sas_cm0: iomem(0x0000006000100000), mapped(0x00000000cf094242), size(1048576)[10243.093411] mpt3sas_cm0: ioport(0x0000000000004000), size(256)[10243.093489] mpt3sas_cm0: Issuing Hard Reset as part of OS Resume[10243.093491] mpt3sas_cm0: mpt3sas_ctl_pre_reset_handler: Releasing the trace buffer due to adapter reset.[10243.150940] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k[10243.476262] mpt3sas_cm0: basedisplay_fwpkg_version: complete[10243.476264] mpt3sas_cm0: FW Package Ver(37.00.00.00)[10243.476865] mpt3sas_cm0: SAS3808: FWVersion(37.00.00.00), ChipRevision(0x00)[10243.476867] mpt3sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ)[10243.476987] mpt3sas_cm0: Enable interrupt coalescing only for first 8 reply queues[10243.477071] mpt3sas_cm0: performance mode: balanced[10243.477097] mpt3sas_cm0: sending port enable !![10243.697428] sd 7:0:0:0: [sdh] Starting disk[10253.361770] mpt3sas_cm0: port enable: SUCCESS[10253.362217] mpt3sas_cm0: search for end-devices: start[10253.362572] scsi target9:0:2: handle(0x0009), sas_addr(0x300162b20f06df80)[10253.362583] scsi target9:0:2: enclosure logical id(0x300062b20f09df80), slot(8)[10253.362637] scsi target9:0:1: handle(0x0025), sas_addr(0x5000cca2b03734b1)[10253.362645] scsi target9:0:1: enclosure logical id(0x300062b20f09df80), slot(3)[10253.362697] scsi target9:0:0: handle(0x0026), sas_addr(0x5000cca2c7031e5d)[10253.362704] scsi target9:0:0: enclosure logical id(0x300062b20f09df80), slot(1)[10253.362768] mpt3sas_cm0: search for end-devices: complete[10253.362772] mpt3sas_cm0: search for end-devices: start[10253.362775] mpt3sas_cm0: search for PCIe end-devices: complete[10253.362778] mpt3sas_cm0: search for expanders: start[10253.362781] mpt3sas_cm0: search for expanders: complete[10253.362790] mpt3sas_cm0: mpt3sas_base_hard_reset_handler: SUCCESS[10253.362896] mpt3sas_cm0: removing unresponding devices: start[10253.362906] mpt3sas_cm0: removing unresponding devices: end-devices[10253.362910] mpt3sas_cm0: Removing unresponding devices: pcie end-devices[10253.362914] mpt3sas_cm0: removing unresponding devices: expanders[10253.362918] mpt3sas_cm0: removing unresponding devices: complete[10253.362925] mpt3sas_cm0: Update devices with firmware reported queue depth[10253.362938] sd 9:0:0:0: qdepth(64), tagged(1), scsi_level(8), cmd_que(1)[10253.362951] sd 9:0:1:0: qdepth(64), tagged(1), scsi_level(7), cmd_que(1)[10253.362959] ses 9:0:2:0: qdepth(1), tagged(0), scsi_level(8), cmd_que(0)[10253.362965] mpt3sas_cm0: scan devices: start[10253.363256] mpt3sas_cm0: scan devices: expanders start[10253.363311] mpt3sas_cm0: break from expander scan: ioc_status(0x0022), loginfo(0x310f0400)[10253.363318] mpt3sas_cm0: scan devices: expanders complete[10253.363321] mpt3sas_cm0: scan devices: end devices start[10253.363821] mpt3sas_cm0: break from end device scan: ioc_status(0x0022), loginfo(0x310f0400)[10253.363827] mpt3sas_cm0: scan devices: end devices complete[10253.363830] mpt3sas_cm0: scan devices: pcie end devices start[10253.364229] mpt3sas_cm0: break from pcie end device scan: ioc_status(0x0022), loginfo(0x310f0400)[10253.364234] mpt3sas_cm0: pcie devices: pcie end devices complete[10253.364237] mpt3sas_cm0: scan devices: complete[10253.375086] random: crng reseeded on system resumption[10254.111881] sd 9:0:0:0: device_block, handle(0x0026)[10255.863123] sd 9:0:0:0: device_unblock and setting to running, handle(0x0026)[10256.069246] sd 9:0:0:0: Power-on or device reset occurred[10256.611808] sd 9:0:0:0: device_block, handle(0x0026)[10257.482453] sd 5:0:0:0: [sdg] Starting disk[10257.497349] sd 4:0:0:0: [sdf] Starting disk[10257.703650] sd 1:0:0:0: [sdc] Starting disk[10258.071707] sd 2:0:0:0: [sdd] Starting disk[10258.129572] sd 3:0:0:0: [sde] Starting disk[10258.268460] sd 0:0:0:0: [sdb] Starting disk[10258.861528] sd 9:0:0:0: device_unblock and setting to running, handle(0x0026)[10258.861683] sd 9:0:0:0: [sdi] tag#1781 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=2s[10258.861704] sd 9:0:0:0: [sdi] tag#1781 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00[10258.861798] sd 9:0:0:0: [sdi] tag#1782 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=0s[10258.861808] sd 9:0:0:0: [sdi] tag#1782 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00[10258.862120] mpt3sas_cm0: remove hba_port entry: 000000006b465d84 port: 1 from hba_port list[10258.895901] sd 9:0:0:0: [sdi] Synchronizing SCSI cache[10258.895988] sd 9:0:0:0: [sdi] Synchronize Cache(10) failed: Result: hostbyte=0x01 driverbyte=DRIVER_OK[10258.898560] mpt3sas_cm0: mpt3sas_transport_port_remove: removed: sas_addr(0x5000cca2c7031e5d)[10258.898574] mpt3sas_cm0: removing handle(0x0026), sas_addr(0x5000cca2c7031e5d)[10258.898580] mpt3sas_cm0: enclosure logical id(0x300062b20f09df80), slot(1)[10258.898585] mpt3sas_cm0: enclosure level(0x0000), connector name( C0.0)[29121.168182] mpt3sas_cm0: pdev=0x000000003dabe66d, slot=0000:03:00.0, entering operating state[29121.168220] mpt3sas_cm0: sending message unit reset !![29121.168673] sd 7:0:0:0: [sdh] Synchronizing SCSI cache[29121.168722] sd 5:0:0:0: [sdg] Synchronizing SCSI cache[29121.169642] mpt3sas_cm0: message unit reset: SUCCESS[29121.176778] sd 4:0:0:0: [sdf] Synchronizing SCSI cache[29121.177681] sd 3:0:0:0: [sde] Synchronizing SCSI cache[29121.177878] sd 1:0:0:0: [sdc] Synchronizing SCSI cache[29121.178697] sd 0:0:0:0: [sdb] Synchronizing SCSI cache[29121.178708] sd 2:0:0:0: [sdd] Synchronizing SCSI cache[29121.794226] mpt3sas_cm0: pdev=0x000000003dabe66d, slot=0000:03:00.0, previous operating state [D0][29121.794269] mpt3sas_cm0: 63 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32626328 kB)[29121.865392] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k[29121.865403] mpt3sas_cm0: MSI-X vectors supported: 128[29121.865405] mpt3sas_cm0: 8 28 28[29121.865856] mpt3sas_cm0: High IOPs queues : enabled[29121.865857] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 179[29121.865858] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 180[29121.865858] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 181[29121.865859] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 182[29121.865859] mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 183[29121.865859] mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 184[29121.865860] mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 185[29121.865860] mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 186[29121.865860] mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 187[29121.865861] mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 188[29121.865861] mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 189[29121.865861] mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 190[29121.865862] mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 191[29121.865862] mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 192[29121.865862] mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 193[29121.865863] mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 194[29121.865863] mpt3sas0-msix16: PCI-MSI-X enabled: IRQ 195[29121.865863] mpt3sas0-msix17: PCI-MSI-X enabled: IRQ 196[29121.865864] mpt3sas0-msix18: PCI-MSI-X enabled: IRQ 197[29121.865864] mpt3sas0-msix19: PCI-MSI-X enabled: IRQ 198[29121.865864] mpt3sas0-msix20: PCI-MSI-X enabled: IRQ 199[29121.865865] mpt3sas0-msix21: PCI-MSI-X enabled: IRQ 200[29121.865865] mpt3sas0-msix22: PCI-MSI-X enabled: IRQ 201[29121.865865] mpt3sas0-msix23: PCI-MSI-X enabled: IRQ 202[29121.865866] mpt3sas0-msix24: PCI-MSI-X enabled: IRQ 203[29121.865866] mpt3sas0-msix25: PCI-MSI-X enabled: IRQ 204[29121.865866] mpt3sas0-msix26: PCI-MSI-X enabled: IRQ 205[29121.865866] mpt3sas0-msix27: PCI-MSI-X enabled: IRQ 206[29121.865867] mpt3sas_cm0: iomem(0x0000006000100000), mapped(0x000000004e84654d), size(1048576)[29121.865868] mpt3sas_cm0: ioport(0x0000000000004000), size(256)[29121.865946] mpt3sas_cm0: Issuing Hard Reset as part of OS Resume[29121.923398] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k[29122.248719] mpt3sas_cm0: basedisplay_fwpkg_version: complete[29122.248721] mpt3sas_cm0: FW Package Ver(37.00.00.00)[29122.249329] mpt3sas_cm0: SAS3808: FWVersion(37.00.00.00), ChipRevision(0x00)[29122.249331] mpt3sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ)[29122.249452] mpt3sas_cm0: Enable interrupt coalescing only for first 8 reply queues[29122.249536] mpt3sas_cm0: performance mode: balanced[29122.249562] mpt3sas_cm0: sending port enable !![29122.483286] sd 7:0:0:0: [sdh] Starting disk[29132.139437] mpt3sas_cm0: port enable: SUCCESS[29132.139903] mpt3sas_cm0: search for end-devices: start[29132.140258] scsi target9:0:2: handle(0x0009), sas_addr(0x300162b20f06df80)[29132.140268] scsi target9:0:2: enclosure logical id(0x300062b20f09df80), slot(8)[29132.140322] scsi target9:0:1: handle(0x0025), sas_addr(0x5000cca2b03734b1)[29132.140330] scsi target9:0:1: enclosure logical id(0x300062b20f09df80), slot(3)[29132.140386] scsi target9:0:0: handle(0x0026), sas_addr(0x5000cca2c7031e5d)[29132.140393] scsi target9:0:0: enclosure logical id(0x300062b20f09df80), slot(1)[29132.140460] mpt3sas_cm0: search for end-devices: complete[29132.140463] mpt3sas_cm0: search for end-devices: start[29132.140467] mpt3sas_cm0: search for PCIe end-devices: complete[29132.140470] mpt3sas_cm0: search for expanders: start[29132.140473] mpt3sas_cm0: search for expanders: complete[29132.140481] mpt3sas_cm0: mpt3sas_base_hard_reset_handler: SUCCESS[29132.140645] mpt3sas_cm0: removing unresponding devices: start[29132.140664] mpt3sas_cm0: removing unresponding devices: end-devices[29132.140672] mpt3sas_cm0: Removing unresponding devices: pcie end-devices[29132.140677] mpt3sas_cm0: removing unresponding devices: expanders[29132.140681] mpt3sas_cm0: removing unresponding devices: complete[29132.140693] mpt3sas_cm0: Update devices with firmware reported queue depth[29132.140748] sd 9:0:0:0: qdepth(64), tagged(1), scsi_level(8), cmd_que(1)[29132.140767] sd 9:0:1:0: qdepth(64), tagged(1), scsi_level(7), cmd_que(1)[29132.140779] ses 9:0:2:0: qdepth(1), tagged(0), scsi_level(8), cmd_que(0)[29132.140787] mpt3sas_cm0: scan devices: start[29132.141262] mpt3sas_cm0: scan devices: expanders start[29132.141329] mpt3sas_cm0: break from expander scan: ioc_status(0x0022), loginfo(0x310f0400)[29132.141341] mpt3sas_cm0: scan devices: expanders complete[29132.141346] mpt3sas_cm0: scan devices: end devices start[29132.142062] mpt3sas_cm0: break from end device scan: ioc_status(0x0022), loginfo(0x310f0400)[29132.142075] mpt3sas_cm0: scan devices: end devices complete[29132.142079] mpt3sas_cm0: scan devices: pcie end devices start[29132.142459] mpt3sas_cm0: break from pcie end device scan: ioc_status(0x0022), loginfo(0x310f0400)[29132.142465] mpt3sas_cm0: pcie devices: pcie end devices complete[29132.142468] mpt3sas_cm0: scan devices: complete[29132.152235] random: crng reseeded on system resumption[29136.048890] sd 4:0:0:0: [sdf] Starting disk[29136.173416] sd 5:0:0:0: [sdg] Starting disk[29136.309740] sd 1:0:0:0: [sdc] Starting disk[29136.740630] sd 0:0:0:0: [sdb] Starting disk[29136.742682] sd 3:0:0:0: [sde] Starting disk[29136.928559] sd 2:0:0:0: [sdd] Starting disk[29137.889408] sd 9:0:0:0: device_block, handle(0x0026)[29139.890822] sd 9:0:0:0: device_unblock and setting to running, handle(0x0026)[29140.096563] sd 9:0:0:0: Power-on or device reset occurred[29141.889271] sd 9:0:0:0: device_block, handle(0x0026)[29144.639064] sd 9:0:0:0: device_unblock and setting to running, handle(0x0026)[29144.639241] sd 9:0:0:0: [sdi] tag#1679 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=4s[29144.639260] sd 9:0:0:0: [sdi] tag#1679 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00[29144.639339] sd 9:0:0:0: [sdi] tag#1680 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=0s[29144.639349] sd 9:0:0:0: [sdi] tag#1680 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00[29144.639720] mpt3sas_cm0: remove hba_port entry: 0000000082b727e1 port: 1 from hba_port list[29144.668820] mpt3sas_cm0: mpt3sas_transport_port_remove: removed: sas_addr(0x5000cca2c7031e5d)[29144.668824] mpt3sas_cm0: removing handle(0x0026), sas_addr(0x5000cca2c7031e5d)[29144.668825] mpt3sas_cm0: enclosure logical id(0x300062b20f09df80), slot(1)[29144.668826] mpt3sas_cm0: enclosure level(0x0000), connector name( C0.0)I switched cables, switched to a 9400-8i HBA card and this behavior still occurs. I reinstalled the Spin Down SAS Drives Plugin. First I thought the emulated sector size of 512 bytes was the problem so i low level formatted the drive, see [Guide] Low level formatting SAS drives.Does anyone have a suggestion or hint what to do? It is driving me nuts, since I can not solve this for two weeks... dmseg.log syslog.log
January 20Jan 20 Community Expert SAS hardware may not correctly support sleep, recommend not using it.
January 21Jan 21 Author Manually spinning down/up is working though. The system only runs into problems when the whole system is going to sleep. I am checking the power control EPC feature now and trying to disable it. Edited January 21Jan 21 by subsonicg1ft
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.