subsonicg1ft

Manually spinning down/up is working though. I am checking the power control EPC feature now and trying to disable it.

Hello together, i got a LSI 9500-8i HBA card connected to two SAS drives. Both /dev/sdi and /dev/sdj get recognize at first start up without any issue. But after putting the system to sleep and wake it up again, the same drive /dev/sdi keeps disappearing from the system. Preclearing it, or LSI 9500-8i details storcli64 /c0 show CLI Version = 007.3603.0000.0000 Oct 30, 2025 Operating system = Linux 6.12.54-Unraid Controller = 0 Status = Success Description = None Product Name = HBA 9500-8i Serial Number = xxx SAS Address = 500062b20f06df80 PCI Address = 00:03:00:00 System Time = 01/19/2026 19:43:30 FW Package Build = 37.00.00.00 FW Version = 37.00.00.00 BIOS Version = 09.27.00.00_14.00.00.00 NVDATA Version = 37.00.00.10 PSOC FW Version = 0x003D PSOC Part Number = 14790 Driver Name = mpt3sas Driver Version = 48.100.00.00 Bus Number = 3 Device Number = 0 Function Number = 0 Domain ID = 0 Vendor Id = 0x1000 Device Id = 0xE6 SubVendor Id = 0x1000 SubDevice Id = 0x4060 Board Name = HBA 9500-8i Board Assembly = 03-50077-03002 Board Tracer Number = xxx Security Protocol = None Package Stamp Mismatch = Yes Physical Drives = 1 PD LIST : ======= ------------------------------------------------------------------------ EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp ------------------------------------------------------------------------ 0:3 1 JBOD - 10.837 TB SAS HDD - - 4 KB HUH721212AL4200 - ------------------------------------------------------------------------ EID-Enclosure Device ID|Slt-Slot No|DID-Device ID|DG-DriveGroup UGood-Unconfigured Good|UBad-Unconfigured Bad|Intf-Interface Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition Requested Boot Drive = Not Set Here my drives after start up lsscsi [0:0:0:0] disk ATA ST20000NM007D-3D SN03 /dev/sdb [1:0:0:0] disk ATA ST20000NM007D-3D SN03 /dev/sdc [2:0:0:0] disk ATA ST20000NM007D-3D SN01 /dev/sdd [3:0:0:0] disk ATA ST20000NM007D-3D SN01 /dev/sde [4:0:0:0] disk ATA ST20000NM007D-3D SN01 /dev/sdf [5:0:0:0] disk ATA ST20000NM007D-3D SN01 /dev/sdg [7:0:0:0] disk ATA WDC WD5000LPVT-0 1A01 /dev/sdh [8:0:0:0] disk Kingston DataTraveler 3.0 PMAP /dev/sda [9:0:0:0] disk WDC WUH722020BL5204 C5C0 /dev/sdi [9:0:1:0] disk HGST HUH721212AL4200 DD08 /dev/sdj [9:0:2:0] enclosu BROADCOM VirtualSES 03 - [N:0:0:1] disk CT1000P310SSD8__1 /dev/nvme0n1 [N:1:0:1] disk CT2000P310SSD8__1 /dev/nvme1n syslog Jan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000 Jan 19 06:11:55 Tower kernel: resource: resource sanity check: requesting [mem 0x00000000fedc0000-0x00000000fedcffff], which spans more than pnp 00:03 [mem 0xfedc0000-0xfedc7fff] Jan 19 06:11:55 Tower kernel: caller Router+0xac/0xf0 [corefreqk] mapping multiple BARs Jan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000 Jan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000 Jan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000 Jan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000 Jan 19 06:11:55 Tower kernel: resource: resource sanity check: requesting [mem 0x00000000fee00000-0x00000000fee0ffff], which spans more than Reserved [mem 0xfee00000-0xfee00fff] Jan 19 06:11:55 Tower kernel: caller Router+0xac/0xf0 [corefreqk] mapping multiple BARs Jan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000 Jan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000 Jan 19 06:11:55 Tower kernel: CoreFreq: SoC_SKL_VTD: request_mem_region 0xfed90000 Jan 19 06:11:55 Tower kernel: CoreFreq: Resume(6:7:19) Jan 19 06:11:55 Tower kernel: mei_hdcp 0000:00:16.0-b638ab7e-94e2-4ea2-a552-d1c54b627f04: bound 0000:00:02.0 (ops i915_hdcp_ops [i915]) Jan 19 06:11:55 Tower kernel: OOM killer enabled. Jan 19 06:11:55 Tower kernel: Restarting tasks ... Jan 19 06:11:55 Tower kernel: mei_pxp 0000:00:16.0-fbf6fcf1-96cf-4e2e-a6a6-1bab8cbe36b1: bound 0000:00:02.0 (ops i915_pxp_tee_component_ops [i915]) Jan 19 06:11:55 Tower crond[2234]: time disparity of 456 minutes detected Jan 19 06:11:55 Tower kernel: done. Jan 19 06:11:55 Tower kernel: random: crng reseeded on system resumption Jan 19 06:11:55 Tower kernel: PM: suspend exit Jan 19 06:11:55 Tower s3_sleep: Wake-up from sleep mode Jan 19 06:11:56 Tower kernel: sd 9:0:0:0: device_block, handle(0x0026) Jan 19 06:11:58 Tower kernel: sd 9:0:0:0: device_unblock and setting to running, handle(0x0026) Jan 19 06:11:58 Tower kernel: sd 9:0:0:0: Power-on or device reset occurred Jan 19 06:11:58 Tower kernel: sd 9:0:0:0: device_block, handle(0x0026) Jan 19 06:11:59 Tower kernel: ata6: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 06:11:59 Tower kernel: ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 06:11:59 Tower kernel: sd 5:0:0:0: [sdg] Starting disk Jan 19 06:11:59 Tower kernel: sd 4:0:0:0: [sdf] Starting disk Jan 19 06:11:59 Tower kernel: ata6.00: configured for UDMA/133 Jan 19 06:11:59 Tower kernel: ata5.00: configured for UDMA/133 Jan 19 06:11:59 Tower kernel: ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 06:11:59 Tower kernel: sd 1:0:0:0: [sdc] Starting disk Jan 19 06:11:59 Tower kernel: ata2.00: configured for UDMA/133 Jan 19 06:12:00 Tower kernel: ata3: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 06:12:00 Tower kernel: ata4: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 06:12:00 Tower kernel: sd 2:0:0:0: [sdd] Starting disk Jan 19 06:12:00 Tower kernel: ata3.00: configured for UDMA/133 Jan 19 06:12:00 Tower kernel: sd 3:0:0:0: [sde] Starting disk Jan 19 06:12:00 Tower kernel: ata4.00: configured for UDMA/133 Jan 19 06:12:00 Tower kernel: ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 06:12:00 Tower kernel: sd 0:0:0:0: [sdb] Starting disk Jan 19 06:12:00 Tower kernel: ata1.00: configured for UDMA/133 Jan 19 06:12:01 Tower kernel: sd 9:0:0:0: device_unblock and setting to running, handle(0x0026) Jan 19 06:12:01 Tower kernel: sd 9:0:0:0: [sdi] tag#1781 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=2s Jan 19 06:12:01 Tower kernel: sd 9:0:0:0: [sdi] tag#1781 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 Jan 19 06:12:01 Tower kernel: I/O error, dev sdi, sector 0 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 2 Jan 19 06:12:01 Tower kernel: sd 9:0:0:0: [sdi] tag#1782 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=0s Jan 19 06:12:01 Tower kernel: sd 9:0:0:0: [sdi] tag#1782 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 Jan 19 06:12:01 Tower kernel: I/O error, dev sdi, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2 Jan 19 06:12:01 Tower kernel: Buffer I/O error on dev sdi, logical block 0, async page read Jan 19 06:12:01 Tower kernel: mpt3sas_cm0: remove hba_port entry: 000000006b465d84 port: 1 from hba_port list Jan 19 06:12:01 Tower emhttpd: read SMART /dev/sdh Jan 19 06:12:01 Tower emhttpd: read SMART /dev/sdg Jan 19 06:12:01 Tower emhttpd: read SMART /dev/sdd Jan 19 06:12:01 Tower emhttpd: read SMART /dev/sde Jan 19 06:12:01 Tower emhttpd: read SMART /dev/sdb Jan 19 06:12:01 Tower emhttpd: read SMART /dev/sdf Jan 19 06:12:01 Tower emhttpd: read SMART /dev/sdc Jan 19 06:12:01 Tower emhttpd: read SMART /dev/sdi Jan 19 06:12:01 Tower kernel: sd 9:0:0:0: [sdi] Synchronizing SCSI cache Jan 19 06:12:01 Tower kernel: sd 9:0:0:0: [sdi] Synchronize Cache(10) failed: Result: hostbyte=0x01 driverbyte=DRIVER_OK Jan 19 06:12:01 Tower kernel: mpt3sas_cm0: mpt3sas_transport_port_remove: removed: sas_addr(0x5000cca2c7031e5d) Jan 19 06:12:01 Tower kernel: mpt3sas_cm0: removing handle(0x0026), sas_addr(0x5000cca2c7031e5d) Jan 19 06:12:01 Tower kernel: mpt3sas_cm0: enclosure logical id(0x300062b20f09df80), slot(1) Jan 19 06:12:01 Tower kernel: mpt3sas_cm0: enclosure level(0x0000), connector name( C0.0) Jan 19 06:12:01 Tower webgui: Successful login user root from 192.xxx.xxx.xxx Jan 19 06:12:02 Tower emhttpd: read SMART /dev/sdj Jan 19 06:12:02 Tower emhttpd: spinning down /dev/sdh Jan 19 06:12:02 Tower emhttpd: spinning down /dev/sdg Jan 19 06:12:02 Tower emhttpd: spinning down /dev/sdd Jan 19 06:12:02 Tower emhttpd: spinning down /dev/sde Jan 19 06:12:02 Tower emhttpd: spinning down /dev/sdb Jan 19 06:12:02 Tower emhttpd: spinning down /dev/sdf Jan 19 06:12:02 Tower emhttpd: spinning down /dev/sdc Jan 19 06:12:03 Tower emhttpd: offline: WUH722020BL5204_xxxxxxxx_35000cca2c7031e5c (sdi) 4096 4882956288 Jan 19 06:12:14 Tower sshd-session[1110560]: Connection from 192.xxx.xxx.xxx port 47670 on 192.xxx.xxx.xxx port 22 rdomain "" Jan 19 06:12:14 Tower sshd-session[1110560]: Accepted key ED25519 SHA256:XXX found at /root/.ssh/authorized_keys:1 Jan 19 06:12:14 Tower sshd-session[1110560]: Postponed publickey for root from 192.xxx.xxx.xxx port 47670 ssh2 [preauth] Jan 19 06:12:14 Tower fanctrlplus: [HDDBay_oben] Temp=*°C (Idle) → PWM=0 → RPM=0 Jan 19 06:12:16 Tower sshd-session[1110560]: Accepted key ED25519 SHA256:xxx found at /root/.ssh/authorized_keys:1 Jan 19 06:12:16 Tower sshd-session[1110560]: Accepted publickey for root from 192.xxx.xxx.xxx port 47670 ssh2: ED25519 SHA256:xxx Jan 19 06:12:16 Tower sshd-session[1110560]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Jan 19 06:12:16 Tower elogind-daemon[2044]: New session 2 of user root. Jan 19 06:12:16 Tower sshd-session[1110560]: User child is on pid 1110878 Jan 19 06:12:16 Tower sshd-session[1110878]: Starting session: shell on pts/0 for root from 192.xxx.xxx.xxx port 47670 id 0 Jan 19 09:21:52 Tower s3_sleep: Wake-up from sleep mode Jan 19 09:21:52 Tower sshd-session[46812]: Connection from 192.xxx.xxx.xxx port 54340 on 192.xxx.xxx.xxx port 22 rdomain "" Jan 19 09:21:52 Tower sshd-session[46812]: Accepted key ED25519 SHA256:XXX found at /root/.ssh/authorized_keys:1 Jan 19 09:21:52 Tower sshd-session[46812]: Postponed publickey for root from 192.xxx.xxx.xxx port 54340 ssh2 [preauth] Jan 19 09:21:55 Tower sshd-session[46812]: Accepted key ED25519 SHA256:XXX found at /root/.ssh/authorized_keys:1 Jan 19 09:21:55 Tower sshd-session[46812]: Accepted publickey for root from 192.xxx.xxx.xxx port 54340 ssh2: ED25519 SHA256:XXX Jan 19 09:21:55 Tower sshd-session[46812]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Jan 19 09:21:55 Tower elogind-daemon[2043]: New session 2 of user root. Jan 19 09:21:55 Tower sshd-session[46812]: User child is on pid 47346 Jan 19 09:21:55 Tower sshd-session[47346]: Starting session: shell on pts/0 for root from 192.xxx.xxx.xxx port 54340 id 0 Jan 19 09:21:56 Tower kernel: ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 09:21:56 Tower kernel: sd 4:0:0:0: [sdf] Starting disk Jan 19 09:21:56 Tower kernel: ata5.00: configured for UDMA/133 Jan 19 09:21:56 Tower kernel: ata6: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 09:21:56 Tower kernel: sd 5:0:0:0: [sdg] Starting disk Jan 19 09:21:56 Tower kernel: ata6.00: configured for UDMA/133 Jan 19 09:21:56 Tower kernel: ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 09:21:56 Tower kernel: sd 1:0:0:0: [sdc] Starting disk Jan 19 09:21:56 Tower kernel: ata2.00: configured for UDMA/133 Jan 19 09:21:57 Tower kernel: ata3: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 09:21:57 Tower kernel: ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 09:21:57 Tower kernel: sd 2:0:0:0: [sdd] Starting disk Jan 19 09:21:57 Tower kernel: sd 0:0:0:0: [sdb] Starting disk Jan 19 09:21:57 Tower kernel: ata3.00: configured for UDMA/133 Jan 19 09:21:57 Tower kernel: ata1.00: configured for UDMA/133 Jan 19 09:21:57 Tower kernel: ata4: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 09:21:57 Tower kernel: sd 3:0:0:0: [sde] Starting disk Jan 19 09:21:57 Tower kernel: ata4.00: configured for UDMA/133 Jan 19 09:22:02 Tower kernel: sd 9:0:1:0: Power-on or device reset occurred Jan 19 09:22:08 Tower kernel: sd 9:0:0:0: Power-on or device reset occurred Jan 19 18:54:04 Tower s3_sleep: Wake-up from sleep mode Jan 19 18:54:08 Tower kernel: ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 18:54:08 Tower kernel: sd 4:0:0:0: [sdf] Starting disk Jan 19 18:54:08 Tower kernel: ata5.00: configured for UDMA/133 Jan 19 18:54:08 Tower kernel: ata6: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 18:54:08 Tower kernel: sd 5:0:0:0: [sdg] Starting disk Jan 19 18:54:08 Tower kernel: ata6.00: configured for UDMA/133 Jan 19 18:54:08 Tower kernel: ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 18:54:08 Tower kernel: sd 1:0:0:0: [sdc] Starting disk Jan 19 18:54:08 Tower kernel: ata2.00: configured for UDMA/133 Jan 19 18:54:09 Tower kernel: ata4: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 18:54:09 Tower kernel: ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 18:54:09 Tower kernel: sd 0:0:0:0: [sdb] Starting disk Jan 19 18:54:09 Tower kernel: sd 3:0:0:0: [sde] Starting disk Jan 19 18:54:09 Tower kernel: ata1.00: configured for UDMA/133 Jan 19 18:54:09 Tower kernel: ata4.00: configured for UDMA/133 Jan 19 18:54:09 Tower kernel: ata3: SATA link up 6.0 Gbps (SStatus 133 SControl 300) Jan 19 18:54:09 Tower kernel: sd 2:0:0:0: [sdd] Starting disk Jan 19 18:54:09 Tower kernel: ata3.00: configured for UDMA/133 Jan 19 18:54:09 Tower emhttpd: read SMART /dev/sdj Jan 19 18:54:09 Tower emhttpd: read SMART /dev/sdh Jan 19 18:54:09 Tower emhttpd: read SMART /dev/sdg Jan 19 18:54:09 Tower emhttpd: read SMART /dev/sdd Jan 19 18:54:09 Tower emhttpd: read SMART /dev/sde Jan 19 18:54:09 Tower emhttpd: read SMART /dev/sdb Jan 19 18:54:09 Tower emhttpd: read SMART /dev/sdf Jan 19 18:54:09 Tower emhttpd: read SMART /dev/sdc Jan 19 18:54:09 Tower emhttpd: read SMART /dev/sdi Jan 19 18:54:10 Tower kernel: sd 9:0:0:0: device_block, handle(0x0026) Jan 19 18:54:12 Tower kernel: sd 9:0:0:0: device_unblock and setting to running, handle(0x0026) Jan 19 18:54:12 Tower kernel: sd 9:0:0:0: Power-on or device reset occurred Jan 19 18:54:14 Tower kernel: sd 9:0:0:0: device_block, handle(0x0026) Jan 19 18:54:17 Tower kernel: sd 9:0:0:0: device_unblock and setting to running, handle(0x0026) Jan 19 18:54:17 Tower kernel: sd 9:0:0:0: [sdi] tag#1679 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=4s Jan 19 18:54:17 Tower kernel: sd 9:0:0:0: [sdi] tag#1679 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 Jan 19 18:54:17 Tower kernel: I/O error, dev sdi, sector 0 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 2 Jan 19 18:54:17 Tower kernel: sd 9:0:0:0: [sdi] tag#1680 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=0s Jan 19 18:54:17 Tower kernel: sd 9:0:0:0: [sdi] tag#1680 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 Jan 19 18:54:17 Tower kernel: I/O error, dev sdi, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2 Jan 19 18:54:17 Tower kernel: Buffer I/O error on dev sdi, logical block 0, async page read Jan 19 18:54:17 Tower kernel: mpt3sas_cm0: remove hba_port entry: 0000000082b727e1 port: 1 from hba_port list Jan 19 18:54:17 Tower kernel: mpt3sas_cm0: mpt3sas_transport_port_remove: removed: sas_addr(0x5000cca2c7031e5d) Jan 19 18:54:17 Tower kernel: mpt3sas_cm0: removing handle(0x0026), sas_addr(0x5000cca2c7031e5d) Jan 19 18:54:17 Tower kernel: mpt3sas_cm0: enclosure logical id(0x300062b20f09df80), slot(1) Jan 19 18:54:17 Tower kernel: mpt3sas_cm0: enclosure level(0x0000), connector name( C0.0) Jan 19 18:54:36 Tower crond[2232]: time disparity of 94 minutes detected Jan 19 18:55:04 Tower emhttpd: offline: WUH722020BL5204_XXX_35000cca2c7031e5c (sdi) 4096 4882956288 Jan 19 19:00:02 Tower move: mover: started Jan 19 19:00:02 Tower move: mover: finished Jan 19 19:24:06 Tower emhttpd: spinning down /dev/sdj Jan 19 19:24:06 Tower SAS Assist v2024.11.25: Spinning down device /dev/sdj Jan 19 19:24:06 Tower emhttpd: spinning down /dev/sdh Jan 19 19:24:06 Tower emhttpd: spinning down /dev/sdg Jan 19 19:24:06 Tower emhttpd: spinning down /dev/sdd Jan 19 19:24:06 Tower emhttpd: spinning down /dev/sde Jan 19 19:24:06 Tower emhttpd: spinning down /dev/sdb Jan 19 19:24:06 Tower emhttpd: spinning down /dev/sdf Jan 19 19:24:06 Tower emhttpd: spinning down /dev/sdc dmesg -w | grep -E "(mpt|scsi| sd )" [ 0.007434] Device empty [ 0.111408] Dynamic Preempt: voluntary [ 0.111472] rcu: Preemptible hierarchical RCU implementation. [ 3.760974] scsi host0: ahci [ 3.761064] scsi host1: ahci [ 3.761142] scsi host2: ahci [ 3.761220] scsi host3: ahci [ 3.761295] scsi host4: ahci [ 3.761370] scsi host5: ahci [ 3.761444] scsi host6: ahci [ 3.761523] scsi host7: ahci [ 4.571641] scsi host8: usb-storage 1-10:1.0 [ 5.591508] scsi 8:0:0:0: Direct-Access Kingston DataTraveler 3.0 PMAP PQ: 0 ANSI: 6 [ 5.592317] sd 8:0:0:0: Attached scsi generic sg0 type 0 [ 5.762848] sd 8:0:0:0: [sda] 121096320 512-byte logical blocks: (62.0 GB/57.7 GiB) [ 5.764493] sd 8:0:0:0: [sda] Write Protect is off [ 5.764515] sd 8:0:0:0: [sda] Mode Sense: 45 00 00 00 [ 5.765475] sd 8:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 5.780321] sd 8:0:0:0: [sda] Attached SCSI removable disk [ 6.804763] scsi 0:0:0:0: Direct-Access ATA ST20000NM007D-3D SN03 PQ: 0 ANSI: 5 [ 6.805556] sd 0:0:0:0: [sdb] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB) [ 6.805581] sd 0:0:0:0: [sdb] 4096-byte physical blocks [ 6.805629] sd 0:0:0:0: [sdb] Write Protect is off [ 6.805636] sd 0:0:0:0: [sdb] Mode Sense: 00 3a 00 00 [ 6.805658] sd 0:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.805667] sd 0:0:0:0: Attached scsi generic sg1 type 0 [ 6.805722] sd 0:0:0:0: [sdb] Preferred minimum I/O size 4096 bytes [ 6.806275] scsi 1:0:0:0: Direct-Access ATA ST20000NM007D-3D SN03 PQ: 0 ANSI: 5 [ 6.807172] sd 1:0:0:0: [sdc] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB) [ 6.807198] sd 1:0:0:0: [sdc] 4096-byte physical blocks [ 6.807225] sd 1:0:0:0: [sdc] Write Protect is off [ 6.807237] sd 1:0:0:0: [sdc] Mode Sense: 00 3a 00 00 [ 6.807238] sd 1:0:0:0: Attached scsi generic sg2 type 0 [ 6.807270] sd 1:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.807342] sd 1:0:0:0: [sdc] Preferred minimum I/O size 4096 bytes [ 6.807700] scsi 2:0:0:0: Direct-Access ATA ST20000NM007D-3D SN01 PQ: 0 ANSI: 5 [ 6.808095] sd 2:0:0:0: Attached scsi generic sg3 type 0 [ 6.808184] sd 2:0:0:0: [sdd] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB) [ 6.808199] sd 2:0:0:0: [sdd] 4096-byte physical blocks [ 6.808215] sd 2:0:0:0: [sdd] Write Protect is off [ 6.808221] sd 2:0:0:0: [sdd] Mode Sense: 00 3a 00 00 [ 6.808238] sd 2:0:0:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.808272] sd 2:0:0:0: [sdd] Preferred minimum I/O size 4096 bytes [ 6.808546] scsi 3:0:0:0: Direct-Access ATA ST20000NM007D-3D SN01 PQ: 0 ANSI: 5 [ 6.809418] sd 3:0:0:0: Attached scsi generic sg4 type 0 [ 6.809551] sd 3:0:0:0: [sde] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB) [ 6.809566] sd 3:0:0:0: [sde] 4096-byte physical blocks [ 6.809581] sd 3:0:0:0: [sde] Write Protect is off [ 6.809593] sd 3:0:0:0: [sde] Mode Sense: 00 3a 00 00 [ 6.809612] sd 3:0:0:0: [sde] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.809647] sd 3:0:0:0: [sde] Preferred minimum I/O size 4096 bytes [ 6.809691] scsi 4:0:0:0: Direct-Access ATA ST20000NM007D-3D SN01 PQ: 0 ANSI: 5 [ 6.810257] sd 4:0:0:0: Attached scsi generic sg5 type 0 [ 6.810293] sd 4:0:0:0: [sdf] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB) [ 6.810301] sd 4:0:0:0: [sdf] 4096-byte physical blocks [ 6.810313] sd 4:0:0:0: [sdf] Write Protect is off [ 6.810318] sd 4:0:0:0: [sdf] Mode Sense: 00 3a 00 00 [ 6.810336] sd 4:0:0:0: [sdf] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.810367] sd 4:0:0:0: [sdf] Preferred minimum I/O size 4096 bytes [ 6.810609] scsi 5:0:0:0: Direct-Access ATA ST20000NM007D-3D SN01 PQ: 0 ANSI: 5 [ 6.810971] sd 5:0:0:0: Attached scsi generic sg6 type 0 [ 6.811098] sd 5:0:0:0: [sdg] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB) [ 6.811115] sd 5:0:0:0: [sdg] 4096-byte physical blocks [ 6.811132] sd 5:0:0:0: [sdg] Write Protect is off [ 6.811137] sd 5:0:0:0: [sdg] Mode Sense: 00 3a 00 00 [ 6.811155] sd 5:0:0:0: [sdg] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.811189] sd 5:0:0:0: [sdg] Preferred minimum I/O size 4096 bytes [ 6.811227] scsi 7:0:0:0: Direct-Access ATA WDC WD5000LPVT-0 1A01 PQ: 0 ANSI: 5 [ 6.811556] sd 7:0:0:0: Attached scsi generic sg7 type 0 [ 6.811621] sd 7:0:0:0: [sdh] 976773168 512-byte logical blocks: (500 GB/466 GiB) [ 6.811630] sd 7:0:0:0: [sdh] 4096-byte physical blocks [ 6.811646] sd 7:0:0:0: [sdh] Write Protect is off [ 6.811652] sd 7:0:0:0: [sdh] Mode Sense: 00 3a 00 00 [ 6.811669] sd 7:0:0:0: [sdh] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.811709] sd 7:0:0:0: [sdh] Preferred minimum I/O size 4096 bytes [ 6.863791] sd 0:0:0:0: [sdb] Attached SCSI disk [ 6.865330] sd 3:0:0:0: [sde] Attached SCSI disk [ 6.871848] sd 4:0:0:0: [sdf] Attached SCSI disk [ 6.873275] sd 5:0:0:0: [sdg] Attached SCSI disk [ 6.875678] sd 1:0:0:0: [sdc] Attached SCSI disk [ 6.877669] sd 2:0:0:0: [sdd] Attached SCSI disk [ 7.647571] sd 7:0:0:0: [sdh] Attached SCSI disk [ 33.881782] mpt3sas version 48.100.00.00 loaded [ 33.881927] mpt3sas_cm0: 63 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32626328 kB) [ 33.938607] mpt3sas_cm0: MSI-X vectors supported: 128 [ 33.938614] mpt3sas_cm0: 8 28 28 [ 33.939062] mpt3sas_cm0: High IOPs queues : enabled [ 33.939064] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 180 [ 33.939065] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 181 [ 33.939066] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 182 [ 33.939066] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 183 [ 33.939067] mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 184 [ 33.939068] mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 185 [ 33.939069] mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 186 [ 33.939069] mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 187 [ 33.939070] mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 188 [ 33.939071] mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 189 [ 33.939072] mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 190 [ 33.939073] mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 191 [ 33.939074] mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 192 [ 33.939074] mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 193 [ 33.939075] mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 194 [ 33.939076] mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 195 [ 33.939077] mpt3sas0-msix16: PCI-MSI-X enabled: IRQ 196 [ 33.939078] mpt3sas0-msix17: PCI-MSI-X enabled: IRQ 197 [ 33.939078] mpt3sas0-msix18: PCI-MSI-X enabled: IRQ 198 [ 33.939079] mpt3sas0-msix19: PCI-MSI-X enabled: IRQ 199 [ 33.939080] mpt3sas0-msix20: PCI-MSI-X enabled: IRQ 200 [ 33.939081] mpt3sas0-msix21: PCI-MSI-X enabled: IRQ 201 [ 33.939081] mpt3sas0-msix22: PCI-MSI-X enabled: IRQ 202 [ 33.939082] mpt3sas0-msix23: PCI-MSI-X enabled: IRQ 203 [ 33.939083] mpt3sas0-msix24: PCI-MSI-X enabled: IRQ 204 [ 33.939084] mpt3sas0-msix25: PCI-MSI-X enabled: IRQ 205 [ 33.939085] mpt3sas0-msix26: PCI-MSI-X enabled: IRQ 206 [ 33.939085] mpt3sas0-msix27: PCI-MSI-X enabled: IRQ 207 [ 33.939086] mpt3sas_cm0: iomem(0x0000006000100000), mapped(0x00000000b25b5b80), size(1048576) [ 33.939088] mpt3sas_cm0: ioport(0x0000000000004000), size(256) [ 33.996605] mpt3sas_cm0: sending message unit reset !! [ 33.998137] mpt3sas_cm0: message unit reset: SUCCESS [ 34.024110] mpt3sas_cm0: scatter gather: sge_in_main_msg(1), sge_per_chain(7), sge_per_io(128), chains_per_io(19) [ 34.024290] mpt3sas_cm0: request pool(0x000000005df14a55) - dma(0x158800000): depth(4872), frame_size(128), pool_size(609 kB) [ 34.026227] mpt3sas_cm0: sense pool(0x00000000a818c509) - dma(0x15a280000): depth(4851), element_size(96), pool_size (454 kB) [ 34.026264] mpt3sas_cm0: reply pool(0x00000000784cc4b8) - dma(0x15a300000): depth(4936), frame_size(128), pool_size(617 kB) [ 34.026268] mpt3sas_cm0: config page(0x000000008de2fa43) - dma(0x159ccb000): size(512) [ 34.026269] mpt3sas_cm0: Allocated physical memory: size(23560 kB) [ 34.026270] mpt3sas_cm0: Current Controller Queue Depth(4848),Max Controller Queue Depth(4864) [ 34.026271] mpt3sas_cm0: Scatter Gather Elements per IO(128) [ 34.351461] mpt3sas_cm0: basedisplay_fwpkg_version: complete [ 34.351465] mpt3sas_cm0: FW Package Ver(37.00.00.00) [ 34.352118] mpt3sas_cm0: SAS3808: FWVersion(37.00.00.00), ChipRevision(0x00) [ 34.352120] mpt3sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ) [ 34.352248] mpt3sas_cm0: Enable interrupt coalescing only for first 8 reply queues [ 34.352335] mpt3sas_cm0: performance mode: balanced [ 34.352383] mpt3sas 0000:03:00.0: Max SCSIIO MPT commands: 4848 shared with nr_hw_queues = 20 [ 34.352385] scsi host9: Fusion MPT SAS Host [ 34.352896] mpt3sas_cm0: registering trace buffer support [ 34.356382] mpt3sas_cm0: Trace buffer memory 2048 KB allocated [ 34.356384] mpt3sas_cm0: sending port enable !! [ 34.356754] mpt3sas_cm0: hba_port entry: 000000005f10e3d4, port: 0 is added to hba_port list [ 34.356853] mpt3sas_cm0: hba_port entry: 000000006b465d84, port: 1 is added to hba_port list [ 34.357386] mpt3sas_cm0: vphy entry: 0000000090a6f384, port id: 0, phy:8 is added to port's vphys_list [ 34.357627] mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x500062b20f06df80), phys(11) [ 34.357864] mpt3sas_cm0: handle(0x26) sas_address(0x5000cca2c7031e5d) port_type(0x1) [ 34.358377] scsi 9:0:0:0: Direct-Access WDC WUH722020BL5204 C5C0 PQ: 0 ANSI: 7 [ 34.358382] scsi 9:0:0:0: SSP: handle(0x0026), sas_addr(0x5000cca2c7031e5d), phy(1), device_name(0x5000cca2c7031e5f) [ 34.358384] scsi 9:0:0:0: enclosure logical id (0x300062b20f09df80), slot(1) [ 34.358386] scsi 9:0:0:0: enclosure level(0x0000), connector name( C0.0) [ 34.358388] scsi 9:0:0:0: qdepth(64), tagged(1), scsi_level(8), cmd_que(1) [ 34.362199] sd 9:0:0:0: Attached scsi generic sg8 type 0 [ 34.362450] mpt3sas_cm0: handle(0x25) sas_address(0x5000cca2b03734b1) port_type(0x1) [ 34.362727] sd 9:0:0:0: [sdi] 4882956288 4096-byte logical blocks: (20.0 TB/18.2 TiB) [ 34.362961] scsi 9:0:1:0: Direct-Access HGST HUH721212AL4200 DD08 PQ: 0 ANSI: 6 [ 34.362965] scsi 9:0:1:0: SSP: handle(0x0025), sas_addr(0x5000cca2b03734b1), phy(3), device_name(0x5000cca2b03734b3) [ 34.362968] scsi 9:0:1:0: enclosure logical id (0x300062b20f09df80), slot(3) [ 34.362969] scsi 9:0:1:0: enclosure level(0x0000), connector name( C0.0) [ 34.362971] scsi 9:0:1:0: qdepth(64), tagged(1), scsi_level(7), cmd_que(1) [ 34.363128] sd 9:0:0:0: [sdi] Write Protect is off [ 34.363130] sd 9:0:0:0: [sdi] Mode Sense: f7 00 10 08 [ 34.363789] sd 9:0:0:0: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 34.365950] sd 9:0:1:0: Attached scsi generic sg9 type 0 [ 34.366305] sd 9:0:1:0: [sdj] 2909274112 4096-byte logical blocks: (11.9 TB/10.8 TiB) [ 34.366369] mpt3sas_cm0: handle(0x9) sas_address(0x300162b20f06df80) port_type(0x0) [ 34.366541] scsi 9:0:2:0: Enclosure BROADCOM VirtualSES 03 PQ: 0 ANSI: 7 [ 34.366544] scsi 9:0:2:0: set ignore_delay_remove for handle(0x0009) [ 34.366546] scsi 9:0:2:0: SES: handle(0x0009), sas_addr(0x300162b20f06df80), phy(8), device_name(0x300162b20f06df80) [ 34.366548] scsi 9:0:2:0: enclosure logical id (0x300062b20f09df80), slot(8) [ 34.366550] scsi 9:0:2:0: enclosure level(0x0000), connector name( C0.1) [ 34.366552] scsi 9:0:2:0: qdepth(1), tagged(0), scsi_level(8), cmd_que(0) [ 34.366821] scsi 9:0:2:0: Attached scsi generic sg10 type 13 [ 34.367369] sd 9:0:1:0: [sdj] Write Protect is off [ 34.367372] sd 9:0:1:0: [sdj] Mode Sense: f7 00 10 08 [ 34.369290] sd 9:0:1:0: [sdj] Write cache: disabled, read cache: enabled, supports DPO and FUA [ 34.377596] mpt3sas_cm0: port enable: SUCCESS [ 34.496022] sd 9:0:0:0: [sdi] Attached SCSI disk [ 34.499614] sd 9:0:1:0: [sdj] Attached SCSI disk [ 83.338988] md: import_slot: 29 empty [ 96.769111] md: import_slot: 29 empty [10234.184498] sd 9:0:0:0: [sdi] Synchronizing SCSI cache [10242.376661] mpt3sas_cm0: pdev=0x0000000071dc58e5, slot=0000:03:00.0, entering operating state [10242.376689] mpt3sas_cm0: sending message unit reset !! [10242.378202] mpt3sas_cm0: message unit reset: SUCCESS [10242.378424] sd 5:0:0:0: [sdg] Synchronizing SCSI cache [10242.379326] sd 7:0:0:0: [sdh] Synchronizing SCSI cache [10242.383324] sd 4:0:0:0: [sdf] Synchronizing SCSI cache [10242.383384] sd 3:0:0:0: [sde] Synchronizing SCSI cache [10242.383394] sd 2:0:0:0: [sdd] Synchronizing SCSI cache [10242.383458] sd 1:0:0:0: [sdc] Synchronizing SCSI cache [10242.383462] sd 0:0:0:0: [sdb] Synchronizing SCSI cache [10243.023097] mpt3sas_cm0: pdev=0x0000000071dc58e5, slot=0000:03:00.0, previous operating state [D0] [10243.023162] mpt3sas_cm0: 63 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32626328 kB) [10243.092932] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k [10243.092943] mpt3sas_cm0: MSI-X vectors supported: 128 [10243.092945] mpt3sas_cm0: 8 28 28 [10243.093399] mpt3sas_cm0: High IOPs queues : enabled [10243.093400] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 179 [10243.093401] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 180 [10243.093401] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 181 [10243.093401] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 182 [10243.093402] mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 183 [10243.093402] mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 184 [10243.093402] mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 185 [10243.093403] mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 186 [10243.093403] mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 187 [10243.093403] mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 188 [10243.093404] mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 189 [10243.093404] mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 190 [10243.093404] mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 191 [10243.093405] mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 192 [10243.093405] mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 193 [10243.093405] mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 194 [10243.093406] mpt3sas0-msix16: PCI-MSI-X enabled: IRQ 195 [10243.093406] mpt3sas0-msix17: PCI-MSI-X enabled: IRQ 196 [10243.093406] mpt3sas0-msix18: PCI-MSI-X enabled: IRQ 197 [10243.093407] mpt3sas0-msix19: PCI-MSI-X enabled: IRQ 198 [10243.093407] mpt3sas0-msix20: PCI-MSI-X enabled: IRQ 199 [10243.093407] mpt3sas0-msix21: PCI-MSI-X enabled: IRQ 200 [10243.093408] mpt3sas0-msix22: PCI-MSI-X enabled: IRQ 201 [10243.093408] mpt3sas0-msix23: PCI-MSI-X enabled: IRQ 202 [10243.093408] mpt3sas0-msix24: PCI-MSI-X enabled: IRQ 203 [10243.093409] mpt3sas0-msix25: PCI-MSI-X enabled: IRQ 204 [10243.093409] mpt3sas0-msix26: PCI-MSI-X enabled: IRQ 205 [10243.093409] mpt3sas0-msix27: PCI-MSI-X enabled: IRQ 206 [10243.093410] mpt3sas_cm0: iomem(0x0000006000100000), mapped(0x00000000cf094242), size(1048576) [10243.093411] mpt3sas_cm0: ioport(0x0000000000004000), size(256) [10243.093489] mpt3sas_cm0: Issuing Hard Reset as part of OS Resume [10243.093491] mpt3sas_cm0: mpt3sas_ctl_pre_reset_handler: Releasing the trace buffer due to adapter reset. [10243.150940] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k [10243.476262] mpt3sas_cm0: basedisplay_fwpkg_version: complete [10243.476264] mpt3sas_cm0: FW Package Ver(37.00.00.00) [10243.476865] mpt3sas_cm0: SAS3808: FWVersion(37.00.00.00), ChipRevision(0x00) [10243.476867] mpt3sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ) [10243.476987] mpt3sas_cm0: Enable interrupt coalescing only for first 8 reply queues [10243.477071] mpt3sas_cm0: performance mode: balanced [10243.477097] mpt3sas_cm0: sending port enable !! [10243.697428] sd 7:0:0:0: [sdh] Starting disk [10253.361770] mpt3sas_cm0: port enable: SUCCESS [10253.362217] mpt3sas_cm0: search for end-devices: start [10253.362572] scsi target9:0:2: handle(0x0009), sas_addr(0x300162b20f06df80) [10253.362583] scsi target9:0:2: enclosure logical id(0x300062b20f09df80), slot(8) [10253.362637] scsi target9:0:1: handle(0x0025), sas_addr(0x5000cca2b03734b1) [10253.362645] scsi target9:0:1: enclosure logical id(0x300062b20f09df80), slot(3) [10253.362697] scsi target9:0:0: handle(0x0026), sas_addr(0x5000cca2c7031e5d) [10253.362704] scsi target9:0:0: enclosure logical id(0x300062b20f09df80), slot(1) [10253.362768] mpt3sas_cm0: search for end-devices: complete [10253.362772] mpt3sas_cm0: search for end-devices: start [10253.362775] mpt3sas_cm0: search for PCIe end-devices: complete [10253.362778] mpt3sas_cm0: search for expanders: start [10253.362781] mpt3sas_cm0: search for expanders: complete [10253.362790] mpt3sas_cm0: mpt3sas_base_hard_reset_handler: SUCCESS [10253.362896] mpt3sas_cm0: removing unresponding devices: start [10253.362906] mpt3sas_cm0: removing unresponding devices: end-devices [10253.362910] mpt3sas_cm0: Removing unresponding devices: pcie end-devices [10253.362914] mpt3sas_cm0: removing unresponding devices: expanders [10253.362918] mpt3sas_cm0: removing unresponding devices: complete [10253.362925] mpt3sas_cm0: Update devices with firmware reported queue depth [10253.362938] sd 9:0:0:0: qdepth(64), tagged(1), scsi_level(8), cmd_que(1) [10253.362951] sd 9:0:1:0: qdepth(64), tagged(1), scsi_level(7), cmd_que(1) [10253.362959] ses 9:0:2:0: qdepth(1), tagged(0), scsi_level(8), cmd_que(0) [10253.362965] mpt3sas_cm0: scan devices: start [10253.363256] mpt3sas_cm0: scan devices: expanders start [10253.363311] mpt3sas_cm0: break from expander scan: ioc_status(0x0022), loginfo(0x310f0400) [10253.363318] mpt3sas_cm0: scan devices: expanders complete [10253.363321] mpt3sas_cm0: scan devices: end devices start [10253.363821] mpt3sas_cm0: break from end device scan: ioc_status(0x0022), loginfo(0x310f0400) [10253.363827] mpt3sas_cm0: scan devices: end devices complete [10253.363830] mpt3sas_cm0: scan devices: pcie end devices start [10253.364229] mpt3sas_cm0: break from pcie end device scan: ioc_status(0x0022), loginfo(0x310f0400) [10253.364234] mpt3sas_cm0: pcie devices: pcie end devices complete [10253.364237] mpt3sas_cm0: scan devices: complete [10253.375086] random: crng reseeded on system resumption [10254.111881] sd 9:0:0:0: device_block, handle(0x0026) [10255.863123] sd 9:0:0:0: device_unblock and setting to running, handle(0x0026) [10256.069246] sd 9:0:0:0: Power-on or device reset occurred [10256.611808] sd 9:0:0:0: device_block, handle(0x0026) [10257.482453] sd 5:0:0:0: [sdg] Starting disk [10257.497349] sd 4:0:0:0: [sdf] Starting disk [10257.703650] sd 1:0:0:0: [sdc] Starting disk [10258.071707] sd 2:0:0:0: [sdd] Starting disk [10258.129572] sd 3:0:0:0: [sde] Starting disk [10258.268460] sd 0:0:0:0: [sdb] Starting disk [10258.861528] sd 9:0:0:0: device_unblock and setting to running, handle(0x0026) [10258.861683] sd 9:0:0:0: [sdi] tag#1781 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=2s [10258.861704] sd 9:0:0:0: [sdi] tag#1781 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 [10258.861798] sd 9:0:0:0: [sdi] tag#1782 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=0s [10258.861808] sd 9:0:0:0: [sdi] tag#1782 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 [10258.862120] mpt3sas_cm0: remove hba_port entry: 000000006b465d84 port: 1 from hba_port list [10258.895901] sd 9:0:0:0: [sdi] Synchronizing SCSI cache [10258.895988] sd 9:0:0:0: [sdi] Synchronize Cache(10) failed: Result: hostbyte=0x01 driverbyte=DRIVER_OK [10258.898560] mpt3sas_cm0: mpt3sas_transport_port_remove: removed: sas_addr(0x5000cca2c7031e5d) [10258.898574] mpt3sas_cm0: removing handle(0x0026), sas_addr(0x5000cca2c7031e5d) [10258.898580] mpt3sas_cm0: enclosure logical id(0x300062b20f09df80), slot(1) [10258.898585] mpt3sas_cm0: enclosure level(0x0000), connector name( C0.0) [29121.168182] mpt3sas_cm0: pdev=0x000000003dabe66d, slot=0000:03:00.0, entering operating state [29121.168220] mpt3sas_cm0: sending message unit reset !! [29121.168673] sd 7:0:0:0: [sdh] Synchronizing SCSI cache [29121.168722] sd 5:0:0:0: [sdg] Synchronizing SCSI cache [29121.169642] mpt3sas_cm0: message unit reset: SUCCESS [29121.176778] sd 4:0:0:0: [sdf] Synchronizing SCSI cache [29121.177681] sd 3:0:0:0: [sde] Synchronizing SCSI cache [29121.177878] sd 1:0:0:0: [sdc] Synchronizing SCSI cache [29121.178697] sd 0:0:0:0: [sdb] Synchronizing SCSI cache [29121.178708] sd 2:0:0:0: [sdd] Synchronizing SCSI cache [29121.794226] mpt3sas_cm0: pdev=0x000000003dabe66d, slot=0000:03:00.0, previous operating state [D0] [29121.794269] mpt3sas_cm0: 63 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32626328 kB) [29121.865392] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k [29121.865403] mpt3sas_cm0: MSI-X vectors supported: 128 [29121.865405] mpt3sas_cm0: 8 28 28 [29121.865856] mpt3sas_cm0: High IOPs queues : enabled [29121.865857] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 179 [29121.865858] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 180 [29121.865858] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 181 [29121.865859] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 182 [29121.865859] mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 183 [29121.865859] mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 184 [29121.865860] mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 185 [29121.865860] mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 186 [29121.865860] mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 187 [29121.865861] mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 188 [29121.865861] mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 189 [29121.865861] mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 190 [29121.865862] mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 191 [29121.865862] mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 192 [29121.865862] mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 193 [29121.865863] mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 194 [29121.865863] mpt3sas0-msix16: PCI-MSI-X enabled: IRQ 195 [29121.865863] mpt3sas0-msix17: PCI-MSI-X enabled: IRQ 196 [29121.865864] mpt3sas0-msix18: PCI-MSI-X enabled: IRQ 197 [29121.865864] mpt3sas0-msix19: PCI-MSI-X enabled: IRQ 198 [29121.865864] mpt3sas0-msix20: PCI-MSI-X enabled: IRQ 199 [29121.865865] mpt3sas0-msix21: PCI-MSI-X enabled: IRQ 200 [29121.865865] mpt3sas0-msix22: PCI-MSI-X enabled: IRQ 201 [29121.865865] mpt3sas0-msix23: PCI-MSI-X enabled: IRQ 202 [29121.865866] mpt3sas0-msix24: PCI-MSI-X enabled: IRQ 203 [29121.865866] mpt3sas0-msix25: PCI-MSI-X enabled: IRQ 204 [29121.865866] mpt3sas0-msix26: PCI-MSI-X enabled: IRQ 205 [29121.865866] mpt3sas0-msix27: PCI-MSI-X enabled: IRQ 206 [29121.865867] mpt3sas_cm0: iomem(0x0000006000100000), mapped(0x000000004e84654d), size(1048576) [29121.865868] mpt3sas_cm0: ioport(0x0000000000004000), size(256) [29121.865946] mpt3sas_cm0: Issuing Hard Reset as part of OS Resume [29121.923398] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k [29122.248719] mpt3sas_cm0: basedisplay_fwpkg_version: complete [29122.248721] mpt3sas_cm0: FW Package Ver(37.00.00.00) [29122.249329] mpt3sas_cm0: SAS3808: FWVersion(37.00.00.00), ChipRevision(0x00) [29122.249331] mpt3sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ) [29122.249452] mpt3sas_cm0: Enable interrupt coalescing only for first 8 reply queues [29122.249536] mpt3sas_cm0: performance mode: balanced [29122.249562] mpt3sas_cm0: sending port enable !! [29122.483286] sd 7:0:0:0: [sdh] Starting disk [29132.139437] mpt3sas_cm0: port enable: SUCCESS [29132.139903] mpt3sas_cm0: search for end-devices: start [29132.140258] scsi target9:0:2: handle(0x0009), sas_addr(0x300162b20f06df80) [29132.140268] scsi target9:0:2: enclosure logical id(0x300062b20f09df80), slot(8) [29132.140322] scsi target9:0:1: handle(0x0025), sas_addr(0x5000cca2b03734b1) [29132.140330] scsi target9:0:1: enclosure logical id(0x300062b20f09df80), slot(3) [29132.140386] scsi target9:0:0: handle(0x0026), sas_addr(0x5000cca2c7031e5d) [29132.140393] scsi target9:0:0: enclosure logical id(0x300062b20f09df80), slot(1) [29132.140460] mpt3sas_cm0: search for end-devices: complete [29132.140463] mpt3sas_cm0: search for end-devices: start [29132.140467] mpt3sas_cm0: search for PCIe end-devices: complete [29132.140470] mpt3sas_cm0: search for expanders: start [29132.140473] mpt3sas_cm0: search for expanders: complete [29132.140481] mpt3sas_cm0: mpt3sas_base_hard_reset_handler: SUCCESS [29132.140645] mpt3sas_cm0: removing unresponding devices: start [29132.140664] mpt3sas_cm0: removing unresponding devices: end-devices [29132.140672] mpt3sas_cm0: Removing unresponding devices: pcie end-devices [29132.140677] mpt3sas_cm0: removing unresponding devices: expanders [29132.140681] mpt3sas_cm0: removing unresponding devices: complete [29132.140693] mpt3sas_cm0: Update devices with firmware reported queue depth [29132.140748] sd 9:0:0:0: qdepth(64), tagged(1), scsi_level(8), cmd_que(1) [29132.140767] sd 9:0:1:0: qdepth(64), tagged(1), scsi_level(7), cmd_que(1) [29132.140779] ses 9:0:2:0: qdepth(1), tagged(0), scsi_level(8), cmd_que(0) [29132.140787] mpt3sas_cm0: scan devices: start [29132.141262] mpt3sas_cm0: scan devices: expanders start [29132.141329] mpt3sas_cm0: break from expander scan: ioc_status(0x0022), loginfo(0x310f0400) [29132.141341] mpt3sas_cm0: scan devices: expanders complete [29132.141346] mpt3sas_cm0: scan devices: end devices start [29132.142062] mpt3sas_cm0: break from end device scan: ioc_status(0x0022), loginfo(0x310f0400) [29132.142075] mpt3sas_cm0: scan devices: end devices complete [29132.142079] mpt3sas_cm0: scan devices: pcie end devices start [29132.142459] mpt3sas_cm0: break from pcie end device scan: ioc_status(0x0022), loginfo(0x310f0400) [29132.142465] mpt3sas_cm0: pcie devices: pcie end devices complete [29132.142468] mpt3sas_cm0: scan devices: complete [29132.152235] random: crng reseeded on system resumption [29136.048890] sd 4:0:0:0: [sdf] Starting disk [29136.173416] sd 5:0:0:0: [sdg] Starting disk [29136.309740] sd 1:0:0:0: [sdc] Starting disk [29136.740630] sd 0:0:0:0: [sdb] Starting disk [29136.742682] sd 3:0:0:0: [sde] Starting disk [29136.928559] sd 2:0:0:0: [sdd] Starting disk [29137.889408] sd 9:0:0:0: device_block, handle(0x0026) [29139.890822] sd 9:0:0:0: device_unblock and setting to running, handle(0x0026) [29140.096563] sd 9:0:0:0: Power-on or device reset occurred [29141.889271] sd 9:0:0:0: device_block, handle(0x0026) [29144.639064] sd 9:0:0:0: device_unblock and setting to running, handle(0x0026) [29144.639241] sd 9:0:0:0: [sdi] tag#1679 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=4s [29144.639260] sd 9:0:0:0: [sdi] tag#1679 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 [29144.639339] sd 9:0:0:0: [sdi] tag#1680 UNKNOWN(0x2003) Result: hostbyte=0x01 driverbyte=DRIVER_OK cmd_age=0s [29144.639349] sd 9:0:0:0: [sdi] tag#1680 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 [29144.639720] mpt3sas_cm0: remove hba_port entry: 0000000082b727e1 port: 1 from hba_port list [29144.668820] mpt3sas_cm0: mpt3sas_transport_port_remove: removed: sas_addr(0x5000cca2c7031e5d) [29144.668824] mpt3sas_cm0: removing handle(0x0026), sas_addr(0x5000cca2c7031e5d) [29144.668825] mpt3sas_cm0: enclosure logical id(0x300062b20f09df80), slot(1) [29144.668826] mpt3sas_cm0: enclosure level(0x0000), connector name( C0.0) I switched cables, switched to a 9400-8i HBA card and this behavior still occurs. I reinstalled the Spin Down SAS Drives Plugin. First I thought the emulated sector size of 512 bytes was the problem so i low level formatted the drive, see [Guide] Low level formatting SAS drives. Does anyone have a suggestion or hint what to do? It is driving me nuts, since I can not solve this for two weeks... dmseg.log syslog.log

I ran into the issue that my SAS drive was formatted in emulated 512 bytes sector size and i low level formatted it into 4096 sector size. Since analyzing another problem with my SAS drive which took me several hours of headache (two new HBA cards and SAS drives) i formatted my drive to the specific native sector size. Here is my summary for anyone running into the same issue. Sources / inspiration: [Guide] Changing block size on SAS and SCSI drives How to reformat drive sector size | 520b 524b 528b to 512b or 4k @ArtofServer: thank you for your amazing content! 😀 Setting Parity check running - no docker container possible -> Ubuntu Playground could not be used Broadcom 9500-8i PCI HBA Card (newest firmware version: FW Version = 37.00.00.00) Ultrastar DC HC560 SAS drive (WUH722020BL5204) (used drive from ebay) Required additional software Create a directory /boot/extra, navigate to to the official Slackware page https://slackware.pkgs.org/15.0/slackware-patches-x86_64/sg3_utils-1.47-x86_64-2_slack15.0.txz.html, navigate to the Download section and copy the link to the binary files, download, install it and verify installation. Hint: all files in /boot/extra will get automatically installed at first boot. mkdir /boot/extra cd /boot/extra wget https://slackware.uk/slackware/slackware64-15.0/slackware64/l/sg3_utils-1.47-x86_64-1.txz installpkg sg3_utils-1.47-x86_64-1.txz whereis sg3_utils Get drive information Get the generic SCSI name of all devices and search for your specific drive, here drive WUH722020BL5204 has /dev/sg8. lsscsi -g[0:0:0:0] disk ATA ST20000NM007D-3D SN03 /dev/sdb /dev/sg1 [1:0:0:0] disk ATA ST20000NM007D-3D SN03 /dev/sdc /dev/sg2 [2:0:0:0] disk ATA ST20000NM007D-3D SN01 /dev/sdd /dev/sg3 [3:0:0:0] disk ATA ST20000NM007D-3D SN01 /dev/sde /dev/sg4 [4:0:0:0] disk ATA ST20000NM007D-3D SN01 /dev/sdf /dev/sg5 [5:0:0:0] disk ATA ST20000NM007D-3D SN01 /dev/sdg /dev/sg6 [7:0:0:0] disk ATA WDC WD5000LPVT-0 1A01 /dev/sdh /dev/sg7 [8:0:0:0] disk Kingston DataTraveler 3.0 PMAP /dev/sda /dev/sg0 [9:0:0:0] disk WDC WUH722020BL5204 C5C0 /dev/sdi /dev/sg8 [9:0:1:0] disk HGST HUH721212AL4200 DD08 /dev/sdj /dev/sg9 [9:0:2:0] enclosu BROADCOM VirtualSES 03 - /dev/sg10 [N:0:0:1] disk CT2000P310SSD8__1 /dev/nvme0n1 - [N:1:0:1] disk CT1000P310SSD8__1 /dev/nvme1n1 -Validate if the generic name shows the expected info with the sg3_scan command. sg_scan -i /dev/sgX/dev/sg8: scsi9 channel=0 id=0 lun=0 WDC WUH722020BL5204 C5C0 [rmb=0 cmdq=1 pqual=0 pdev=0x0]Check the current drive parameter in line Logical block length. Here it is 512 bytes and i want it to be 4096 bytes, according to the official datasheet Ultrastar DC HC560 page 2, Format: Sector size (bytes) 4Kn: 4096 (SAS Models row). Ensure that you follow the manufacturer's recommendations for sector sizes for your hard drive! sg_readcap /dev/sgXREAD CAPACITY (10) indicates device capacity too large now trying 16 byte cdb variant Read Capacity results: Protection: prot_en=0, p_type=0, p_i_exponent=0 Logical block provisioning: lbpme=0, lbprz=0 Last LBA=39063650303 (0x9185fffff), Number of logical blocks=39063650304 Logical block length=512 bytes Logical blocks per physical block exponent=3 [so physical block length=4096 bytes] Lowest aligned LBA=0 Hence: Device size: 20000588955648 bytes, 19074048.0 MiB, 20000.59 GB, 20.00 TBLow level format According to @ArtofServer Sometimes changing the sector size directly does not work. To do this, the disk must first be zeroed sg_format --format /dev/sgX and then the sector size changed sg_format --format --size=4096 /dev/sgX. I highly recommend to create a tmux session in order to prevent loss of connection during this step, since formatting will take several hours. Replace /dev/sgX with your specific generic drive name. After creating a new tmux session, a green highlighted lines at the end of your concosle will apear, indicating that you are in the tmux session. Just enter the sg_format command with your specific sector sizes values, here 4096 bytes. To detach tmux session: Ctrl+b then d To reattach tmux session: tmux attach -t format_session To list all tmux sessions: tmux ls tmux new -s format_session sg_format -v --format --size=4096 /dev/sgXThis process took almost 24h for a 20TB drive. After the sg_format command is finished validate the sector size with sg_readcap /dev/sgXREAD CAPACITY (10) indicates device capacity too large now trying 16 byte cdb variant Read Capacity results: Protection: prot_en=0, p_type=0, p_i_exponent=0 Logical block provisioning: lbpme=0, lbprz=0 Last LBA=4882956287 (0x1230bffff), Number of logical blocks=4882956288 Logical block length=4096 bytes Logical blocks per physical block exponent=0 Lowest aligned LBA=0 Hence: Device size: 20000588955648 bytes, 19074048.0 MiB, 20000.59 GB, 20.00 TB Terminate the tmux session tmux kill-session -t session_nameHope this is helpful. Have a good one!

Hi jchaven, yes each unraid server has its own Tailscale account. I am going to check the admin console of my backup server.

Hello everyone, I have two unraid servers each with a own tailnet: main unraid server (DNS main.demo-dns.ts.net) backup unraid server (DNS backup.demo-dns.ts.net) Any idea how to add the main server to the tailnet of the backup server? Somehow I can not figure it out.. Thank you in advance! Kind regards

I had the same issue, since the reauthenticate button was moved to Settings/Tailscale/Settings/Advanced View. Open your tailscale Plugin, navigate to settings and check the advanced view button: Navigate to the Tailscale tab and Login in. You will be navigated to the tailscale login prompt and need your credentials. Dont forget to refresh the Unraid Tailscale window, in order to update the displayed data. Cheers!

Hallo all, somehow MediaElch can not access / see the subdirectories and movies defined in host path 2 and 3. Key 1 = 000, Key 2 = 99 and Key 3 = 100. Example file structure within the defined host path2: drwxrwxrwx 2 nobody users 71 Jan 15 06:05 dir1 drwxrwxrwx 2 nobody users 82 Jan 15 06:04 dir2 drwxrwxrwx 2 nobody users 74 Jan 15 08:29 dir3 UID and GID matches with key 2 and key 3: id nobody uid=99(nobody) gid=100(users) groups=100(users),98(nobody) What am I missing? Thank you in advance!

Hello all, Currently I'm running Unraid V6.12.14 with the apps: - ITE IT87 Driver - Nuvoton NCT6687 Driver - Dynamix System Autofan - Dynamix System Temp I have searched for directories related to hardware info, e.g. the temperatures which are displayed in the dashboard: ```bash find /sys -type d -name "*hw*" find: ‘/sys/kernel/slab’: Input/output error /sys/class/hwmon /sys/devices/platform/it87.2592/hwmon /sys/devices/platform/it87.2592/hwmon/hwmon3 /sys/devices/platform/coretemp.0/hwmon /sys/devices/platform/coretemp.0/hwmon/hwmon2 /sys/devices/pci0000:00/0000:00:1d.1/0000:06:00.0/nvme/nvme0/hwmon1 /sys/devices/virtual/thermal/thermal_zone0/hwmon0 /sys/devices/virtual/misc/hw_random /sys/module/hwmon_vid ``` I am wondering where the temperatures of the disks in the array are stored. Anyone has an idea? I don't want to read out the specs using smartctl, since the values should be already available somewhere. Why I am doing this? I want to record the temperatures of system, in order to optimize the airflow/cooling within the case. Therefore I have wrote a little script, which selects the specific temperatures of my components: #!/usr/bin/bash # Version 2 # Better performing temperature logger than logging # with $(sensors | awk '/CPU Temp/ {print $3}'). # This script gets the current temperature values # and sleeps (sleep_interval) for 10s # Usage: # bash temp_loggerV2.sh <test_period> <specs> # # Example, logging for 60 seconds and specifying # an idle system: # bash temp_loggerV2.sh 60 idle # # Tested on Unraid V6.12.14 # Operants test_period=$1 specs=$2 sleep_interval=10 if ((test_period<sleep_interval));then test_period=$((10/sleep_interval)) else test_period=$((test_period/sleep_interval)) fi logdir=/boot/config/plugins/stresstest # Variables path_T_cpu="/sys/devices/platform/it87.2592/hwmon/hwmon3/temp2_input" path_T_main="/sys/devices/virtual/thermal/thermal_zone0/hwmon0/temp1_input" path_T_nvme="/sys/devices/pci0000:00/0000:00:1d.1/0000:06:00.0/nvme/nvme0/hwmon1/temp1_input" T_cpu=0 T_main=0 T_nvme=0 sum_T_cpu=0 sum_T_main=0 sum_T_nvme=0 # Messages msg_head="Measurement\tT_cpu / (k°C)\tT_main / (k°C)\tT_nvme / (k°C)\n" msg_line="==============================================================\n" # Verifying stresstest log directory & creating logfile if [[ ! -d "$logdir" ]]; then mkdir "$logdir" fi log_filename=${logdir}/$(date +%Y%m%d_%H%M%S)_temperature_${specs}.log touch $log_filename # Temperature logger function record_temps() { test_period=$1 printf "${msg_head}" | tee -a ${log_filename} printf "${msg_line}" | tee -a ${log_filename} for ((i = 0 ; i < "${test_period}" ; i++)); do # CPU T_cpu=$(cat $path_T_cpu) sum_T_cpu=$(echo ${sum_T_cpu} ${T_cpu} | awk '{print $1 + $2}') # Mainboard T_main=$(cat $path_T_main) sum_T_main=$(echo ${sum_T_main} ${T_main} | awk '{print $1 + $2}') # NVME T_nvme=$(cat $path_T_nvme) sum_T_nvme=$(echo ${sum_T_nvme} ${T_nvme} | awk '{print $1 + $2}') # Logging printf "${i}\t\t${T_cpu}\t\t${T_main}\t\t${T_nvme}\n" | tee -a ${log_filename} sleep $sleep_interval done # Average avg_T_cpu=$(awk -v var1=$sum_T_cpu -v var2=$test_period 'BEGIN { print ( var1 / var2 / 1000 ) }') avg_T_main=$(awk -v var1=$sum_T_main -v var2=$test_period 'BEGIN { print ( var1 / var2 / 1000 ) }') avg_T_nvme=$(awk -v var1=$sum_T_nvme -v var2=$test_period 'BEGIN { print ( var1 / var2 /1000 ) }') printf "${msg_line}" | tee -a ${log_filename} echo "Average CPU temperature: ${avg_T_cpu}°C" | tee -a ${log_filename} echo "Average Mainboard temperature: ${avg_T_main}°C" | tee -a ${log_filename} echo "Average NVME temperature: ${avg_T_nvme}°C" | tee -a ${log_filename} } record_temps ${test_period} printf "Log was written to $log_filename\n" Anyone who want to use it, has to change the variables path_T_cpu, path_T_main and path_T_nvme according to his/her system. Running it via User scripts destroys the tab seperators, but the log is still readable. The log is stored under /boot/config/plugins/stresstest/<YYYYMMDD_HHMMSS>_temperature_<specs>.log.