Greetings all,
I have an issue with a few disks also not spinning down. I've noticed this was happening ever since my upgrade to 6.11. I'm currently running 6.11.5. I've uninstalled every app / plugin that reads anything from disk or reports smart information (temp, fan control etc) and disabled docker completely. I've changed spindown to 15 minutes and I see the calls to SAS Assist, but seconds later a Read call for SMART is kicked in and it spins the disk back up. The drives with issues can be seen with green mark below:
My System Log looks like the following:
---------------------------------------------------------------------
Nov 27 13:15:40 Tower emhttpd: spinning down /dev/sdt
Nov 27 13:15:40 Tower emhttpd: spinning down /dev/sdn
Nov 27 13:15:40 Tower emhttpd: spinning down /dev/sdo
Nov 27 13:15:41 Tower emhttpd: spinning down /dev/sdu
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sdm
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sdj
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sdk
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sdh
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sdg
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sdd
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sde
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sdb
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sdr
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sdf
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sdc
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sds
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sdi
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdm
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdg
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdj
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdd
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdh
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdb
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sde
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdk
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdf
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdi
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdc
Nov 27 13:16:25 Tower emhttpd: read SMART /dev/sdh
Nov 27 13:16:25 Tower emhttpd: read SMART /dev/sde
Nov 27 13:16:25 Tower emhttpd: read SMART /dev/sdf
Nov 27 13:16:25 Tower emhttpd: read SMART /dev/sdi
Nov 27 13:16:38 Tower emhttpd: spinning down /dev/sdq
Nov 27 13:16:38 Tower emhttpd: spinning down /dev/sdl
Nov 27 13:16:38 Tower emhttpd: spinning down /dev/sdp
Nov 27 13:16:38 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdl
Nov 27 13:31:26 Tower emhttpd: spinning down /dev/sdh
Nov 27 13:31:26 Tower emhttpd: spinning down /dev/sde
Nov 27 13:31:26 Tower emhttpd: spinning down /dev/sdf
Nov 27 13:31:26 Tower emhttpd: spinning down /dev/sdi
Nov 27 13:31:26 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdh
Nov 27 13:31:26 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdf
Nov 27 13:31:26 Tower SAS Assist v2022.08.02: Spinning down device /dev/sde
Nov 27 13:31:26 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdi
Nov 27 13:31:45 Tower emhttpd: read SMART /dev/sdh
Nov 27 13:31:45 Tower emhttpd: read SMART /dev/sde
Nov 27 13:31:45 Tower emhttpd: read SMART /dev/sdf
Nov 27 13:31:45 Tower emhttpd: read SMART /dev/sdi
---------------------------------------------------------------------
Disk SDE Log:
-----------------------
Nov 27 12:59:55 Tower kernel: sd 1:1:19:0: [sde] 11721045168 512-byte logical blocks: (6.00 TB/5.46 TiB)
Nov 27 12:59:55 Tower kernel: sd 1:1:19:0: [sde] 4096-byte physical blocks
Nov 27 12:59:55 Tower kernel: sd 1:1:19:0: [sde] Write Protect is off
Nov 27 12:59:55 Tower kernel: sd 1:1:19:0: [sde] Mode Sense: db 00 10 08
Nov 27 12:59:55 Tower kernel: sd 1:1:19:0: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
Nov 27 12:59:55 Tower kernel: sd 1:1:19:0: [sde] Preferred minimum I/O size 4096 bytes
Nov 27 12:59:55 Tower kernel: sde: sde1
Nov 27 12:59:55 Tower kernel: sd 1:1:19:0: [sde] Attached SCSI removable disk
Nov 27 13:00:19 Tower emhttpd: ST6000NM0034_Z4D2WVPZ0000R601KR6P_35000c500841f8d57 (sde) 512 11721045168
Nov 27 13:00:19 Tower kernel: mdcmd (5): import 4 sde 64 5860522532 0 ST6000NM0034_Z4D2WVPZ0000R601KR6P_35000c500841f8d57
Nov 27 13:00:19 Tower kernel: md: import disk4: (sde) ST6000NM0034_Z4D2WVPZ0000R601KR6P_35000c500841f8d57 size: 5860522532
Nov 27 13:00:19 Tower emhttpd: read SMART /dev/sde
Nov 27 13:00:25 Tower emhttpd: shcmd (41): echo 128 > /sys/block/sde/queue/nr_requests
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sde
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sde
Nov 27 13:16:25 Tower emhttpd: read SMART /dev/sde
Nov 27 13:31:26 Tower emhttpd: spinning down /dev/sde
Nov 27 13:31:26 Tower SAS Assist v2022.08.02: Spinning down device /dev/sde
Nov 27 13:31:45 Tower emhttpd: read SMART /dev/sde
Disk SDH Log:
------------------------
Nov 27 12:59:55 Tower kernel: sd 1:1:22:0: [sdh] 11721045168 512-byte logical blocks: (6.00 TB/5.46 TiB)
Nov 27 12:59:55 Tower kernel: sd 1:1:22:0: [sdh] 4096-byte physical blocks
Nov 27 12:59:55 Tower kernel: sd 1:1:22:0: [sdh] Write Protect is off
Nov 27 12:59:55 Tower kernel: sd 1:1:22:0: [sdh] Mode Sense: d7 00 10 08
Nov 27 12:59:55 Tower kernel: sd 1:1:22:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
Nov 27 12:59:55 Tower kernel: sd 1:1:22:0: [sdh] Disabling DIF Type 2 protection
Nov 27 12:59:55 Tower kernel: sd 1:1:22:0: [sdh] Enabling DIF Type 0 protection
Nov 27 12:59:55 Tower kernel: sd 1:1:22:0: [sdh] Preferred minimum I/O size 4096 bytes
Nov 27 12:59:55 Tower kernel: sdh: sdh1
Nov 27 12:59:55 Tower kernel: sd 1:1:22:0: [sdh] Attached SCSI removable disk
Nov 27 13:00:19 Tower emhttpd: ST6000NM0034_Z4D1JRGF0000R533HWD2_35000c5008345baf3 (sdh) 512 11721045168
Nov 27 13:00:19 Tower kernel: mdcmd (6): import 5 sdh 64 5860522532 0 ST6000NM0034_Z4D1JRGF0000R533HWD2_35000c5008345baf3
Nov 27 13:00:19 Tower kernel: md: import disk5: (sdh) ST6000NM0034_Z4D1JRGF0000R533HWD2_35000c5008345baf3 size: 5860522532
Nov 27 13:00:19 Tower emhttpd: read SMART /dev/sdh
Nov 27 13:00:25 Tower emhttpd: shcmd (42): echo 128 > /sys/block/sdh/queue/nr_requests
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sdh
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdh
Nov 27 13:16:25 Tower emhttpd: read SMART /dev/sdh
Nov 27 13:31:26 Tower emhttpd: spinning down /dev/sdh
Nov 27 13:31:26 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdh
Nov 27 13:31:45 Tower emhttpd: read SMART /dev/sdh
Disk SDF Log:
------------------------
Nov 27 12:59:55 Tower kernel: sd 1:1:20:0: [sdf] 11721045168 512-byte logical blocks: (6.00 TB/5.46 TiB)
Nov 27 12:59:55 Tower kernel: sd 1:1:20:0: [sdf] 4096-byte physical blocks
Nov 27 12:59:55 Tower kernel: sd 1:1:20:0: [sdf] Write Protect is off
Nov 27 12:59:55 Tower kernel: sd 1:1:20:0: [sdf] Mode Sense: db 00 10 08
Nov 27 12:59:55 Tower kernel: sd 1:1:20:0: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
Nov 27 12:59:55 Tower kernel: sd 1:1:20:0: [sdf] Preferred minimum I/O size 4096 bytes
Nov 27 12:59:55 Tower kernel: sdf: sdf1
Nov 27 12:59:55 Tower kernel: sd 1:1:20:0: [sdf] Attached SCSI removable disk
Nov 27 13:00:19 Tower emhttpd: ST6000NM0034_S4D1C5GJ0000E715D6DK_35000c50099185123 (sdf) 512 11721045168
Nov 27 13:00:19 Tower kernel: mdcmd (9): import 8 sdf 64 5860522532 0 ST6000NM0034_S4D1C5GJ0000E715D6DK_35000c50099185123
Nov 27 13:00:19 Tower kernel: md: import disk8: (sdf) ST6000NM0034_S4D1C5GJ0000E715D6DK_35000c50099185123 size: 5860522532
Nov 27 13:00:19 Tower emhttpd: read SMART /dev/sdf
Nov 27 13:00:25 Tower emhttpd: shcmd (45): echo 128 > /sys/block/sdf/queue/nr_requests
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sdf
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdf
Nov 27 13:16:25 Tower emhttpd: read SMART /dev/sdf
Nov 27 13:31:26 Tower emhttpd: spinning down /dev/sdf
Nov 27 13:31:26 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdf
Nov 27 13:31:45 Tower emhttpd: read SMART /dev/sdf
Disk SDI Log:
-----------------------
Nov 27 12:59:55 Tower kernel: sd 1:1:23:0: [sdi] 11721045168 512-byte logical blocks: (6.00 TB/5.46 TiB)
Nov 27 12:59:55 Tower kernel: sd 1:1:23:0: [sdi] 4096-byte physical blocks
Nov 27 12:59:55 Tower kernel: sd 1:1:23:0: [sdi] Write Protect is off
Nov 27 12:59:55 Tower kernel: sd 1:1:23:0: [sdi] Mode Sense: d7 00 10 08
Nov 27 12:59:55 Tower kernel: sd 1:1:23:0: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
Nov 27 12:59:55 Tower kernel: sd 1:1:23:0: [sdi] Preferred minimum I/O size 4096 bytes
Nov 27 12:59:55 Tower kernel: sdi: sdi1
Nov 27 12:59:55 Tower kernel: sd 1:1:23:0: [sdi] Attached SCSI removable disk
Nov 27 13:00:19 Tower emhttpd: ST6000NM0034_S4D0BBE9_35000c5008efc9f2b (sdi) 512 11721045168
Nov 27 13:00:19 Tower kernel: mdcmd (10): import 9 sdi 64 5860522532 0 ST6000NM0034_S4D0BBE9_35000c5008efc9f2b
Nov 27 13:00:19 Tower kernel: md: import disk9: (sdi) ST6000NM0034_S4D0BBE9_35000c5008efc9f2b size: 5860522532
Nov 27 13:00:19 Tower emhttpd: read SMART /dev/sdi
Nov 27 13:00:25 Tower emhttpd: shcmd (46): echo 128 > /sys/block/sdi/queue/nr_requests
Nov 27 13:16:07 Tower emhttpd: spinning down /dev/sdi
Nov 27 13:16:07 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdi
Nov 27 13:16:25 Tower emhttpd: read SMART /dev/sdi
Nov 27 13:31:26 Tower emhttpd: spinning down /dev/sdi
Nov 27 13:31:26 Tower SAS Assist v2022.08.02: Spinning down device /dev/sdi
Nov 27 13:31:45 Tower emhttpd: read SMART /dev/sdi
tower-diagnostics-20221127-1339.zip