Unable to spindown after moving disks to LSI 9300-16i

[limawaken]

over the weekend i swapped out my old LSI 8i HBA and connected all my disks to the 16i card.

previously some were on the m/b sata controller and some were on the 8i.

all my disks are SATA.

even after a day all the disks would still be active (green dot). previously they were all able to spin down.

 

i have tried updating to latest 6.11.5.

there was a small difference after installing 6.11.5. on the previous 6.11.2 clicking the green dot would turn to the spinning circle and after a few seconds would go back to the green dot. on 6.11.5 clicking on the green dot would turn to the spinning circle forever. when i refresh the page it would be back to the green dot.

 

i don't have turbo-write plugin installed and spin up group under disk settings is not enabled.

as far as i can tell there is no read/write activity happening on the array.

 

this is what clicking on disklog information shows:

Dec 19 09:52:16 SILOmetalico kernel: sd 9:0:1:0: [sdc] 976773168 512-byte logical blocks: (500 GB/466 GiB)
Dec 19 09:52:16 SILOmetalico kernel: sd 9:0:1:0: [sdc] Write Protect is off
Dec 19 09:52:16 SILOmetalico kernel: sd 9:0:1:0: [sdc] Mode Sense: 9b 00 10 08
Dec 19 09:52:16 SILOmetalico kernel: sd 9:0:1:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
Dec 19 09:52:16 SILOmetalico kernel: sdc: sdc1
Dec 19 09:52:16 SILOmetalico kernel: sd 9:0:1:0: [sdc] Attached SCSI disk
Dec 19 09:52:36 SILOmetalico  emhttpd: WDC_WD5000AAKX-001CA0_WD-WCAYUS199252 (sdc) 512 976773168
Dec 19 09:52:36 SILOmetalico kernel: mdcmd (9): import 8 sdc 64 488386552 0 WDC_WD5000AAKX-001CA0_WD-WCAYUS199252
Dec 19 09:52:36 SILOmetalico kernel: md: import disk8: (sdc) WDC_WD5000AAKX-001CA0_WD-WCAYUS199252 size: 488386552 
Dec 19 09:52:36 SILOmetalico  emhttpd: read SMART /dev/sdc
Dec 19 09:56:49 SILOmetalico  emhttpd: spinning down /dev/sdc
Dec 19 09:56:49 SILOmetalico  emhttpd: sdspin /dev/sdc down: 1

 

disklog does show that the disks spin down, but they actually are not (as far as i can tell).

power usage seems to be between 125W - 135W, previously it would be at 95W - 105W when disks were idle.

 

i looked through other similar posts but those seems to be related to SAS drives or some other plugin or disk activity.

 

for my case, the only change is connecting all the drives to the 16i card. unraid booted up without any fuss.

other than redoing the IOMMU group there was nothing else that had to be reconfigured.

 

is there some setting i need to check on the LSI controller or in my bios?

under my system devices the LSI card appears as

Serial Attached SCSI controller: Broadcom / LSI SAS3008 PCI-Express Fusion-MPT SAS-3 (rev 02)

 

any ideas what could be preventing all the disks from spinning down?

 

 

thanks.

Edited December 19, 2022 by limawaken

[JorgeB]

Please post the diagnostics 

[limawaken]

hi jb!

 

here's the diagnostics. i'm currently rebuilding disk5, because earlier i had to remove a disk to change the caddy which had broken. i think it wasn't seated properly when i put it back... array started and disk was being emulated. strange because i'm very sure it didn't have any errors when the array first started.

 

 

thanks.

silometalico-diagnostics-20221219-1818.zip

[JorgeB]

When the rebuild is done update the LSI firmware to latest, it's using an ancient version.

[limawaken]

you're awesome.

 

firmware and bios updated, rebooted the machine and verified that the updated controller detected all the drives, then unraid started right up.

after about 30 mins the disks spun down. back to 95w when array disks idle.

 

that was it! amazing... just wow...

[Wingmanos]

Hey Limawaken,

 

Do you have the files or URLs maybe.
I am trying to find the firmware or BIOS files.

But only just got a new card LSI SAS3008 PCI-Express Fusion-MPT SAS-3 (rev 02) and noticed my drives dont spin down.

When looking i see a whole lot of firmware files but when i open the readme they refrense cards that a re non the LSI SAS3008

 

[JorgeB]

Go to Broadcom support site and look for the firmware for the 9300-8i.