hello im new to unraid (coming from synology) and testing it the last few days a lot so far

 

my problem is now that sometimes after reboot my LSI HBA dont show my HDDs?

unraid is starting but every drive from HBA is missing

 

even multible reboot dont help

i can directly see in the black/white unraid loading screen thats are only sda sdb sdc drives are recognized (devies from my mainboard sata ports)

 

strange thing is that under devices i can see my HBA? but with no listed drives

Quote

[1000:0072] 01:00.0 RAID bus controller: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)

 

but if i unplug my power cable after shutdown and boot then it will start normal and show all my HDDs (thats the only known way for me to fix this .. unplugging power)

Quote

    [1000:0072] 01:00.0 RAID bus controller: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)
                [1:0:0:0]    disk    ATA      ST8000AS0002-1NA AR13  /dev/sdd   8.00TB
                [1:0:1:0]    disk    ATA      ST8000NM0055-1RM SN05  /dev/sde   8.00TB
                [1:0:2:0]    disk    ATA      ST8000NM0055-1RM SN05  /dev/sdf   8.00TB
                [1:0:3:0]    disk    ATA      WDC WD80EMAZ-00W 0A83  /dev/sdg   8.00TB
                [1:0:4:0]    disk    ATA      ST8000AS0002-1NA AR13  /dev/sdh   8.00TB
                [1:0:5:0]    disk    ATA      ST8000AS0002-1NA AR13  /dev/sdi   8.00TB
                [1:0:6:0]    disk    ATA      WDC WD80EMAZ-00W 0A83  /dev/sdj   8.00TB
                [1:0:7:0]    disk    ATA      WDC WD80EMAZ-00W 0A83  /dev/sdk   8.00TB
                [1:0:8:0]    disk    ATA      WDC WD80EMAZ-00W 0A83  /dev/sdl   8.00TB

 

 

i using a LSI flashed to IT mode (20.00.07.00-IT) with an HP SAS expander
LSI Broadcom 9211-8i 6Gbps SATA/SAS HBA Controller IT MODE Avago PCIe x8 2.0

HP HSTNM-B017 24 Bay 3Gb SAS Expander Card PCI-Ex8 SP# 487738-001

 

 

im trying to nail it down what causes this hick hack

my guess is it comes from my recent install of my new 10G NiC (Asus XG-C100C 10G)

ok even without this nic i installed yesterday i saw a few days ago sometimes this no drive bug but it was really rarly and was with a reboot fixed

Quote

[1d6a:d107] 05:00.0 Ethernet controller: Aquantia Corp. AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] (rev 02)

 

i tryed multible scenarios and createt for every one a diagnostic report

i was able to get in a direction what maybe can cause this problem

 

i guess it only happend if i use wake on lan with 10gb asus installed
without the asus card wake on lan seems to function normal and no missing drive happens

but with installed asus card and trying to wake up server after normal shutdown (no sleep!) it won´t show my drives

even reboot cant fix this problem i have to shutdown unplugging power cable and boot again to see my drives

 

what i can say is my onboard nic from mainboard resets every time after reboot its wake on g status i have to set it manuel with ethtool -s eth0 wol g if i wanna wake it up after shutdown...

        "Supports Wake-on: pumbg
        Wake-on: d"

and in my mainboard bios i cant find an option for wake on lan even in my manuel is no wake on lan discription

 

i hope someone of you can help me with all this logs to fix this problem

i want to use my 10gbit nic and i need the onboard nic to use WoL

so the only reason to use my onboard nic is to send magic packet there to wake up server

all other stuff i want to handle with my 10gbnic

 

 

 

all good - normal boot with powerbutton - NO Asus 10Gbe card installed.zip all good - WOL after shutdown - NO ASUS card installed.zip first boot after installing 10GB ASUS card - seems fine.zip normal boot with powerbutton - 10GB ASUS card installed - seems fine.zip WOL after shutdown - 10GB ASUS installed - NO DRIVES!.zip reboot over GUI after first NO DRIVE happend - NO drives after reboot.zip shutdown with no drives - UNPLUGGING POWER- reboot all seems fine.zip no drives even without 10gb card.zip

3 hours ago, p4nda said:

without the asus card wake on lan seems to function normal

You need both WOL ? How about only enable onboard one.

 

Suggest you try swap both PCIe card's slot.

Edited August 23, 20205 yr by Benson

hai

i tried every pci slot combination...

 

no i not need both cards WOL

but the onboard one is the only one i can wake up with magic packet

 

as far i know most pci-e 10g cards cant wake up pc over WOL (from shut downed)

same for my synology nas the 10g ports are pcie and cant wake up only the 1g synolog onboards port can

 

thats why i have to plug in 2 lan cables

the one on the 1gb is only for the magic packet

traffic i want all over the 10g connection

 

strange thing is now after switching network rules both nics it looks like it works without erros tried it ~15 times now and no hdd lose

Interface eth0: is now 1g onboard (was 10g asus before)

Interface eth1: is now 10g asus (was 1g onboard before)

 

dont know if was this the fix that i only switched interfaces eth0 and eth1

 

ok nevermind even with this interface rule switch it apears again

 

p4nda-unraid-diagnostics-20200823-2100.zip

Edited August 23, 20205 yr by p4nda
.

28 minutes ago, p4nda said:

as far i know most pci-e 10g cards cant wake up pc over WOL (from shut downed)

Yes, most shouldn't support WOL. But I found you said if not enable WOL on 10G then everything seems return normal, so I ask could you simple not enable WOL on 10G NIC.

 

30 minutes ago, p4nda said:

strange thing is now after switching network rules both nics it looks like it works

Strange, but I don't think it will be cause or solution, because those setting won't affect if PC restart from S4/S5.

 

I also seldom see people report need completely unplug power in order to resume disk show up.

13 minutes ago, Benson said:

 But I found you said if not enable WOL on 10G then everything seems return normal, so I ask could you simple not enable WOL on 10G NIC.

i dont touch my asus 10g card it has allready after booting unraid  wol g activ

Wake-on: g
 Current message level: 0x00000005 (5)

 

what i do is with user script now send "ethtool -s eth0 wol g" to my onboard nic to enable the wol G option

it resets after every boot so i have to send it again

 

im playing now around with the bonding of the 2 nics
i have activ_backup(1) mod but unraid always uses the slow 1g nic as activ

 

cat /sys/class/net/bond0/bonding/active_slave says everytime eth0 and this is my 1g onboard

so i use this command to force my 10g asus card to get the activ slave

 

echo eth1 > /sys/class/net/bond0/bonding/primary

 

but i guess it looks like the hba error happens more if i shutdown with my 10gb nic as activ slave

so i will try now with user script on array stop before shutdown to set back to eth0 as activ slave

 

6 minutes ago, p4nda said:

i have activ_backup(1) mod but unraid always uses the slow 1g nic as activ

You can try simple execute "ethtoool -r ethX" X is the 1G port, then Unraid will use 10G link.

 

Also thank you for below method

echo eth1 > /sys/class/net/bond0/bonding/primary

Edited August 23, 20205 yr by Benson

Were you able to find the issue? I'm having the same problem, I changed the cables, the card, PCIe slow and after 3 days the drive have gone missing again. Rebooting makes the drives appear again