Unraid 6.10.0-rc1 - Kernel Panic after every reboot

[TheSkaz]

I cant get get the server to stay running. it boots completely, then after about 5 minutes or so, kernel panics:

 

 

I just finally got to the point that I can add vms and docker images. after adding them, this started happening.... is it zfs? something I can do about it?

syslog.zip server-diagnostics-20210929-1255.zip

[TheSkaz]

if I dont access the web UI, and instead go through ssh, seems to stay up... will report back

[TheSkaz]

nope, crashed again. took much longer this time though....

 

[ChatNoir]

You should try to boot in safe mode to see if it is stable that way.

[TheSkaz]

booting in safe mode fails. I get an error about mounting a bad fs. I didnt record its exact error.

[JorgeB]

Try booting after disconnecting the zfs pool.

[TheSkaz]

did that. I moved my important info off of the pools and destroyed them all. currenly there are 0 zfs pools and was still getting kernel panics.

 

 

I have now installed a clean version of 6.9.2 with a couple plugins installed. docker and vms are disabled. system froze again, but no kernel panic. will do a couple more things and report back

 

[TheSkaz]

quick question:

 

Im getting a lot of noise in syslog with this:  (1000s of them)

 

Sep 29 20:17:42 Tower kernel: usb 12-3-port4: Cannot enable. Maybe the USB cable is bad?

 

and I dont have anything plugged into the usb ports aside from the keyboard, the flash drive, and APC UPS.

 

root@Tower:~# lsusb
Bus 016 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 015 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 014 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 013 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 012 Device 003: ID 174c:3074 ASMedia Technology Inc. ASM1074 SuperSpeed hub
Bus 012 Device 002: ID 174c:3074 ASMedia Technology Inc. ASM1074 SuperSpeed hub
Bus 012 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 011 Device 003: ID 174c:2074 ASMedia Technology Inc. ASM1074 High-Speed hub
Bus 011 Device 004: ID 0781:5581 SanDisk Corp. Ultra
Bus 011 Device 002: ID 174c:2074 ASMedia Technology Inc. ASM1074 High-Speed hub
Bus 011 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 009 Device 004: ID 0b05:18bb ASUSTek Computer, Inc. AURA LED Controller
Bus 009 Device 003: ID 0b05:18f3 ASUSTek Computer, Inc. AURA LED Controller
Bus 009 Device 002: ID 05e3:0610 Genesys Logic, Inc. 4-port hub
Bus 009 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 010 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 008 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 007 Device 002: ID c0f4:04c0 SZH usb keyboard
Bus 007 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 006 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 005 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 004 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 003 Device 002: ID 051d:0003 American Power Conversion UPS
Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

 

If I read the error correctly, is it complaining about  the ASM1074 SuperSpeed hub? 

 

edit: went into bios and there was a front and back asm1074 hub. disabled the front, still gave same error, disabled back and the flash drive wasnt recognized. moved the flash drive to the only USB2 port there was (BIOS Flash port) and it booted, no more usb errors. now that that is done, next steps

Edited September 30, 2021 by TheSkaz

[TheSkaz]

created zpools:

root@Tower:~# zpool create tank raidz sdm sdn sdo sdp sdq sdr sdu sdv sdy sdz
root@Tower:~# zpool create fast raidz nvme0n1 nvme1n1 nvme2n1 nvme4n1
root@Tower:~# zpool status
  pool: fast
 state: ONLINE
config:

        NAME         STATE     READ WRITE CKSUM
        fast         ONLINE       0     0     0
          raidz1-0   ONLINE       0     0     0
            nvme0n1  ONLINE       0     0     0
            nvme1n1  ONLINE       0     0     0
            nvme2n1  ONLINE       0     0     0
            nvme4n1  ONLINE       0     0     0

errors: No known data errors

  pool: tank
 state: ONLINE
config:

        NAME        STATE     READ WRITE CKSUM
        tank        ONLINE       0     0     0
          raidz1-0  ONLINE       0     0     0
            sdm     ONLINE       0     0     0
            sdn     ONLINE       0     0     0
            sdo     ONLINE       0     0     0
            sdp     ONLINE       0     0     0
            sdq     ONLINE       0     0     0
            sdr     ONLINE       0     0     0
            sdu     ONLINE       0     0     0
            sdv     ONLINE       0     0     0
            sdy     ONLINE       0     0     0
            sdz     ONLINE       0     0     0

errors: No known data errors
root@Tower:~# 

 

how can I stress test this without putting real data on here to see if it craps out?

[JorgeB]

Best bet is to post in the existing zfs plugin support thread.

[TheSkaz]

I did some googling. and currently testing with fio and doing some benchmarks. I might open another thread and post them with all the settings and such.