Unraid Crashing Frequently

Stupifier · December 5, 2020

Relevant syslog section of the crash below. Any ideas? Crash happens almost daily. I don't know what causes it. I don't even know how to interpret this kinda crash. Attached Diagnostics.
-On latest Motherboard BIOS
-Turned off DOCP/XMP RAM profile

Dec 4 20:05:06 BEAST-UNRAID kernel: BUG: kernel NULL pointer dereference, address: 0000000000000402
Dec 4 20:05:06 BEAST-UNRAID kernel: #PF: supervisor read access in kernel mode
Dec 4 20:05:06 BEAST-UNRAID kernel: #PF: error_code(0x0000) - not-present page
Dec 4 20:05:06 BEAST-UNRAID kernel: PGD 0 P4D 0
Dec 4 20:05:06 BEAST-UNRAID kernel: Oops: 0000 [#1] SMP NOPTI
Dec 4 20:05:06 BEAST-UNRAID kernel: CPU: 1 PID: 19008 Comm: php-fpm7 Not tainted 5.8.18-Unraid #1
Dec 4 20:05:06 BEAST-UNRAID kernel: Hardware name: System manufacturer System Product Name/TUF GAMING X570-PLUS, BIOS 2816 11/24/2020
Dec 4 20:05:06 BEAST-UNRAID kernel: RIP: 0010:fuse_readahead+0x124/0x352
Dec 4 20:05:06 BEAST-UNRAID kernel: Code: 41 bd 01 00 00 00 41 8b 44 24 18 48 8d 74 02 ff e8 eb b3 16 00 41 8d 55 ff 48 85 c0 44 89 eb 0f 84 03 01 00 00 4b 89 44 ef f8 <48> 8b 10 41 8b 4c 24 1c 81 e2 00 00 01 00 48 83 fa 01 19 d2 81 e2
Dec 4 20:05:06 BEAST-UNRAID kernel: RSP: 0000:ffffc9000088bc50 EFLAGS: 00010202
Dec 4 20:05:06 BEAST-UNRAID kernel: RAX: 0000000000000402 RBX: 0000000000000001 RCX: 0000000000000000
Dec 4 20:05:06 BEAST-UNRAID kernel: RDX: 0000000000000000 RSI: ffff888ea29ad6d0 RDI: 0000000000000402
Dec 4 20:05:06 BEAST-UNRAID kernel: RBP: 0000000000000001 R08: 0000000000000402 R09: ffffc9000088bc60
Dec 4 20:05:06 BEAST-UNRAID kernel: R10: ffffc9000088bc60 R11: ffffc9000088bc60 R12: ffffc9000088bd68
Dec 4 20:05:06 BEAST-UNRAID kernel: R13: 0000000000000001 R14: ffff8885f74ecf00 R15: ffff888104343db0
Dec 4 20:05:06 BEAST-UNRAID kernel: FS: 00001549b406cd48(0000) GS:ffff888fee840000(0000) knlGS:0000000000000000
Dec 4 20:05:06 BEAST-UNRAID kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Dec 4 20:05:06 BEAST-UNRAID kernel: CR2: 0000000000000402 CR3: 000000064187e000 CR4: 0000000000340ee0
Dec 4 20:05:06 BEAST-UNRAID kernel: Call Trace:
Dec 4 20:05:06 BEAST-UNRAID kernel: read_pages+0x59/0x11f
Dec 4 20:05:06 BEAST-UNRAID kernel: ? 0xffffffff81000000
Dec 4 20:05:06 BEAST-UNRAID kernel: page_cache_readahead_unbounded+0x16e/0x19e
Dec 4 20:05:06 BEAST-UNRAID kernel: filemap_fault+0x264/0x441
Dec 4 20:05:06 BEAST-UNRAID kernel: __do_fault+0x49/0x64
Dec 4 20:05:06 BEAST-UNRAID kernel: handle_mm_fault+0xae0/0xe1a
Dec 4 20:05:06 BEAST-UNRAID kernel: exc_page_fault+0x298/0x40c
Dec 4 20:05:06 BEAST-UNRAID kernel: ? asm_exc_page_fault+0x8/0x30
Dec 4 20:05:06 BEAST-UNRAID kernel: asm_exc_page_fault+0x1e/0x30
Dec 4 20:05:06 BEAST-UNRAID kernel: RIP: 0033:0x5607eea40cc9
Dec 4 20:05:06 BEAST-UNRAID kernel: Code: 01 00 00 00 48 39 ca 0f 86 8f 04 00 00 e9 0b 6f 00 00 48 89 55 28 41 80 7f 01 3d 0f 85 f4 04 00 00 e9 ba 04 00 00 48 89 55 28 <41> 8a 47 01 3c 5f 0f 86 d7 04 00 00 e9 94 06 00 00 48 89 55 28 41
Dec 4 20:05:06 BEAST-UNRAID kernel: RSP: 002b:00007ffc2975d460 EFLAGS: 00010207
Dec 4 20:05:06 BEAST-UNRAID kernel: RAX: 00005607eebdb740 RBX: 00005607eecc9820 RCX: 00001549b2cce0db
Dec 4 20:05:06 BEAST-UNRAID kernel: RDX: 00001549b2ccd7fa RSI: 00001549b2cce0fb RDI: ffffffffffe65c55
Dec 4 20:05:06 BEAST-UNRAID kernel: RBP: 00005607eecc96c0 R08: 0000000000000000 R09: 00001549b26770a8
Dec 4 20:05:06 BEAST-UNRAID kernel: R10: 00005607eebdb740 R11: 00005607eea40cc5 R12: 00007ffc2975d5f8
Dec 4 20:05:06 BEAST-UNRAID kernel: R13: 00005607eebdb540 R14: 00000000000000e4 R15: 00001549b2ccd7f9
Dec 4 20:05:06 BEAST-UNRAID kernel: Modules linked in: macvlan xt_CHECKSUM ipt_REJECT ip6table_mangle ip6table_nat iptable_mangle ip6table_filter ip6_tables vhost_net tun vhost vhost_iotlb tap veth xt_nat iptable_filter xfs nfsd lockd grace sunrpc md_mod nct6775 hwmon_vid iptable_nat xt_MASQUERADE nf_nat ip_tables wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libblake2s blake2s_x86_64 libblake2s_generic libchacha bonding wmi_bmof edac_mce_amd kvm_amd kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel crypto_simd cryptd glue_helper rapl k10temp i2c_piix4 i2c_core ccp r8169 ahci libahci realtek mpt3sas nvme raid_class scsi_transport_sas nvme_core button wmi acpi_cpufreq
Dec 4 20:05:06 BEAST-UNRAID kernel: CR2: 0000000000000402
Dec 4 20:05:06 BEAST-UNRAID kernel: ---[ end trace 416906022743205d ]---
Dec 4 20:05:06 BEAST-UNRAID kernel: RIP: 0010:fuse_readahead+0x124/0x352
Dec 4 20:05:06 BEAST-UNRAID kernel: Code: 41 bd 01 00 00 00 41 8b 44 24 18 48 8d 74 02 ff e8 eb b3 16 00 41 8d 55 ff 48 85 c0 44 89 eb 0f 84 03 01 00 00 4b 89 44 ef f8 <48> 8b 10 41 8b 4c 24 1c 81 e2 00 00 01 00 48 83 fa 01 19 d2 81 e2
Dec 4 20:05:06 BEAST-UNRAID kernel: RSP: 0000:ffffc9000088bc50 EFLAGS: 00010202
Dec 4 20:05:06 BEAST-UNRAID kernel: RAX: 0000000000000402 RBX: 0000000000000001 RCX: 0000000000000000
Dec 4 20:05:06 BEAST-UNRAID kernel: RDX: 0000000000000000 RSI: ffff888ea29ad6d0 RDI: 0000000000000402
Dec 4 20:05:06 BEAST-UNRAID kernel: RBP: 0000000000000001 R08: 0000000000000402 R09: ffffc9000088bc60
Dec 4 20:05:06 BEAST-UNRAID kernel: R10: ffffc9000088bc60 R11: ffffc9000088bc60 R12: ffffc9000088bd68
Dec 4 20:05:06 BEAST-UNRAID kernel: R13: 0000000000000001 R14: ffff8885f74ecf00 R15: ffff888104343db0
Dec 4 20:05:06 BEAST-UNRAID kernel: FS: 00001549b406cd48(0000) GS:ffff888fee840000(0000) knlGS:0000000000000000
Dec 4 20:05:06 BEAST-UNRAID kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Dec 4 20:05:06 BEAST-UNRAID kernel: CR2: 0000000000000402 CR3: 000000064187e000 CR4: 0000000000340ee0

beast-unraid-diagnostics-20201204-2146.zip

trurl · December 5, 2020

Stupifier · December 5, 2020

Thank you!
Changed the recommended BIOS settings......lets see if I hit another crash

-Changed the Power Idle Setting to "Typical"
-Changed my RAM speed to correspond to my specific Ryzen CPU

Stupifier · December 5, 2020

Got another crash.....only things I changed were what I said above....and it I still crashed.
Relevant syslog:

Dec 5 15:44:15 BEAST-UNRAID kernel: BUG: kernel NULL pointer dereference, address: 0000000000000402
Dec 5 15:44:15 BEAST-UNRAID kernel: #PF: supervisor read access in kernel mode
Dec 5 15:44:15 BEAST-UNRAID kernel: #PF: error_code(0x0000) - not-present page
Dec 5 15:44:15 BEAST-UNRAID kernel: PGD 0 P4D 0
Dec 5 15:44:15 BEAST-UNRAID kernel: Oops: 0000 [#1] SMP NOPTI
Dec 5 15:44:15 BEAST-UNRAID kernel: CPU: 14 PID: 6277 Comm: php-fpm7 Not tainted 5.8.18-Unraid #1
Dec 5 15:44:15 BEAST-UNRAID kernel: Hardware name: System manufacturer System Product Name/TUF GAMING X570-PLUS, BIOS 2816 11/24/2020
Dec 5 15:44:15 BEAST-UNRAID kernel: RIP: 0010:fuse_readahead+0x124/0x352
Dec 5 15:44:15 BEAST-UNRAID kernel: Code: 41 bd 01 00 00 00 41 8b 44 24 18 48 8d 74 02 ff e8 eb b3 16 00 41 8d 55 ff 48 85 c0 44 89 eb 0f 84 03 01 00 00 4b 89 44 ef f8 <48> 8b 10 41 8b 4c 24 1c 81 e2 00 00 01 00 48 83 fa 01 19 d2 81 e2
Dec 5 15:44:15 BEAST-UNRAID kernel: RSP: 0000:ffffc90003dffc50 EFLAGS: 00010202
Dec 5 15:44:15 BEAST-UNRAID kernel: RAX: 0000000000000402 RBX: 0000000000000001 RCX: 0000000000000000
Dec 5 15:44:15 BEAST-UNRAID kernel: RDX: 0000000000000000 RSI: ffff888e8b980920 RDI: 0000000000000402
Dec 5 15:44:15 BEAST-UNRAID kernel: RBP: 0000000000000001 R08: 0000000000000402 R09: ffffc90003dffc60
Dec 5 15:44:15 BEAST-UNRAID kernel: R10: ffffc90003dffc60 R11: ffffc90003dffc60 R12: ffffc90003dffd68
Dec 5 15:44:15 BEAST-UNRAID kernel: R13: 0000000000000001 R14: ffff888f5d4b5b00 R15: ffff88890c64ae50
Dec 5 15:44:15 BEAST-UNRAID kernel: FS: 00001531ca1f0d48(0000) GS:ffff888feeb80000(0000) knlGS:0000000000000000
Dec 5 15:44:15 BEAST-UNRAID kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Dec 5 15:44:15 BEAST-UNRAID kernel: CR2: 0000000000000402 CR3: 0000000f5aef4000 CR4: 0000000000340ee0
Dec 5 15:44:15 BEAST-UNRAID kernel: Call Trace:
Dec 5 15:44:15 BEAST-UNRAID kernel: read_pages+0x59/0x11f
Dec 5 15:44:15 BEAST-UNRAID kernel: ? 0xffffffff81000000
Dec 5 15:44:15 BEAST-UNRAID kernel: page_cache_readahead_unbounded+0x16e/0x19e
Dec 5 15:44:15 BEAST-UNRAID kernel: filemap_fault+0x264/0x441
Dec 5 15:44:15 BEAST-UNRAID kernel: __do_fault+0x49/0x64
Dec 5 15:44:15 BEAST-UNRAID kernel: handle_mm_fault+0xae0/0xe1a
Dec 5 15:44:15 BEAST-UNRAID kernel: exc_page_fault+0x298/0x40c
Dec 5 15:44:15 BEAST-UNRAID kernel: ? asm_exc_page_fault+0x8/0x30
Dec 5 15:44:15 BEAST-UNRAID kernel: asm_exc_page_fault+0x1e/0x30
Dec 5 15:44:15 BEAST-UNRAID kernel: RIP: 0033:0x563c4be7a42a
Dec 5 15:44:15 BEAST-UNRAID kernel: Code: ff 49 8d 57 0f 48 89 55 28 41 0f b6 57 0f f6 04 10 10 0f 85 00 ba ff ff c7 45 10 0f 00 00 00 41 bd 68 01 00 00 e9 b1 17 00 00 <41> 0f b6 3f 48 8d 15 0b 52 19 00 48 89 f8 f6 04 3a 40 75 68 40 80
Dec 5 15:44:15 BEAST-UNRAID kernel: RSP: 002b:00007fffa51c4bd0 EFLAGS: 00010287
Dec 5 15:44:15 BEAST-UNRAID kernel: RAX: 000000000000004f RBX: 0000563c4c0fd820 RCX: 00001531c8e505e3
Dec 5 15:44:15 BEAST-UNRAID kernel: RDX: 00007fffa51c4f86 RSI: 00001531c8e51531 RDI: 00007fffa51c4d68
Dec 5 15:44:15 BEAST-UNRAID kernel: RBP: 0000563c4c0fd6c0 R08: 0000000000000001 R09: 00001531c893eeb0
Dec 5 15:44:15 BEAST-UNRAID kernel: R10: 0000563c4c00f740 R11: 0000563c4be74d7a R12: 00007fffa51c4d68
Dec 5 15:44:15 BEAST-UNRAID kernel: R13: 0000563c4c00f540 R14: 0000000000000111 R15: 00001531c8e505e1
Dec 5 15:44:15 BEAST-UNRAID kernel: Modules linked in: macvlan xt_CHECKSUM ipt_REJECT ip6table_mangle ip6table_nat iptable_mangle ip6table_filter ip6_tables xt_nat vhost_net tun vhost vhost_iotlb tap veth iptable_filter xfs nfsd lockd grace sunrpc md_mod nct6775 hwmon_vid iptable_nat xt_MASQUERADE nf_nat ip_tables wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libblake2s blake2s_x86_64 libblake2s_generic libchacha bonding wmi_bmof edac_mce_amd kvm_amd kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel crypto_simd cryptd glue_helper rapl k10temp i2c_piix4 i2c_core ccp r8169 ahci mpt3sas libahci realtek nvme raid_class scsi_transport_sas nvme_core button wmi acpi_cpufreq
Dec 5 15:44:15 BEAST-UNRAID kernel: CR2: 0000000000000402
Dec 5 15:44:15 BEAST-UNRAID kernel: ---[ end trace 0a8580407c25edba ]---
Dec 5 15:44:15 BEAST-UNRAID kernel: RIP: 0010:fuse_readahead+0x124/0x352
Dec 5 15:44:15 BEAST-UNRAID kernel: Code: 41 bd 01 00 00 00 41 8b 44 24 18 48 8d 74 02 ff e8 eb b3 16 00 41 8d 55 ff 48 85 c0 44 89 eb 0f 84 03 01 00 00 4b 89 44 ef f8 <48> 8b 10 41 8b 4c 24 1c 81 e2 00 00 01 00 48 83 fa 01 19 d2 81 e2
Dec 5 15:44:15 BEAST-UNRAID kernel: RSP: 0000:ffffc90003dffc50 EFLAGS: 00010202
Dec 5 15:44:15 BEAST-UNRAID kernel: RAX: 0000000000000402 RBX: 0000000000000001 RCX: 0000000000000000
Dec 5 15:44:15 BEAST-UNRAID kernel: RDX: 0000000000000000 RSI: ffff888e8b980920 RDI: 0000000000000402
Dec 5 15:44:15 BEAST-UNRAID kernel: RBP: 0000000000000001 R08: 0000000000000402 R09: ffffc90003dffc60
Dec 5 15:44:15 BEAST-UNRAID kernel: R10: ffffc90003dffc60 R11: ffffc90003dffc60 R12: ffffc90003dffd68
Dec 5 15:44:15 BEAST-UNRAID kernel: R13: 0000000000000001 R14: ffff888f5d4b5b00 R15: ffff88890c64ae50
Dec 5 15:44:15 BEAST-UNRAID kernel: FS: 00001531ca1f0d48(0000) GS:ffff888feeb80000(0000) knlGS:0000000000000000
Dec 5 15:44:15 BEAST-UNRAID kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Dec 5 15:44:15 BEAST-UNRAID kernel: CR2: 0000000000000402 CR3: 0000000f5aef4000 CR4: 0000000000340ee0
Dec 5 15:45:15 BEAST-UNRAID kernel: Hardware name: System manufacturer System Product Name/TUF GAMING X570-PLUS, BIOS 2816 11/24/2020
Dec 5 15:45:15 BEAST-UNRAID kernel: RIP: 0010:do_exit+0x4b/0x8d8
Dec 5 15:45:15 BEAST-UNRAID kernel: Code: 65 48 8b 1c 25 c0 7b 01 00 48 8b 83 c8 06 00 00 48 85 c0 74 17 48 8b 10 48 39 d0 75 0d 48 8b 50 10 48 83 c0 10 48 39 c2 74 02 <0f> 0b 65 8b 05 8b 2e fc 7e 25 00 ff ff 00 48 c7 c7 dd 64 d7 81 89
Dec 5 15:45:15 BEAST-UNRAID kernel: RSP: 0018:ffffc90003dffee8 EFLAGS: 00010092
Dec 5 15:45:15 BEAST-UNRAID kernel: RAX: ffffc90003dffcd0 RBX: ffff888ea725f000 RCX: 0000000000000000
Dec 5 15:45:15 BEAST-UNRAID kernel: RDX: 0000000000000009 RSI: 0000000000000002 RDI: 0000000000000009
Dec 5 15:45:15 BEAST-UNRAID kernel: RBP: 0000000000000009 R08: 000000000000000f R09: ffffffff8242de00
Dec 5 15:45:15 BEAST-UNRAID kernel: R10: 0000000000000046 R11: 0000000000000064 R12: 000000000000147a
Dec 5 15:45:15 BEAST-UNRAID kernel: R13: 0000000000000009 R14: 0000000000000046 R15: 0000000000000000
Dec 5 15:45:15 BEAST-UNRAID kernel: FS: 0000000000000000(0000) GS:ffff888fee840000(0000) knlGS:0000000000000000
Dec 5 15:45:15 BEAST-UNRAID kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Dec 5 15:45:15 BEAST-UNRAID kernel: CR2: 000000000000147a CR3: 000000000200a000 CR4: 0000000000340ee0
Dec 5 15:45:15 BEAST-UNRAID kernel: Call Trace:
Dec 5 15:45:15 BEAST-UNRAID kernel: rewind_stack_do_exit+0x17/0x17
Dec 5 15:45:15 BEAST-UNRAID kernel: RIP: 0033:0x563c4be7a42a
Dec 5 15:45:15 BEAST-UNRAID kernel: Code: Unable to access opcode bytes at RIP 0x563c4be7a400.
Dec 5 15:45:15 BEAST-UNRAID kernel: RSP: 002b:00007fffa51c4bd0 EFLAGS: 00010287
Dec 5 15:45:15 BEAST-UNRAID kernel: RAX: 000000000000004f RBX: 0000563c4c0fd820 RCX: 00001531c8e505e3
Dec 5 15:45:15 BEAST-UNRAID kernel: RDX: 00007fffa51c4f86 RSI: 00001531c8e51531 RDI: 00007fffa51c4d68
Dec 5 15:45:15 BEAST-UNRAID kernel: RBP: 0000563c4c0fd6c0 R08: 0000000000000001 R09: 00001531c893eeb0
Dec 5 15:45:15 BEAST-UNRAID kernel: R10: 0000563c4c00f740 R11: 0000563c4be74d7a R12: 00007fffa51c4d68
Dec 5 15:45:15 BEAST-UNRAID kernel: R13: 0000563c4c00f540 R14: 0000000000000111 R15: 00001531c8e505e1
Dec 5 15:45:15 BEAST-UNRAID kernel: ---[ end trace 0a8580407c25ee18 ]---
Dec 5 15:45:15 BEAST-UNRAID kernel: Fixing recursive fault but reboot is needed!
Dec 5 15:45:15 BEAST-UNRAID kernel: BUG: unable to handle page fault for address: 00000000000014c2
Dec 5 15:45:15 BEAST-UNRAID kernel: #PF: supervisor write access in kernel mode
Dec 5 15:45:15 BEAST-UNRAID kernel: #PF: error_code(0x0002) - not-present page
Dec 5 15:45:15 BEAST-UNRAID kernel: PGD 0 P4D 0
Dec 5 15:45:15 BEAST-UNRAID kernel: Oops: 0002 [#49] SMP NOPTI

trurl · December 6, 2020

Have you done memtest?

Stupifier · December 6, 2020

4 hours ago, trurl said:

Have you done memtest?

Not yet.....but I just Disabled the Motherboard BIOS Global C-State setting about 20 hours ago.
If I still get crash, I'll do memtest.

stebwen · December 7, 2020

Hi,

i also got frequent Unraid crashes... so far as i found out, it always happens when the last disk spins down. Don't know why it is like that, but setting one disk (i chose parity) to "never" spin down helped me. The crashes are gone now.
Maybe this helps you too. I know its a workaround, but for now its fine. I have read another thread where it was reported to be a power supply problem... for now i don't have another PSU to test, so i'll stick to the method.

Stupifier · December 7, 2020

5 hours ago, stebwen said:

Hi,

i also got frequent Unraid crashes... so far as i found out, it always happens when the last disk spins down. Don't know why it is like that, but setting one disk (i chose parity) to "never" spin down helped me. The crashes are gone now.
Maybe this helps you too. I know its a workaround, but for now its fine. I have read another thread where it was reported to be a power supply problem... for now i don't have another PSU to test, so i'll stick to the method.

Post a syslog of that crash....I think your issue is not related to this crash.

Upon deeper searching.....this looks like it might be my issue. I say this because all of my crashes state "php-fpm7" as a possible problem....just like people here. Still testing this though as suggested to turn off organizr docker container.

Edited December 7, 2020 by Stupifier

stebwen · January 2, 2021

On 12/7/2020 at 12:07 PM, stebwen said:

Hi,

i also got frequent Unraid crashes... so far as i found out, it always happens when the last disk spins down. Don't know why it is like that, but setting one disk (i chose parity) to "never" spin down helped me. The crashes are gone now.
Maybe this helps you too. I know its a workaround, but for now its fine. I have read another thread where it was reported to be a power supply problem... for now i don't have another PSU to test, so i'll stick to the method.

False alarm, im sorry.

Status update:

I replaced two of my drives (in an array of 5 disks) to bigger ones. One was already showing a SMART warning.
The problem of crashing UNRAID is gone now.

Unraid Crashing Frequently

Recommended Posts

Stupifier

Link to comment

trurl

Link to comment

Stupifier

Link to comment

Stupifier

Link to comment

trurl

Link to comment

Stupifier

Link to comment

stebwen

Link to comment

Stupifier

Link to comment

stebwen

Link to comment

Join the conversation