Over the past few months, my Unraid server has been having issues that can't be fixed by anything other than a reboot. Docker services stop and eventually the UI won't even load. At first it was showing up as BTRFS errors (something like `write time tree block corruption detected`). The most common fix for that was deleting docker.img and recreating it, which I've done ~5 times. The next thing I did was get rid of my cache pool in favor of a new XFS-formatted drive (so no more BTRFS drives).
Unfortunately, the issue persists, but with new error messaging:
Mar 7 10:39:31 Unraid kernel: BUG: Bad page map in process khugepaged pte:ffff88815db81540 pmd:269680067 Mar 7 10:39:31 Unraid kernel: addr:000014d3c4cf3000 vm_flags:00200073 anon_vma:ffff88838f232f08 mapping:0000000000000000 index:14d3c4cf3 Mar 7 10:39:31 Unraid kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Mar 7 10:39:31 Unraid kernel: CPU: 0 PID: 63 Comm: khugepaged Tainted: G W 5.19.17-Unraid #2 Mar 7 10:39:31 Unraid kernel: Hardware name: Gigabyte Technology Co., Ltd. Z490 VISION G/Z490 VISION G, BIOS F6 07/15/2020 Mar 7 10:39:31 Unraid kernel: Call Trace: Mar 7 10:39:31 Unraid kernel: <TASK> Mar 7 10:39:31 Unraid kernel: dump_stack_lvl+0x44/0x5c Mar 7 10:39:31 Unraid kernel: print_bad_pte+0x1cb/0x1e5 Mar 7 10:39:31 Unraid kernel: vm_normal_page+0x84/0x9e Mar 7 10:39:31 Unraid kernel: khugepaged+0x7d6/0x179c Mar 7 10:39:31 Unraid kernel: ? _raw_spin_rq_lock_irqsave+0x20/0x20 Mar 7 10:39:31 Unraid kernel: ? preempt_latency_start+0x2b/0x46 Mar 7 10:39:31 Unraid kernel: ? collapse_pte_mapped_thp+0x275/0x275 Mar 7 10:39:31 Unraid kernel: kthread+0xe4/0xef Mar 7 10:39:31 Unraid kernel: ? kthread_complete_and_exit+0x1b/0x1b Mar 7 10:39:31 Unraid kernel: ret_from_fork+0x1f/0x30 Mar 7 10:39:31 Unraid kernel: </TASK> Mar 7 10:39:31 Unraid kernel: Disabling lock debugging due to kernel taint Mar 7 10:48:46 Unraid emhttpd: spinning down /dev/sdg Mar 7 10:49:47 Unraid emhttpd: spinning down /dev/sdf Mar 7 10:49:58 Unraid emhttpd: spinning down /dev/sdc Mar 7 10:50:03 Unraid emhttpd: spinning down /dev/sdd Mar 7 11:00:01 Unraid docker: RAM-Disk synced Mar 7 11:10:40 Unraid kernel: BUG: Bad page map in process python3 pte:8400777ea247e045 pmd:269680067 Mar 7 11:10:40 Unraid kernel: addr:000014d3c4cf3000 vm_flags:00200073 anon_vma:ffff88838f232f08 mapping:0000000000000000 index:14d3c4cf3 Mar 7 11:10:40 Unraid kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Mar 7 11:10:40 Unraid kernel: CPU: 0 PID: 13646 Comm: python3 Tainted: G B W 5.19.17-Unraid #2 Mar 7 11:10:40 Unraid kernel: Hardware name: Gigabyte Technology Co., Ltd. Z490 VISION G/Z490 VISION G, BIOS F6 07/15/2020 Mar 7 11:10:40 Unraid kernel: Call Trace: Mar 7 11:10:40 Unraid kernel: <TASK> Mar 7 11:10:40 Unraid kernel: dump_stack_lvl+0x44/0x5c Mar 7 11:10:40 Unraid kernel: print_bad_pte+0x1cb/0x1e5 Mar 7 11:10:40 Unraid kernel: vm_normal_page+0x84/0x9e Mar 7 11:10:40 Unraid kernel: __handle_mm_fault+0x507/0xc7d Mar 7 11:10:40 Unraid kernel: handle_mm_fault+0x113/0x1d7 Mar 7 11:10:40 Unraid kernel: do_user_addr_fault+0x36a/0x514 Mar 7 11:10:40 Unraid kernel: exc_page_fault+0xfc/0x11e Mar 7 11:10:40 Unraid kernel: asm_exc_page_fault+0x22/0x30 Mar 7 11:10:40 Unraid kernel: RIP: 0033:0x14d46c79461f Mar 7 11:10:40 Unraid kernel: Code: 8b 2c 0b 4a 89 2c 09 4a 8b 7c 0b 08 4a 89 7c 09 08 4a 8b 74 0b 10 4a 89 74 09 10 4e 8b 5c 0b 18 4e 89 5c 09 18 4a 8b 54 0b 20 <4a> 89 54 09 20 4e 8b 44 0b 28 4e 89 44 09 28 4a 8b 6c 0b 30 4a 89 Mar 7 11:10:40 Unraid kernel: RSP: 002b:000014d4135ee9b0 EFLAGS: 00010283 Mar 7 11:10:40 Unraid kernel: RAX: 000014d3c48b5880 RBX: 000014d3c72b4030 RCX: 000014d3c48b58b0 Mar 7 11:10:40 Unraid kernel: RDX: 333231305a595857 RSI: 4e4d4c4b4a494847 RDI: 4645444342413938 Mar 7 11:10:40 Unraid kernel: RBP: 3736353433323130 R08: 4a49484746454443 R09: 000000000043d730 Mar 7 11:10:40 Unraid kernel: R10: 00000000006ffff0 R11: 565554535251504f R12: 00000000006ffff7 Mar 7 11:10:40 Unraid kernel: R13: 000014d4135eea00 R14: 000014d4135ee9f8 R15: 0000000000700008 Mar 7 11:10:40 Unraid kernel: </TASK> Mar 7 11:10:40 Unraid kernel: python3: Corrupted page table at address 14d3c4cf3000 Mar 7 11:10:40 Unraid kernel: PGD 24b010067 P4D 24b010067 PUD 2fd77067 PMD 269680067 PTE 8400777ea247e065 Mar 7 11:10:40 Unraid kernel: Bad pagetable: 000f [#1] PREEMPT SMP NOPTI Mar 7 11:10:40 Unraid kernel: CPU: 0 PID: 13646 Comm: python3 Tainted: G B W 5.19.17-Unraid #2 Mar 7 11:10:40 Unraid kernel: Hardware name: Gigabyte Technology Co., Ltd. Z490 VISION G/Z490 VISION G, BIOS F6 07/15/2020 Mar 7 11:10:40 Unraid kernel: RIP: 0033:0x14d46c79461f Mar 7 11:10:40 Unraid kernel: Code: 8b 2c 0b 4a 89 2c 09 4a 8b 7c 0b 08 4a 89 7c 09 08 4a 8b 74 0b 10 4a 89 74 09 10 4e 8b 5c 0b 18 4e 89 5c 09 18 4a 8b 54 0b 20 <4a> 89 54 09 20 4e 8b 44 0b 28 4e 89 44 09 28 4a 8b 6c 0b 30 4a 89 Mar 7 11:10:40 Unraid kernel: RSP: 002b:000014d4135ee9b0 EFLAGS: 00010283 Mar 7 11:10:40 Unraid kernel: RAX: 000014d3c48b5880 RBX: 000014d3c72b4030 RCX: 000014d3c48b58b0 Mar 7 11:10:40 Unraid kernel: RDX: 333231305a595857 RSI: 4e4d4c4b4a494847 RDI: 4645444342413938 Mar 7 11:10:40 Unraid kernel: RBP: 3736353433323130 R08: 4a49484746454443 R09: 000000000043d730 Mar 7 11:10:40 Unraid kernel: R10: 00000000006ffff0 R11: 565554535251504f R12: 00000000006ffff7 Mar 7 11:10:40 Unraid kernel: R13: 000014d4135eea00 R14: 000014d4135ee9f8 R15: 0000000000700008 Mar 7 11:10:40 Unraid kernel: FS: 000014d4135ffb30 GS: 0000000000000000 Mar 7 11:10:40 Unraid kernel: Modules linked in: tun af_packet xt_mark veth macvlan xt_nat xt_tcpudp xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo xt_addrtype iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter xfs nfsd auth_rpcgss oid_registry lockd grace sunrpc md_mod iptable_mangle wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libchacha ip6table_filter ip6_tables iptable_filter ip_tables x_tables bridge stp llc bonding tls x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm i2c_i801 crct10dif_pclmul crc32_pclmul gigabyte_wmi wmi_bmof intel_wmi_thunderbolt mxm_wmi crc32c_intel ghash_clmulni_intel aesni_intel crypto_simd cryptd rapl intel_cstate intel_uncore i2c_smbus i915 igc nvme ahci nvme_core libahci iosf_mbi drm_buddy i2c_algo_bit ttm drm_display_helper drm_kms_helper cp210x usbserial drm intel_pch_thermal intel_gtt agpgart i2c_core syscopyarea sysfillrect Mar 7 11:10:40 Unraid kernel: sysimgblt fb_sys_fops thermal fan video wmi backlight acpi_pad acpi_tad button unix Mar 7 11:10:40 Unraid kernel: ---[ end trace 0000000000000000 ]---
I've also attached diagnostics, and would love some direction on what to try next. Thank you!!