October 2, 20232 yr Hey Everyone, Was hoping that you could help me - it seems like after a lot of years of running well my unraid install locks up every few days requiring a total restart - it can then be fine for a while before becomming completely unresponsive again a few days, sometimes a week later. Oct 1 00:00:07 Event Plugin Auto Update: Update available for unassigned.devices.plg (Not set to Auto Update) Oct 1 00:00:08 Event Plugin Auto Update: Community Applications Plugin Auto Update finished Oct 1 00:00:10 Event root: /var/lib/docker: 2.8 GiB (3016413184 bytes) trimmed on /dev/loop2 Oct 1 00:00:10 Event root: /mnt/cache: 12.3 GiB (13187272704 bytes) trimmed on /dev/sdk1 Oct 1 00:00:12 Event Docker Auto Update: No updates will be installed Oct 1 02:09:35 Event kernel: BUG: Bad page map in process khugepaged pte:ffff88814facc9d0 pmd:06c0f067 Oct 1 02:09:35 Event kernel: addr:0000153540193000 vm_flags:00100073 anon_vma:ffff88820afb9b60 mapping:0000000000000000 index:153540193 Oct 1 02:09:35 Event kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 1 02:09:35 Event kernel: CPU: 3 PID: 71 Comm: khugepaged Tainted: P B D W IO 6.1.49-Unraid #1 Oct 1 02:09:35 Event kernel: Hardware name: Supermicro X8ST3/X8ST3, BIOS 2.0 07/29/10 Oct 1 02:09:35 Event kernel: Call Trace: Oct 1 02:09:35 Event kernel: <TASK> Oct 1 02:09:35 Event kernel: dump_stack_lvl+0x44/0x5c Oct 1 02:09:35 Event kernel: print_bad_pte+0x1bc/0x1d6 Oct 1 02:09:35 Event kernel: vm_normal_page+0x81/0x9b Oct 1 02:09:35 Event kernel: hpage_collapse_scan_pmd+0x19f/0x40d Oct 1 02:09:35 Event kernel: khugepaged+0x31d/0x640 Oct 1 02:09:35 Event kernel: ? __schedule+0x5ba/0x612 Oct 1 02:09:35 Event kernel: ? preempt_latency_start+0x2b/0x46 Oct 1 02:09:35 Event kernel: ? collapse_pte_mapped_thp+0x383/0x383 Oct 1 02:09:35 Event kernel: kthread+0xe7/0xef Oct 1 02:09:35 Event kernel: ? kthread_complete_and_exit+0x1b/0x1b Oct 1 02:09:35 Event kernel: ret_from_fork+0x22/0x30 Oct 1 02:09:35 Event kernel: </TASK> Oct 1 02:20:51 Event kernel: BUG: Bad page map in process khugepaged pte:ffff88814facc9d0 pmd:06c0f067 Oct 1 02:20:51 Event kernel: addr:0000153540193000 vm_flags:00100073 anon_vma:ffff88820afb9b60 mapping:0000000000000000 index:153540193 Oct 1 02:20:51 Event kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 1 02:20:51 Event kernel: CPU: 6 PID: 71 Comm: khugepaged Tainted: P B D W IO 6.1.49-Unraid #1 Oct 1 02:20:51 Event kernel: Hardware name: Supermicro X8ST3/X8ST3, BIOS 2.0 07/29/10 Oct 1 02:20:51 Event kernel: Call Trace: Oct 1 02:20:51 Event kernel: <TASK> Oct 1 02:20:51 Event kernel: dump_stack_lvl+0x44/0x5c Oct 1 02:20:51 Event kernel: print_bad_pte+0x1bc/0x1d6 Oct 1 02:20:51 Event kernel: vm_normal_page+0x81/0x9b Oct 1 02:20:51 Event kernel: hpage_collapse_scan_pmd+0x19f/0x40d Oct 1 02:20:51 Event kernel: khugepaged+0x31d/0x640 Oct 1 02:20:51 Event kernel: ? __schedule+0x5ba/0x612 Oct 1 02:20:51 Event kernel: ? preempt_latency_start+0x2b/0x46 Oct 1 02:20:51 Event kernel: ? collapse_pte_mapped_thp+0x383/0x383 Oct 1 02:20:51 Event kernel: kthread+0xe7/0xef Oct 1 02:20:51 Event kernel: ? kthread_complete_and_exit+0x1b/0x1b Oct 1 02:20:51 Event kernel: ret_from_fork+0x22/0x30 Oct 1 02:20:51 Event kernel: </TASK> Oct 1 02:32:17 Event kernel: BUG: Bad page map in process khugepaged pte:ffff88814facc9d0 pmd:06c0f067 Oct 1 02:32:17 Event kernel: addr:0000153540193000 vm_flags:00100073 anon_vma:ffff88820afb9b60 mapping:0000000000000000 index:153540193 Oct 1 02:32:17 Event kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 1 02:32:17 Event kernel: CPU: 6 PID: 71 Comm: khugepaged Tainted: P B D W IO 6.1.49-Unraid #1 Oct 1 02:32:17 Event kernel: Hardware name: Supermicro X8ST3/X8ST3, BIOS 2.0 07/29/10 Oct 1 02:32:17 Event kernel: Call Trace: Oct 1 02:32:17 Event kernel: <TASK> Oct 1 02:32:17 Event kernel: dump_stack_lvl+0x44/0x5c Oct 1 02:32:17 Event kernel: print_bad_pte+0x1bc/0x1d6 Oct 1 02:32:17 Event kernel: vm_normal_page+0x81/0x9b Oct 1 02:32:17 Event kernel: hpage_collapse_scan_pmd+0x19f/0x40d Oct 1 02:32:17 Event kernel: khugepaged+0x31d/0x640 Oct 1 02:32:17 Event kernel: ? __schedule+0x5ba/0x612 Oct 1 02:32:17 Event kernel: ? preempt_latency_start+0x2b/0x46 Oct 1 02:32:17 Event kernel: ? collapse_pte_mapped_thp+0x383/0x383 Oct 1 02:32:17 Event kernel: kthread+0xe7/0xef Oct 1 02:32:17 Event kernel: ? kthread_complete_and_exit+0x1b/0x1b Oct 1 02:32:17 Event kernel: ret_from_fork+0x22/0x30 Oct 1 02:32:17 Event kernel: </TASK> Oct 1 02:43:33 Event kernel: BUG: Bad page map in process khugepaged pte:ffff88814facc9d0 pmd:06c0f067 Oct 1 02:43:33 Event kernel: addr:0000153540193000 vm_flags:00100073 anon_vma:ffff88820afb9b60 mapping:0000000000000000 index:153540193 Oct 1 02:43:33 Event kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 1 02:43:33 Event kernel: CPU: 0 PID: 71 Comm: khugepaged Tainted: P B D W IO 6.1.49-Unraid #1 Oct 1 02:43:33 Event kernel: Hardware name: Supermicro X8ST3/X8ST3, BIOS 2.0 07/29/10 Oct 1 02:43:33 Event kernel: Call Trace: Oct 1 02:43:33 Event kernel: <TASK> Oct 1 02:43:33 Event kernel: dump_stack_lvl+0x44/0x5c Oct 1 02:43:33 Event kernel: print_bad_pte+0x1bc/0x1d6 Oct 1 02:43:33 Event kernel: vm_normal_page+0x81/0x9b Oct 1 02:43:33 Event kernel: hpage_collapse_scan_pmd+0x19f/0x40d Oct 1 02:43:33 Event kernel: khugepaged+0x31d/0x640 Oct 1 02:43:33 Event kernel: ? __schedule+0x5ba/0x612 Oct 1 02:43:33 Event kernel: ? preempt_latency_start+0x2b/0x46 Oct 1 02:43:33 Event kernel: ? collapse_pte_mapped_thp+0x383/0x383 Oct 1 02:43:33 Event kernel: kthread+0xe7/0xef Oct 1 02:43:33 Event kernel: ? kthread_complete_and_exit+0x1b/0x1b Oct 1 02:43:33 Event kernel: ret_from_fork+0x22/0x30 Oct 1 02:43:33 Event kernel: </TASK> Oct 1 02:54:59 Event kernel: BUG: Bad page map in process khugepaged pte:ffff88814facc9d0 pmd:06c0f067 Oct 1 02:54:59 Event kernel: addr:0000153540193000 vm_flags:00100073 anon_vma:ffff88820afb9b60 mapping:0000000000000000 index:153540193 Oct 1 02:54:59 Event kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 1 02:54:59 Event kernel: CPU: 6 PID: 71 Comm: khugepaged Tainted: P B D W IO 6.1.49-Unraid #1 Oct 1 02:54:59 Event kernel: Hardware name: Supermicro X8ST3/X8ST3, BIOS 2.0 07/29/10 Oct 1 02:54:59 Event kernel: Call Trace: Oct 1 02:54:59 Event kernel: <TASK> Oct 1 02:54:59 Event kernel: dump_stack_lvl+0x44/0x5c Oct 1 02:54:59 Event kernel: print_bad_pte+0x1bc/0x1d6 Oct 1 02:54:59 Event kernel: vm_normal_page+0x81/0x9b Oct 1 02:54:59 Event kernel: hpage_collapse_scan_pmd+0x19f/0x40d Oct 1 02:54:59 Event kernel: khugepaged+0x31d/0x640 Oct 1 02:54:59 Event kernel: ? __schedule+0x5ba/0x612 Oct 1 02:54:59 Event kernel: ? preempt_latency_start+0x2b/0x46 Oct 1 02:54:59 Event kernel: ? collapse_pte_mapped_thp+0x383/0x383 Oct 1 02:54:59 Event kernel: kthread+0xe7/0xef Oct 1 02:54:59 Event kernel: ? kthread_complete_and_exit+0x1b/0x1b Oct 1 02:54:59 Event kernel: ret_from_fork+0x22/0x30 Oct 1 02:54:59 Event kernel: </TASK> Oct 1 03:06:15 Event kernel: BUG: Bad page map in process khugepaged pte:ffff88814facc9d0 pmd:06c0f067 Oct 1 03:06:15 Event kernel: addr:0000153540193000 vm_flags:00100073 anon_vma:ffff88820afb9b60 mapping:0000000000000000 index:153540193 Oct 1 03:06:15 Event kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 1 03:06:15 Event kernel: CPU: 0 PID: 71 Comm: khugepaged Tainted: P B D W IO 6.1.49-Unraid #1 Oct 1 03:06:15 Event kernel: Hardware name: Supermicro X8ST3/X8ST3, BIOS 2.0 07/29/10 Oct 1 03:06:15 Event kernel: Call Trace: Oct 1 03:06:15 Event kernel: <TASK> Oct 1 03:06:15 Event kernel: dump_stack_lvl+0x44/0x5c Oct 1 03:06:15 Event kernel: print_bad_pte+0x1bc/0x1d6 Oct 1 03:06:15 Event kernel: vm_normal_page+0x81/0x9b Oct 1 03:06:15 Event kernel: hpage_collapse_scan_pmd+0x19f/0x40d Oct 1 03:06:15 Event kernel: khugepaged+0x31d/0x640 Oct 1 03:06:15 Event kernel: ? __schedule+0x5ba/0x612 Oct 1 03:06:15 Event kernel: ? preempt_latency_start+0x2b/0x46 Oct 1 03:06:15 Event kernel: ? collapse_pte_mapped_thp+0x383/0x383 Oct 1 03:06:15 Event kernel: kthread+0xe7/0xef Oct 1 03:06:15 Event kernel: ? kthread_complete_and_exit+0x1b/0x1b Oct 1 03:06:15 Event kernel: ret_from_fork+0x22/0x30 Oct 1 03:06:15 Event kernel: </TASK> Oct 1 03:12:20 Event kernel: ------------[ cut here ]------------ Oct 1 03:12:20 Event kernel: WARNING: CPU: 3 PID: 11839 at net/netfilter/nf_nat_core.c:594 nf_nat_setup_info+0x8c/0x7d1 [nf_nat] Oct 1 03:12:20 Event kernel: Modules linked in: xt_mark tun veth macvlan xt_nat xt_tcpudp xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 xt_addrtype br_netfilter xfs md_mod zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) tcp_diag inet_diag ip6table_filter ip6_tables iptable_filter ip_tables x_tables bridge stp llc e1000e intel_powerclamp coretemp mgag200 drm_shmem_helper i2c_algo_bit kvm_intel drm_kms_helper kvm crc32c_intel drm sha512_ssse3 mptsas intel_cstate intel_uncore mpt3sas mptscsih i2c_i801 backlight i2c_smbus mptbase ahci syscopyarea ipmi_si sysfillrect raid_class i2c_core libahci joydev input_leds sysimgblt fb_sys_fops led_class scsi_transport_sas i5500_temp button acpi_cpufreq unix [last unloaded: e1000e] Oct 1 03:12:20 Event kernel: CPU: 3 PID: 11839 Comm: kworker/u32:4 Tainted: P B D W IO 6.1.49-Unraid #1 Oct 1 03:12:20 Event kernel: Hardware name: Supermicro X8ST3/X8ST3, BIOS 2.0 07/29/10 Oct 1 03:12:20 Event kernel: Workqueue: events_unbound macvlan_process_broadcast [macvlan] Oct 1 03:12:20 Event kernel: RIP: 0010:nf_nat_setup_info+0x8c/0x7d1 [nf_nat] Oct 1 03:12:20 Event kernel: Code: a8 80 75 26 48 8d 73 58 48 8d 7c 24 20 e8 18 1b 84 00 48 8d 43 0c 4c 8b bb 88 00 00 00 48 89 44 24 18 eb 54 0f ba e0 08 73 07 <0f> 0b e9 75 06 00 00 48 8d 73 58 48 8d 7c 24 20 e8 eb 1a 84 00 48 Oct 1 03:12:20 Event kernel: RSP: 0018:ffffc900001bcc78 EFLAGS: 00010282 Oct 1 03:12:20 Event kernel: RAX: 0000000000000180 RBX: ffff88818f4e0f00 RCX: ffff888105628380 Oct 1 03:12:20 Event kernel: RDX: 0000000000000000 RSI: ffffc900001bcd5c RDI: ffff88818f4e0f00 Oct 1 03:12:20 Event kernel: RBP: ffffc900001bcd40 R08: 000000003702a8c0 R09: 0000000000000000 Oct 1 03:12:20 Event kernel: R10: 0000000000000158 R11: 0000000000000000 R12: ffffc900001bcd5c Oct 1 03:12:20 Event kernel: R13: 0000000000000000 R14: ffffc900001bce40 R15: 0000000000000001 Oct 1 03:12:20 Event kernel: FS: 0000000000000000(0000) GS:ffff888217ac0000(0000) knlGS:0000000000000000 Oct 1 03:12:20 Event kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Oct 1 03:12:20 Event kernel: CR2: 0000151398593760 CR3: 000000000220a000 CR4: 00000000000006e0 Oct 1 03:12:20 Event kernel: Call Trace: Oct 1 03:12:20 Event kernel: <IRQ> Oct 1 03:12:20 Event kernel: ? __warn+0xab/0x122 Oct 1 03:12:20 Event kernel: ? report_bug+0x109/0x17e Oct 1 03:12:20 Event kernel: ? nf_nat_setup_info+0x8c/0x7d1 [nf_nat] Oct 1 03:12:20 Event kernel: ? handle_bug+0x41/0x6f Oct 1 03:12:20 Event kernel: ? exc_invalid_op+0x13/0x60 Oct 1 03:12:20 Event kernel: ? asm_exc_invalid_op+0x16/0x20 Oct 1 03:12:20 Event kernel: ? nf_nat_setup_info+0x8c/0x7d1 [nf_nat] Oct 1 03:12:20 Event kernel: ? nf_nat_setup_info+0x44/0x7d1 [nf_nat] Oct 1 03:12:20 Event kernel: ? xt_write_recseq_end+0xf/0x1c [ip_tables] Oct 1 03:12:20 Event kernel: ? __local_bh_enable_ip+0x56/0x6b Oct 1 03:12:20 Event kernel: ? ipt_do_table+0x57a/0x5bf [ip_tables] Oct 1 03:12:20 Event kernel: ? xt_write_recseq_end+0xf/0x1c [ip_tables] Oct 1 03:12:20 Event kernel: __nf_nat_alloc_null_binding+0x66/0x81 [nf_nat] Oct 1 03:12:20 Event kernel: nf_nat_inet_fn+0xc0/0x1a8 [nf_nat] Oct 1 03:12:20 Event kernel: nf_nat_ipv4_local_in+0x2a/0xaa [nf_nat] Oct 1 03:12:20 Event kernel: nf_hook_slow+0x3d/0x96 Oct 1 03:12:20 Event kernel: ? ip_protocol_deliver_rcu+0x164/0x164 Oct 1 03:12:20 Event kernel: NF_HOOK.constprop.0+0x79/0xd9 Oct 1 03:12:20 Event kernel: ? ip_protocol_deliver_rcu+0x164/0x164 Oct 1 03:12:20 Event kernel: __netif_receive_skb_one_core+0x77/0x9c Oct 1 03:12:20 Event kernel: process_backlog+0x8c/0x116 Oct 1 03:12:20 Event kernel: __napi_poll.constprop.0+0x2b/0x124 Oct 1 03:12:20 Event kernel: net_rx_action+0x159/0x24f Oct 1 03:12:20 Event kernel: ? check_preempt_wakeup+0x156/0x1f2 Oct 1 03:12:20 Event kernel: __do_softirq+0x129/0x288 Oct 1 03:12:20 Event kernel: do_softirq+0x7f/0xab Oct 1 03:12:20 Event kernel: </IRQ> Oct 1 03:12:20 Event kernel: <TASK> Oct 1 03:12:20 Event kernel: __local_bh_enable_ip+0x4c/0x6b Oct 1 03:12:20 Event kernel: netif_rx+0x52/0x5a Oct 1 03:12:20 Event kernel: macvlan_broadcast+0x10a/0x150 [macvlan] Oct 1 03:12:20 Event kernel: macvlan_process_broadcast+0xbc/0x12f [macvlan] Oct 1 03:12:20 Event kernel: process_one_work+0x1ab/0x295 Oct 1 03:12:20 Event kernel: worker_thread+0x18b/0x244 Oct 1 03:12:20 Event kernel: ? rescuer_thread+0x281/0x281 Oct 1 03:12:20 Event kernel: kthread+0xe7/0xef Oct 1 03:12:20 Event kernel: ? kthread_complete_and_exit+0x1b/0x1b Oct 1 03:12:20 Event kernel: ret_from_fork+0x22/0x30 Oct 1 03:12:20 Event kernel: </TASK> Oct 1 03:12:20 Event kernel: ---[ end trace 0000000000000000 ]--- Oct 1 03:17:41 Event kernel: BUG: Bad page map in process khugepaged pte:ffff88814facc9d0 pmd:06c0f067 Oct 1 03:17:41 Event kernel: addr:0000153540193000 vm_flags:00100073 anon_vma:ffff88820afb9b60 mapping:0000000000000000 index:153540193 Oct 1 03:17:41 Event kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 1 03:17:41 Event kernel: CPU: 0 PID: 71 Comm: khugepaged Tainted: P B D W IO 6.1.49-Unraid #1 Oct 1 03:17:41 Event kernel: Hardware name: Supermicro X8ST3/X8ST3, BIOS 2.0 07/29/10 Oct 1 03:17:41 Event kernel: Call Trace: Oct 1 03:17:41 Event kernel: <TASK> Oct 1 03:17:41 Event kernel: dump_stack_lvl+0x44/0x5c Oct 1 03:17:41 Event kernel: print_bad_pte+0x1bc/0x1d6 Oct 1 03:17:41 Event kernel: vm_normal_page+0x81/0x9b Oct 1 03:17:41 Event kernel: hpage_collapse_scan_pmd+0x19f/0x40d Oct 1 03:17:41 Event kernel: khugepaged+0x31d/0x640 Oct 1 03:17:41 Event kernel: ? __schedule+0x5ba/0x612 Oct 1 03:17:41 Event kernel: ? preempt_latency_start+0x2b/0x46 Oct 1 03:17:41 Event kernel: ? collapse_pte_mapped_thp+0x383/0x383 Oct 1 03:17:41 Event kernel: kthread+0xe7/0xef Oct 1 03:17:41 Event kernel: ? kthread_complete_and_exit+0x1b/0x1b Oct 1 03:17:41 Event kernel: ret_from_fork+0x22/0x30 Oct 1 03:17:41 Event kernel: </TASK> Oct 1 03:28:57 Event kernel: BUG: Bad page map in process khugepaged pte:ffff88814facc9d0 pmd:06c0f067 Oct 1 03:28:57 Event kernel: addr:0000153540193000 vm_flags:00100073 anon_vma:ffff88820afb9b60 mapping:0000000000000000 index:153540193 Oct 1 03:28:57 Event kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 1 03:28:57 Event kernel: CPU: 1 PID: 71 Comm: khugepaged Tainted: P B D W IO 6.1.49-Unraid #1 Oct 1 03:28:57 Event kernel: Hardware name: Supermicro X8ST3/X8ST3, BIOS 2.0 07/29/10 Oct 1 03:28:57 Event kernel: Call Trace: Oct 1 03:28:57 Event kernel: <TASK> Oct 1 03:28:57 Event kernel: dump_stack_lvl+0x44/0x5c Oct 1 03:28:57 Event kernel: print_bad_pte+0x1bc/0x1d6 Oct 1 03:28:57 Event kernel: vm_normal_page+0x81/0x9b Oct 1 03:28:57 Event kernel: hpage_collapse_scan_pmd+0x19f/0x40d Oct 1 03:28:57 Event kernel: khugepaged+0x31d/0x640 Oct 1 03:28:57 Event kernel: ? __schedule+0x5ba/0x612 Oct 1 03:28:57 Event kernel: ? preempt_latency_start+0x2b/0x46 Oct 1 03:28:57 Event kernel: ? collapse_pte_mapped_thp+0x383/0x383 Oct 1 03:28:57 Event kernel: kthread+0xe7/0xef Oct 1 03:28:57 Event kernel: ? kthread_complete_and_exit+0x1b/0x1b Oct 1 03:28:57 Event kernel: ret_from_fork+0x22/0x30 Oct 1 03:28:57 Event kernel: </TASK> I set up logging and this appears to be the last messages in the log before it goes offline - could anyone direct me in the right direction to try and sort this one ? Thanks
October 3, 20232 yr Community Expert Macvlan call traces will usually end up crashing the server, switching to ipvlan should fix it (Settings -> Docker Settings -> Docker custom network type -> ipvlan (advanced view must be enabled, top right)).
October 3, 20232 yr Author Awesome thanks so much. - will try it out and report back, has something changed massively in recent versions regarding Macvlan ? Not sure I’ve changed much over the years other than upgrading unpaid versions and it was rock solid up until a few weeks ago !
October 3, 20232 yr Community Expert 2 minutes ago, 3guk said: has something changed massively in recent versions regarding Macvlan ? It's normal for users that didn't have macvlan issues before to start having them with the newer kernels.
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.