6.120 - Unrecoverable crash after 5 to 10 minutes

[gretachini]

After upgrading from 6.11.5 to 6.12.0, after a bit of time passes, I can no longer connect to Unraid. Rebooting also doesn't allow connections: I have to completely reformat my USB drive and run from a backup.

The last time it happened I ran tail -f on the system log, and this is what showed up before crashing:

Jun 16 00:18:36 chonker kernel: general protection fault, probably for non-canonical address 0xe68b5cc41347210e: 0000 [#1] PREEMPT SMP NOPTI
Jun 16 00:18:36 chonker kernel: CPU: 11 PID: 18932 Comm: Network Tainted: P        W  O       6.1.33-Unraid #1
Jun 16 00:18:36 chonker kernel: Hardware name: Micro-Star International Co., Ltd. MS-7C82/MAG B460M MORTAR WIFI (MS-7C82), BIOS 1.41 12/03/2020
Jun 16 00:18:36 chonker kernel: RIP: 0010:nf_nat_setup_info+0x14a/0x7d1 [nf_nat]
Jun 16 00:18:36 chonker kernel: Code: 4c 89 ff e8 1e f8 ff ff 48 8b 15 4a 6a 00 00 89 c0 48 8d 04 c2 4c 8b 30 4d 85 f6 74 2a 49 81 ee 90 00 00 00 eb 21 8a 44 24 46 <41> 38 46 46 74 21 49 8b 96 90 00 00 00 48 85 d2 0f 84 56 ff ff ff
Jun 16 00:18:36 chonker kernel: RSP: 0018:ffffc90000340738 EFLAGS: 00010282
Jun 16 00:18:36 chonker kernel: RAX: ffff888142bf4806 RBX: ffff8881507ef400 RCX: 911c2f2f43b23fd7
Jun 16 00:18:36 chonker kernel: RDX: e68b5cc413472158 RSI: da422dc5bff567b6 RDI: c25dba15011f0e06
Jun 16 00:18:36 chonker kernel: RBP: ffffc90000340800 R08: 732d2524b7231a5f R09: 4aa4027e1fcf3267
Jun 16 00:18:36 chonker kernel: R10: a0dff80207ea819e R11: ffffc90000340710 R12: ffffc90000340814
Jun 16 00:18:36 chonker kernel: R13: 0000000000000000 R14: e68b5cc4134720c8 R15: ffffffff82a11440
Jun 16 00:18:36 chonker kernel: FS:  00001552cc6c2b30(0000) GS:ffff88901f4c0000(0000) knlGS:0000000000000000
Jun 16 00:18:36 chonker kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 16 00:18:36 chonker kernel: CR2: 0000000000537d30 CR3: 0000000453404002 CR4: 00000000007706e0
Jun 16 00:18:36 chonker kernel: PKRU: 55555554
Jun 16 00:18:36 chonker kernel: Call Trace:
Jun 16 00:18:36 chonker kernel: <IRQ>
Jun 16 00:18:36 chonker kernel: ? __die_body+0x1a/0x5c
Jun 16 00:18:36 chonker kernel: ? die_addr+0x38/0x51
Jun 16 00:18:36 chonker kernel: ? exc_general_protection+0x30f/0x345
Jun 16 00:18:36 chonker kernel: ? asm_exc_general_protection+0x22/0x30
Jun 16 00:18:36 chonker kernel: ? nf_nat_setup_info+0x14a/0x7d1 [nf_nat]
Jun 16 00:18:36 chonker kernel: ? nf_nat_setup_info+0x128/0x7d1 [nf_nat]
Jun 16 00:18:36 chonker kernel: ? krealloc+0x82/0x93
Jun 16 00:18:36 chonker kernel: nf_nat_masquerade_ipv4+0x114/0x13c [nf_nat]
Jun 16 00:18:36 chonker kernel: masquerade_tg+0x48/0x66 [xt_MASQUERADE]
Jun 16 00:18:36 chonker kernel: ipt_do_table+0x51b/0x5bf [ip_tables]
Jun 16 00:18:36 chonker kernel: ? xt_write_recseq_end+0xf/0x1c [ip_tables]
Jun 16 00:18:36 chonker kernel: ? __local_bh_enable_ip+0x56/0x6b
Jun 16 00:18:36 chonker kernel: ? ipt_do_table+0x57a/0x5bf [ip_tables]
Jun 16 00:18:36 chonker kernel: nf_nat_inet_fn+0x123/0x1a8 [nf_nat]
Jun 16 00:18:36 chonker kernel: nf_nat_ipv4_out+0x15/0x91 [nf_nat]
Jun 16 00:18:36 chonker kernel: nf_hook_slow+0x3a/0x96
Jun 16 00:18:36 chonker kernel: ? __ip_finish_output+0x144/0x144
Jun 16 00:18:36 chonker kernel: nf_hook+0xdf/0x110
Jun 16 00:18:36 chonker kernel: ? ethnl_put_bitset32+0x250/0x328
Jun 16 00:18:36 chonker kernel: ? __ip_finish_output+0x144/0x144
Jun 16 00:18:36 chonker kernel: ip_output+0x78/0x88
Jun 16 00:18:36 chonker kernel: ? __ip_finish_output+0x144/0x144
Jun 16 00:18:36 chonker kernel: ip_sabotage_in+0x4f/0x60 [br_netfilter]
Jun 16 00:18:36 chonker kernel: nf_hook_slow+0x3a/0x96
Jun 16 00:18:36 chonker kernel: ? ip_rcv_finish_core.constprop.0+0x3e8/0x3e8
Jun 16 00:18:36 chonker kernel: NF_HOOK.constprop.0+0x79/0xd9
Jun 16 00:18:36 chonker kernel: ? ip_rcv_finish_core.constprop.0+0x3e8/0x3e8
Jun 16 00:18:36 chonker kernel: __netif_receive_skb_one_core+0x77/0x9c
Jun 16 00:18:36 chonker kernel: netif_receive_skb+0xbf/0x127
Jun 16 00:18:36 chonker kernel: br_handle_frame_finish+0x438/0x472 [bridge]
Jun 16 00:18:36 chonker kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
Jun 16 00:18:36 chonker kernel: br_nf_hook_thresh+0xe2/0x109 [br_netfilter]
Jun 16 00:18:36 chonker kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
Jun 16 00:18:36 chonker kernel: br_nf_pre_routing_finish+0x2c1/0x2ec [br_netfilter]
Jun 16 00:18:36 chonker kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
Jun 16 00:18:36 chonker kernel: ? NF_HOOK.isra.0+0xe4/0x140 [br_netfilter]
Jun 16 00:18:36 chonker kernel: ? br_nf_hook_thresh+0x109/0x109 [br_netfilter]
Jun 16 00:18:36 chonker kernel: br_nf_pre_routing+0x236/0x24a [br_netfilter]
Jun 16 00:18:36 chonker kernel: ? br_nf_hook_thresh+0x109/0x109 [br_netfilter]
Jun 16 00:18:36 chonker kernel: br_handle_frame+0x277/0x2e0 [bridge]
Jun 16 00:18:36 chonker kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
Jun 16 00:18:36 chonker kernel: __netif_receive_skb_core.constprop.0+0x4fa/0x6e9
Jun 16 00:18:36 chonker kernel: ? select_task_rq_fair+0xb94/0xbaa
Jun 16 00:18:36 chonker kernel: ? rcu_sched_clock_irq+0x9b2/0xa37
Jun 16 00:18:36 chonker kernel: __netif_receive_skb_one_core+0x40/0x9c
Jun 16 00:18:36 chonker kernel: process_backlog+0x8c/0x116
Jun 16 00:18:36 chonker kernel: __napi_poll.constprop.0+0x28/0x124
Jun 16 00:18:36 chonker kernel: net_rx_action+0x159/0x24f
Jun 16 00:18:36 chonker kernel: ? rcu_nocb_unlock_irqrestore+0x17/0x40
Jun 16 00:18:36 chonker kernel: __do_softirq+0x126/0x288
Jun 16 00:18:36 chonker kernel: do_softirq+0x7f/0xab
Jun 16 00:18:36 chonker kernel: </IRQ>
Jun 16 00:18:36 chonker kernel: <TASK>
Jun 16 00:18:36 chonker kernel: __local_bh_enable_ip+0x4c/0x6b
Jun 16 00:18:36 chonker kernel: ip_finish_output2+0x36a/0x39d
Jun 16 00:18:36 chonker kernel: __ip_queue_xmit+0x2d8/0x31f
Jun 16 00:18:36 chonker kernel: __tcp_transmit_skb+0x841/0x8b1
Jun 16 00:18:36 chonker kernel: tcp_connect+0x7e4/0x86f
Jun 16 00:18:36 chonker kernel: tcp_v4_connect+0x41a/0x47d
Jun 16 00:18:36 chonker kernel: __inet_stream_connect+0xdd/0x314
Jun 16 00:18:36 chonker kernel: inet_stream_connect+0x39/0x52
Jun 16 00:18:36 chonker kernel: __sys_connect+0x68/0xa7
Jun 16 00:18:36 chonker kernel: __x64_sys_connect+0x14/0x1b
Jun 16 00:18:36 chonker kernel: do_syscall_64+0x68/0x81
Jun 16 00:18:36 chonker kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd
Jun 16 00:18:36 chonker kernel: RIP: 0033:0x1552ce1124a3
Jun 16 00:18:36 chonker kernel: Code: c3 8b 07 85 c0 75 24 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 <c3> e9 c7 d1 ff ff 41 54 b8 02 00 00 00 49 89 f4 be 00 88 08 00 55
Jun 16 00:18:36 chonker kernel: RSP: 002b:00001552cc6c1058 EFLAGS: 00000246 ORIG_RAX: 000000000000002a
Jun 16 00:18:36 chonker kernel: RAX: ffffffffffffffda RBX: 00001552cc6c2b30 RCX: 00001552ce1124a3
Jun 16 00:18:36 chonker kernel: RDX: 0000000000000010 RSI: 00001552c708d99c RDI: 0000000000000084
Jun 16 00:18:36 chonker kernel: RBP: 00001552cbb420e0 R08: 0000000000000000 R09: 0000000000000000
Jun 16 00:18:36 chonker kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 000000000000002a
Jun 16 00:18:36 chonker kernel: R13: 0000000000000010 R14: 0000000000000000 R15: 00001552cc7890f8
Jun 16 00:18:36 chonker kernel: </TASK>
Jun 16 00:18:36 chonker kernel: Modules linked in: tcp_diag udp_diag inet_diag xt_CHECKSUM ipt_REJECT nf_reject_ipv4 ip6table_mangle ip6table_nat iptable_mangle vhost_net tun vhost vhost_iotlb tap xt_nat xt_tcpudp veth macvlan xt_conntrack nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo xt_addrtype br_netfilter xfs dm_crypt dm_mod md_mod nfsd auth_rpcgss oid_registry lockd grace sunrpc zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) iptable_nat xt_MASQUERADE nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libchacha ip6table_filter ip6_tables iptable_filter ip_tables x_tables efivarfs af_packet 8021q garp mrp bridge stp llc bonding tls i915 x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm iosf_mbi drm_buddy i2c_algo_bit ttm drm_display_helper drm_kms_helper crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel
Jun 16 00:18:36 chonker kernel: sha512_ssse3 drm aesni_intel crypto_simd cryptd btusb mei_hdcp mei_pxp i2c_i801 btrtl intel_gtt rapl btbcm i2c_smbus btintel agpgart intel_cstate wmi_bmof intel_wmi_thunderbolt mxm_wmi r8169 nvme bluetooth intel_uncore mei_me i2c_core joydev nvme_core ahci mei ecdh_generic syscopyarea realtek libahci ecc sysfillrect sysimgblt thermal fb_sys_fops fan video wmi backlight intel_pmc_core acpi_pad acpi_tad button unix [last unloaded: md_mod]
Jun 16 00:18:36 chonker kernel: ---[ end trace 0000000000000000 ]---
Jun 16 00:18:36 chonker kernel: RIP: 0010:nf_nat_setup_info+0x14a/0x7d1 [nf_nat]
Jun 16 00:18:36 chonker kernel: Code: 4c 89 ff e8 1e f8 ff ff 48 8b 15 4a 6a 00 00 89 c0 48 8d 04 c2 4c 8b 30 4d 85 f6 74 2a 49 81 ee 90 00 00 00 eb 21 8a 44 24 46 <41> 38 46 46 74 21 49 8b 96 90 00 00 00 48 85 d2 0f 84 56 ff ff ff
Jun 16 00:18:36 chonker kernel: RSP: 0018:ffffc90000340738 EFLAGS: 00010282
Jun 16 00:18:36 chonker kernel: RAX: ffff888142bf4806 RBX: ffff8881507ef400 RCX: 911c2f2f43b23fd7
Jun 16 00:18:36 chonker kernel: RDX: e68b5cc413472158 RSI: da422dc5bff567b6 RDI: c25dba15011f0e06
Jun 16 00:18:36 chonker kernel: RBP: ffffc90000340800 R08: 732d2524b7231a5f R09: 4aa4027e1fcf3267
Jun 16 00:18:36 chonker kernel: R10: a0dff80207ea819e R11: ffffc90000340710 R12: ffffc90000340814
Jun 16 00:18:36 chonker kernel: R13: 0000000000000000 R14: e68b5cc4134720c8 R15: ffffffff82a11440
Jun 16 00:18:36 chonker kernel: FS:  00001552cc6c2b30(0000) GS:ffff88901f4c0000(0000) knlGS:0000000000000000
Jun 16 00:18:36 chonker kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 16 00:18:36 chonker kernel: CR2: 0000000000537d30 CR3: 0000000453404002 CR4: 00000000007706e0
Jun 16 00:18:36 chonker kernel: PKRU: 55555554

Network error: Software caused connection abort

I'm not sure what comes up if I try booting Unraid because checking would require lugging my server over to my monitor and plugging it in, but if doing that iis required for troubleshooting I'd be more than happy to. Or if other logs are required, please let me know how to obtain them and I'll throw them up here.

 

Thank you

[JorgeB]

Try switching to ipvlan (Settings -> Docker Settings -> Docker custom network type -> ipvlan (advanced view must be enabled, top right)).

[gretachini]

Thanks for the reply. I enabled this as well as restricting the DHCP pool, as this seemed to help when reading another topic.

It's been up for a couple hours so far. Hoping it stays up!