beastieg

Members
  • Posts

    3
  • Joined

  • Last visited

Recent Profile Visitors

The recent visitors block is disabled and is not being shown to other users.

beastieg's Achievements

Noob

Noob (1/14)

1

Reputation

  1. Thanks for the responses. I’ve migrated most of my docker containers to host and now only have pihole on it’s own IP. It’s been stable ever since. I’ll hold onto this setup until the 6.10 is released. Thanks again.
  2. Hi all; I have been experiencing some 'regular' kernel panics for the last few weeks. The always seem to be related to either "nf_nat_setup_info" or "__nf_conntrack_confirm". It 'feels' like it seems be more often when there heavy disk IO, e.g. the latest crash happened when I was performing a "slackpkg install-new" within a vbatts/slackware:14.2 docker image with no networking setup (this command downloads and installs all missing slackware base packages so hits the network and writes to disk) Output from rsyslog for the latest crash is as follows: Tower kernel:BUG: unable to handle page fault for address: 00000000000f9bf7 Tower kernel:#PF: supervisor read access in kernel mode Tower kernel:#PF: error_code(0x0000) - not-present page Tower kernel:PGD 0 P4D 0 Tower kernel:Oops: 0000 [#1] SMP NOPTI Tower kernel:CPU: 4 PID: 15595 Comm: transmission-da Tainted: P W O 5.10.28-Unraid #1 Tower kernel:Hardware name: ASUS System Product Name/ROG CROSSHAIR VIII FORMULA, BIOS 3602 06/04/2021 Tower kernel:RIP: 0010:nf_nat_setup_info+0x129/0x6aa [nf_nat] Tower kernel:Code: ff 48 8b 15 ef 6a 00 00 89 c0 48 8d 04 c2 48 8b 10 48 85 d2 74 80 48 81 ea 98 00 00 00 48 85 d2 0f 84 70 ff ff ff 8a 44 24 46 <38> 42 46 74 09 48 8b 92 98 00 00 00 eb d9 48 8b 4a 20 48 8b 42 28 Tower kernel:RSP: 0018:ffffc900002f0700 EFLAGS: 00010206 Tower kernel:RAX: ffff8881a5a66e06 RBX: ffff888119804000 RCX: 0000000000000000 Tower kernel:RDX: 00000000000f9bb1 RSI: 00000000341bebfe RDI: ffffc900002f0720 Tower kernel:RBP: ffffc900002f07c8 R08: 00000000178296bf R09: ffff8881a1232140 Tower kernel:R10: 0000000000000348 R11: ffffffff815cbe4b R12: 0000000000000000 Tower kernel:R13: ffffc900002f0720 R14: ffffc900002f07dc R15: ffffffff8210b440 Tower kernel:FS: 000015375552cb38(0000) GS:ffff888fee900000(0000) knlGS:0000000000000000 Tower kernel:CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Tower kernel:CR2: 00000000000f9bf7 CR3: 00000001c9b94000 CR4: 0000000000750ee0 Tower kernel:PKRU: 55555554 Tower kernel:Call Trace: Tower kernel: <IRQ> Tower kernel: ? dma_map_page_attrs+0x6a/0x199 Tower kernel: ? cpufreq_dbs_governor_start+0x76/0x157 Tower kernel: ? __ksize+0x15/0x64 Tower kernel: ? krealloc+0x26/0x7a Tower kernel: nf_nat_masquerade_ipv4+0x10b/0x131 [nf_nat] Tower kernel: masquerade_tg+0x44/0x5e [xt_MASQUERADE] Tower kernel: ? __qdisc_run+0x21d/0x3c9 Tower kernel: ipt_do_table+0x51a/0x5c0 [ip_tables] Tower kernel: ? __dev_queue_xmit+0x4d9/0x501 Tower kernel: ? fib_validate_source+0xb0/0xda Tower kernel: nf_nat_inet_fn+0xe9/0x183 [nf_nat] Tower kernel: nf_nat_ipv4_out+0xf/0x88 [nf_nat] Tower kernel: nf_hook_slow+0x39/0x8e Tower kernel: nf_hook+0xab/0xd3 Tower kernel: ? __ip_finish_output+0x146/0x146 Tower kernel: ip_output+0x7d/0x8a Tower kernel: ? __ip_finish_output+0x146/0x146 Tower kernel: ip_forward+0x3f1/0x420 Tower kernel: ? ip_check_defrag+0x18f/0x18f Tower kernel: ip_sabotage_in+0x43/0x4d [br_netfilter] Tower kernel: nf_hook_slow+0x39/0x8e Tower kernel: nf_hook.constprop.0+0xb1/0xd8 Tower kernel: ? l3mdev_l3_rcv.constprop.0+0x50/0x50 Tower kernel: ip_rcv+0x41/0x61 Tower kernel: __netif_receive_skb_one_core+0x74/0x95 Tower kernel: netif_receive_skb+0x79/0xa1 Tower kernel: br_handle_frame_finish+0x30d/0x351 Tower kernel: ? br_pass_frame_up+0xda/0xda Tower kernel: br_nf_hook_thresh+0xa3/0xc3 [br_netfilter] Tower kernel: ? br_pass_frame_up+0xda/0xda Tower kernel: br_nf_pre_routing_finish+0x23d/0x264 [br_netfilter] Tower kernel: ? br_pass_frame_up+0xda/0xda Tower kernel: ? br_handle_frame_finish+0x351/0x351 Tower kernel: ? nf_nat_ipv4_pre_routing+0x1e/0x4a [nf_nat] Tower kernel: ? br_nf_forward_finish+0xd0/0xd0 [br_netfilter] Tower kernel: ? br_handle_frame_finish+0x351/0x351 Tower kernel: NF_HOOK+0xd7/0xf7 [br_netfilter] Tower kernel: ? br_nf_forward_finish+0xd0/0xd0 [br_netfilter] Tower kernel: br_nf_pre_routing+0x229/0x239 [br_netfilter] Tower kernel: ? br_nf_forward_finish+0xd0/0xd0 [br_netfilter] Tower kernel: br_handle_frame+0x25e/0x2a6 Tower kernel: ? br_pass_frame_up+0xda/0xda Tower kernel: __netif_receive_skb_core+0x335/0x4e7 Tower kernel: ? sk_reset_timer+0xf/0x1f Tower kernel: ? tcp_schedule_loss_probe+0xe2/0xf1 Tower kernel: __netif_receive_skb_one_core+0x3d/0x95 Tower kernel: process_backlog+0xa3/0x13b Tower kernel: net_rx_action+0xf4/0x29d Tower kernel: __do_softirq+0xc4/0x1c2 Tower kernel: asm_call_irq_on_stack+0x12/0x20 Tower kernel: </IRQ> Tower kernel: do_softirq_own_stack+0x2c/0x39 Tower kernel: do_softirq+0x3a/0x44 Tower kernel: __local_bh_enable_ip+0x3b/0x43 Tower kernel: ip_finish_output2+0x2ec/0x31f Tower kernel: ? ipv4_mtu+0x3d/0x64 Tower kernel: __ip_queue_xmit+0x2a3/0x2df Tower kernel: __tcp_transmit_skb+0x845/0x8ba Tower kernel: tcp_connect+0x76d/0x7f4 Tower kernel: tcp_v4_connect+0x3fc/0x455 Tower kernel: __inet_stream_connect+0xd3/0x2b6 Tower kernel: inet_stream_connect+0x34/0x49 Tower kernel: __sys_connect+0x62/0x9d Tower kernel: ? __sys_bind+0x78/0x9f Tower kernel: __x64_sys_connect+0x11/0x14 Tower kernel: do_syscall_64+0x5d/0x6a Tower kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9 Tower kernel:RIP: 0033:0x1537559f4390 Tower kernel:Code: c3 8b 07 85 c0 75 24 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 <c3> e9 8a d2 ff ff 41 54 b8 02 00 00 00 49 89 f4 be 00 88 08 00 55 Tower kernel:RSP: 002b:000015375552c4d8 EFLAGS: 00000246 ORIG_RAX: 000000000000002a Tower kernel:RAX: ffffffffffffffda RBX: 000015375552cb38 RCX: 00001537559f4390 Tower kernel:RDX: 0000000000000010 RSI: 000015375552c558 RDI: 000000000000008d Tower kernel:RBP: 000000000000008d R08: 0000000000000000 R09: 0000000000000000 Tower kernel:R10: 0000000000000000 R11: 0000000000000246 R12: 000000000000002a Tower kernel:R13: 0000000000006e81 R14: 0000153755635240 R15: 00001537555aeb24 Tower kernel:Modules linked in: veth xt_nat xt_tcpudp macvlan xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xt_addrtype iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter xfs nfsd lockd grace sunrpc md_mod nvidia_drm(PO) nvidia_modeset(PO) drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops nvidia(PO) drm backlight agpgart nct6775 hwmon_vid jc42 ip6table_filter ip6_tables iptable_filter ip_tables x_tables atlantic igb i2c_algo_bit edac_mce_amd btusb btrtl btbcm kvm_amd btintel wmi_bmof mxm_wmi bluetooth kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel ecdh_generic crypto_simd ecc cryptd glue_helper ahci i2c_piix4 libahci rapl ccp i2c_core wmi k10temp button acpi_cpufreq [last unloaded: atlantic] Tower kernel:CR2: 00000000000f9bf7 Below are some other examples of panics with different nf_ module errors: Tower kernel:------------[ cut here ]------------ Tower kernel:WARNING: CPU: 2 PID: 28941 at net/netfilter/nf_conntrack_core.c:1120 __nf_conntrack_confirm+0x9b/0x1e6 [nf_conntrack] Tower kernel:Modules linked in: veth macvlan xt_nat xt_tcpudp xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xt_addrtype iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter xfs nfsd lockd grace sunrpc md_mod nvidia_drm(PO) nvidia_modeset(PO) drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops nvidia(PO) drm backlight agpgart nct6775 hwmon_vid jc42 ip6table_filter ip6_tables iptable_filter ip_tables x_tables atlantic igb i2c_algo_bit edac_mce_amd wmi_bmof mxm_wmi btusb kvm_amd btrtl btbcm btintel kvm bluetooth ecdh_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel ecc i2c_piix4 crypto_simd cryptd ahci glue_helper i2c_core libahci wmi ccp rapl k10temp button acpi_cpufreq [last unloaded: atlantic] Tower kernel:CPU: 2 PID: 28941 Comm: kworker/2:2 Tainted: P O 5.10.28-Unraid #1 Tower kernel:Hardware name: ASUS System Product Name/ROG CROSSHAIR VIII FORMULA, BIOS 3602 06/04/2021 Tower kernel:Workqueue: events macvlan_process_broadcast [macvlan] Tower kernel:RIP: 0010:__nf_conntrack_confirm+0x9b/0x1e6 [nf_conntrack] Tower kernel:Code: e8 dc f8 ff ff 44 89 fa 89 c6 41 89 c4 48 c1 eb 20 89 df 41 89 de e8 36 f6 ff ff 84 c0 75 bb 48 8b 85 80 00 00 00 a8 08 74 18 <0f> 0b 89 df 44 89 e6 31 db e8 6d f3 ff ff e8 35 f5 ff ff e9 22 01 Tower kernel:RSP: 0018:ffffc90000298dd8 EFLAGS: 00010202 Tower kernel:RAX: 0000000000000188 RBX: 00000000000007ee RCX: 00000000161c1b5b Tower kernel:RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffffa014e1b8 Tower kernel:RBP: ffff8881a8c45040 R08: 00000000c2f8323d R09: ffff888201a76e20 Tower kernel:R10: 0000000000000098 R11: ffff8881bf72e000 R12: 0000000000006551 Tower kernel:R13: ffffffff8210b440 R14: 00000000000007ee R15: 0000000000000000 Tower kernel:FS: 0000000000000000(0000) GS:ffff888fee880000(0000) knlGS:0000000000000000 Tower kernel:CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Tower kernel:CR2: 000014fe70d0d000 CR3: 0000000140442000 CR4: 0000000000750ee0 Tower kernel:PKRU: 55555554 Tower kernel:Call Trace: Tower kernel: <IRQ> Tower kernel: nf_conntrack_confirm+0x2f/0x36 [nf_conntrack] Tower kernel: nf_hook_slow+0x39/0x8e Tower kernel: nf_hook.constprop.0+0xb1/0xd8 Tower kernel: ? ip_protocol_deliver_rcu+0xfe/0xfe Tower kernel: ip_local_deliver+0x49/0x75 Tower kernel: __netif_receive_skb_one_core+0x74/0x95 Tower kernel: process_backlog+0xa3/0x13b Tower kernel: net_rx_action+0xf4/0x29d Tower kernel: __do_softirq+0xc4/0x1c2 Tower kernel: asm_call_irq_on_stack+0x12/0x20 Tower kernel: </IRQ> Tower kernel: do_softirq_own_stack+0x2c/0x39 Tower kernel: do_softirq+0x3a/0x44 Tower kernel: netif_rx_ni+0x1c/0x22 Tower kernel: macvlan_broadcast+0x10e/0x13c [macvlan] Tower kernel: macvlan_process_broadcast+0xf8/0x143 [macvlan] Tower kernel: process_one_work+0x13c/0x1d5 Tower kernel: worker_thread+0x18b/0x22f Tower kernel: ? process_scheduled_works+0x27/0x27 Tower kernel: kthread+0xe5/0xea Tower kernel: ? __kthread_bind_mask+0x57/0x57 Tower kernel: ret_from_fork+0x22/0x30 Tower kernel:---[ end trace 2104524fb0c87f00 ]--- Tower kernel:------------[ cut here ]------------ Tower kernel:WARNING: CPU: 7 PID: 0 at net/netfilter/nf_conntrack_core.c:1120 __nf_conntrack_confirm+0x9b/0x1e6 [nf_conntrack] Tower kernel:Modules linked in: veth xt_nat xt_tcpudp macvlan xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xt_addrtype iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter xfs nfsd lockd grace sunrpc md_mod nvidia_drm(PO) nvidia_modeset(PO) drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops nvidia(PO) drm backlight agpgart nct6775 hwmon_vid jc42 ip6table_filter ip6_tables iptable_filter ip_tables x_tables atlantic igb i2c_algo_bit edac_mce_amd btusb btrtl btbcm kvm_amd btintel wmi_bmof mxm_wmi bluetooth kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel ecdh_generic crypto_simd ecc cryptd glue_helper ahci i2c_piix4 libahci rapl ccp i2c_core wmi k10temp button acpi_cpufreq [last unloaded: atlantic] Tower kernel:CPU: 7 PID: 0 Comm: swapper/7 Tainted: P O 5.10.28-Unraid #1 Tower kernel:Hardware name: ASUS System Product Name/ROG CROSSHAIR VIII FORMULA, BIOS 3602 06/04/2021 Tower kernel:RIP: 0010:__nf_conntrack_confirm+0x9b/0x1e6 [nf_conntrack] Tower kernel:Code: e8 dc f8 ff ff 44 89 fa 89 c6 41 89 c4 48 c1 eb 20 89 df 41 89 de e8 36 f6 ff ff 84 c0 75 bb 48 8b 85 80 00 00 00 a8 08 74 18 <0f> 0b 89 df 44 89 e6 31 db e8 6d f3 ff ff e8 35 f5 ff ff e9 22 01 Tower kernel:RSP: 0018:ffffc90000374918 EFLAGS: 00010202 Tower kernel:RAX: 0000000000000188 RBX: 000000000000bf34 RCX: 0000000033b30fd9 Tower kernel:RDX: 0000000000000000 RSI: 00000000000000a9 RDI: ffffffffa0276ed0 Tower kernel:RBP: ffff8883baabc000 R08: 00000000dda053ee R09: ffff8881a1232180 Tower kernel:R10: 0000000000000158 R11: ffff888f015e4900 R12: 00000000000098a9 Tower kernel:R13: ffffffff8210b440 R14: 000000000000bf34 R15: 0000000000000000 Tower kernel:FS: 0000000000000000(0000) GS:ffff888fee9c0000(0000) knlGS:0000000000000000 Tower kernel:CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Tower kernel:CR2: 000000c0007f4018 CR3: 00000001b1a76000 CR4: 0000000000750ee0 Tower kernel:PKRU: 55555554 Tower kernel:Call Trace: Tower kernel: <IRQ> Tower kernel: nf_conntrack_confirm+0x2f/0x36 [nf_conntrack] Tower kernel: nf_hook_slow+0x39/0x8e Tower kernel: nf_hook.constprop.0+0xb1/0xd8 Tower kernel: ? ip_protocol_deliver_rcu+0xfe/0xfe Tower kernel: ip_local_deliver+0x49/0x75 Tower kernel: ip_sabotage_in+0x43/0x4d [br_netfilter] Tower kernel: nf_hook_slow+0x39/0x8e Tower kernel: nf_hook.constprop.0+0xb1/0xd8 Tower kernel: ? l3mdev_l3_rcv.constprop.0+0x50/0x50 Tower kernel: ip_rcv+0x41/0x61 Tower kernel: __netif_receive_skb_one_core+0x74/0x95 Tower kernel: netif_receive_skb+0x79/0xa1 Tower kernel: br_handle_frame_finish+0x30d/0x351 Tower kernel: ? br_pass_frame_up+0xda/0xda Tower kernel: br_nf_hook_thresh+0xa3/0xc3 [br_netfilter] Tower kernel: ? br_pass_frame_up+0xda/0xda Tower kernel: br_nf_pre_routing_finish+0x23d/0x264 [br_netfilter] Tower kernel: ? br_pass_frame_up+0xda/0xda Tower kernel: ? br_handle_frame_finish+0x351/0x351 Tower kernel: ? nf_nat_ipv4_pre_routing+0x1e/0x4a [nf_nat] Tower kernel: ? br_nf_forward_finish+0xd0/0xd0 [br_netfilter] Tower kernel: ? br_handle_frame_finish+0x351/0x351 Tower kernel: NF_HOOK+0xd7/0xf7 [br_netfilter] Tower kernel: ? br_nf_forward_finish+0xd0/0xd0 [br_netfilter] Tower kernel: br_nf_pre_routing+0x229/0x239 [br_netfilter] Tower kernel: ? br_nf_forward_finish+0xd0/0xd0 [br_netfilter] Tower kernel: br_handle_frame+0x25e/0x2a6 Tower kernel: ? br_pass_frame_up+0xda/0xda Tower kernel: __netif_receive_skb_core+0x335/0x4e7 Tower kernel: __netif_receive_skb_list_core+0x78/0x104 Tower kernel: netif_receive_skb_list_internal+0x1bf/0x1f2 Tower kernel: ? napi_gro_receive+0x5a/0x88 Tower kernel: gro_normal_list+0x1d/0x39 Tower kernel: napi_complete_done+0x79/0x104 Tower kernel: aq_vec_poll+0x14a/0x190 [atlantic] Tower kernel: net_rx_action+0xf4/0x29d Tower kernel: __do_softirq+0xc4/0x1c2 Tower kernel: asm_call_irq_on_stack+0x12/0x20 Tower kernel: </IRQ> Tower kernel: do_softirq_own_stack+0x2c/0x39 Tower kernel: __irq_exit_rcu+0x45/0x80 Tower kernel: common_interrupt+0x119/0x12e Tower kernel: asm_common_interrupt+0x1e/0x40 Tower kernel:RIP: 0010:arch_local_irq_enable+0x7/0x8 Tower kernel:Code: 00 48 83 c4 28 4c 89 e0 5b 5d 41 5c 41 5d 41 5e 41 5f c3 9c 58 0f 1f 44 00 00 c3 fa 66 0f 1f 44 00 00 c3 fb 66 0f 1f 44 00 00 <c3> 55 8b af 28 04 00 00 b8 01 00 00 00 45 31 c9 53 45 31 d2 39 c5 Tower kernel:RSP: 0018:ffffc9000016fea0 EFLAGS: 00000246 Tower kernel:RAX: ffff888fee9e2380 RBX: 0000000000000002 RCX: 000000000000001f Tower kernel:RDX: 0000000000000000 RSI: 0000000025a5a65f RDI: 0000000000000000 Tower kernel:RBP: ffff8881059cb800 R08: 00000ff3d64eefcc R09: 00000000000003d5 Tower kernel:R10: 000000000000132f R11: 071c71c71c71c71c R12: 00000ff3d64eefcc Tower kernel:R13: ffffffff820c8c40 R14: 0000000000000002 R15: 0000000000000000 Tower kernel: cpuidle_enter_state+0x101/0x1c4 Tower kernel: cpuidle_enter+0x25/0x31 Tower kernel: do_idle+0x1a6/0x214 Tower kernel: cpu_startup_entry+0x18/0x1a Tower kernel: secondary_startup_64_no_verify+0xb0/0xbb Tower kernel:---[ end trace 0fcf60ed1a7d3c2d ]--- I thought it was related to moving a docker container to br0 and then enabling "Host access to custom networks: yes" (I'd been playing with setting up Nginx-Proxy-Manager-Official as a reverse proxy in front of some containers and needed it listening on 80 and 443. I've since disabled "Host access to custom networks: yes", since some other post indicate similar issues when this is enabled. ( But it's still happening so I'm looking for ideas of how to debug this issue further: The thoughts I've had: Remove all dockers from br0 I have plex and pihole running on br0 so they can have their own ips on the network. Plex is new to this setup (3 weeks?) pihold has been running for over a year on br0 no issues. Run a memtest for 24 hours I've just not wanted to have the server offline for 24 hours over the festive break Upgrade to 6.10.0-rc2 This looks like macvlan has been replaced with ipvlan, though there seems to be a known bug in the version of samba in 6.10.0-rc2 and MacOS (I can't find the unraid forum link right now). I have a mac on the network and I'd rather no cripple the samba access if I don't have to. Does anyone else have any suggestions on other things to try / places to look? Thanks
  3. Thanks for this. I took your solution and added some scripting to make it easier to summarise all my docker containers. Leaving this here in case it helps someone else: docker ps | awk '{print $1}' | grep -v CONTAINER | xargs -n 1 -I {} sh -c "echo -e \\\n#================\\\nDocker container:{}; docker exec {} du -hx -d1 / "