• 6.9.0/6.9.1 - Kernel Panic due to netfilter (nf_nat_setup_info) - Docker Static IP (macvlan)


    CorneliousJD
    • Urgent

    So I had posted another thread about after a kernel panic, docker host access to custom networks doesn't work until docker is stopped/restarted on 6.9.0

     

     

    After further investigation and setting up syslogging, it apperas that it may actually be that host access that's CAUSING the kernel panic? 

    EDIT: 3/16 - I guess I needed to create a VLAN for my dockers with static IPs, so far that's working, so it's probably not HOST access causing the issue, but rather br0 static IPs being set. See following posts below.

     

    Here's my last kernel panic that thankfully got logged to syslog. It references macvlan and netfilter. I don't know enough to be super useful here, but this is my docker setup.

     

    image.png.dac2782e9408016de37084cf21ad64a5.png

     

    Mar 12 03:57:07 Server kernel: ------------[ cut here ]------------
    Mar 12 03:57:07 Server kernel: WARNING: CPU: 17 PID: 626 at net/netfilter/nf_nat_core.c:614 nf_nat_setup_info+0x6c/0x652 [nf_nat]
    Mar 12 03:57:07 Server kernel: Modules linked in: ccp macvlan xt_CHECKSUM ipt_REJECT ip6table_mangle ip6table_nat iptable_mangle vhost_net tun vhost vhost_iotlb tap veth xt_nat xt_MASQUERADE iptable_nat nf_nat xfs md_mod ip6table_filter ip6_tables iptable_filter ip_tables bonding igb i2c_algo_bit cp210x usbserial sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel crypto_simd cryptd ipmi_ssif isci glue_helper mpt3sas i2c_i801 rapl libsas i2c_smbus input_leds i2c_core ahci intel_cstate raid_class led_class acpi_ipmi intel_uncore libahci scsi_transport_sas wmi ipmi_si button [last unloaded: ipmi_devintf]
    Mar 12 03:57:07 Server kernel: CPU: 17 PID: 626 Comm: kworker/17:2 Tainted: G        W         5.10.19-Unraid #1
    Mar 12 03:57:07 Server kernel: Hardware name: Supermicro PIO-617R-TLN4F+-ST031/X9DRi-LN4+/X9DR3-LN4+, BIOS 3.2 03/04/2015
    Mar 12 03:57:07 Server kernel: Workqueue: events macvlan_process_broadcast [macvlan]
    Mar 12 03:57:07 Server kernel: RIP: 0010:nf_nat_setup_info+0x6c/0x652 [nf_nat]
    Mar 12 03:57:07 Server kernel: Code: 89 fb 49 89 f6 41 89 d4 76 02 0f 0b 48 8b 93 80 00 00 00 89 d0 25 00 01 00 00 45 85 e4 75 07 89 d0 25 80 00 00 00 85 c0 74 07 <0f> 0b e9 1f 05 00 00 48 8b 83 90 00 00 00 4c 8d 6c 24 20 48 8d 73
    Mar 12 03:57:07 Server kernel: RSP: 0018:ffffc90006778c38 EFLAGS: 00010202
    Mar 12 03:57:07 Server kernel: RAX: 0000000000000080 RBX: ffff88837c8303c0 RCX: ffff88811e834880
    Mar 12 03:57:07 Server kernel: RDX: 0000000000000180 RSI: ffffc90006778d14 RDI: ffff88837c8303c0
    Mar 12 03:57:07 Server kernel: RBP: ffffc90006778d00 R08: 0000000000000000 R09: ffff889083c68160
    Mar 12 03:57:07 Server kernel: R10: 0000000000000158 R11: ffff8881e79c1400 R12: 0000000000000000
    Mar 12 03:57:07 Server kernel: R13: 0000000000000000 R14: ffffc90006778d14 R15: 0000000000000001
    Mar 12 03:57:07 Server kernel: FS:  0000000000000000(0000) GS:ffff88903fc40000(0000) knlGS:0000000000000000
    Mar 12 03:57:07 Server kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
    Mar 12 03:57:07 Server kernel: CR2: 000000c000b040b8 CR3: 000000000200c005 CR4: 00000000001706e0
    Mar 12 03:57:07 Server kernel: Call Trace:
    Mar 12 03:57:07 Server kernel: <IRQ>
    Mar 12 03:57:07 Server kernel: ? activate_task+0x9/0x12
    Mar 12 03:57:07 Server kernel: ? resched_curr+0x3f/0x4c
    Mar 12 03:57:07 Server kernel: ? ipt_do_table+0x49b/0x5c0 [ip_tables]
    Mar 12 03:57:07 Server kernel: ? try_to_wake_up+0x1b0/0x1e5
    Mar 12 03:57:07 Server kernel: nf_nat_alloc_null_binding+0x71/0x88 [nf_nat]
    Mar 12 03:57:07 Server kernel: nf_nat_inet_fn+0x91/0x182 [nf_nat]
    Mar 12 03:57:07 Server kernel: nf_hook_slow+0x39/0x8e
    Mar 12 03:57:07 Server kernel: nf_hook.constprop.0+0xb1/0xd8
    Mar 12 03:57:07 Server kernel: ? ip_protocol_deliver_rcu+0xfe/0xfe
    Mar 12 03:57:07 Server kernel: ip_local_deliver+0x49/0x75
    Mar 12 03:57:07 Server kernel: ip_sabotage_in+0x43/0x4d
    Mar 12 03:57:07 Server kernel: nf_hook_slow+0x39/0x8e
    Mar 12 03:57:07 Server kernel: nf_hook.constprop.0+0xb1/0xd8
    Mar 12 03:57:07 Server kernel: ? l3mdev_l3_rcv.constprop.0+0x50/0x50
    Mar 12 03:57:07 Server kernel: ip_rcv+0x41/0x61
    Mar 12 03:57:07 Server kernel: __netif_receive_skb_one_core+0x74/0x95
    Mar 12 03:57:07 Server kernel: process_backlog+0xa3/0x13b
    Mar 12 03:57:07 Server kernel: net_rx_action+0xf4/0x29d
    Mar 12 03:57:07 Server kernel: __do_softirq+0xc4/0x1c2
    Mar 12 03:57:07 Server kernel: asm_call_irq_on_stack+0x12/0x20
    Mar 12 03:57:07 Server kernel: </IRQ>
    Mar 12 03:57:07 Server kernel: do_softirq_own_stack+0x2c/0x39
    Mar 12 03:57:07 Server kernel: do_softirq+0x3a/0x44
    Mar 12 03:57:07 Server kernel: netif_rx_ni+0x1c/0x22
    Mar 12 03:57:07 Server kernel: macvlan_broadcast+0x10e/0x13c [macvlan]
    Mar 12 03:57:07 Server kernel: macvlan_process_broadcast+0xf8/0x143 [macvlan]
    Mar 12 03:57:07 Server kernel: process_one_work+0x13c/0x1d5
    Mar 12 03:57:07 Server kernel: worker_thread+0x18b/0x22f
    Mar 12 03:57:07 Server kernel: ? process_scheduled_works+0x27/0x27
    Mar 12 03:57:07 Server kernel: kthread+0xe5/0xea
    Mar 12 03:57:07 Server kernel: ? __kthread_bind_mask+0x57/0x57
    Mar 12 03:57:07 Server kernel: ret_from_fork+0x22/0x30
    Mar 12 03:57:07 Server kernel: ---[ end trace b3ca21ac5f2c2720 ]---

     




    User Feedback

    Recommended Comments



    weirdly enough i had a stable server and started seeing these recently, i have not changed anything in my configuration except updated some docker containers, and yes i am using macvlan and a static ip on each docker container.

     

    It occurs very rarely for me, but i've seen it once or twice before. My first attempt to resolve it was updating the bios and lowering the memory speeds to 3000mhz instead of the rated 3200mhz just to see if it went away but nope.

     

    On unraid: 6.10.3

    Ideas?

     

    Quote

    Nov  9 15:06:46 NAS kernel: WARNING: CPU: 9 PID: 31904 at net/netfilter/nf_conntrack_core.c:1192 __nf_conntrack_confirm+0xb8/0x254 [nf_conntrack]
    Nov  9 15:06:46 NAS kernel: Modules linked in: nvidia_modeset(PO) nvidia_uvm(PO) xt_mark xt_CHECKSUM ipt_REJECT nf_reject_ipv4 xt_nat xt_tcpudp ip6table_mangle ip6table_nat iptable_mangle vhost_net tun vhost vhost_iotlb tap macvlan xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xt_addrtype iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter xfs dm_crypt dm_mod dax cmac cifs asn1_decoder cifs_arc4 cifs_md4 oid_registry md_mod nvidia(PO) ipmi_devintf wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libchacha ip6table_filter ip6_tables iptable_filter ip_tables x_tables ast drm_vram_helper i2c_algo_bit drm_ttm_helper ttm drm_kms_helper drm backlight i10nm_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm ipmi_ssif crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel crypto_simd cryptd rapl mpt3sas ixgbe intel_cstate agpgart i2c_i801 nvme i2c_smbus ahci
    Nov  9 15:06:46 NAS kernel: syscopyarea raid_class sysfillrect input_leds sysimgblt intel_uncore nvme_core i2c_core scsi_transport_sas fb_sys_fops mdio led_class intel_pch_thermal libahci acpi_ipmi ipmi_si acpi_power_meter acpi_pad button
    Nov  9 15:06:46 NAS kernel: CPU: 9 PID: 31904 Comm: kworker/9:2 Tainted: P           O      5.15.46-Unraid #1
    Nov  9 15:06:46 NAS kernel: Hardware name: Supermicro Super Server/X12SPI-TF, BIOS 1.6 08/18/2023
    Nov  9 15:06:46 NAS kernel: Workqueue: events macvlan_process_broadcast [macvlan]
    Nov  9 15:06:46 NAS kernel: RIP: 0010:__nf_conntrack_confirm+0xb8/0x254 [nf_conntrack]
    Nov  9 15:06:46 NAS kernel: Code: 89 c6 48 89 44 24 18 e8 53 e4 ff ff 44 89 f2 44 89 ef 89 c6 89 c5 e8 2c e8 ff ff 84 c0 75 9f 49 8b 87 80 00 00 00 a8 08 74 19 <0f> 0b 89 ee 44 89 ef 45 31 e4 e8 dc df ff ff e8 ae e4 ff ff e9 71
    Nov  9 15:06:46 NAS kernel: RSP: 0018:ffffc900006dcdb0 EFLAGS: 00010202
    Nov  9 15:06:46 NAS kernel: RAX: 0000000000000188 RBX: ffffffff828e1500 RCX: 0000000000000000
    Nov  9 15:06:46 NAS kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffffa0497e0c
    Nov  9 15:06:46 NAS kernel: RBP: 000000000001f6f3 R08: 74240b71a151d658 R09: db22a56f3851aa95
    Nov  9 15:06:46 NAS kernel: R10: d54aed9152b79c28 R11: 112bcba66aa370c9 R12: 000000000001b937
    Nov  9 15:06:46 NAS kernel: R13: 000000000001b937 R14: 0000000000000000 R15: ffff8894faeb2800
    Nov  9 15:06:46 NAS kernel: FS:  0000000000000000(0000) GS:ffff889fffc40000(0000) knlGS:0000000000000000
    Nov  9 15:06:46 NAS kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
    Nov  9 15:06:46 NAS kernel: CR2: 0000000000000000 CR3: 000000000220a006 CR4: 0000000000772ee0
    Nov  9 15:06:46 NAS kernel: PKRU: 55555554
    Nov  9 15:06:46 NAS kernel: Call Trace:
    Nov  9 15:06:46 NAS kernel: <IRQ>
    Nov  9 15:06:46 NAS kernel: nf_conntrack_confirm+0x26/0x3f [nf_conntrack]
    Nov  9 15:06:46 NAS kernel: nf_hook_slow+0x3b/0x93
    Nov  9 15:06:46 NAS kernel: ? ip_protocol_deliver_rcu+0x135/0x135
    Nov  9 15:06:46 NAS kernel: NF_HOOK.constprop.0+0x73/0xce
    Nov  9 15:06:46 NAS kernel: ? ip_protocol_deliver_rcu+0x135/0x135
    Nov  9 15:06:46 NAS kernel: __netif_receive_skb_one_core+0x79/0x9a
    Nov  9 15:06:46 NAS kernel: process_backlog+0xab/0x143
    Nov  9 15:06:46 NAS kernel: __napi_poll.constprop.0+0x27/0x114
    Nov  9 15:06:46 NAS kernel: net_rx_action+0xe8/0x1f2
    Nov  9 15:06:46 NAS kernel: __do_softirq+0xec/0x218
    Nov  9 15:06:46 NAS kernel: do_softirq+0x50/0x68
    Nov  9 15:06:46 NAS kernel: </IRQ>
    Nov  9 15:06:46 NAS kernel: <TASK>
    Nov  9 15:06:46 NAS kernel: netif_rx_ni+0x53/0x85
    Nov  9 15:06:46 NAS kernel: macvlan_broadcast+0x116/0x144 [macvlan]
    Nov  9 15:06:46 NAS kernel: macvlan_process_broadcast+0xc7/0x110 [macvlan]
    Nov  9 15:06:46 NAS kernel: process_one_work+0x195/0x27a
    Nov  9 15:06:46 NAS kernel: worker_thread+0x19c/0x240
    Nov  9 15:06:46 NAS kernel: ? rescuer_thread+0x28b/0x28b
    Nov  9 15:06:46 NAS kernel: kthread+0xdc/0xe3
    Nov  9 15:06:46 NAS kernel: ? set_kthread_struct+0x32/0x32
    Nov  9 15:06:46 NAS kernel: ret_from_fork+0x1f/0x30
    Nov  9 15:06:46 NAS kernel: </TASK>
    Nov  9 15:06:46 NAS kernel: ---[ end trace 7a7875718a124e5a ]---

     

    Link to comment
    4 hours ago, JorgeB said:

    Change to ipvlan or update to v6.12.4 and see the release notes.

    Good luck with that.  When I attempted to use ipvlan, the entire unraid server had issues talking to the network.

     

    I was hoping to no longer be a part of this topic as my server had been running fine for over 6 months without issues.  Then, being super dumb, I updated to 6.12.4 and the server kernel panic'd literally the next day.  Hopefully, after it finishes a parity check, it'll go back to normal.  Fingers crossed.

    Link to comment
    Just now, jzawacki said:

    Good luck with that.  When I attempted to use ipvlan, the entire unraid server had issues talking to the network.

     

    I was hoping to no longer be a part of this topic as my server had been running fine for over 6 months without issues.  Then, being super dumb, I updated to 6.12.4 and the server kernel panic'd literally the next day.  Hopefully, after it finishes a parity check, it'll go back to normal.  Fingers crossed.

    I solved my issues before but just making a dedicated NIC for docker with macvlan and I haven't had any crashes since. 

     

    I don't plan on switching back even if they have this fixed. I don't see a reason to change from a known good and working config. You may want to try it? Worth a shot!

    Link to comment
    8 hours ago, jzawacki said:

    When I attempted to use ipvlan, the entire unraid server had issues talking to the network.

    You can use macvlan with 6.12.4, see the release notes.

    Link to comment
    6 hours ago, JorgeB said:

    You can use macvlan with 6.12.4, see the release notes.

    I am using macvlan becuase ipvlan never worked properly.  ipvlan wasn't even an option.

    Link to comment
    48 minutes ago, jzawacki said:

    I am using macvlan becuase ipvlan never worked properly

    And one more time, you can use macvlan with v6.12.4, see the release notes for how to.

    Link to comment
    1 hour ago, JorgeB said:

    And one more time, you can use macvlan with v6.12.4, see the release notes for how to.

    And one more time.  I was already using macvlan with v6.12.4 and have read the release notes about it.

    Link to comment
    2 minutes ago, jzawacki said:

    And one more time.  I was already using macvlan with v6.12.4 and have read the release notes about it.

    Sorry, but then don't understand what your problem is.

    Link to comment

    I have the same kernel panic :(

    I don't know how to solve. I'm new of unraid but I can't have an unstable system like this. (1 crash a day more or less) 

     

    ==> /var/log/syslog <==
    Nov 29 18:50:23 littleboy kernel: eth0: renamed from vethc01a291
    Nov 29 18:50:23 littleboy kernel: IPv6: ADDRCONF(NETDEV_CHANGE): vethe7bf79d: link becomes ready
    Nov 29 18:50:23 littleboy kernel: docker0: port 4(vethe7bf79d) entered blocking state
    Nov 29 18:50:23 littleboy kernel: docker0: port 4(vethe7bf79d) entered forwarding state
    Nov 29 18:50:24 littleboy kernel: vetha81c8d4: renamed from eth0
    Nov 29 18:50:24 littleboy kernel: docker0: port 3(veth44ec7b9) entered disabled state
    Nov 29 18:50:26 littleboy kernel: docker0: port 3(veth44ec7b9) entered disabled state
    Nov 29 18:50:26 littleboy kernel: device veth44ec7b9 left promiscuous mode
    Nov 29 18:50:26 littleboy kernel: docker0: port 3(veth44ec7b9) entered disabled state
    Nov 29 18:50:26 littleboy kernel: vethc01a291: renamed from eth0
    Nov 29 18:50:26 littleboy kernel: docker0: port 4(vethe7bf79d) entered disabled state
    Nov 29 18:50:27 littleboy kernel: docker0: port 4(vethe7bf79d) entered disabled state
    Nov 29 18:50:27 littleboy kernel: device vethe7bf79d left promiscuous mode
    Nov 29 18:50:27 littleboy kernel: docker0: port 4(vethe7bf79d) entered disabled state
    Nov 29 18:50:32 littleboy kernel: docker0: port 3(veth4f5471a) entered blocking state
    Nov 29 18:50:32 littleboy kernel: docker0: port 3(veth4f5471a) entered disabled state
    Nov 29 18:50:32 littleboy kernel: device veth4f5471a entered promiscuous mode
    Nov 29 18:50:35 littleboy kernel: docker0: port 4(veth5002242) entered blocking state
    Nov 29 18:50:35 littleboy kernel: docker0: port 4(veth5002242) entered disabled state
    Nov 29 18:50:35 littleboy kernel: device veth5002242 entered promiscuous mode
    
    ==> /var/log/docker.log <==
    time="2023-11-29T18:50:39.483983782+01:00" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
    time="2023-11-29T18:50:39.484061171+01:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
    time="2023-11-29T18:50:39.484085169+01:00" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
    time="2023-11-29T18:50:39.484301234+01:00" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/3abdd8eef404470e6c87538269d4ea7d4b32ccdb39f23043cbcfb3189e660611 pid=39453 runtime=io.containerd.runc.v2
    time="2023-11-29T18:50:40.065645157+01:00" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
    time="2023-11-29T18:50:40.065735723+01:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
    time="2023-11-29T18:50:40.065758913+01:00" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
    time="2023-11-29T18:50:40.065953331+01:00" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/3ac9cb939dc49fccaae04cd4113e377ea414d00dbef9fd7832ac5b1dbfabf0b2 pid=39966 runtime=io.containerd.runc.v2
    
    ==> /var/log/syslog <==
    Nov 29 18:50:39 littleboy kernel: eth0: renamed from veth43bcc6d
    Nov 29 18:50:39 littleboy kernel: IPv6: ADDRCONF(NETDEV_CHANGE): veth4f5471a: link becomes ready
    Nov 29 18:50:39 littleboy kernel: docker0: port 3(veth4f5471a) entered blocking state
    Nov 29 18:50:39 littleboy kernel: docker0: port 3(veth4f5471a) entered forwarding state
    Nov 29 18:50:40 littleboy kernel: eth0: renamed from vethc561baa
    Nov 29 18:50:40 littleboy kernel: IPv6: ADDRCONF(NETDEV_CHANGE): veth5002242: link becomes ready
    Nov 29 18:50:40 littleboy kernel: docker0: port 4(veth5002242) entered blocking state
    Nov 29 18:50:40 littleboy kernel: docker0: port 4(veth5002242) entered forwarding state
    Nov 29 18:53:06 littleboy kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { 2-.... } 21143 jiffies s: 105445 root: 0x1/.
    Nov 29 18:53:06 littleboy kernel: rcu: blocking rcu_node structures (internal RCU debug): l=1:0-14:0x4/.
    Nov 29 18:53:06 littleboy kernel: Sending NMI from CPU 84 to CPUs 2:
    Nov 29 18:53:06 littleboy kernel: NMI backtrace for cpu 2
    Nov 29 18:53:06 littleboy kernel: CPU: 2 PID: 850 Comm: npm install Tainted: P        W  O       6.1.49-Unraid #1
    Nov 29 18:53:06 littleboy kernel: Hardware name: VxRack AS PowerEdge R740xd/0RR8YK, BIOS 2.19.1 06/04/2023
    Nov 29 18:53:06 littleboy kernel: RIP: 0010:nf_nat_setup_info+0x146/0x7d1 [nf_nat]
    Nov 29 18:53:06 littleboy kernel: Code: 18 4c 89 f2 4c 89 ff e8 1e f8 ff ff 48 8b 15 4a 6a 00 00 89 c0 48 8d 04 c2 4c 8b 30 4d 85 f6 74 2a 49 81 ee 90 00 00 00 eb 21 <8a> 44 24 46 41 38 46 46 74 21 49 8b 96 90 00 00 00 48 85 d2 0f 84
    Nov 29 18:53:06 littleboy kernel: RSP: 0018:ffffc900089fc738 EFLAGS: 00000286
    Nov 29 18:53:06 littleboy kernel: RAX: ffff88a106958e06 RBX: ffff888e5d6a1000 RCX: a706ed18065b4908
    Nov 29 18:53:06 littleboy kernel: RDX: ffff8881eda97890 RSI: 26cbe6897865622e RDI: 2a87b77939a0cc9d
    Nov 29 18:53:06 littleboy kernel: RBP: ffffc900089fc800 R08: 6f84c2f0878e2f7a R09: dcf3e2ac25213978
    Nov 29 18:53:06 littleboy kernel: R10: a3df108aaba40bc7 R11: ffffc900089fc710 R12: ffffc900089fc814
    Nov 29 18:53:06 littleboy kernel: R13: 0000000000000000 R14: ffff8881eda97800 R15: ffffffff82a11d00
    Nov 29 18:53:06 littleboy kernel: FS:  00001457b2f33800(0000) GS:ffff889fff640000(0000) knlGS:0000000000000000
    Nov 29 18:53:06 littleboy kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
    Nov 29 18:53:06 littleboy kernel: CR2: 0000000008b3e000 CR3: 000000267aee6003 CR4: 00000000007706e0
    Nov 29 18:53:06 littleboy kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
    Nov 29 18:53:06 littleboy kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
    Nov 29 18:53:06 littleboy kernel: PKRU: 55555554
    Nov 29 18:53:06 littleboy kernel: Call Trace:
    Nov 29 18:53:06 littleboy kernel: <NMI>
    Nov 29 18:53:06 littleboy kernel: ? nmi_cpu_backtrace+0xd3/0x104
    Nov 29 18:53:06 littleboy kernel: ? nmi_cpu_backtrace_handler+0xd/0x15
    Nov 29 18:53:06 littleboy kernel: ? nmi_handle+0x54/0x131
    Nov 29 18:53:06 littleboy kernel: ? nf_nat_setup_info+0x146/0x7d1 [nf_nat]
    Nov 29 18:53:06 littleboy kernel: ? default_do_nmi+0x66/0x15b
    Nov 29 18:53:06 littleboy kernel: ? exc_nmi+0xbf/0x130
    Nov 29 18:53:06 littleboy kernel: ? end_repeat_nmi+0x16/0x67
    Nov 29 18:53:06 littleboy kernel: ? nf_nat_setup_info+0x146/0x7d1 [nf_nat]
    Nov 29 18:53:06 littleboy kernel: ? nf_nat_setup_info+0x146/0x7d1 [nf_nat]
    Nov 29 18:53:06 littleboy kernel: ? nf_nat_setup_info+0x146/0x7d1 [nf_nat]
    Nov 29 18:53:06 littleboy kernel: </NMI>
    Nov 29 18:53:06 littleboy kernel: <IRQ>
    Nov 29 18:53:06 littleboy kernel: ? krealloc+0x82/0x93
    Nov 29 18:53:06 littleboy kernel: nf_nat_masquerade_ipv4+0x114/0x13c [nf_nat]
    Nov 29 18:53:06 littleboy kernel: masquerade_tg+0x48/0x66 [xt_MASQUERADE]
    Nov 29 18:53:06 littleboy kernel: ipt_do_table+0x51b/0x5bf [ip_tables]
    Nov 29 18:53:06 littleboy kernel: ? fib_validate_source+0xce/0xdf
    Nov 29 18:53:06 littleboy kernel: nf_nat_inet_fn+0x123/0x1a8 [nf_nat]
    Nov 29 18:53:06 littleboy kernel: nf_nat_ipv4_out+0x15/0x91 [nf_nat]
    Nov 29 18:53:06 littleboy kernel: nf_hook_slow+0x3a/0x96
    Nov 29 18:53:06 littleboy kernel: ? __ip_finish_output+0x144/0x144
    Nov 29 18:53:06 littleboy kernel: nf_hook+0xdf/0x110
    Nov 29 18:53:06 littleboy kernel: ? dev_ethtool+0x7c0/0x2349
    Nov 29 18:53:06 littleboy kernel: ? __ip_finish_output+0x144/0x144
    Nov 29 18:53:06 littleboy kernel: ip_output+0x78/0x88
    Nov 29 18:53:06 littleboy kernel: ? __ip_finish_output+0x144/0x144
    Nov 29 18:53:06 littleboy kernel: ip_sabotage_in+0x4f/0x60 [br_netfilter]
    Nov 29 18:53:06 littleboy kernel: nf_hook_slow+0x3a/0x96
    Nov 29 18:53:06 littleboy kernel: ? ip_rcv_finish_core.constprop.0+0x3e8/0x3e8
    Nov 29 18:53:06 littleboy kernel: NF_HOOK.constprop.0+0x79/0xd9
    Nov 29 18:53:06 littleboy kernel: ? ip_rcv_finish_core.constprop.0+0x3e8/0x3e8
    Nov 29 18:53:06 littleboy kernel: __netif_receive_skb_one_core+0x77/0x9c
    Nov 29 18:53:06 littleboy kernel: netif_receive_skb+0xbf/0x127
    Nov 29 18:53:06 littleboy kernel: br_handle_frame_finish+0x438/0x472 [bridge]
    Nov 29 18:53:06 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:53:06 littleboy kernel: br_nf_hook_thresh+0xe2/0x109 [br_netfilter]
    Nov 29 18:53:06 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:53:06 littleboy kernel: br_nf_pre_routing_finish+0x2c1/0x2ec [br_netfilter]
    Nov 29 18:53:06 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:53:06 littleboy kernel: ? NF_HOOK.isra.0+0xe4/0x140 [br_netfilter]
    Nov 29 18:53:06 littleboy kernel: ? br_nf_hook_thresh+0x109/0x109 [br_netfilter]
    Nov 29 18:53:06 littleboy kernel: br_nf_pre_routing+0x236/0x24a [br_netfilter]
    Nov 29 18:53:06 littleboy kernel: ? br_nf_hook_thresh+0x109/0x109 [br_netfilter]
    Nov 29 18:53:06 littleboy kernel: br_handle_frame+0x277/0x2e0 [bridge]
    Nov 29 18:53:06 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:53:06 littleboy kernel: __netif_receive_skb_core.constprop.0+0x4fa/0x6e9
    Nov 29 18:53:06 littleboy kernel: ? se_is_idle+0x16/0x34
    Nov 29 18:53:06 littleboy kernel: ? place_entity+0x6e/0xae
    Nov 29 18:53:06 littleboy kernel: __netif_receive_skb_one_core+0x40/0x9c
    Nov 29 18:53:06 littleboy kernel: process_backlog+0x8c/0x116
    Nov 29 18:53:06 littleboy kernel: __napi_poll.constprop.0+0x28/0x124
    Nov 29 18:53:06 littleboy kernel: net_rx_action+0x159/0x24f
    Nov 29 18:53:06 littleboy kernel: __do_softirq+0x126/0x288
    Nov 29 18:53:06 littleboy kernel: do_softirq+0x7f/0xab
    Nov 29 18:53:06 littleboy kernel: </IRQ>
    Nov 29 18:53:06 littleboy kernel: <TASK>
    Nov 29 18:53:06 littleboy kernel: __local_bh_enable_ip+0x4c/0x6b
    Nov 29 18:53:06 littleboy kernel: ip_finish_output2+0x36a/0x39d
    Nov 29 18:53:06 littleboy kernel: __ip_queue_xmit+0x2d8/0x31f
    Nov 29 18:53:06 littleboy kernel: __tcp_transmit_skb+0x841/0x8b1
    Nov 29 18:53:06 littleboy kernel: tcp_connect+0x7e4/0x86f
    Nov 29 18:53:06 littleboy kernel: tcp_v4_connect+0x41a/0x47d
    Nov 29 18:53:06 littleboy kernel: __inet_stream_connect+0xdd/0x314
    Nov 29 18:53:06 littleboy kernel: ? percpu_counter_add_batch+0x85/0xa2
    Nov 29 18:53:06 littleboy kernel: inet_stream_connect+0x39/0x52
    Nov 29 18:53:06 littleboy kernel: __sys_connect+0x68/0xa7
    Nov 29 18:53:06 littleboy kernel: __x64_sys_connect+0x14/0x1b
    Nov 29 18:53:06 littleboy kernel: do_syscall_64+0x68/0x81
    Nov 29 18:53:06 littleboy kernel: entry_SYSCALL_64_after_hwframe+0x64/0xce
    Nov 29 18:53:06 littleboy kernel: RIP: 0033:0x1457b313d59b
    Nov 29 18:53:06 littleboy kernel: Code: 83 ec 18 89 54 24 0c 48 89 34 24 89 7c 24 08 e8 bb fa ff ff 8b 54 24 0c 48 8b 34 24 41 89 c0 8b 7c 24 08 b8 2a 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 2f 44 89 c7 89 44 24 08 e8 f1 fa ff ff 8b 44
    Nov 29 18:53:06 littleboy kernel: RSP: 002b:00007ffe60b9dec0 EFLAGS: 00000293 ORIG_RAX: 000000000000002a
    Nov 29 18:53:06 littleboy kernel: RAX: ffffffffffffffda RBX: 0000000005b380a0 RCX: 00001457b313d59b
    Nov 29 18:53:06 littleboy kernel: RDX: 0000000000000010 RSI: 00007ffe60b9df50 RDI: 00000000000002d0
    Nov 29 18:53:06 littleboy kernel: RBP: 00007ffe60b9df20 R08: 0000000000000000 R09: 000000000714c230
    Nov 29 18:53:06 littleboy kernel: R10: 0000000000000f84 R11: 0000000000000293 R12: 000000000714c288
    Nov 29 18:53:06 littleboy kernel: R13: 00007ffe60b9df50 R14: 0000000000000010 R15: 00001457b2f336a0
    Nov 29 18:53:06 littleboy kernel: </TASK>
    Nov 29 18:53:44 littleboy kernel: rcu: INFO: rcu_preempt self-detected stall on CPU
    Nov 29 18:53:44 littleboy kernel: rcu: 	2-....: (1 GPs behind) idle=14dc/1/0x4000000000000000 softirq=9300215/9300216 fqs=21807
    Nov 29 18:53:44 littleboy kernel: (t=60001 jiffies g=36305665 q=1727860 ncpus=88)
    Nov 29 18:53:44 littleboy kernel: CPU: 2 PID: 850 Comm: npm install Tainted: P        W  O       6.1.49-Unraid #1
    Nov 29 18:53:44 littleboy kernel: Hardware name: VxRack AS PowerEdge R740xd/0RR8YK, BIOS 2.19.1 06/04/2023
    Nov 29 18:53:44 littleboy kernel: RIP: 0010:nf_nat_setup_info+0x157/0x7d1 [nf_nat]
    Nov 29 18:53:44 littleboy kernel: Code: 00 00 89 c0 48 8d 04 c2 4c 8b 30 4d 85 f6 74 2a 49 81 ee 90 00 00 00 eb 21 8a 44 24 46 41 38 46 46 74 21 49 8b 96 90 00 00 00 <48> 85 d2 0f 84 56 ff ff ff 4c 8d b2 70 ff ff ff 4d 85 f6 75 da e9
    Nov 29 18:53:44 littleboy kernel: RSP: 0018:ffffc900089fc738 EFLAGS: 00000212
    Nov 29 18:53:44 littleboy kernel: RAX: ffff88a106958e06 RBX: ffff888e5d6a1000 RCX: a706ed18065b4908
    Nov 29 18:53:44 littleboy kernel: RDX: ffff8881eda97890 RSI: 26cbe6897865622e RDI: 2a87b77939a0cc9d
    Nov 29 18:53:44 littleboy kernel: RBP: ffffc900089fc800 R08: 6f84c2f0878e2f7a R09: dcf3e2ac25213978
    Nov 29 18:53:44 littleboy kernel: R10: a3df108aaba40bc7 R11: ffffc900089fc710 R12: ffffc900089fc814
    Nov 29 18:53:44 littleboy kernel: R13: 0000000000000000 R14: ffff8881eda97800 R15: ffffffff82a11d00
    Nov 29 18:53:44 littleboy kernel: FS:  00001457b2f33800(0000) GS:ffff889fff640000(0000) knlGS:0000000000000000
    Nov 29 18:53:44 littleboy kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
    Nov 29 18:53:44 littleboy kernel: CR2: 0000000008b3e000 CR3: 000000267aee6003 CR4: 00000000007706e0
    Nov 29 18:53:44 littleboy kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
    Nov 29 18:53:44 littleboy kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
    Nov 29 18:53:44 littleboy kernel: PKRU: 55555554
    Nov 29 18:53:44 littleboy kernel: Call Trace:
    Nov 29 18:53:44 littleboy kernel: <IRQ>
    Nov 29 18:53:44 littleboy kernel: ? rcu_dump_cpu_stacks+0x95/0xb9
    Nov 29 18:53:44 littleboy kernel: ? rcu_sched_clock_irq+0x337/0xa37
    Nov 29 18:53:44 littleboy kernel: ? cgroup_rstat_updated+0x21/0xa5
    Nov 29 18:53:44 littleboy kernel: ? tick_init_jiffy_update+0x7c/0x7c
    Nov 29 18:53:44 littleboy kernel: ? update_process_times+0x62/0x81
    Nov 29 18:53:44 littleboy kernel: ? tick_sched_timer+0x43/0x71
    Nov 29 18:53:44 littleboy kernel: ? __hrtimer_run_queues+0xe8/0x190
    Nov 29 18:53:44 littleboy kernel: ? hrtimer_interrupt+0x9c/0x16e
    Nov 29 18:53:44 littleboy kernel: ? __sysvec_apic_timer_interrupt+0xc2/0x12f
    Nov 29 18:53:44 littleboy kernel: ? sysvec_apic_timer_interrupt+0x27/0xa6
    Nov 29 18:53:44 littleboy kernel: ? asm_sysvec_apic_timer_interrupt+0x16/0x20
    Nov 29 18:53:44 littleboy kernel: ? nf_nat_setup_info+0x157/0x7d1 [nf_nat]
    Nov 29 18:53:44 littleboy kernel: ? nf_nat_setup_info+0x128/0x7d1 [nf_nat]
    Nov 29 18:53:44 littleboy kernel: ? krealloc+0x82/0x93
    Nov 29 18:53:44 littleboy kernel: nf_nat_masquerade_ipv4+0x114/0x13c [nf_nat]
    Nov 29 18:53:44 littleboy kernel: masquerade_tg+0x48/0x66 [xt_MASQUERADE]
    Nov 29 18:53:44 littleboy kernel: ipt_do_table+0x51b/0x5bf [ip_tables]
    Nov 29 18:53:44 littleboy kernel: ? fib_validate_source+0xce/0xdf
    Nov 29 18:53:44 littleboy kernel: nf_nat_inet_fn+0x123/0x1a8 [nf_nat]
    Nov 29 18:53:44 littleboy kernel: nf_nat_ipv4_out+0x15/0x91 [nf_nat]
    Nov 29 18:53:44 littleboy kernel: nf_hook_slow+0x3a/0x96
    Nov 29 18:53:44 littleboy kernel: ? __ip_finish_output+0x144/0x144
    Nov 29 18:53:44 littleboy kernel: nf_hook+0xdf/0x110
    Nov 29 18:53:44 littleboy kernel: ? dev_ethtool+0x7c0/0x2349
    Nov 29 18:53:44 littleboy kernel: ? __ip_finish_output+0x144/0x144
    Nov 29 18:53:44 littleboy kernel: ip_output+0x78/0x88
    Nov 29 18:53:44 littleboy kernel: ? __ip_finish_output+0x144/0x144
    Nov 29 18:53:44 littleboy kernel: ip_sabotage_in+0x4f/0x60 [br_netfilter]
    Nov 29 18:53:44 littleboy kernel: nf_hook_slow+0x3a/0x96
    Nov 29 18:53:44 littleboy kernel: ? ip_rcv_finish_core.constprop.0+0x3e8/0x3e8
    Nov 29 18:53:44 littleboy kernel: NF_HOOK.constprop.0+0x79/0xd9
    Nov 29 18:53:44 littleboy kernel: ? ip_rcv_finish_core.constprop.0+0x3e8/0x3e8
    Nov 29 18:53:44 littleboy kernel: __netif_receive_skb_one_core+0x77/0x9c
    Nov 29 18:53:44 littleboy kernel: netif_receive_skb+0xbf/0x127
    Nov 29 18:53:44 littleboy kernel: br_handle_frame_finish+0x438/0x472 [bridge]
    Nov 29 18:53:44 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:53:44 littleboy kernel: br_nf_hook_thresh+0xe2/0x109 [br_netfilter]
    Nov 29 18:53:44 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:53:44 littleboy kernel: br_nf_pre_routing_finish+0x2c1/0x2ec [br_netfilter]
    Nov 29 18:53:44 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:53:44 littleboy kernel: ? NF_HOOK.isra.0+0xe4/0x140 [br_netfilter]
    Nov 29 18:53:44 littleboy kernel: ? br_nf_hook_thresh+0x109/0x109 [br_netfilter]
    Nov 29 18:53:44 littleboy kernel: br_nf_pre_routing+0x236/0x24a [br_netfilter]
    Nov 29 18:53:44 littleboy kernel: ? br_nf_hook_thresh+0x109/0x109 [br_netfilter]
    Nov 29 18:53:44 littleboy kernel: br_handle_frame+0x277/0x2e0 [bridge]
    Nov 29 18:53:44 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:53:44 littleboy kernel: __netif_receive_skb_core.constprop.0+0x4fa/0x6e9
    Nov 29 18:53:44 littleboy kernel: ? se_is_idle+0x16/0x34
    Nov 29 18:53:44 littleboy kernel: ? place_entity+0x6e/0xae
    Nov 29 18:53:44 littleboy kernel: __netif_receive_skb_one_core+0x40/0x9c
    Nov 29 18:53:44 littleboy kernel: process_backlog+0x8c/0x116
    Nov 29 18:53:44 littleboy kernel: __napi_poll.constprop.0+0x28/0x124
    Nov 29 18:53:44 littleboy kernel: net_rx_action+0x159/0x24f
    Nov 29 18:53:44 littleboy kernel: __do_softirq+0x126/0x288
    Nov 29 18:53:44 littleboy kernel: do_softirq+0x7f/0xab
    Nov 29 18:53:44 littleboy kernel: </IRQ>
    Nov 29 18:53:44 littleboy kernel: <TASK>
    Nov 29 18:53:44 littleboy kernel: __local_bh_enable_ip+0x4c/0x6b
    Nov 29 18:53:44 littleboy kernel: ip_finish_output2+0x36a/0x39d
    Nov 29 18:53:44 littleboy kernel: __ip_queue_xmit+0x2d8/0x31f
    Nov 29 18:53:44 littleboy kernel: __tcp_transmit_skb+0x841/0x8b1
    Nov 29 18:53:44 littleboy kernel: tcp_connect+0x7e4/0x86f
    Nov 29 18:53:44 littleboy kernel: tcp_v4_connect+0x41a/0x47d
    Nov 29 18:53:44 littleboy kernel: __inet_stream_connect+0xdd/0x314
    Nov 29 18:53:44 littleboy kernel: ? percpu_counter_add_batch+0x85/0xa2
    Nov 29 18:53:44 littleboy kernel: inet_stream_connect+0x39/0x52
    Nov 29 18:53:44 littleboy kernel: __sys_connect+0x68/0xa7
    Nov 29 18:53:44 littleboy kernel: __x64_sys_connect+0x14/0x1b
    Nov 29 18:53:44 littleboy kernel: do_syscall_64+0x68/0x81
    Nov 29 18:53:44 littleboy kernel: entry_SYSCALL_64_after_hwframe+0x64/0xce
    Nov 29 18:53:44 littleboy kernel: RIP: 0033:0x1457b313d59b
    Nov 29 18:53:44 littleboy kernel: Code: 83 ec 18 89 54 24 0c 48 89 34 24 89 7c 24 08 e8 bb fa ff ff 8b 54 24 0c 48 8b 34 24 41 89 c0 8b 7c 24 08 b8 2a 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 2f 44 89 c7 89 44 24 08 e8 f1 fa ff ff 8b 44
    Nov 29 18:53:44 littleboy kernel: RSP: 002b:00007ffe60b9dec0 EFLAGS: 00000293 ORIG_RAX: 000000000000002a
    Nov 29 18:53:44 littleboy kernel: RAX: ffffffffffffffda RBX: 0000000005b380a0 RCX: 00001457b313d59b
    Nov 29 18:53:44 littleboy kernel: RDX: 0000000000000010 RSI: 00007ffe60b9df50 RDI: 00000000000002d0
    Nov 29 18:53:44 littleboy kernel: RBP: 00007ffe60b9df20 R08: 0000000000000000 R09: 000000000714c230
    Nov 29 18:53:44 littleboy kernel: R10: 0000000000000f84 R11: 0000000000000293 R12: 000000000714c288
    Nov 29 18:53:44 littleboy kernel: R13: 00007ffe60b9df50 R14: 0000000000000010 R15: 00001457b2f336a0
    Nov 29 18:53:44 littleboy kernel: </TASK>
    Nov 29 18:54:11 littleboy kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { 2-.... } 85655 jiffies s: 105445 root: 0x1/.
    Nov 29 18:54:11 littleboy kernel: rcu: blocking rcu_node structures (internal RCU debug): l=1:0-14:0x4/.
    Nov 29 18:54:11 littleboy kernel: Sending NMI from CPU 84 to CPUs 2:
    Nov 29 18:54:11 littleboy kernel: NMI backtrace for cpu 2
    Nov 29 18:54:11 littleboy kernel: CPU: 2 PID: 850 Comm: npm install Tainted: P        W  O       6.1.49-Unraid #1
    Nov 29 18:54:11 littleboy kernel: Hardware name: VxRack AS PowerEdge R740xd/0RR8YK, BIOS 2.19.1 06/04/2023
    Nov 29 18:54:11 littleboy kernel: RIP: 0010:nf_nat_setup_info+0x150/0x7d1 [nf_nat]
    Nov 29 18:54:11 littleboy kernel: Code: ff ff 48 8b 15 4a 6a 00 00 89 c0 48 8d 04 c2 4c 8b 30 4d 85 f6 74 2a 49 81 ee 90 00 00 00 eb 21 8a 44 24 46 41 38 46 46 74 21 <49> 8b 96 90 00 00 00 48 85 d2 0f 84 56 ff ff ff 4c 8d b2 70 ff ff
    Nov 29 18:54:11 littleboy kernel: RSP: 0018:ffffc900089fc738 EFLAGS: 00000212
    Nov 29 18:54:11 littleboy kernel: RAX: ffff88a106958e06 RBX: ffff888e5d6a1000 RCX: a706ed18065b4908
    Nov 29 18:54:11 littleboy kernel: RDX: ffff8881eda97890 RSI: 26cbe6897865622e RDI: 2a87b77939a0cc9d
    Nov 29 18:54:11 littleboy kernel: RBP: ffffc900089fc800 R08: 6f84c2f0878e2f7a R09: dcf3e2ac25213978
    Nov 29 18:54:11 littleboy kernel: R10: a3df108aaba40bc7 R11: ffffc900089fc710 R12: ffffc900089fc814
    Nov 29 18:54:11 littleboy kernel: R13: 0000000000000000 R14: ffff8881eda97800 R15: ffffffff82a11d00
    Nov 29 18:54:11 littleboy kernel: FS:  00001457b2f33800(0000) GS:ffff889fff640000(0000) knlGS:0000000000000000
    Nov 29 18:54:11 littleboy kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
    Nov 29 18:54:11 littleboy kernel: CR2: 0000000008b3e000 CR3: 000000267aee6003 CR4: 00000000007706e0
    Nov 29 18:54:11 littleboy kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
    Nov 29 18:54:11 littleboy kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
    Nov 29 18:54:11 littleboy kernel: PKRU: 55555554
    Nov 29 18:54:11 littleboy kernel: Call Trace:
    Nov 29 18:54:11 littleboy kernel: <NMI>
    Nov 29 18:54:11 littleboy kernel: ? nmi_cpu_backtrace+0xd3/0x104
    Nov 29 18:54:11 littleboy kernel: ? nmi_cpu_backtrace_handler+0xd/0x15
    Nov 29 18:54:11 littleboy kernel: ? nmi_handle+0x54/0x131
    Nov 29 18:54:11 littleboy kernel: ? nf_nat_setup_info+0x150/0x7d1 [nf_nat]
    Nov 29 18:54:11 littleboy kernel: ? default_do_nmi+0x66/0x15b
    Nov 29 18:54:11 littleboy kernel: ? exc_nmi+0xbf/0x130
    Nov 29 18:54:11 littleboy kernel: ? end_repeat_nmi+0x16/0x67
    Nov 29 18:54:11 littleboy kernel: ? nf_nat_setup_info+0x150/0x7d1 [nf_nat]
    Nov 29 18:54:11 littleboy kernel: ? nf_nat_setup_info+0x150/0x7d1 [nf_nat]
    Nov 29 18:54:11 littleboy kernel: ? nf_nat_setup_info+0x150/0x7d1 [nf_nat]
    Nov 29 18:54:11 littleboy kernel: </NMI>
    Nov 29 18:54:11 littleboy kernel: <IRQ>
    Nov 29 18:54:11 littleboy kernel: ? krealloc+0x82/0x93
    Nov 29 18:54:11 littleboy kernel: nf_nat_masquerade_ipv4+0x114/0x13c [nf_nat]
    Nov 29 18:54:11 littleboy kernel: masquerade_tg+0x48/0x66 [xt_MASQUERADE]
    Nov 29 18:54:11 littleboy kernel: ipt_do_table+0x51b/0x5bf [ip_tables]
    Nov 29 18:54:11 littleboy kernel: ? fib_validate_source+0xce/0xdf
    Nov 29 18:54:11 littleboy kernel: nf_nat_inet_fn+0x123/0x1a8 [nf_nat]
    Nov 29 18:54:11 littleboy kernel: nf_nat_ipv4_out+0x15/0x91 [nf_nat]
    Nov 29 18:54:11 littleboy kernel: nf_hook_slow+0x3a/0x96
    Nov 29 18:54:11 littleboy kernel: ? __ip_finish_output+0x144/0x144
    Nov 29 18:54:11 littleboy kernel: nf_hook+0xdf/0x110
    Nov 29 18:54:11 littleboy kernel: ? dev_ethtool+0x7c0/0x2349
    Nov 29 18:54:11 littleboy kernel: ? __ip_finish_output+0x144/0x144
    Nov 29 18:54:11 littleboy kernel: ip_output+0x78/0x88
    Nov 29 18:54:11 littleboy kernel: ? __ip_finish_output+0x144/0x144
    Nov 29 18:54:11 littleboy kernel: ip_sabotage_in+0x4f/0x60 [br_netfilter]
    Nov 29 18:54:11 littleboy kernel: nf_hook_slow+0x3a/0x96
    Nov 29 18:54:11 littleboy kernel: ? ip_rcv_finish_core.constprop.0+0x3e8/0x3e8
    Nov 29 18:54:11 littleboy kernel: NF_HOOK.constprop.0+0x79/0xd9
    Nov 29 18:54:11 littleboy kernel: ? ip_rcv_finish_core.constprop.0+0x3e8/0x3e8
    Nov 29 18:54:11 littleboy kernel: __netif_receive_skb_one_core+0x77/0x9c
    Nov 29 18:54:11 littleboy kernel: netif_receive_skb+0xbf/0x127
    Nov 29 18:54:11 littleboy kernel: br_handle_frame_finish+0x438/0x472 [bridge]
    Nov 29 18:54:11 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:54:11 littleboy kernel: br_nf_hook_thresh+0xe2/0x109 [br_netfilter]
    Nov 29 18:54:11 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:54:11 littleboy kernel: br_nf_pre_routing_finish+0x2c1/0x2ec [br_netfilter]
    Nov 29 18:54:11 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:54:11 littleboy kernel: ? NF_HOOK.isra.0+0xe4/0x140 [br_netfilter]
    Nov 29 18:54:11 littleboy kernel: ? br_nf_hook_thresh+0x109/0x109 [br_netfilter]
    Nov 29 18:54:11 littleboy kernel: br_nf_pre_routing+0x236/0x24a [br_netfilter]
    Nov 29 18:54:11 littleboy kernel: ? br_nf_hook_thresh+0x109/0x109 [br_netfilter]
    Nov 29 18:54:11 littleboy kernel: br_handle_frame+0x277/0x2e0 [bridge]
    Nov 29 18:54:11 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:54:11 littleboy kernel: __netif_receive_skb_core.constprop.0+0x4fa/0x6e9
    Nov 29 18:54:11 littleboy kernel: ? se_is_idle+0x16/0x34
    Nov 29 18:54:11 littleboy kernel: ? place_entity+0x6e/0xae
    Nov 29 18:54:11 littleboy kernel: __netif_receive_skb_one_core+0x40/0x9c
    Nov 29 18:54:11 littleboy kernel: process_backlog+0x8c/0x116
    Nov 29 18:54:11 littleboy kernel: __napi_poll.constprop.0+0x28/0x124
    Nov 29 18:54:11 littleboy kernel: net_rx_action+0x159/0x24f
    Nov 29 18:54:11 littleboy kernel: __do_softirq+0x126/0x288
    Nov 29 18:54:11 littleboy kernel: do_softirq+0x7f/0xab
    Nov 29 18:54:11 littleboy kernel: </IRQ>
    Nov 29 18:54:11 littleboy kernel: <TASK>
    Nov 29 18:54:11 littleboy kernel: __local_bh_enable_ip+0x4c/0x6b
    Nov 29 18:54:11 littleboy kernel: ip_finish_output2+0x36a/0x39d
    Nov 29 18:54:11 littleboy kernel: __ip_queue_xmit+0x2d8/0x31f
    Nov 29 18:54:11 littleboy kernel: __tcp_transmit_skb+0x841/0x8b1
    Nov 29 18:54:11 littleboy kernel: tcp_connect+0x7e4/0x86f
    Nov 29 18:54:11 littleboy kernel: tcp_v4_connect+0x41a/0x47d
    Nov 29 18:54:11 littleboy kernel: __inet_stream_connect+0xdd/0x314
    Nov 29 18:54:11 littleboy kernel: ? percpu_counter_add_batch+0x85/0xa2
    Nov 29 18:54:11 littleboy kernel: inet_stream_connect+0x39/0x52
    Nov 29 18:54:11 littleboy kernel: __sys_connect+0x68/0xa7
    Nov 29 18:54:11 littleboy kernel: __x64_sys_connect+0x14/0x1b
    Nov 29 18:54:11 littleboy kernel: do_syscall_64+0x68/0x81
    Nov 29 18:54:11 littleboy kernel: entry_SYSCALL_64_after_hwframe+0x64/0xce
    Nov 29 18:54:11 littleboy kernel: RIP: 0033:0x1457b313d59b
    Nov 29 18:54:11 littleboy kernel: Code: 83 ec 18 89 54 24 0c 48 89 34 24 89 7c 24 08 e8 bb fa ff ff 8b 54 24 0c 48 8b 34 24 41 89 c0 8b 7c 24 08 b8 2a 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 2f 44 89 c7 89 44 24 08 e8 f1 fa ff ff 8b 44
    Nov 29 18:54:11 littleboy kernel: RSP: 002b:00007ffe60b9dec0 EFLAGS: 00000293 ORIG_RAX: 000000000000002a
    Nov 29 18:54:11 littleboy kernel: RAX: ffffffffffffffda RBX: 0000000005b380a0 RCX: 00001457b313d59b
    Nov 29 18:54:11 littleboy kernel: RDX: 0000000000000010 RSI: 00007ffe60b9df50 RDI: 00000000000002d0
    Nov 29 18:54:11 littleboy kernel: RBP: 00007ffe60b9df20 R08: 0000000000000000 R09: 000000000714c230
    Nov 29 18:54:11 littleboy kernel: R10: 0000000000000f84 R11: 0000000000000293 R12: 000000000714c288
    Nov 29 18:54:11 littleboy kernel: R13: 00007ffe60b9df50 R14: 0000000000000010 R15: 00001457b2f336a0
    Nov 29 18:54:11 littleboy kernel: </TASK>
    Nov 29 18:55:16 littleboy kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { 2-.... } 151192 jiffies s: 105445 root: 0x1/.
    Nov 29 18:55:16 littleboy kernel: rcu: blocking rcu_node structures (internal RCU debug): l=1:0-14:0x4/.
    Nov 29 18:55:16 littleboy kernel: Sending NMI from CPU 84 to CPUs 2:
    Nov 29 18:55:16 littleboy kernel: NMI backtrace for cpu 2
    Nov 29 18:55:16 littleboy kernel: CPU: 2 PID: 850 Comm: npm install Tainted: P        W  O       6.1.49-Unraid #1
    Nov 29 18:55:16 littleboy kernel: Hardware name: VxRack AS PowerEdge R740xd/0RR8YK, BIOS 2.19.1 06/04/2023
    Nov 29 18:55:16 littleboy kernel: RIP: 0010:nf_nat_setup_info+0x150/0x7d1 [nf_nat]
    Nov 29 18:55:16 littleboy kernel: Code: ff ff 48 8b 15 4a 6a 00 00 89 c0 48 8d 04 c2 4c 8b 30 4d 85 f6 74 2a 49 81 ee 90 00 00 00 eb 21 8a 44 24 46 41 38 46 46 74 21 <49> 8b 96 90 00 00 00 48 85 d2 0f 84 56 ff ff ff 4c 8d b2 70 ff ff
    Nov 29 18:55:16 littleboy kernel: RSP: 0018:ffffc900089fc738 EFLAGS: 00000212
    Nov 29 18:55:16 littleboy kernel: RAX: ffff88a106958e06 RBX: ffff888e5d6a1000 RCX: a706ed18065b4908
    Nov 29 18:55:16 littleboy kernel: RDX: ffff8881eda97890 RSI: 26cbe6897865622e RDI: 2a87b77939a0cc9d
    Nov 29 18:55:16 littleboy kernel: RBP: ffffc900089fc800 R08: 6f84c2f0878e2f7a R09: dcf3e2ac25213978
    Nov 29 18:55:16 littleboy kernel: R10: a3df108aaba40bc7 R11: ffffc900089fc710 R12: ffffc900089fc814
    Nov 29 18:55:16 littleboy kernel: R13: 0000000000000000 R14: ffff8881eda97800 R15: ffffffff82a11d00
    Nov 29 18:55:16 littleboy kernel: FS:  00001457b2f33800(0000) GS:ffff889fff640000(0000) knlGS:0000000000000000
    Nov 29 18:55:16 littleboy kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
    Nov 29 18:55:16 littleboy kernel: CR2: 0000000008b3e000 CR3: 000000267aee6003 CR4: 00000000007706e0
    Nov 29 18:55:16 littleboy kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
    Nov 29 18:55:16 littleboy kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
    Nov 29 18:55:16 littleboy kernel: PKRU: 55555554
    Nov 29 18:55:16 littleboy kernel: Call Trace:
    Nov 29 18:55:16 littleboy kernel: <NMI>
    Nov 29 18:55:16 littleboy kernel: ? nmi_cpu_backtrace+0xd3/0x104
    Nov 29 18:55:16 littleboy kernel: ? nmi_cpu_backtrace_handler+0xd/0x15
    Nov 29 18:55:16 littleboy kernel: ? nmi_handle+0x54/0x131
    Nov 29 18:55:16 littleboy kernel: ? nf_nat_setup_info+0x150/0x7d1 [nf_nat]
    Nov 29 18:55:16 littleboy kernel: ? default_do_nmi+0x66/0x15b
    Nov 29 18:55:16 littleboy kernel: ? exc_nmi+0xbf/0x130
    Nov 29 18:55:16 littleboy kernel: ? end_repeat_nmi+0x16/0x67
    Nov 29 18:55:16 littleboy kernel: ? nf_nat_setup_info+0x150/0x7d1 [nf_nat]
    Nov 29 18:55:16 littleboy kernel: ? nf_nat_setup_info+0x150/0x7d1 [nf_nat]
    Nov 29 18:55:16 littleboy kernel: ? nf_nat_setup_info+0x150/0x7d1 [nf_nat]
    Nov 29 18:55:16 littleboy kernel: </NMI>
    Nov 29 18:55:16 littleboy kernel: <IRQ>
    Nov 29 18:55:16 littleboy kernel: ? krealloc+0x82/0x93
    Nov 29 18:55:16 littleboy kernel: nf_nat_masquerade_ipv4+0x114/0x13c [nf_nat]
    Nov 29 18:55:16 littleboy kernel: masquerade_tg+0x48/0x66 [xt_MASQUERADE]
    Nov 29 18:55:16 littleboy kernel: ipt_do_table+0x51b/0x5bf [ip_tables]
    Nov 29 18:55:16 littleboy kernel: ? fib_validate_source+0xce/0xdf
    Nov 29 18:55:16 littleboy kernel: nf_nat_inet_fn+0x123/0x1a8 [nf_nat]
    Nov 29 18:55:16 littleboy kernel: nf_nat_ipv4_out+0x15/0x91 [nf_nat]
    Nov 29 18:55:16 littleboy kernel: nf_hook_slow+0x3a/0x96
    Nov 29 18:55:16 littleboy kernel: ? __ip_finish_output+0x144/0x144
    Nov 29 18:55:16 littleboy kernel: nf_hook+0xdf/0x110
    Nov 29 18:55:16 littleboy kernel: ? dev_ethtool+0x7c0/0x2349
    Nov 29 18:55:16 littleboy kernel: ? __ip_finish_output+0x144/0x144
    Nov 29 18:55:16 littleboy kernel: ip_output+0x78/0x88
    Nov 29 18:55:16 littleboy kernel: ? __ip_finish_output+0x144/0x144
    Nov 29 18:55:16 littleboy kernel: ip_sabotage_in+0x4f/0x60 [br_netfilter]
    Nov 29 18:55:16 littleboy kernel: nf_hook_slow+0x3a/0x96
    Nov 29 18:55:16 littleboy kernel: ? ip_rcv_finish_core.constprop.0+0x3e8/0x3e8
    Nov 29 18:55:16 littleboy kernel: NF_HOOK.constprop.0+0x79/0xd9
    Nov 29 18:55:16 littleboy kernel: ? ip_rcv_finish_core.constprop.0+0x3e8/0x3e8
    Nov 29 18:55:16 littleboy kernel: __netif_receive_skb_one_core+0x77/0x9c
    Nov 29 18:55:16 littleboy kernel: netif_receive_skb+0xbf/0x127
    Nov 29 18:55:16 littleboy kernel: br_handle_frame_finish+0x438/0x472 [bridge]
    Nov 29 18:55:16 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:55:16 littleboy kernel: br_nf_hook_thresh+0xe2/0x109 [br_netfilter]
    Nov 29 18:55:16 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:55:16 littleboy kernel: br_nf_pre_routing_finish+0x2c1/0x2ec [br_netfilter]
    Nov 29 18:55:16 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:55:16 littleboy kernel: ? NF_HOOK.isra.0+0xe4/0x140 [br_netfilter]
    Nov 29 18:55:16 littleboy kernel: ? br_nf_hook_thresh+0x109/0x109 [br_netfilter]
    Nov 29 18:55:16 littleboy kernel: br_nf_pre_routing+0x236/0x24a [br_netfilter]
    Nov 29 18:55:16 littleboy kernel: ? br_nf_hook_thresh+0x109/0x109 [br_netfilter]
    Nov 29 18:55:16 littleboy kernel: br_handle_frame+0x277/0x2e0 [bridge]
    Nov 29 18:55:16 littleboy kernel: ? br_pass_frame_up+0xdd/0xdd [bridge]
    Nov 29 18:55:16 littleboy kernel: __netif_receive_skb_core.constprop.0+0x4fa/0x6e9
    Nov 29 18:55:16 littleboy kernel: ? se_is_idle+0x16/0x34
    Nov 29 18:55:16 littleboy kernel: ? place_entity+0x6e/0xae
    Nov 29 18:55:16 littleboy kernel: __netif_receive_skb_one_core+0x40/0x9c
    Nov 29 18:55:16 littleboy kernel: process_backlog+0x8c/0x116
    Nov 29 18:55:16 littleboy kernel: __napi_poll.constprop.0+0x28/0x124
    Nov 29 18:55:16 littleboy kernel: net_rx_action+0x159/0x24f
    Nov 29 18:55:16 littleboy kernel: __do_softirq+0x126/0x288
    Nov 29 18:55:16 littleboy kernel: do_softirq+0x7f/0xab
    Nov 29 18:55:16 littleboy kernel: </IRQ>
    Nov 29 18:55:16 littleboy kernel: <TASK>
    Nov 29 18:55:16 littleboy kernel: __local_bh_enable_ip+0x4c/0x6b
    Nov 29 18:55:16 littleboy kernel: ip_finish_output2+0x36a/0x39d
    Nov 29 18:55:16 littleboy kernel: __ip_queue_xmit+0x2d8/0x31f
    Nov 29 18:55:16 littleboy kernel: __tcp_transmit_skb+0x841/0x8b1
    Nov 29 18:55:16 littleboy kernel: tcp_connect+0x7e4/0x86f
    Nov 29 18:55:16 littleboy kernel: tcp_v4_connect+0x41a/0x47d
    Nov 29 18:55:16 littleboy kernel: __inet_stream_connect+0xdd/0x314
    Nov 29 18:55:16 littleboy kernel: ? percpu_counter_add_batch+0x85/0xa2
    Nov 29 18:55:16 littleboy kernel: inet_stream_connect+0x39/0x52
    Nov 29 18:55:16 littleboy kernel: __sys_connect+0x68/0xa7
    Nov 29 18:55:16 littleboy kernel: __x64_sys_connect+0x14/0x1b
    Nov 29 18:55:16 littleboy kernel: do_syscall_64+0x68/0x81
    Nov 29 18:55:16 littleboy kernel: entry_SYSCALL_64_after_hwframe+0x64/0xce
    Nov 29 18:55:16 littleboy kernel: RIP: 0033:0x1457b313d59b
    Nov 29 18:55:16 littleboy kernel: Code: 83 ec 18 89 54 24 0c 48 89 34 24 89 7c 24 08 e8 bb fa ff ff 8b 54 24 0c 48 8b 34 24 41 89 c0 8b 7c 24 08 b8 2a 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 2f 44 89 c7 89 44 24 08 e8 f1 fa ff ff 8b 44
    Nov 29 18:55:16 littleboy kernel: RSP: 002b:00007ffe60b9dec0 EFLAGS: 00000293 ORIG_RAX: 000000000000002a
    Nov 29 18:55:16 littleboy kernel: RAX: ffffffffffffffda RBX: 0000000005b380a0 RCX: 00001457b313d59b
    Nov 29 18:55:16 littleboy kernel: RDX: 0000000000000010 RSI: 00007ffe60b9df50 RDI: 00000000000002d0
    Nov 29 18:55:16 littleboy kernel: RBP: 00007ffe60b9df20 R08: 0000000000000000 R09: 000000000714c230
    Nov 29 18:55:16 littleboy kernel: R10: 0000000000000f84 R11: 0000000000000293 R12: 000000000714c288
    Nov 29 18:55:16 littleboy kernel: R13: 00007ffe60b9df50 R14: 0000000000000010 R15: 00001457b2f336a0
    Nov 29 18:55:16 littleboy kernel: </TASK>
    client_loop: send disconnect: Broken pipe

     

    Link to comment
    5 minutes ago, skler said:

    I have the same kernel panic

    If you don't need macvlan change the docker network to ipvlan, if you need macvlan make sure you are on 6.12.4 or newer and disable bridging for eth0, more info on the release notes.

    Link to comment
    5 hours ago, JorgeB said:

    If you don't need macvlan change the docker network to ipvlan, if you need macvlan make sure you are on 6.12.4 or newer and disable bridging for eth0, more info on the release notes.

    I can do both things. Let me try, I keep you posted and thanks for reply 

    Edited by skler
    Link to comment
    7 hours ago, JorgeB said:

    If you don't need macvlan change the docker network to ipvlan, if you need macvlan make sure you are on 6.12.4 or newer and disable bridging for eth0, more info on the release notes.

     

    So this is now the network configuration (bridging no):

    97132142_Screenshot2023-11-30at01_25_39.thumb.png.560c039cfcf3458349366dba4ae7cad7.png

     

    In Docker settings (also in advanced mode) I can't find the selection from macvlan / ipvlan, but I have "Host Access" active (that is on macvlan I guess): 

     

    1279730127_Screenshot2023-11-30at01_35_15.thumb.png.06b1519666f68f4eebb68ac8cdcb5263.png

     

    But I can't see anymore the "shim-br0" interface (that was causing to have two mac addresses on the same ip)

     

    root@littleboy:~# ifconfig shim-br0
    shim-br0: error fetching interface information: Device not found

     

     

     

    Link to comment
    6 hours ago, skler said:

    In Docker settings (also in advanced mode) I can't find the selection from macvlan / ipvlan, but I have "Host Access" active (that is on macvlan I guess): 

    Correct, if you update to v6.12.5 you'll see both, but only macvlan is available with bridging disabled. 

    Link to comment

    @JorgeB Hi, i Changed everything like the Release Notes says for MACVLAN Setup (Need to do this, couse i am a German FritzBox user).. i set up everything correctly 

     

    Like This: 

     

    Settings > Network Settings > eth0 > Enable Bridging = No  <-- Done

    Settings > Docker > Host access to custom networks = Enabled <-- Done

     

    If your Docker containers with custom IPs are not starting, edit them and change the "Network type" to "Custom: eth0". We attempted to do this automatically, but depending on how things were customized you may need to do it manually. <-- Checkt and Done

     

    if your VMs are having network issues, edit them and set the Network Source to "vhost0". Also, ensure there is a MAC address assigned. <-- Checkt and Done

     

    Could u Please Check my Syslog if this ist still a MACVLAN Problem? or maybe its something else? Becouse after Changing Settings, it Crashed again. 

     

     

    syslog Absturz2

     

    Link to comment
    2 hours ago, eLpresidente said:

    Could u Please Check my Syslog if this ist still a MACVLAN Problem? or maybe its something else? Becouse after Changing Settings, it Crashed again. 

    You are having NIC issues, it's getting detached:

     

    Nov 30 00:57:55 stevenas kernel: igc 0000:04:00.0 eth0: PCIe link lost, device now detached

     

    Link to comment
    1 minute ago, JorgeB said:

    You are having NIC issues, it's getting detached:

     

    Nov 30 00:57:55 stevenas kernel: igc 0000:04:00.0 eth0: PCIe link lost, device now detached

     

    oh okey i see.. any hint what i have to looking for? 

    I now relativ hard to say, but maybe u have solved an issue that was similar to this..

     

    Thanks 

    Link to comment
    3 hours ago, eLpresidente said:

    I now relativ hard to say, but maybe u have solved an issue that was similar to this..

    That looks more like a hardware issue, if that's an addon NIC try a different PCIe slot, if it's onboard try with an addon NIC if possible.

     

     

    Link to comment
    27 minutes ago, JorgeB said:

    That looks more like a hardware issue, if that's and addon NIC try a different PCIe slot, if it's onboard try with an addon NIC if possible.

    oh okey, that doesn't sound promissing.. its onboard NIC Intel "I266" if i am right..  and no more room for addon NIC.. damn.. 

    Link to comment



    Join the conversation

    You can post now and register later. If you have an account, sign in now to post with your account.
    Note: Your post will require moderator approval before it will be visible.

    Guest
    Add a comment...

    ×   Pasted as rich text.   Restore formatting

      Only 75 emoji are allowed.

    ×   Your link has been automatically embedded.   Display as a link instead

    ×   Your previous content has been restored.   Clear editor

    ×   You cannot paste images directly. Upload or insert images from URL.


  • Status Definitions

     

    Open = Under consideration.

     

    Solved = The issue has been resolved.

     

    Solved version = The issue has been resolved in the indicated release version.

     

    Closed = Feedback or opinion better posted on our forum for discussion. Also for reports we cannot reproduce or need more information. In this case just add a comment and we will review it again.

     

    Retest = Please retest in latest release.


    Priority Definitions

     

    Minor = Something not working correctly.

     

    Urgent = Server crash, data loss, or other showstopper.

     

    Annoyance = Doesn't affect functionality but should be fixed.

     

    Other = Announcement or other non-issue.