Jump to content

After upgrading CPU + Adding new Pool, Unraid hangs every ~3hrs

Flight777

By Flight777
in General Support

Recommended Posts

Flight777 Noob

Flight777

Posted
Posted

Hi all,

After my Unraid has been stable for years, I've down some upgrades the last couple of days:

  • Added new 12tb HDD as parity drive
  • Swapped i3 10105 for I5 11600K
  • I still had a nvme drive laying around so I created an additional pool for anything not important that needs fast speeds.

 

However, over the last 24hrs I had multiple occassions where Unraid suddenly just hangs and does not respond. Only a technical reboot :P (disrupt power) gets it back. The only other circumstance is that parity correcting check was running.

Anyone can help me analyse what is going on?

 

Below is a snippet of the syslog, at 02:04 is the moment it stopped responding basically until 09 the next morning when I realized and reset.

  

Aug 10 01:49:58 LS15mainframe kernel: BUG: kernel NULL pointer dereference, address: 0000000000000630
Aug 10 01:49:58 LS15mainframe kernel: #PF: supervisor read access in kernel mode
Aug 10 01:49:58 LS15mainframe kernel: #PF: error_code(0x0000) - not-present page
Aug 10 01:49:58 LS15mainframe kernel: PGD d61ff8067 P4D d61ff8067 PUD d3b8b5067 PMD 0 
Aug 10 01:49:58 LS15mainframe kernel: Oops: 0000 [#1] PREEMPT SMP NOPTI
Aug 10 01:49:58 LS15mainframe kernel: CPU: 7 PID: 8739 Comm: docker-compose Tainted: P           O       6.1.99-Unraid #1
Aug 10 01:49:58 LS15mainframe kernel: Hardware name: Micro-Star International Co., Ltd. MS-7C80/MAG Z490 TOMAHAWK (MS-7C80), BIOS 1.C0 06/11/2022
Aug 10 01:49:58 LS15mainframe kernel: RIP: 0010:mem_cgroup_lruvec+0x35/0x4c
Aug 10 01:49:58 LS15mainframe kernel: Code: ff ff 84 c0 74 09 48 8d 83 80 4b 00 00 eb 1b 48 85 ed 75 07 48 8b 2d 02 b2 17 01 48 63 83 00 4a 00 00 48 8b 84 c5 50 08 00 00 <48> 39 98 30 06 00 00 74 07 48 89 98 30 06 00 00 5b 5d c3 cc cc cc
Aug 10 01:49:58 LS15mainframe kernel: RSP: 0018:ffffc900028b7a88 EFLAGS: 00010286
Aug 10 01:49:58 LS15mainframe kernel: RAX: 0000000000000000 RBX: ffff8890807f8000 RCX: ffffea0006074e80
Aug 10 01:49:58 LS15mainframe kernel: RDX: ffffea0006074e08 RSI: ffff8890807f8000 RDI: ffff8885001a2000
Aug 10 01:49:58 LS15mainframe kernel: RBP: ffff8885001a2000 R08: ffff8890403f2c40 R09: ffff8890403f2c58
Aug 10 01:49:58 LS15mainframe kernel: R10: 0000000000000000 R11: ffff888d583e5408 R12: ffff8890807f8000
Aug 10 01:49:58 LS15mainframe kernel: R13: ffffea0006074e80 R14: 0000000000000000 R15: ffff888ba19da750
Aug 10 01:49:58 LS15mainframe kernel: FS:  0000000000000000(0000) GS:ffff8890403c0000(0000) knlGS:0000000000000000
Aug 10 01:49:58 LS15mainframe kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Aug 10 01:49:58 LS15mainframe kernel: CR2: 0000000000000630 CR3: 0000000d55bf4005 CR4: 0000000000772ee0
Aug 10 01:49:58 LS15mainframe kernel: PKRU: 55555554
Aug 10 01:49:58 LS15mainframe kernel: Call Trace:
Aug 10 01:49:58 LS15mainframe kernel: <TASK>
Aug 10 01:49:58 LS15mainframe kernel: ? __die_body+0x1a/0x5c
Aug 10 01:49:58 LS15mainframe kernel: ? page_fault_oops+0x329/0x376
Aug 10 01:49:58 LS15mainframe kernel: ? do_user_addr_fault+0x12e/0x465
Aug 10 01:49:58 LS15mainframe kernel: ? exc_page_fault+0xfb/0x11d
Aug 10 01:49:58 LS15mainframe kernel: ? asm_exc_page_fault+0x22/0x30
Aug 10 01:49:58 LS15mainframe kernel: ? mem_cgroup_lruvec+0x35/0x4c
Aug 10 01:49:58 LS15mainframe kernel: ? mem_cgroup_lruvec+0xd/0x4c
Aug 10 01:49:58 LS15mainframe kernel: __mod_lruvec_page_state+0x5f/0x76
Aug 10 01:49:58 LS15mainframe kernel: page_remove_rmap+0x102/0x239
Aug 10 01:49:58 LS15mainframe kernel: unmap_page_range+0x467/0x67b
Aug 10 01:49:58 LS15mainframe kernel: unmap_vmas+0xb6/0x100
Aug 10 01:49:58 LS15mainframe kernel: ? folio_batch_move_lru+0x9e/0xca
Aug 10 01:49:58 LS15mainframe kernel: exit_mmap+0xdb/0x22e
Aug 10 01:49:58 LS15mainframe kernel: __mmput+0x43/0xe3
Aug 10 01:49:58 LS15mainframe kernel: do_exit+0x31b/0x923
Aug 10 01:49:58 LS15mainframe kernel: do_group_exit+0x7a/0x7a
Aug 10 01:49:58 LS15mainframe kernel: get_signal+0x622/0x65a
Aug 10 01:49:58 LS15mainframe kernel: ? paravirt_write_msr+0xb/0x11
Aug 10 01:49:58 LS15mainframe kernel: ? kick_process+0x3d/0x54
Aug 10 01:49:58 LS15mainframe kernel: arch_do_signal_or_restart+0x36/0x607
Aug 10 01:49:58 LS15mainframe kernel: ? do_futex+0xcd/0x143
Aug 10 01:49:58 LS15mainframe kernel: exit_to_user_mode_prepare+0x58/0x112
Aug 10 01:49:58 LS15mainframe kernel: syscall_exit_to_user_mode+0x18/0x23
Aug 10 01:49:58 LS15mainframe kernel: do_syscall_64+0x71/0x7b
Aug 10 01:49:58 LS15mainframe kernel: entry_SYSCALL_64_after_hwframe+0x6e/0xd8
Aug 10 01:49:58 LS15mainframe kernel: RIP: 0033:0x470103
Aug 10 01:49:58 LS15mainframe kernel: Code: Unable to access opcode bytes at 0x4700d9.
Aug 10 01:49:58 LS15mainframe kernel: RSP: 002b:000000c000517d70 EFLAGS: 00000286 ORIG_RAX: 00000000000000ca
Aug 10 01:49:58 LS15mainframe kernel: RAX: fffffffffffffe00 RBX: 0000000000000000 RCX: 0000000000470103
Aug 10 01:49:58 LS15mainframe kernel: RDX: 0000000000000000 RSI: 0000000000000080 RDI: 000000c0005a0548
Aug 10 01:49:58 LS15mainframe kernel: RBP: 000000c000517db8 R08: 0000000000000000 R09: 0000000000000000
Aug 10 01:49:58 LS15mainframe kernel: R10: 0000000000000000 R11: 0000000000000286 R12: 0000000000000000
Aug 10 01:49:58 LS15mainframe kernel: R13: 000000c000600400 R14: 000000c0005024e0 R15: 0000000000000003
Aug 10 01:49:58 LS15mainframe kernel: </TASK>
Aug 10 01:49:58 LS15mainframe kernel: Modules linked in: nf_tables xt_connmark xt_comment iptable_raw wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libchacha xt_mark udp_diag xt_CHECKSUM ipt_REJECT nf_reject_ipv4 ip6table_mangle ip6table_nat iptable_mangle vhost_net tun vhost vhost_iotlb veth xt_nat xt_tcpudp xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 xt_addrtype br_netfilter bridge stp llc xfs md_mod tcp_diag inet_diag ip6table_filter ip6_tables iptable_filter ip_tables x_tables efivarfs macvtap macvlan tap bonding tls e1000e r8169 realtek zfs(PO) zunicode(PO) zzstd(O) zlua(O) intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp zavl(PO) coretemp icp(PO) i915 kvm_intel zcommon(PO) znvpair(PO) spl(O) kvm iosf_mbi drm_buddy i2c_algo_bit ttm drm_display_helper crct10dif_pclmul drm_kms_helper crc32_pclmul crc32c_intel
Aug 10 01:49:58 LS15mainframe kernel: ghash_clmulni_intel sha512_ssse3 sha256_ssse3 sha1_ssse3 mei_hdcp mei_pxp wmi_bmof intel_wmi_thunderbolt mxm_wmi nvme i2c_i801 aesni_intel crypto_simd drm cryptd intel_cstate intel_uncore nvme_core i2c_smbus mei_me intel_gtt agpgart mei ahci i2c_core cp210x libahci input_leds joydev usbserial led_class cdc_acm syscopyarea sysfillrect sysimgblt thermal intel_pch_thermal fb_sys_fops fan video wmi backlight intel_pmc_core button acpi_pad acpi_tad unix [last unloaded: e1000e]
Aug 10 01:49:58 LS15mainframe kernel: CR2: 0000000000000630
Aug 10 01:49:58 LS15mainframe kernel: ---[ end trace 0000000000000000 ]---
Aug 10 01:49:58 LS15mainframe kernel: RIP: 0010:mem_cgroup_lruvec+0x35/0x4c
Aug 10 01:49:58 LS15mainframe kernel: Code: ff ff 84 c0 74 09 48 8d 83 80 4b 00 00 eb 1b 48 85 ed 75 07 48 8b 2d 02 b2 17 01 48 63 83 00 4a 00 00 48 8b 84 c5 50 08 00 00 <48> 39 98 30 06 00 00 74 07 48 89 98 30 06 00 00 5b 5d c3 cc cc cc
Aug 10 01:49:58 LS15mainframe kernel: RSP: 0018:ffffc900028b7a88 EFLAGS: 00010286
Aug 10 01:49:58 LS15mainframe kernel: RAX: 0000000000000000 RBX: ffff8890807f8000 RCX: ffffea0006074e80
Aug 10 01:49:58 LS15mainframe kernel: RDX: ffffea0006074e08 RSI: ffff8890807f8000 RDI: ffff8885001a2000
Aug 10 01:49:58 LS15mainframe kernel: RBP: ffff8885001a2000 R08: ffff8890403f2c40 R09: ffff8890403f2c58
Aug 10 01:49:58 LS15mainframe kernel: R10: 0000000000000000 R11: ffff888d583e5408 R12: ffff8890807f8000
Aug 10 01:49:58 LS15mainframe kernel: R13: ffffea0006074e80 R14: 0000000000000000 R15: ffff888ba19da750
Aug 10 01:49:58 LS15mainframe kernel: FS:  0000000000000000(0000) GS:ffff8890403c0000(0000) knlGS:0000000000000000
Aug 10 01:49:58 LS15mainframe kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Aug 10 01:49:58 LS15mainframe kernel: CR2: 0000000000000630 CR3: 0000000d55bf4005 CR4: 0000000000772ee0
Aug 10 01:49:58 LS15mainframe kernel: PKRU: 55555554
Aug 10 01:49:58 LS15mainframe kernel: note: docker-compose[8739] exited with irqs disabled
Aug 10 01:49:58 LS15mainframe kernel: note: docker-compose[8739] exited with preempt_count 1
Aug 10 01:49:58 LS15mainframe kernel: Fixing recursive fault but reboot is needed!
Aug 10 01:49:58 LS15mainframe kernel: BUG: using smp_processor_id() in preemptible [00000000] code: docker-compose/8739
Aug 10 01:49:58 LS15mainframe kernel: caller is __schedule+0x2f/0x612
Aug 10 01:49:58 LS15mainframe kernel: CPU: 7 PID: 8739 Comm: docker-compose Tainted: P      D    O       6.1.99-Unraid #1
Aug 10 01:49:58 LS15mainframe kernel: Hardware name: Micro-Star International Co., Ltd. MS-7C80/MAG Z490 TOMAHAWK (MS-7C80), BIOS 1.C0 06/11/2022
Aug 10 01:49:58 LS15mainframe kernel: Call Trace:
Aug 10 01:49:58 LS15mainframe kernel: <TASK>
Aug 10 01:49:58 LS15mainframe kernel: dump_stack_lvl+0x44/0x5c
Aug 10 01:49:58 LS15mainframe kernel: check_preemption_disabled+0xcb/0xe0
Aug 10 01:49:58 LS15mainframe kernel: __schedule+0x2f/0x612
Aug 10 01:49:58 LS15mainframe kernel: ? _printk+0x58/0x73
Aug 10 01:49:58 LS15mainframe kernel: do_task_dead+0x3f/0x41
Aug 10 01:49:58 LS15mainframe kernel: make_task_dead+0x114/0x11c
Aug 10 01:49:58 LS15mainframe kernel: rewind_stack_and_make_dead+0x17/0x17
Aug 10 01:49:58 LS15mainframe kernel: RIP: 0033:0x470103
Aug 10 01:49:58 LS15mainframe kernel: Code: Unable to access opcode bytes at 0x4700d9.
Aug 10 01:49:58 LS15mainframe kernel: RSP: 002b:000000c000517d70 EFLAGS: 00000286 ORIG_RAX: 00000000000000ca
Aug 10 01:49:58 LS15mainframe kernel: RAX: fffffffffffffe00 RBX: 0000000000000000 RCX: 0000000000470103
Aug 10 01:49:58 LS15mainframe kernel: RDX: 0000000000000000 RSI: 0000000000000080 RDI: 000000c0005a0548
Aug 10 01:49:58 LS15mainframe kernel: RBP: 000000c000517db8 R08: 0000000000000000 R09: 0000000000000000
Aug 10 01:49:58 LS15mainframe kernel: R10: 0000000000000000 R11: 0000000000000286 R12: 0000000000000000
Aug 10 01:49:58 LS15mainframe kernel: R13: 000000c000600400 R14: 000000c0005024e0 R15: 0000000000000003
Aug 10 01:49:58 LS15mainframe kernel: </TASK>
Aug 10 01:49:58 LS15mainframe kernel: BUG: scheduling while atomic: docker-compose/8739/0x00000000
Aug 10 01:49:58 LS15mainframe kernel: Modules linked in: nf_tables xt_connmark xt_comment iptable_raw wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libchacha xt_mark udp_diag xt_CHECKSUM ipt_REJECT nf_reject_ipv4 ip6table_mangle ip6table_nat iptable_mangle vhost_net tun vhost vhost_iotlb veth xt_nat xt_tcpudp xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 xt_addrtype br_netfilter bridge stp llc xfs md_mod tcp_diag inet_diag ip6table_filter ip6_tables iptable_filter ip_tables x_tables efivarfs macvtap macvlan tap bonding tls e1000e r8169 realtek zfs(PO) zunicode(PO) zzstd(O) zlua(O) intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp zavl(PO) coretemp icp(PO) i915 kvm_intel zcommon(PO) znvpair(PO) spl(O) kvm iosf_mbi drm_buddy i2c_algo_bit ttm drm_display_helper crct10dif_pclmul drm_kms_helper crc32_pclmul crc32c_intel
Aug 10 01:49:58 LS15mainframe kernel: ghash_clmulni_intel sha512_ssse3 sha256_ssse3 sha1_ssse3 mei_hdcp mei_pxp wmi_bmof intel_wmi_thunderbolt mxm_wmi nvme i2c_i801 aesni_intel crypto_simd drm cryptd intel_cstate intel_uncore nvme_core i2c_smbus mei_me intel_gtt agpgart mei ahci i2c_core cp210x libahci input_leds joydev usbserial led_class cdc_acm syscopyarea sysfillrect sysimgblt thermal intel_pch_thermal fb_sys_fops fan video wmi backlight intel_pmc_core button acpi_pad acpi_tad unix [last unloaded: e1000e]
Aug 10 01:49:58 LS15mainframe kernel: Preemption disabled at:
Aug 10 01:49:58 LS15mainframe kernel: [<0000000000000000>] 0x0
Aug 10 01:49:58 LS15mainframe kernel: CPU: 7 PID: 8739 Comm: docker-compose Tainted: P      D    O       6.1.99-Unraid #1
Aug 10 01:49:58 LS15mainframe kernel: Hardware name: Micro-Star International Co., Ltd. MS-7C80/MAG Z490 TOMAHAWK (MS-7C80), BIOS 1.C0 06/11/2022
Aug 10 01:49:58 LS15mainframe kernel: Call Trace:
Aug 10 01:49:58 LS15mainframe kernel: <TASK>
Aug 10 01:49:58 LS15mainframe kernel: dump_stack_lvl+0x44/0x5c
Aug 10 01:49:58 LS15mainframe kernel: __schedule_bug+0x9a/0xac
Aug 10 01:49:58 LS15mainframe kernel: __schedule+0x59/0x612
Aug 10 01:49:58 LS15mainframe kernel: ? _printk+0x58/0x73
Aug 10 01:49:58 LS15mainframe kernel: do_task_dead+0x3f/0x41
Aug 10 01:49:58 LS15mainframe kernel: make_task_dead+0x114/0x11c
Aug 10 01:49:58 LS15mainframe kernel: rewind_stack_and_make_dead+0x17/0x17
Aug 10 01:49:58 LS15mainframe kernel: RIP: 0033:0x470103
Aug 10 01:49:58 LS15mainframe kernel: Code: Unable to access opcode bytes at 0x4700d9.
Aug 10 01:49:58 LS15mainframe kernel: RSP: 002b:000000c000517d70 EFLAGS: 00000286 ORIG_RAX: 00000000000000ca
Aug 10 01:49:58 LS15mainframe kernel: RAX: fffffffffffffe00 RBX: 0000000000000000 RCX: 0000000000470103
Aug 10 01:49:58 LS15mainframe kernel: RDX: 0000000000000000 RSI: 0000000000000080 RDI: 000000c0005a0548
Aug 10 01:49:58 LS15mainframe kernel: RBP: 000000c000517db8 R08: 0000000000000000 R09: 0000000000000000
Aug 10 01:49:58 LS15mainframe kernel: R10: 0000000000000000 R11: 0000000000000286 R12: 0000000000000000
Aug 10 01:49:58 LS15mainframe kernel: R13: 000000c000600400 R14: 000000c0005024e0 R15: 0000000000000003
Aug 10 01:49:58 LS15mainframe kernel: </TASK>
Aug 10 01:49:58 LS15mainframe kernel: ------------[ cut here ]------------
Aug 10 01:49:58 LS15mainframe kernel: Voluntary context switch within RCU read-side critical section!
Aug 10 01:49:58 LS15mainframe kernel: WARNING: CPU: 7 PID: 8739 at kernel/rcu/tree_plugin.h:320 rcu_note_context_switch+0x6a/0x3dc
Aug 10 01:49:58 LS15mainframe kernel: Modules linked in: nf_tables xt_connmark xt_comment iptable_raw wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libchacha xt_mark udp_diag xt_CHECKSUM ipt_REJECT nf_reject_ipv4 ip6table_mangle ip6table_nat iptable_mangle vhost_net tun vhost vhost_iotlb veth xt_nat xt_tcpudp xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 xt_addrtype br_netfilter bridge stp llc xfs md_mod tcp_diag inet_diag ip6table_filter ip6_tables iptable_filter ip_tables x_tables efivarfs macvtap macvlan tap bonding tls e1000e r8169 realtek zfs(PO) zunicode(PO) zzstd(O) zlua(O) intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp zavl(PO) coretemp icp(PO) i915 kvm_intel zcommon(PO) znvpair(PO) spl(O) kvm iosf_mbi drm_buddy i2c_algo_bit ttm drm_display_helper crct10dif_pclmul drm_kms_helper crc32_pclmul crc32c_intel
Aug 10 01:49:58 LS15mainframe kernel: ghash_clmulni_intel sha512_ssse3 sha256_ssse3 sha1_ssse3 mei_hdcp mei_pxp wmi_bmof intel_wmi_thunderbolt mxm_wmi nvme i2c_i801 aesni_intel crypto_simd drm cryptd intel_cstate intel_uncore nvme_core i2c_smbus mei_me intel_gtt agpgart mei ahci i2c_core cp210x libahci input_leds joydev usbserial led_class cdc_acm syscopyarea sysfillrect sysimgblt thermal intel_pch_thermal fb_sys_fops fan video wmi backlight intel_pmc_core button acpi_pad acpi_tad unix [last unloaded: e1000e]
Aug 10 01:49:58 LS15mainframe kernel: CPU: 7 PID: 8739 Comm: docker-compose Tainted: P      D W  O       6.1.99-Unraid #1
Aug 10 01:49:58 LS15mainframe kernel: Hardware name: Micro-Star International Co., Ltd. MS-7C80/MAG Z490 TOMAHAWK (MS-7C80), BIOS 1.C0 06/11/2022
Aug 10 01:49:58 LS15mainframe kernel: RIP: 0010:rcu_note_context_switch+0x6a/0x3dc
Aug 10 01:49:58 LS15mainframe kernel: Code: 75 2a 41 8b 84 24 0c 03 00 00 85 c0 7e 1e 80 3d 17 1d 2b 01 00 75 15 48 c7 c7 f2 b6 0c 82 c6 05 07 1d 2b 01 01 e8 34 1c f9 ff <0f> 0b 65 48 8b 04 25 80 cb 01 00 8b 80 0c 03 00 00 85 c0 0f 8e bc
Aug 10 01:49:58 LS15mainframe kernel: RSP: 0018:ffffc900028b7e90 EFLAGS: 00010082
Aug 10 01:49:58 LS15mainframe kernel: RAX: 0000000000000000 RBX: ffff8885cd650000 RCX: 0000000000000027
Aug 10 01:49:58 LS15mainframe kernel: RDX: 0000000000000003 RSI: ffffffff820d96e1 RDI: 00000000ffffffff
Aug 10 01:49:58 LS15mainframe kernel: RBP: ffff8890403eee00 R08: 0000000000000000 R09: ffffc900028b7e18
Aug 10 01:49:58 LS15mainframe kernel: R10: 00007fffffffffff R11: ffffffff82974fc1 R12: ffff8885cd650000
Aug 10 01:49:58 LS15mainframe kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
Aug 10 01:49:58 LS15mainframe kernel: FS:  0000000000000000(0000) GS:ffff8890403c0000(0000) knlGS:0000000000000000
Aug 10 01:49:58 LS15mainframe kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Aug 10 01:49:58 LS15mainframe kernel: CR2: 0000000000000630 CR3: 0000000d55bf4005 CR4: 0000000000772ee0
Aug 10 01:49:58 LS15mainframe kernel: PKRU: 55555554
Aug 10 01:49:58 LS15mainframe kernel: Call Trace:
Aug 10 01:49:58 LS15mainframe kernel: <TASK>
Aug 10 01:49:58 LS15mainframe kernel: ? __warn+0xab/0x122
Aug 10 01:49:58 LS15mainframe kernel: ? report_bug+0x109/0x17e
Aug 10 01:49:58 LS15mainframe kernel: ? rcu_note_context_switch+0x6a/0x3dc
Aug 10 01:49:58 LS15mainframe kernel: ? handle_bug+0x41/0x6f
Aug 10 01:49:58 LS15mainframe kernel: ? exc_invalid_op+0x13/0x60
Aug 10 01:49:58 LS15mainframe kernel: ? asm_exc_invalid_op+0x16/0x20
Aug 10 01:49:58 LS15mainframe kernel: ? rcu_note_context_switch+0x6a/0x3dc
Aug 10 01:49:58 LS15mainframe kernel: __schedule+0xa9/0x612
Aug 10 01:49:58 LS15mainframe kernel: ? _printk+0x58/0x73
Aug 10 01:49:58 LS15mainframe kernel: do_task_dead+0x3f/0x41
Aug 10 01:49:58 LS15mainframe kernel: make_task_dead+0x114/0x11c
Aug 10 01:49:58 LS15mainframe kernel: rewind_stack_and_make_dead+0x17/0x17
Aug 10 01:49:58 LS15mainframe kernel: RIP: 0033:0x470103
Aug 10 01:49:58 LS15mainframe kernel: Code: Unable to access opcode bytes at 0x4700d9.
Aug 10 01:49:58 LS15mainframe kernel: RSP: 002b:000000c000517d70 EFLAGS: 00000286 ORIG_RAX: 00000000000000ca
Aug 10 01:49:58 LS15mainframe kernel: RAX: fffffffffffffe00 RBX: 0000000000000000 RCX: 0000000000470103
Aug 10 01:49:58 LS15mainframe kernel: RDX: 0000000000000000 RSI: 0000000000000080 RDI: 000000c0005a0548
Aug 10 01:49:58 LS15mainframe kernel: RBP: 000000c000517db8 R08: 0000000000000000 R09: 0000000000000000
Aug 10 01:49:58 LS15mainframe kernel: R10: 0000000000000000 R11: 0000000000000286 R12: 0000000000000000
Aug 10 01:49:58 LS15mainframe kernel: R13: 000000c000600400 R14: 000000c0005024e0 R15: 0000000000000003
Aug 10 01:49:58 LS15mainframe kernel: </TASK>
Aug 10 01:49:58 LS15mainframe kernel: ---[ end trace 0000000000000000 ]---
Aug 10 01:50:21 LS15mainframe kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P8739 } 21158 jiffies s: 24129 root: 0x0/T
Aug 10 01:50:21 LS15mainframe kernel: rcu: blocking rcu_node structures (internal RCU debug):
Aug 10 01:50:58 LS15mainframe kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Aug 10 01:50:58 LS15mainframe kernel: rcu: #011Tasks blocked on level-0 rcu_node (CPUs 0-11): P8739/2:b..l
Aug 10 01:50:58 LS15mainframe kernel: #011(detected by 5, t=60002 jiffies, g=3234421, q=303652 ncpus=12)
Aug 10 01:51:25 LS15mainframe kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P8739 } 85158 jiffies s: 24129 root: 0x0/T
Aug 10 01:51:25 LS15mainframe kernel: rcu: blocking rcu_node structures (internal RCU debug):
Aug 10 01:52:30 LS15mainframe kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P8739 } 150695 jiffies s: 24129 root: 0x0/T
Aug 10 01:52:30 LS15mainframe kernel: rcu: blocking rcu_node structures (internal RCU debug):
Aug 10 01:53:36 LS15mainframe kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P8739 } 216230 jiffies s: 24129 root: 0x0/T
Aug 10 01:53:36 LS15mainframe kernel: rcu: blocking rcu_node structures (internal RCU debug):
Aug 10 01:53:58 LS15mainframe kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Aug 10 01:53:58 LS15mainframe kernel: rcu: #011Tasks blocked on level-0 rcu_node (CPUs 0-11): P8739/2:b..l
Aug 10 01:53:58 LS15mainframe kernel: #011(detected by 5, t=240007 jiffies, g=3234421, q=1095406 ncpus=12)
Aug 10 01:54:42 LS15mainframe kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P8739 } 281767 jiffies s: 24129 root: 0x0/T
Aug 10 01:54:42 LS15mainframe kernel: rcu: blocking rcu_node structures (internal RCU debug):
Aug 10 01:55:47 LS15mainframe kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P8739 } 347302 jiffies s: 24129 root: 0x0/T
Aug 10 01:55:47 LS15mainframe kernel: rcu: blocking rcu_node structures (internal RCU debug):
Aug 10 01:56:53 LS15mainframe kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P8739 } 412838 jiffies s: 24129 root: 0x0/T
Aug 10 01:56:53 LS15mainframe kernel: rcu: blocking rcu_node structures (internal RCU debug):
Aug 10 01:56:58 LS15mainframe kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Aug 10 01:56:58 LS15mainframe kernel: rcu: #011Tasks blocked on level-0 rcu_node (CPUs 0-11): P8739/2:b..l
Aug 10 01:56:58 LS15mainframe kernel: #011(detected by 9, t=420012 jiffies, g=3234421, q=1905844 ncpus=12)
Aug 10 01:57:58 LS15mainframe kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P8739 } 478375 jiffies s: 24129 root: 0x0/T
Aug 10 01:57:58 LS15mainframe kernel: rcu: blocking rcu_node structures (internal RCU debug):
Aug 10 01:59:04 LS15mainframe kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P8739 } 543911 jiffies s: 24129 root: 0x0/T
Aug 10 01:59:04 LS15mainframe kernel: rcu: blocking rcu_node structures (internal RCU debug):
Aug 10 01:59:58 LS15mainframe kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Aug 10 01:59:58 LS15mainframe kernel: rcu: #011Tasks blocked on level-0 rcu_node (CPUs 0-11): P8739/2:b..l
Aug 10 01:59:58 LS15mainframe kernel: #011(detected by 4, t=600017 jiffies, g=3234421, q=2708809 ncpus=12)
Aug 10 02:00:09 LS15mainframe kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P8739 } 609446 jiffies s: 24129 root: 0x0/T
Aug 10 02:00:09 LS15mainframe kernel: rcu: blocking rcu_node structures (internal RCU debug):
Aug 10 02:00:38 LS15mainframe nginx: 2024/08/10 02:00:38 [error] 8724#8724: *112429 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:00:38 LS15mainframe nginx: 2024/08/10 02:00:38 [error] 8724#8724: *112428 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:00:38 LS15mainframe nginx: 2024/08/10 02:00:38 [error] 8724#8724: *112427 upstream timed out (110: Connection timed out) while reading upstream, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", upstream: "fastcgi://unix:/var/run/php5-fpm.sock:", host: "192.168.31.10"
Aug 10 02:00:58 LS15mainframe nginx: 2024/08/10 02:00:58 [error] 8724#8724: *112547 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:00:58 LS15mainframe nginx: 2024/08/10 02:00:58 [error] 8724#8724: *112547 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", host: "192.168.31.10"
Aug 10 02:00:58 LS15mainframe nginx: 2024/08/10 02:00:58 [error] 8724#8724: *112548 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:00:58 LS15mainframe nginx: 2024/08/10 02:00:58 [error] 8724#8724: *112548 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:00:58 LS15mainframe nginx: 2024/08/10 02:00:58 [error] 8724#8724: *112549 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:00:58 LS15mainframe nginx: 2024/08/10 02:00:58 [error] 8724#8724: *112549 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:01:15 LS15mainframe kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P8739 } 674982 jiffies s: 24129 root: 0x0/T
Aug 10 02:01:15 LS15mainframe kernel: rcu: blocking rcu_node structures (internal RCU debug):
Aug 10 02:01:18 LS15mainframe nginx: 2024/08/10 02:01:18 [error] 8724#8724: *112612 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:01:18 LS15mainframe nginx: 2024/08/10 02:01:18 [error] 8724#8724: *112612 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", host: "192.168.31.10"
Aug 10 02:01:18 LS15mainframe nginx: 2024/08/10 02:01:18 [error] 8724#8724: *112613 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:01:18 LS15mainframe nginx: 2024/08/10 02:01:18 [error] 8724#8724: *112613 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:01:18 LS15mainframe nginx: 2024/08/10 02:01:18 [error] 8724#8724: *112614 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:01:18 LS15mainframe nginx: 2024/08/10 02:01:18 [error] 8724#8724: *112614 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:01:38 LS15mainframe nginx: 2024/08/10 02:01:38 [error] 8724#8724: *112678 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:01:38 LS15mainframe nginx: 2024/08/10 02:01:38 [error] 8724#8724: *112678 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", host: "192.168.31.10"
Aug 10 02:01:38 LS15mainframe nginx: 2024/08/10 02:01:38 [error] 8724#8724: *112679 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:01:38 LS15mainframe nginx: 2024/08/10 02:01:38 [error] 8724#8724: *112679 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:01:38 LS15mainframe nginx: 2024/08/10 02:01:38 [error] 8724#8724: *112680 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:01:38 LS15mainframe nginx: 2024/08/10 02:01:38 [error] 8724#8724: *112680 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:01:58 LS15mainframe nginx: 2024/08/10 02:01:58 [error] 8724#8724: *112745 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:01:58 LS15mainframe nginx: 2024/08/10 02:01:58 [error] 8724#8724: *112745 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", host: "192.168.31.10"
Aug 10 02:01:58 LS15mainframe nginx: 2024/08/10 02:01:58 [error] 8724#8724: *112746 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:01:58 LS15mainframe nginx: 2024/08/10 02:01:58 [error] 8724#8724: *112746 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:01:58 LS15mainframe nginx: 2024/08/10 02:01:58 [error] 8724#8724: *112747 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:01:58 LS15mainframe nginx: 2024/08/10 02:01:58 [error] 8724#8724: *112747 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:02:18 LS15mainframe nginx: 2024/08/10 02:02:18 [error] 8724#8724: *112810 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:02:18 LS15mainframe nginx: 2024/08/10 02:02:18 [error] 8724#8724: *112810 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", host: "192.168.31.10"
Aug 10 02:02:18 LS15mainframe nginx: 2024/08/10 02:02:18 [error] 8724#8724: *112811 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:02:18 LS15mainframe nginx: 2024/08/10 02:02:18 [error] 8724#8724: *112811 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:02:18 LS15mainframe nginx: 2024/08/10 02:02:18 [error] 8724#8724: *112812 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:02:18 LS15mainframe nginx: 2024/08/10 02:02:18 [error] 8724#8724: *112812 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:02:20 LS15mainframe kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P8739 } 740518 jiffies s: 24129 root: 0x0/T
Aug 10 02:02:20 LS15mainframe kernel: rcu: blocking rcu_node structures (internal RCU debug):
Aug 10 02:02:38 LS15mainframe nginx: 2024/08/10 02:02:38 [error] 8724#8724: *112876 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:02:38 LS15mainframe nginx: 2024/08/10 02:02:38 [error] 8724#8724: *112876 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", host: "192.168.31.10"
Aug 10 02:02:38 LS15mainframe nginx: 2024/08/10 02:02:38 [error] 8724#8724: *112877 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:02:38 LS15mainframe nginx: 2024/08/10 02:02:38 [error] 8724#8724: *112877 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:02:38 LS15mainframe nginx: 2024/08/10 02:02:38 [error] 8724#8724: *112878 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:02:38 LS15mainframe nginx: 2024/08/10 02:02:38 [error] 8724#8724: *112878 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:02:58 LS15mainframe nginx: 2024/08/10 02:02:58 [error] 8724#8724: *112943 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:02:58 LS15mainframe nginx: 2024/08/10 02:02:58 [error] 8724#8724: *112943 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", host: "192.168.31.10"
Aug 10 02:02:58 LS15mainframe nginx: 2024/08/10 02:02:58 [error] 8724#8724: *112944 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:02:58 LS15mainframe nginx: 2024/08/10 02:02:58 [error] 8724#8724: *112944 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:02:58 LS15mainframe nginx: 2024/08/10 02:02:58 [error] 8724#8724: *112945 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:02:58 LS15mainframe nginx: 2024/08/10 02:02:58 [error] 8724#8724: *112945 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:02:58 LS15mainframe kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Aug 10 02:02:58 LS15mainframe kernel: rcu: #011Tasks blocked on level-0 rcu_node (CPUs 0-11): P8739/2:b..l
Aug 10 02:02:58 LS15mainframe kernel: #011(detected by 7, t=780022 jiffies, g=3234421, q=3844786 ncpus=12)
Aug 10 02:03:18 LS15mainframe nginx: 2024/08/10 02:03:18 [error] 8724#8724: *113008 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:03:18 LS15mainframe nginx: 2024/08/10 02:03:18 [error] 8724#8724: *113008 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", host: "192.168.31.10"
Aug 10 02:03:18 LS15mainframe nginx: 2024/08/10 02:03:18 [error] 8724#8724: *113009 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:03:18 LS15mainframe nginx: 2024/08/10 02:03:18 [error] 8724#8724: *113009 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:03:18 LS15mainframe nginx: 2024/08/10 02:03:18 [error] 8724#8724: *113010 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:03:18 LS15mainframe nginx: 2024/08/10 02:03:18 [error] 8724#8724: *113010 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:03:26 LS15mainframe kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P8739 } 806054 jiffies s: 24129 root: 0x0/T
Aug 10 02:03:26 LS15mainframe kernel: rcu: blocking rcu_node structures (internal RCU debug):
Aug 10 02:03:38 LS15mainframe nginx: 2024/08/10 02:03:38 [error] 8724#8724: *113074 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:03:38 LS15mainframe nginx: 2024/08/10 02:03:38 [error] 8724#8724: *113074 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", host: "192.168.31.10"
Aug 10 02:03:38 LS15mainframe nginx: 2024/08/10 02:03:38 [error] 8724#8724: *113075 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:03:38 LS15mainframe nginx: 2024/08/10 02:03:38 [error] 8724#8724: *113075 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:03:38 LS15mainframe nginx: 2024/08/10 02:03:38 [error] 8724#8724: *113076 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:03:38 LS15mainframe nginx: 2024/08/10 02:03:38 [error] 8724#8724: *113076 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:03:58 LS15mainframe nginx: 2024/08/10 02:03:58 [error] 8724#8724: *113139 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:03:58 LS15mainframe nginx: 2024/08/10 02:03:58 [error] 8724#8724: *113139 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", host: "192.168.31.10"
Aug 10 02:03:58 LS15mainframe nginx: 2024/08/10 02:03:58 [error] 8724#8724: *113140 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:03:58 LS15mainframe nginx: 2024/08/10 02:03:58 [error] 8724#8724: *113140 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:03:58 LS15mainframe nginx: 2024/08/10 02:03:58 [error] 8724#8724: *113141 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:03:58 LS15mainframe nginx: 2024/08/10 02:03:58 [error] 8724#8724: *113141 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:04:18 LS15mainframe nginx: 2024/08/10 02:04:18 [error] 8724#8724: *113206 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:04:18 LS15mainframe nginx: 2024/08/10 02:04:18 [error] 8724#8724: *113206 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", host: "192.168.31.10"
Aug 10 02:04:18 LS15mainframe nginx: 2024/08/10 02:04:18 [error] 8724#8724: *113207 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:04:18 LS15mainframe nginx: 2024/08/10 02:04:18 [error] 8724#8724: *113207 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:04:18 LS15mainframe nginx: 2024/08/10 02:04:18 [error] 8724#8724: *113208 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:04:18 LS15mainframe nginx: 2024/08/10 02:04:18 [error] 8724#8724: *113208 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:04:31 LS15mainframe kernel: rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { P8739 } 871590 jiffies s: 24129 root: 0x0/T
Aug 10 02:04:31 LS15mainframe kernel: rcu: blocking rcu_node structures (internal RCU debug):
Aug 10 02:04:38 LS15mainframe nginx: 2024/08/10 02:04:38 [error] 8724#8724: *113272 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:04:38 LS15mainframe nginx: 2024/08/10 02:04:38 [error] 8724#8724: *113272 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", host: "192.168.31.10"
Aug 10 02:04:38 LS15mainframe nginx: 2024/08/10 02:04:38 [error] 8724#8724: *113273 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:04:38 LS15mainframe nginx: 2024/08/10 02:04:38 [error] 8724#8724: *113273 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:04:38 LS15mainframe nginx: 2024/08/10 02:04:38 [error] 8724#8724: *113274 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:04:38 LS15mainframe nginx: 2024/08/10 02:04:38 [error] 8724#8724: *113274 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:04:58 LS15mainframe nginx: 2024/08/10 02:04:58 [error] 8724#8724: *113337 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:04:58 LS15mainframe nginx: 2024/08/10 02:04:58 [error] 8724#8724: *113337 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /Dashboard HTTP/1.1", host: "192.168.31.10"
Aug 10 02:04:58 LS15mainframe nginx: 2024/08/10 02:04:58 [error] 8724#8724: *113338 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:04:58 LS15mainframe nginx: 2024/08/10 02:04:58 [error] 8724#8724: *113338 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.vm.manager/include/VMMachines.php HTTP/1.1", host: "192.168.31.10"
Aug 10 02:04:58 LS15mainframe nginx: 2024/08/10 02:04:58 [error] 8724#8724: *113339 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", subrequest: "/auth-request.php", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.31.10"
Aug 10 02:04:58 LS15mainframe nginx: 2024/08/10 02:04:58 [error] 8724#8724: *113339 auth request unexpected status: 504 while sending to client, client: 172.17.0.10, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", host: "192.168.31.10"
Aug 10 09:04:51 LS15mainframe file.activity: Starting File Activity

 

Link to comment
Flight777 Noob

Flight777

Posted
  • Author
Posted

After some testing, seems to have to do with the XMP profile. I did some memtesting and got errors on RAM, after switching XMP off memtest shows 0 errors and all seems stable for the last few hrs.

 

Strange...normally XMP should work out of the box?

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
Go to topic listing
×
×
  • Create New...