Jump to content

unRAID v6.9.2 - WebGUI Unresponsive. Page Fault RC?


Go to solution Solved by OrneryTaurus,

Recommended Posts

Greetings everyone!

 

A while ago I posted about my server becoming unresponsive and at the time I was unable to capture diagnostics logs. Today it became unresponsive and I was able to capture logs via SSH. Reviewing the syslog, it seems a page fault of some sort happened shortly before I was unable to access things. The weird part was the WebGUI was inaccessible except for the Main tab (some of it would load but not the full page towards the bottom). Also, all dockers were running just fine.

 

I did attempt to remove the primary network connection after the inaccessibility happened to determine if there was a fault with the primary. This did not resolve the issue. Any insight as to what the fault might mean? No changes have been made to the system except updating dockers.

 

Here is the issue I have identified from the syslog:

 

May 24 14:19:18 Smalls kernel: BUG: unable to handle page fault for address: fffff8efd25da188
May 24 14:19:18 Smalls kernel: #PF: supervisor read access in kernel mode
May 24 14:19:18 Smalls kernel: #PF: error_code(0x0000) - not-present page
May 24 14:19:18 Smalls kernel: PGD 0 P4D 0 
May 24 14:19:18 Smalls kernel: Oops: 0000 [#1] SMP PTI
May 24 14:19:18 Smalls kernel: CPU: 19 PID: 41800 Comm: node Tainted: P        W  O      5.10.28-Unraid #1
May 24 14:19:18 Smalls kernel: Hardware name: Supermicro X9DR3-F/X9DR3-F, BIOS 3.4 06/30/2020
May 24 14:19:18 Smalls kernel: RIP: 0010:compound_head+0x0/0x11
May 24 14:19:18 Smalls kernel: Code: 89 06 31 c0 c3 48 8b 17 b8 01 00 00 00 48 f7 c2 9f ff ff ff 74 13 48 b8 98 0f 00 00 00 00 f0 7f 48 85 c2 0f 95 c0 0f b6 c0 c3 <48> 8b 57 08 48 89 f8 f6 c2 01 74 04 48 8d 42 ff c3 e8 ea ff ff ff
May 24 14:19:18 Smalls kernel: RSP: 0018:ffffc9000c41fca0 EFLAGS: 00010282
May 24 14:19:18 Smalls kernel: RAX: 0000000000000001 RBX: 00001a1efab1c000 RCX: 0000000000000014
May 24 14:19:18 Smalls kernel: RDX: 0000003bbf497686 RSI: ffffea00612d77c0 RDI: fffff8efd25da180
May 24 14:19:18 Smalls kernel: RBP: ffffc9000c41fdd8 R08: fffff8efd25da180 R09: 7c00003bbf497686
May 24 14:19:18 Smalls kernel: R10: ffffffffffffffff R11: 000000000000000c R12: ffff88816d12f2e8
May 24 14:19:18 Smalls kernel: R13: 000fffe7b4a20162 R14: ffff8881227efc80 R15: ffff8892884213d8
May 24 14:19:18 Smalls kernel: FS:  00001539a27beb38(0000) GS:ffff88a03f9c0000(0000) knlGS:0000000000000000
May 24 14:19:18 Smalls kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 24 14:19:18 Smalls kernel: CR2: fffff8efd25da188 CR3: 000000119b2da002 CR4: 00000000001706e0
May 24 14:19:18 Smalls kernel: Call Trace:
May 24 14:19:18 Smalls kernel: migration_entry_to_page+0x19/0x2e
May 24 14:19:18 Smalls kernel: unmap_page_range+0x440/0x648
May 24 14:19:18 Smalls kernel: unmap_vmas+0x6c/0x9a
May 24 14:19:18 Smalls kernel: ? lru_add_drain_cpu+0x23/0xf8
May 24 14:19:18 Smalls kernel: unmap_region+0xad/0x105
May 24 14:19:18 Smalls kernel: __do_munmap+0x27b/0x2f4
May 24 14:19:18 Smalls kernel: __vm_munmap+0x70/0xb0
May 24 14:19:18 Smalls kernel: __x64_sys_munmap+0x12/0x15
May 24 14:19:18 Smalls kernel: do_syscall_64+0x5d/0x6a
May 24 14:19:18 Smalls kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
May 24 14:19:18 Smalls kernel: RIP: 0033:0x1539a36135a0
May 24 14:19:18 Smalls kernel: Code: 00 00 00 0f 05 48 89 c7 e8 8a 87 fe ff 5a c3 55 48 89 f5 53 48 89 fb 50 e8 85 ed 01 00 b8 0b 00 00 00 48 89 df 48 89 ee 0f 05 <48> 89 c7 e8 65 87 fe ff 5a 5b 5d c3 31 c0 83 fa 04 74 0c 48 63 d2
May 24 14:19:18 Smalls kernel: RSP: 002b:00001539a27be840 EFLAGS: 00000246 ORIG_RAX: 000000000000000b
May 24 14:19:18 Smalls kernel: RAX: ffffffffffffffda RBX: 00001a1efab00000 RCX: 00001539a36135a0
May 24 14:19:18 Smalls kernel: RDX: 0000000000000000 RSI: 0000000000040000 RDI: 00001a1efab00000
May 24 14:19:18 Smalls kernel: RBP: 0000000000040000 R08: 0000153999e1db10 R09: 0000153999e1da50
May 24 14:19:18 Smalls kernel: R10: 0000000000000013 R11: 0000000000000246 R12: 00001a1efab00000
May 24 14:19:18 Smalls kernel: R13: 00001539a27be980 R14: 00001539a27be890 R15: 0000000000000000
May 24 14:19:18 Smalls kernel: Modules linked in: xt_mark nvidia_uvm(PO) xt_CHECKSUM ipt_REJECT nf_reject_ipv4 ip6table_mangle ip6table_nat iptable_mangle nf_tables vhost_net tun vhost vhost_iotlb tap xt_nat xt_tcpudp macvlan xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xt_addrtype iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter xfs md_mod nvidia_drm(PO) nvidia_modeset(PO) drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops nvidia(PO) drm backlight agpgart ip6table_filter ip6_tables iptable_filter ip_tables x_tables bonding ixgbe mdio igb i2c_algo_bit sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm mxm_wmi crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel crypto_simd cryptd ipmi_ssif glue_helper mpt3sas isci rapl libsas i2c_i801 raid_class intel_cstate intel_uncore nvme ahci scsi_transport_sas input_leds i2c_smbus nvme_core i2c_core libahci led_class wmi acpi_ipmi ipmi_si button [last unloaded: mdio]
May 24 14:19:18 Smalls kernel: CR2: fffff8efd25da188
May 24 14:19:18 Smalls kernel: ---[ end trace ec73c4b0205b2e16 ]---
May 24 14:19:18 Smalls kernel: RIP: 0010:compound_head+0x0/0x11
May 24 14:19:18 Smalls kernel: Code: 89 06 31 c0 c3 48 8b 17 b8 01 00 00 00 48 f7 c2 9f ff ff ff 74 13 48 b8 98 0f 00 00 00 00 f0 7f 48 85 c2 0f 95 c0 0f b6 c0 c3 <48> 8b 57 08 48 89 f8 f6 c2 01 74 04 48 8d 42 ff c3 e8 ea ff ff ff
May 24 14:19:18 Smalls kernel: RSP: 0018:ffffc9000c41fca0 EFLAGS: 00010282
May 24 14:19:18 Smalls kernel: RAX: 0000000000000001 RBX: 00001a1efab1c000 RCX: 0000000000000014
May 24 14:19:18 Smalls kernel: RDX: 0000003bbf497686 RSI: ffffea00612d77c0 RDI: fffff8efd25da180
May 24 14:19:18 Smalls kernel: RBP: ffffc9000c41fdd8 R08: fffff8efd25da180 R09: 7c00003bbf497686
May 24 14:19:18 Smalls kernel: R10: ffffffffffffffff R11: 000000000000000c R12: ffff88816d12f2e8
May 24 14:19:18 Smalls kernel: R13: 000fffe7b4a20162 R14: ffff8881227efc80 R15: ffff8892884213d8
May 24 14:19:18 Smalls kernel: FS:  00001539a27beb38(0000) GS:ffff88a03f9c0000(0000) knlGS:0000000000000000
May 24 14:19:18 Smalls kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 24 14:19:18 Smalls kernel: CR2: fffff8efd25da188 CR3: 000000119b2da002 CR4: 00000000001706e0

 

Any insight would be appreciated. Thank you :)

 

Per the recommendation of the 'Need Help? Read Me First' post, I will be upgrading to unRAID v6.10.1 to see if that might fix it but was curious as to the page fault meaning for this specific issue.

smalls-diagnostics-20220524-1557.zip

Edited by OrneryTaurus
Link to comment
May 10 18:52:15 Smalls kernel: macvlan_broadcast+0x10e/0x13c [macvlan]
May 10 18:52:15 Smalls kernel: macvlan_process_broadcast+0xf8/0x143 [macvlan]

 

Macvlan call traces are usually the result of having dockers with a custom IP address, upgrading to v6.10 and switching to ipvlan might fix it (Settings -> Docker Settings -> Docker custom network type -> ipvlan (advanced view must be enable, top right)), or see below for more info.

https://forums.unraid.net/topic/70529-650-call-traces-when-assigning-ip-address-to-docker-containers/

See also here:

https://forums.unraid.net/bug-reports/stable-releases/690691-kernel-panic-due-to-netfilter-nf_nat_setup_info-docker-static-ip-macvlan-r1356/

Link to comment
  • Solution
37 minutes ago, JorgeB said:
May 10 18:52:15 Smalls kernel: macvlan_broadcast+0x10e/0x13c [macvlan]
May 10 18:52:15 Smalls kernel: macvlan_process_broadcast+0xf8/0x143 [macvlan]

 

Macvlan call traces are usually the result of having dockers with a custom IP address, upgrading to v6.10 and switching to ipvlan might fix it (Settings -> Docker Settings -> Docker custom network type -> ipvlan (advanced view must be enable, top right)), or see below for more info.

https://forums.unraid.net/topic/70529-650-call-traces-when-assigning-ip-address-to-docker-containers/

See also here:

https://forums.unraid.net/bug-reports/stable-releases/690691-kernel-panic-due-to-netfilter-nf_nat_setup_info-docker-static-ip-macvlan-r1356/

 

Thanks @JorgeB I will take a look at doing that the first chance I get :)

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...