6.5 UI and Reboot issues


Recommended Posts

I am having quite a few issues that I suspect are all related.

 

After a reboot, everthing works perfectly fine for a while (few hours) Then I get the following problems:

 

  • WebGui Async loads stop working/loading. This affects:
    • Docker section on the Dashboard (never loads)
    • Docker tab (never loads)
    • Fix Common Problems (Scanning model never goes away)
    • Community Application (Loading spinner forever)
  • The next reboot will hang on "stopping emhttpd" and never reboot. SSHing in and typing reboot will force the reboot.
  • hung.png.c0e1e972659204941dec285889024e60.png

 

When this happens I get two types of errors in the syslog:

  • Timeout
Mar 19 09:35:17 Aeris nginx: 2018/03/19 09:35:17 [error] 2797#2797: *492724 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.168.1.103, server: , request: "POST /webGui/include/DashboardApps.php HTTP/2.0", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.11", referrer: "https://192.168.1.11/Dashboard"
Mar 19 10:34:14 Aeris emhttpd: req (5): csrf_token=****************&title=System+Log&cmd=%2FwebGui%2Fscripts%2Ftail_log&arg1=syslog
Mar 19 10:34:14 Aeris emhttpd: cmd: /usr/local/emhttp/plugins/dynamix/scripts/tail_log syslog
Mar 19 10:36:11 Aeris nginx: 2018/03/19 10:36:11 [error] 2797#2797: *501208 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.168.1.103, server: , request: "POST /plugins/dynamix.docker.manager/include/DockerUpdate.php HTTP/2.0", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "aeris.local", referrer: "https://aeris.local/Docker"
Mar 19 10:44:04 Aeris nginx: 2018/03/19 10:44:04 [error] 2797#2797: *502066 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.168.1.103, server: , request: "POST /webGui/include/DashboardApps.php HTTP/2.0", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "1010b0199efcaf4121d36289812113a82758b8a5.unraid.net", referrer: "https://hash.unraid.net/Dashboard"
Mar 19 10:48:16 Aeris nginx: 2018/03/19 10:48:16 [error] 2797#2797: *502066 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.168.1.103, server: , request: "POST /plugins/dynamix.docker.manager/include/DockerUpdate.php HTTP/2.0", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "1010b0199efcaf4121d36289812113a82758b8a5.unraid.net", referrer: "https://hash.unraid.net/Docker"
  • Call Trace:
Mar 20 03:54:05 Aeris kernel: ------------[ cut here ]------------
Mar 20 03:54:05 Aeris kernel: WARNING: CPU: 0 PID: 3 at net/netfilter/nf_conntrack_core.c:769 __nf_conntrack_confirm+0x97/0x4d6
Mar 20 03:54:05 Aeris kernel: Modules linked in: macvlan xt_nat veth ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 iptable_filter ip_tables nf_nat xfs nfsd lockd grace sunrpc md_mod bonding e1000e igb ptp pps_core ipmi_ssif x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc ast ttm aesni_intel drm_kms_helper aes_x86_64 crypto_simd glue_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf agpgart i2c_i801 i2c_algo_bit i2c_core mpt3sas syscopyarea sysfillrect ahci sysimgblt fb_sys_fops libahci raid_class scsi_transport_sas video ie31200_edac backlight ipmi_si acpi_power_meter thermal acpi_pad button fan [last unloaded: pps_core]
Mar 20 03:54:05 Aeris kernel: CPU: 0 PID: 3 Comm: kworker/0:0 Tainted: G        W       4.14.26-unRAID #1
Mar 20 03:54:05 Aeris kernel: Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C236D2I, BIOS P2.30 07/20/2017
Mar 20 03:54:05 Aeris kernel: Workqueue: events macvlan_process_broadcast [macvlan]
Mar 20 03:54:05 Aeris kernel: task: ffff88084bea1d00 task.stack: ffffc90003178000
Mar 20 03:54:05 Aeris kernel: RIP: 0010:__nf_conntrack_confirm+0x97/0x4d6
Mar 20 03:54:05 Aeris kernel: RSP: 0018:ffff88086fc03d30 EFLAGS: 00010202
Mar 20 03:54:05 Aeris kernel: RAX: 0000000000000188 RBX: 000000000000cf32 RCX: 0000000000000001
Mar 20 03:54:05 Aeris kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffffff81c092c8
Mar 20 03:54:05 Aeris kernel: RBP: ffff8802a12c7b00 R08: 0000000000000101 R09: ffff880213aa1500
Mar 20 03:54:05 Aeris kernel: R10: ffff88068eb0884e R11: 0000000000000000 R12: ffffffff81c8b040
Mar 20 03:54:05 Aeris kernel: R13: 00000000000071a1 R14: ffff88041537db80 R15: ffff88041537dbd8
Mar 20 03:54:05 Aeris kernel: FS:  0000000000000000(0000) GS:ffff88086fc00000(0000) knlGS:0000000000000000
Mar 20 03:54:05 Aeris kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 20 03:54:05 Aeris kernel: CR2: 0000152f80165890 CR3: 0000000001c0a004 CR4: 00000000003606f0
Mar 20 03:54:05 Aeris kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 20 03:54:05 Aeris kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Mar 20 03:54:05 Aeris kernel: Call Trace:
Mar 20 03:54:05 Aeris kernel: <IRQ>
Mar 20 03:54:05 Aeris kernel: ipv4_confirm+0xac/0xb4 [nf_conntrack_ipv4]
Mar 20 03:54:05 Aeris kernel: nf_hook_slow+0x37/0x96
Mar 20 03:54:05 Aeris kernel: ip_local_deliver+0xab/0xd3
Mar 20 03:54:05 Aeris kernel: ? inet_del_offload+0x3e/0x3e
Mar 20 03:54:05 Aeris kernel: ip_rcv+0x311/0x346
Mar 20 03:54:05 Aeris kernel: ? ip_local_deliver_finish+0x1b8/0x1b8
Mar 20 03:54:05 Aeris kernel: __netif_receive_skb_core+0x6ba/0x733
Mar 20 03:54:05 Aeris kernel: ? e1000_irq_enable+0x5a/0x67 [e1000e]
Mar 20 03:54:05 Aeris kernel: process_backlog+0x8c/0x12d
Mar 20 03:54:05 Aeris kernel: net_rx_action+0xfb/0x24f
Mar 20 03:54:05 Aeris kernel: __do_softirq+0xcd/0x1c2
Mar 20 03:54:05 Aeris kernel: do_softirq_own_stack+0x2a/0x40
Mar 20 03:54:05 Aeris kernel: </IRQ>
Mar 20 03:54:05 Aeris kernel: do_softirq+0x46/0x52
Mar 20 03:54:05 Aeris kernel: netif_rx_ni+0x21/0x35
Mar 20 03:54:05 Aeris kernel: macvlan_broadcast+0x117/0x14f [macvlan]
Mar 20 03:54:05 Aeris kernel: ? __clear_rsb+0x25/0x3d
Mar 20 03:54:05 Aeris kernel: macvlan_process_broadcast+0xe4/0x114 [macvlan]
Mar 20 03:54:05 Aeris kernel: process_one_work+0x14c/0x23f
Mar 20 03:54:05 Aeris kernel: ? rescuer_thread+0x258/0x258
Mar 20 03:54:05 Aeris kernel: worker_thread+0x1c3/0x292
Mar 20 03:54:05 Aeris kernel: kthread+0x111/0x119
Mar 20 03:54:05 Aeris kernel: ? kthread_create_on_node+0x3a/0x3a
Mar 20 03:54:05 Aeris kernel: ? kthread_create_on_node+0x3a/0x3a
Mar 20 03:54:05 Aeris kernel: ret_from_fork+0x35/0x40
Mar 20 03:54:05 Aeris kernel: Code: 48 c1 eb 20 89 1c 24 e8 24 f9 ff ff 8b 54 24 04 89 df 89 c6 41 89 c5 e8 a9 fa ff ff 84 c0 75 b9 49 8b 86 80 00 00 00 a8 08 74 02 <0f> 0b 4c 89 f7 e8 03 ff ff ff 49 8b 86 80 00 00 00 0f ba e0 09 
Mar 20 03:54:05 Aeris kernel: ---[ end trace 52bfcc756559bffe ]---

 

Anyone have any ideas? It is getting really annoying to reboot (and then ssh and force reboot) every time I want to manage dockers, view the community applications or check Fix Common Problems.

 

aeris-diagnostics-20180322-0806.zip

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.