- Closed
- Minor
Just now when I stopped array and went to tools->update os-> change it from stable to next and told it to update.
It hung at stopping services and the modal window never populated that it was d/ling the update.
I then went crap and thought maybe it was the docker or something stopping unraid from being able to stop the unraid or something.. so then opened a new tab and went to stop the docker but couldnt because array wasnt running. Then tried to have it just do a clean shutdown from the gui.. nothing worked. Logged into box via ssh and could see that syslog showed that it was trying to reboot but was stalled. I then tried to kill dockers by doing 'docker stop <name>' and then later just doing ' docker stop $(docker ps -aq) ' but with no luck. I then just resorted to issuing 'reboot' at the cli. After rebooting the box it warned me that I did an unclean shutdown but everything started just fine.. I stopped the parity check and made sure that my dockers would start and that my shares worked. Once I felt comfortable that everything was fine I went ahead and stopped the dockers and then just went to upgrad eto 6.5.1-rc1. It then d/led and upgraded just fine, rebooted and all appears well.
While reporting this as a first time issue I see that these call traces have actually been happening since Jan 27th of this year.,.. which is after I upgraded to 6.4.0 final.
D:\data>ls -alh
total 1.9M
drwxr-xr-x 1 zoggy 197121 0 Mar 22 03:08 .
drwxr-xr-x 1 zoggy 197121 0 Mar 22 03:04 ..
-rw-r--r-- 1 zoggy 197121 168K Jan 5 01:06 syslog-20180105-010629.txt
-rw-r--r-- 1 zoggy 197121 150K Jan 7 21:11 syslog-20180107-211113.txt
-rw-r--r-- 1 zoggy 197121 153K Jan 11 10:03 syslog-20180111-100344.txt
-rw-r--r-- 1 zoggy 197121 146K Jan 13 10:01 syslog-20180113-100142.txt
-rw-r--r-- 1 zoggy 197121 205K Jan 27 14:46 syslog-20180127-144626.txt
-rw-r--r-- 1 zoggy 197121 160K Feb 2 14:02 syslog-20180202-140207.txt
-rw-r--r-- 1 zoggy 197121 183K Feb 16 00:57 syslog-20180216-005739.txt
-rw-r--r-- 1 zoggy 197121 277K Mar 14 10:03 syslog-20180314-100310.txt
-rw-r--r-- 1 zoggy 197121 194K Mar 22 02:07 syslog-20180322-020712.txt
-rw-r--r-- 1 zoggy 197121 134K Mar 22 02:20 syslog-20180322-022034.txt
D:\data>grep "page allocation" *
syslog-20180127-144626.txt:Jan 13 13:15:53 husky kernel: smbd: page allocation stalls for 16365ms, order:0, mode:0x17000c2(GFP_KERNEL_ACCOUNT|__GFP_HIGHMEM|__GFP_NOTRACK), nodemask=(null)
syslog-20180314-100310.txt:Mar 1 20:16:07 husky kernel: smbd: page allocation stalls for 17256ms, order:0, mode:0x17000c2(GFP_KERNEL_ACCOUNT|__GFP_HIGHMEM|__GFP_NOTRACK), nodemask=(null)
syslog-20180314-100310.txt:Mar 1 20:16:07 husky kernel: emhttpd: page allocation stalls for 17218ms, order:0
syslog-20180322-020712.txt:Mar 20 14:48:03 husky kernel: sh: page allocation stalls for 16849ms, order:0, mode:0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null)
syslog-20180322-020712.txt:Mar 20 14:48:03 husky kernel: page allocation stalls for 16849ms, order:0
syslog-20180322-020712.txt:Mar 21 12:25:10 husky kernel: smbd: page allocation stalls for 16967ms, order:0, mode:0x1c200ca(GFP_HIGHUSER_MOVABLE|__GFP_WRITE), nodemask=(null)
syslog-20180322-020712.txt:Mar 21 12:25:10 husky kernel: util.rb:23: page allocation stalls for 16955ms, order:0, mode:0x15000c0(GFP_KERNEL_ACCOUNT), nodemask=
syslog-20180322-020712.txt:Mar 22 01:41:20 husky kernel: util.rb:23: page allocation stalls for 17140ms, order:0, mode:0x15000c0(GFP_KERNEL_ACCOUNT), nodemask=
syslog-20180322-020712.txt:Mar 22 01:41:20 husky kernel: smbd: page allocation stalls for 17191ms, order:0
syslog-20180322-020712.txt:Mar 22 01:41:20 husky kernel: page allocation stalls for 17061ms, order:0
from: syslog-20180113-100142.txt
Jan 11 10:06:04 husky emhttpd: unRAID System Management Utility version 6.4.0_rc21b
from: syslog-20180127-144626.txt
Jan 13 10:04:00 husky emhttpd: unRAID System Management Utility version 6.4.0
so something in 6.4.0+ is causing this... and the the call trace tonight (Mar 22) that happen just happen to pop up when I went to upgrade to 6.5.1-rc1.
Mar 21 11:36:53 husky kernel: mdcmd (177): spindown 0 Mar 21 12:25:10 husky kernel: smbd: page allocation stalls for 16967ms, order:0, mode:0x1c200ca(GFP_HIGHUSER_MOVABLE|__GFP_WRITE), nodemask=(null) Mar 21 12:25:10 husky kernel: smbd cpuset=/ mems_allowed=0 Mar 21 12:25:10 husky kernel: CPU: 2 PID: 29874 Comm: smbd Not tainted 4.14.26-unRAID #1 Mar 21 12:25:10 husky kernel: Hardware name: MSI MS-7752/Z77A-G45 (MS-7752), BIOS V2.12 09/29/2013 Mar 21 12:25:10 husky kernel: Call Trace: Mar 21 12:25:10 husky kernel: dump_stack+0x5d/0x79 Mar 21 12:25:10 husky kernel: warn_alloc+0xdf/0x160 Mar 21 12:25:10 husky kernel: ? wakeup_kswapd+0x2c/0xb2 Mar 21 12:25:10 husky kernel: __alloc_pages_nodemask+0x578/0xb03 Mar 21 12:25:10 husky kernel: ? __radix_tree_lookup+0x5a/0x7e Mar 21 12:25:10 husky kernel: util.rb:23: page allocation stalls for 16955ms, order:0, mode:0x15000c0(GFP_KERNEL_ACCOUNT), nodemask= Mar 21 12:25:10 husky kernel: pagecache_get_page+0x13b/0x1c7 Mar 21 12:25:10 husky kernel: (null) Mar 21 12:25:10 husky kernel: grab_cache_page_write_begin+0x1a/0x31 Mar 21 12:25:10 husky kernel: util.rb:23 cpuset= Mar 21 12:25:10 husky kernel: fuse_perform_write+0x15d/0x41f Mar 21 12:25:10 husky kernel: 239220f9d32246ca7150bad013fc467ae0f54c5e6cacbdf59881d589351fd6c5 Mar 21 12:25:10 husky kernel: ? file_remove_privs+0x42/0x8f Mar 21 12:25:10 husky kernel: ? call_rwsem_down_write_failed+0x13/0x20 Mar 21 12:25:10 husky kernel: mems_allowed=0 Mar 21 12:25:10 husky kernel: ? call_rwsem_down_write_failed+0x13/0x20 Mar 21 12:25:10 husky kernel: fuse_file_write_iter+0x1b6/0x22e Mar 21 12:25:10 husky kernel: __vfs_write+0xe1/0x109 Mar 21 12:25:10 husky kernel: vfs_write+0xc3/0x166 Mar 21 12:25:10 husky kernel: SyS_pwrite64+0x5b/0x78 Mar 21 12:25:10 husky kernel: do_syscall_64+0xfe/0x107 Mar 21 12:25:10 husky kernel: entry_SYSCALL_64_after_hwframe+0x3d/0xa2 Mar 21 12:25:10 husky kernel: RIP: 0033:0x1547c0a5bbaf Mar 21 12:25:10 husky kernel: RSP: 002b:00001547aabece40 EFLAGS: 00000293 ORIG_RAX: 0000000000000012 Mar 21 12:25:10 husky kernel: RAX: ffffffffffffffda RBX: 000000000000002d RCX: 00001547c0a5bbaf Mar 21 12:25:10 husky kernel: RDX: 0000000000010000 RSI: 000055e5fd06a990 RDI: 000000000000002d Mar 21 12:25:10 husky kernel: RBP: 000055e5fd06a990 R08: 0000000000000000 R09: 00001547aabed700 Mar 21 12:25:10 husky kernel: R10: 0000000002bf0000 R11: 0000000000000293 R12: 0000000000010000 Mar 21 12:25:10 husky kernel: R13: 0000000002bf0000 R14: 00001547bbcd9360 R15: 000055e5fcfb0850 Mar 21 12:25:10 husky kernel: warn_alloc_show_mem: 1 callbacks suppressed Mar 21 12:25:10 husky kernel: CPU: 3 PID: 18627 Comm: util.rb:23 Not tainted 4.14.26-unRAID #1 Mar 21 12:25:10 husky kernel: Mem-Info: Mar 21 12:25:10 husky kernel: Hardware name: MSI MS-7752/Z77A-G45 (MS-7752), BIOS V2.12 09/29/2013 Mar 21 12:25:10 husky kernel: active_anon:830068 inactive_anon:9387 isolated_anon:0 Mar 21 12:25:10 husky kernel: active_file:8176 inactive_file:37180 isolated_file:0 Mar 21 12:25:10 husky kernel: unevictable:0 dirty:533 writeback:0 unstable:0 Mar 21 12:25:10 husky kernel: slab_reclaimable:6722 slab_unreclaimable:13387 Mar 21 12:25:10 husky kernel: mapped:34609 shmem:120267 pagetables:7183 bounce:0 Mar 21 12:25:10 husky kernel: free:37854 free_pcp:206 free_cma:0 Mar 21 12:25:10 husky kernel: Node 0 active_anon:3320272kB inactive_anon:37548kB active_file:32704kB inactive_file:148720kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:138436kB dirty:2132kB writeback:0kB shmem:481068kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 786432kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 21 12:25:10 husky kernel: Call Trace: Mar 21 12:25:10 husky kernel: Node 0 DMA free:15416kB min:560kB low:700kB high:840kB active_anon:140kB inactive_anon:0kB active_file:0kB inactive_file:344kB unevictable:0kB writepending:104kB present:15984kB managed:15900kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 21 12:25:10 husky kernel: dump_stack+0x5d/0x79 Mar 21 12:25:10 husky kernel: lowmem_reserve[]: Mar 21 12:25:10 husky kernel: warn_alloc+0xdf/0x160 Mar 21 12:25:10 husky kernel: 0 3294 3731 Mar 21 12:25:10 husky kernel: ? wakeup_kswapd+0x2c/0xb2 Mar 21 12:25:10 husky kernel: 3731 Mar 21 12:25:10 husky kernel: __alloc_pages_nodemask+0x578/0xb03 Mar 21 12:25:10 husky kernel: Node 0 Mar 21 12:25:10 husky kernel: ? __alloc_skb+0x8e/0x167 Mar 21 12:25:10 husky kernel: DMA32 free:120452kB min:118848kB low:148560kB high:178272kB active_anon:2946360kB inactive_anon:30052kB active_file:32348kB inactive_file:143244kB unevictable:0kB writepending:2028kB present:3540548kB managed:3461596kB mlocked:0kB kernel_stack:9552kB pagetables:24568kB bounce:0kB free_pcp:952kB local_pcp:208kB free_cma:0kB Mar 21 12:25:10 husky kernel: lowmem_reserve[]: 0 Mar 21 12:25:10 husky kernel: alloc_skb_with_frags+0xcc/0x169 Mar 21 12:25:10 husky kernel: 0 436 Mar 21 12:25:10 husky kernel: ? wait_woken+0x68/0x68 Mar 21 12:25:10 husky kernel: 436 Mar 21 12:25:10 husky kernel: sock_alloc_send_pskb+0x179/0x1cf Mar 21 12:25:10 husky kernel: Node 0 Normal free:15548kB min:15756kB low:19692kB high:23628kB active_anon:373772kB inactive_anon:7496kB active_file:356kB inactive_file:5544kB unevictable:0kB writepending:0kB present:514048kB managed:447296kB mlocked:0kB kernel_stack:1728kB pagetables:4164kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 21 12:25:10 husky kernel: ? ___bpf_prog_run+0xbdb/0xfd4 Mar 21 12:25:10 husky kernel: lowmem_reserve[]: Mar 21 12:25:10 husky kernel: unix_stream_sendmsg+0x172/0x2d5 Mar 21 12:25:10 husky kernel: 0 0 Mar 21 12:25:10 husky kernel: sock_sendmsg+0x14/0x1e Mar 21 12:25:10 husky kernel: 0 Mar 21 12:25:10 husky kernel: sock_write_iter+0x70/0x86 Mar 21 12:25:10 husky kernel: 0 Mar 21 12:25:10 husky kernel: __vfs_write+0xe1/0x109 Mar 21 12:25:10 husky kernel: Node 0 Mar 21 12:25:10 husky kernel: vfs_write+0xc3/0x166 Mar 21 12:25:10 husky kernel: DMA: 2*4kB Mar 21 12:25:10 husky kernel: SyS_write+0x48/0x81 Mar 21 12:25:10 husky kernel: (UM) Mar 21 12:25:10 husky kernel: do_syscall_64+0xfe/0x107 Mar 21 12:25:10 husky kernel: 2*8kB Mar 21 12:25:10 husky kernel: entry_SYSCALL_64_after_hwframe+0x3d/0xa2 Mar 21 12:25:10 husky kernel: (UM) Mar 21 12:25:10 husky kernel: RIP: 0033:0x7f6af47222dd Mar 21 12:25:10 husky kernel: RSP: 002b:00007f6ae3dc0950 EFLAGS: 00000293 Mar 21 12:25:10 husky kernel: 2*16kB (UM) Mar 21 12:25:10 husky kernel: ORIG_RAX: 0000000000000001 Mar 21 12:25:10 husky kernel: 0*32kB Mar 21 12:25:10 husky kernel: RAX: ffffffffffffffda RBX: 00007f6adf957238 RCX: 00007f6af47222dd Mar 21 12:25:10 husky kernel: 2*64kB Mar 21 12:25:10 husky kernel: RDX: 0000000000001647 RSI: 00007f6abc782000 RDI: 0000000000000027 Mar 21 12:25:10 husky kernel: RBP: 00007f6abc132b60 R08: 00007f6af4ab91d0 R09: 0000000000000000 Mar 21 12:25:10 husky kernel: (U) Mar 21 12:25:10 husky kernel: R10: 0000000000000003 R11: 0000000000000293 R12: 0000000000000014 Mar 21 12:25:10 husky kernel: 1*128kB Mar 21 12:25:10 husky kernel: R13: 00007f6ac5d0d340 R14: 00007f6af345bc70 R15: 0000000000000002 Mar 21 12:25:10 husky kernel: (U) 1*256kB (U) 1*512kB (M) 2*1024kB (UM) 2*2048kB (UM) 2*4096kB (ME) = 15416kB Mar 21 12:25:10 husky kernel: Node 0 DMA32: 181*4kB (UME) 1343*8kB (UME) 1577*16kB (UME) 898*32kB (UME) 380*64kB (UME) 125*128kB (UE) 17*256kB (UE) 13*512kB (UM) 4*1024kB (ME) 0*2048kB 0*4096kB = 120860kB Mar 21 12:25:10 husky kernel: Node 0 Normal: 221*4kB (UMEH) 179*8kB (UEH) 125*16kB (UMEH) 51*32kB (UMEH) 44*64kB (UMEH) 23*128kB (UMEH) 9*256kB (UMH) 1*512kB (E) 1*1024kB (M) 0*2048kB 0*4096kB = 15548kB Mar 21 12:25:10 husky kernel: 165548 total pagecache pages Mar 21 12:25:10 husky kernel: 0 pages in swap cache Mar 21 12:25:10 husky kernel: Swap cache stats: add 0, delete 0, find 0/0 Mar 21 12:25:10 husky kernel: Free swap = 0kB Mar 21 12:25:10 husky kernel: Total swap = 0kB Mar 21 12:25:10 husky kernel: 1017645 pages RAM Mar 21 12:25:10 husky kernel: 0 pages HighMem/MovableOnly Mar 21 12:25:10 husky kernel: 36447 pages reserved Mar 21 12:25:10 husky kernel: 0 pages cma reserved Mar 21 13:00:01 husky Docker Auto Update: Community Applications Docker Autoupdate running Mar 21 13:00:01 husky Docker Auto Update: Checking for available updates Mar 21 13:18:03 husky Docker Auto Update: Installing Updates for 0 Mar 21 13:18:04 husky Docker Auto Update: Community Applications Docker Autoupdate finished Mar 21 15:25:57 husky kernel: mdcmd (178): spindown 0 Mar 21 17:47:02 husky kernel: mdcmd (179): spindown 4 Mar 21 19:27:45 husky kernel: mdcmd (180): spindown 12 Mar 21 19:27:55 husky kernel: mdcmd (181): spindown 2 Mar 21 19:27:59 husky kernel: mdcmd (182): spindown 3 Mar 21 19:28:00 husky kernel: mdcmd (183): spindown 14 Mar 21 19:28:01 husky kernel: mdcmd (184): spindown 1 Mar 21 19:28:09 husky kernel: mdcmd (185): spindown 5 Mar 21 19:29:55 husky kernel: mdcmd (186): spindown 8 Mar 21 19:36:03 husky kernel: mdcmd (187): spindown 9 Mar 21 19:36:03 husky kernel: mdcmd (188): spindown 13 Mar 22 00:00:01 husky Plugin Auto Update: Checking for available plugin updates Mar 22 00:00:02 husky Plugin Auto Update: Update available for tips.and.tweaks.plg (Not set to Auto Update) Mar 22 00:00:02 husky Plugin Auto Update: Community Applications Plugin Auto Update finished Mar 22 01:41:20 husky kernel: util.rb:23: page allocation stalls for 17140ms, order:0, mode:0x15000c0(GFP_KERNEL_ACCOUNT), nodemask= Mar 22 01:41:20 husky kernel: smbd: page allocation stalls for 17191ms, order:0 Mar 22 01:41:20 husky kernel: (null) Mar 22 01:41:20 husky kernel: , mode:0x1c200ca(GFP_HIGHUSER_MOVABLE|__GFP_WRITE), nodemask= Mar 22 01:41:20 husky kernel: util.rb:23 cpuset= Mar 22 01:41:20 husky kernel: (null) Mar 22 01:41:20 husky kernel: 239220f9d32246ca7150bad013fc467ae0f54c5e6cacbdf59881d589351fd6c5 Mar 22 01:41:20 husky kernel: smbd cpuset= Mar 22 01:41:20 husky kernel: mems_allowed=0 Mar 22 01:41:20 husky kernel: / mems_allowed=0 Mar 22 01:41:20 husky kernel: CPU: 0 PID: 18627 Comm: util.rb:23 Not tainted 4.14.26-unRAID #1 Mar 22 01:41:20 husky kernel: Hardware name: MSI MS-7752/Z77A-G45 (MS-7752), BIOS V2.12 09/29/2013 Mar 22 01:41:20 husky kernel: Call Trace: Mar 22 01:41:20 husky kernel: dump_stack+0x5d/0x79 Mar 22 01:41:20 husky kernel: warn_alloc+0xdf/0x160 Mar 22 01:41:20 husky kernel: ? wakeup_kswapd+0x2c/0xb2 Mar 22 01:41:20 husky kernel: __alloc_pages_nodemask+0x578/0xb03 Mar 22 01:41:20 husky kernel: ? __alloc_skb+0x8e/0x167 Mar 22 01:41:20 husky kernel: alloc_skb_with_frags+0xcc/0x169 Mar 22 01:41:20 husky kernel: ? wait_woken+0x68/0x68 Mar 22 01:41:20 husky kernel: sock_alloc_send_pskb+0x179/0x1cf Mar 22 01:41:20 husky kernel: ? ___bpf_prog_run+0xbdb/0xfd4 Mar 22 01:41:20 husky kernel: unix_stream_sendmsg+0x172/0x2d5 Mar 22 01:41:20 husky kernel: sock_sendmsg+0x14/0x1e Mar 22 01:41:20 husky kernel: sock_write_iter+0x70/0x86 Mar 22 01:41:20 husky kernel: __vfs_write+0xe1/0x109 Mar 22 01:41:20 husky kernel: vfs_write+0xc3/0x166 Mar 22 01:41:20 husky kernel: SyS_write+0x48/0x81 Mar 22 01:41:20 husky kernel: do_syscall_64+0xfe/0x107 Mar 22 01:41:20 husky kernel: entry_SYSCALL_64_after_hwframe+0x3d/0xa2 Mar 22 01:41:20 husky kernel: RIP: 0033:0x7f6af47222dd Mar 22 01:41:20 husky kernel: RSP: 002b:00007f6ae3dc0950 EFLAGS: 00000293 ORIG_RAX: 0000000000000001 Mar 22 01:41:20 husky kernel: RAX: ffffffffffffffda RBX: 00007f6ae1aeaa08 RCX: 00007f6af47222dd Mar 22 01:41:20 husky kernel: RDX: 0000000000001647 RSI: 00007f6abd2be000 RDI: 0000000000000025 Mar 22 01:41:20 husky kernel: RBP: 00007f6ac73bd000 R08: 00007f6af4ab91d0 R09: 0000000000000000 Mar 22 01:41:20 husky kernel: R10: 0000000000000003 R11: 0000000000000293 R12: 0000000000000014 Mar 22 01:41:20 husky kernel: R13: 00007f6ac5d0d340 R14: 00007f6af345bc70 R15: 0000000000000002 Mar 22 01:41:20 husky kernel: warn_alloc_show_mem: 1 callbacks suppressed Mar 22 01:41:20 husky kernel: CPU: 1 PID: 6085 Comm: smbd Not tainted 4.14.26-unRAID #1 Mar 22 01:41:20 husky kernel: Mem-Info: Mar 22 01:41:20 husky kernel: Hardware name: MSI MS-7752/Z77A-G45 (MS-7752), BIOS V2.12 09/29/2013 Mar 22 01:41:20 husky kernel: active_anon:827113 inactive_anon:9364 isolated_anon:0 Mar 22 01:41:20 husky kernel: active_file:11297 inactive_file:35287 isolated_file:0 Mar 22 01:41:20 husky kernel: unevictable:0 dirty:19 writeback:0 unstable:0 Mar 22 01:41:20 husky kernel: slab_reclaimable:7765 slab_unreclaimable:13324 Mar 22 01:41:20 husky kernel: mapped:34949 shmem:120269 pagetables:7092 bounce:0 Mar 22 01:41:20 husky kernel: free:36877 free_pcp:178 free_cma:0 Mar 22 01:41:20 husky kernel: Node 0 active_anon:3308452kB inactive_anon:37456kB active_file:45188kB inactive_file:141148kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:139796kB dirty:76kB writeback:0kB shmem:481076kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 815104kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no Mar 22 01:41:20 husky kernel: Call Trace: Mar 22 01:41:20 husky kernel: Node 0 DMA free:15472kB min:560kB low:700kB high:840kB active_anon:220kB inactive_anon:0kB active_file:48kB inactive_file:160kB unevictable:0kB writepending:0kB present:15984kB managed:15900kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 22 01:41:20 husky kernel: dump_stack+0x5d/0x79 Mar 22 01:41:20 husky kernel: lowmem_reserve[]: 0 Mar 22 01:41:20 husky kernel: warn_alloc+0xdf/0x160 Mar 22 01:41:20 husky kernel: emhttpd: Mar 22 01:41:20 husky kernel: ? wakeup_kswapd+0x2c/0xb2 Mar 22 01:41:20 husky kernel: 3294 Mar 22 01:41:20 husky kernel: __alloc_pages_nodemask+0x578/0xb03 Mar 22 01:41:20 husky kernel: page allocation stalls for 17061ms, order:0 Mar 22 01:41:20 husky kernel: ? __radix_tree_lookup+0x5a/0x7e Mar 22 01:41:20 husky kernel: 3731 Mar 22 01:41:20 husky kernel: pagecache_get_page+0x13b/0x1c7 Mar 22 01:41:20 husky kernel: , mode:0x14000c0(GFP_KERNEL), nodemask= Mar 22 01:41:20 husky kernel: grab_cache_page_write_begin+0x1a/0x31 Mar 22 01:41:20 husky kernel: 3731 Mar 22 01:41:20 husky kernel: fuse_perform_write+0x15d/0x41f Mar 22 01:41:20 husky kernel: (null) Mar 22 01:41:20 husky kernel: ? cap_inode_need_killpriv+0x15/0x1e Mar 22 01:41:20 husky kernel: emhttpd cpuset= Mar 22 01:41:20 husky kernel: Node 0 Mar 22 01:41:20 husky kernel: ? dentry_needs_remove_privs+0x20/0x32 Mar 22 01:41:20 husky kernel: DMA32 free:120032kB min:118848kB low:148560kB high:178272kB active_anon:2934084kB inactive_anon:29964kB active_file:45140kB inactive_file:137176kB unevictable:0kB writepending:76kB present:3540548kB managed:3461596kB mlocked:0kB kernel_stack:8096kB pagetables:22980kB bounce:0kB free_pcp:840kB local_pcp:0kB free_cma:0kB Mar 22 01:41:20 husky kernel: lowmem_reserve[]: Mar 22 01:41:20 husky kernel: / Mar 22 01:41:20 husky kernel: ? file_remove_privs+0x42/0x8f Mar 22 01:41:20 husky kernel: mems_allowed=0 Mar 22 01:41:20 husky kernel: 0 Mar 22 01:41:20 husky kernel: ? futex_wake+0x10d/0x11e Mar 22 01:41:20 husky kernel: 0 Mar 22 01:41:20 husky kernel: fuse_file_write_iter+0x1b6/0x22e Mar 22 01:41:20 husky kernel: 436 Mar 22 01:41:20 husky kernel: __vfs_write+0xe1/0x109 Mar 22 01:41:20 husky kernel: 436 Mar 22 01:41:20 husky kernel: vfs_write+0xc3/0x166 Mar 22 01:41:20 husky kernel: Node 0 Normal free:12004kB min:15756kB low:19692kB high:23628kB active_anon:374148kB inactive_anon:7492kB active_file:0kB inactive_file:4392kB unevictable:0kB writepending:0kB present:514048kB managed:447296kB mlocked:0kB kernel_stack:1696kB pagetables:5388kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 22 01:41:20 husky kernel: lowmem_reserve[]: Mar 22 01:41:20 husky kernel: SyS_pwrite64+0x5b/0x78 Mar 22 01:41:20 husky kernel: 0 Mar 22 01:41:20 husky kernel: do_syscall_64+0xfe/0x107 Mar 22 01:41:20 husky kernel: 0 Mar 22 01:41:20 husky kernel: entry_SYSCALL_64_after_hwframe+0x3d/0xa2 Mar 22 01:41:20 husky kernel: 0 Mar 22 01:41:20 husky kernel: RIP: 0033:0x1547c0a5bbaf Mar 22 01:41:20 husky kernel: 0 Mar 22 01:41:20 husky kernel: RSP: 002b:00001547a35b1e40 EFLAGS: 00000293 ORIG_RAX: 0000000000000012 Mar 22 01:41:20 husky kernel: RAX: ffffffffffffffda RBX: 000000000000002d RCX: 00001547c0a5bbaf Mar 22 01:41:20 husky kernel: RDX: 0000000000010000 RSI: 000055e5fd0450d0 RDI: 000000000000002d Mar 22 01:41:20 husky kernel: Node 0 DMA: Mar 22 01:41:20 husky kernel: RBP: 000055e5fd0450d0 R08: 0000000000000000 R09: 00000000ffffffff Mar 22 01:41:20 husky kernel: R10: 0000000002280000 R11: 0000000000000293 R12: 0000000000010000 Mar 22 01:41:20 husky kernel: R13: 0000000002280000 R14: 00001547bbcd9360 R15: 000055e5fcfb0850 Mar 22 01:41:20 husky kernel: 2*4kB (UM) 1*8kB Mar 22 01:41:20 husky kernel: CPU: 3 PID: 7084 Comm: emhttpd Not tainted 4.14.26-unRAID #1 Mar 22 01:41:20 husky kernel: (U) Mar 22 01:41:20 husky kernel: Hardware name: MSI MS-7752/Z77A-G45 (MS-7752), BIOS V2.12 09/29/2013 Mar 22 01:41:20 husky kernel: 2*16kB Mar 22 01:41:20 husky kernel: Call Trace: Mar 22 01:41:20 husky kernel: (UM) 0*32kB Mar 22 01:41:20 husky kernel: dump_stack+0x5d/0x79 Mar 22 01:41:20 husky kernel: 3*64kB Mar 22 01:41:20 husky kernel: warn_alloc+0xdf/0x160 Mar 22 01:41:20 husky kernel: (UM) Mar 22 01:41:20 husky kernel: ? wakeup_kswapd+0x2c/0xb2 Mar 22 01:41:20 husky kernel: 1*128kB Mar 22 01:41:20 husky kernel: __alloc_pages_nodemask+0x578/0xb03 Mar 22 01:41:20 husky kernel: (U) 1*256kB Mar 22 01:41:20 husky kernel: ? __fuse_get_req+0xf6/0x127 Mar 22 01:41:20 husky kernel: (U) Mar 22 01:41:20 husky kernel: fuse_readdir+0x6a/0x565 Mar 22 01:41:20 husky kernel: 1*512kB Mar 22 01:41:20 husky kernel: ? __handle_mm_fault+0xfa9/0xff7 Mar 22 01:41:20 husky kernel: (M) Mar 22 01:41:20 husky kernel: iterate_dir+0x96/0x12a Mar 22 01:41:20 husky kernel: 2*1024kB (UM) 2*2048kB Mar 22 01:41:20 husky kernel: SyS_getdents+0x8a/0xea Mar 22 01:41:20 husky kernel: (UM) Mar 22 01:41:20 husky kernel: ? compat_fillonedir+0xb7/0xb7 Mar 22 01:41:20 husky kernel: 2*4096kB (ME) Mar 22 01:41:20 husky kernel: ? __do_page_fault+0x365/0x3e2 Mar 22 01:41:20 husky kernel: = 15472kB Mar 22 01:41:20 husky kernel: ? do_syscall_64+0xfe/0x107 Mar 22 01:41:20 husky kernel: ? SyS_old_readdir+0x96/0x96 Mar 22 01:41:20 husky kernel: Node 0 Mar 22 01:41:20 husky kernel: do_syscall_64+0xfe/0x107 Mar 22 01:41:20 husky kernel: DMA32: Mar 22 01:41:20 husky kernel: entry_SYSCALL_64_after_hwframe+0x3d/0xa2 Mar 22 01:41:20 husky kernel: RIP: 0033:0x1537ba21c228 Mar 22 01:41:20 husky kernel: 230*4kB (UME) Mar 22 01:41:20 husky kernel: RSP: 002b:00001537b971ea60 EFLAGS: 00000206 Mar 22 01:41:20 husky kernel: 1103*8kB Mar 22 01:41:20 husky kernel: ORIG_RAX: 000000000000004e Mar 22 01:41:20 husky kernel: (UME) 1552*16kB Mar 22 01:41:20 husky kernel: RAX: ffffffffffffffda RBX: 00001537ac12c4f0 RCX: 00001537ba21c228 Mar 22 01:41:20 husky kernel: (UME) Mar 22 01:41:20 husky kernel: RDX: 0000000000008000 RSI: 00001537ac12c4f0 RDI: 0000000000000007 Mar 22 01:41:20 husky kernel: 696*32kB Mar 22 01:41:20 husky kernel: RBP: 00001537ac12c4f0 R08: 0000000000000078 R09: 0000000000000000 Mar 22 01:41:20 husky kernel: (UME) Mar 22 01:41:20 husky kernel: R10: 00001537ac0008d0 R11: 0000000000000206 R12: ffffffffffffff78 Mar 22 01:41:20 husky kernel: R13: 0000000000000000 R14: ffffffffffffff78 R15: 00001537ac12c4c0 Mar 22 01:41:20 husky kernel: 350*64kB (UME) 125*128kB (UME) 40*256kB (UME) 21*512kB (UM) 4*1024kB (ME) 0*2048kB 0*4096kB = 120336kB Mar 22 01:41:20 husky kernel: Node 0 Normal: 115*4kB (UEH) 113*8kB (UMEH) 177*16kB (UMEH) 36*32kB (MEH) 22*64kB (UMEH) 11*128kB (UMEH) 9*256kB (UMH) 1*512kB (E) 1*1024kB (M) 0*2048kB 0*4096kB = 12004kB Mar 22 01:41:20 husky kernel: 166776 total pagecache pages Mar 22 01:41:20 husky kernel: 0 pages in swap cache Mar 22 01:41:20 husky kernel: Swap cache stats: add 0, delete 0, find 0/0 Mar 22 01:41:20 husky kernel: Free swap = 0kB Mar 22 01:41:20 husky kernel: Total swap = 0kB Mar 22 01:41:20 husky kernel: 1017645 pages RAM Mar 22 01:41:20 husky kernel: 0 pages HighMem/MovableOnly Mar 22 01:41:20 husky kernel: 36447 pages reserved Mar 22 01:41:20 husky kernel: 0 pages cma reserved Mar 22 01:51:14 husky emhttpd: req (4): startState=STARTED&file=&optionCorrect=correct&csrf_token=****************&cmdStop=Stop Mar 22 01:51:14 husky emhttpd: Spinning up all drives... Mar 22 01:51:14 husky emhttpd: shcmd (22911): /usr/sbin/hdparm -S0 /dev/sdn Mar 22 01:51:14 husky kernel: mdcmd (189): nocheck Mar 22 01:51:14 husky kernel: md: nocheck_array: check not active Mar 22 01:51:14 husky kernel: mdcmd (190): spinup 0 Mar 22 01:51:14 husky kernel: mdcmd (191): spinup 1 Mar 22 01:51:14 husky kernel: mdcmd (192): spinup 2 Mar 22 01:51:14 husky kernel: mdcmd (193): spinup 3 Mar 22 01:51:14 husky kernel: mdcmd (194): spinup 4 Mar 22 01:51:14 husky kernel: mdcmd (195): spinup 5 Mar 22 01:51:14 husky kernel: mdcmd (196): spinup 8 Mar 22 01:51:14 husky kernel: mdcmd (197): spinup 9 Mar 22 01:51:14 husky kernel: mdcmd (198): spinup 12 Mar 22 01:51:14 husky kernel: mdcmd (199): spinup 13 Mar 22 01:51:14 husky kernel: mdcmd (200): spinup 14 Mar 22 01:51:14 husky root: Mar 22 01:51:14 husky root: /dev/sdn: Mar 22 01:51:14 husky root: setting standby to 0 (off) Mar 22 01:51:14 husky emhttpd: shcmd (22912): /usr/sbin/hdparm -S0 /dev/sdj Mar 22 01:51:14 husky root: Mar 22 01:51:14 husky root: /dev/sdj: Mar 22 01:51:14 husky root: setting standby to 0 (off) Mar 22 01:51:16 husky emhttpd: Stopping services... Mar 22 01:51:16 husky emhttpd: shcmd (22915): /etc/rc.d/rc.docker stop Mar 22 01:51:21 husky kernel: docker0: port 1(vethe96ca6f) entered disabled state Mar 22 01:51:21 husky kernel: veth85da99e: renamed from eth0 Mar 22 01:51:21 husky avahi-daemon[6775]: Interface vethe96ca6f.IPv6 no longer relevant for mDNS. Mar 22 01:51:21 husky avahi-daemon[6775]: Leaving mDNS multicast group on interface vethe96ca6f.IPv6 with address fe80::8836:a7ff:fe28:b85a. Mar 22 01:51:21 husky kernel: docker0: port 1(vethe96ca6f) entered disabled state Mar 22 01:51:21 husky kernel: device vethe96ca6f left promiscuous mode Mar 22 01:51:21 husky kernel: docker0: port 1(vethe96ca6f) entered disabled state Mar 22 01:51:21 husky avahi-daemon[6775]: Withdrawing address record for fe80::8836:a7ff:fe28:b85a on vethe96ca6f. Mar 22 01:57:51 husky sshd[19266]: Accepted password for root from 192.168.0.2 port 49422 ssh2 Mar 22 02:03:42 husky nginx: 2018/03/22 02:03:42 [error] 6918#6918: *988786 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.168.0.2, server: , request: "POST /plugins/community.applications/include/exec.php HTTP/1.1", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.0.11", referrer: "http://192.168.0.11/Apps" Mar 22 02:05:50 husky sshd[19266]: error: Received disconnect from 192.168.0.2 port 49422:0: Mar 22 02:05:50 husky sshd[19266]: Disconnected from user root 192.168.0.2 port 49422 Mar 22 02:06:01 husky shutdown[9779]: shutting down for system reboot Mar 22 02:06:04 husky init: Switching to runlevel: 6 Mar 22 02:07:08 husky root: Status of all loop devices Mar 22 02:07:08 husky root: /dev/loop1: [2049]:4 (/boot/bzfirmware) Mar 22 02:07:08 husky root: /dev/loop2: [0031]:257 (/mnt/cache/docker.img) Mar 22 02:07:08 husky root: /dev/loop0: [2049]:3 (/boot/bzmodules) Mar 22 02:07:08 husky root: Active pids left on /mnt/* Mar 22 02:07:08 husky root: USER PID ACCESS COMMAND Mar 22 02:07:08 husky root: /mnt/cache: root kernel mount /mnt/cache Mar 22 02:07:08 husky root: (unknown) 3473 F.... postgres Mar 22 02:07:08 husky root: (unknown) 4706 F.... bundle Mar 22 02:07:08 husky root: (unknown) 5774 F.... postgres Mar 22 02:07:08 husky root: (unknown) 6308 F.... postgres Mar 22 02:07:08 husky root: (unknown) 6313 F.... postgres Mar 22 02:07:08 husky root: (unknown) 8807 F.... bundle Mar 22 02:07:08 husky root: (unknown) 8871 F.... postgres Mar 22 02:07:08 husky root: (unknown) 11231 F.... postgres Mar 22 02:07:08 husky root: (unknown) 11786 F.... postgres Mar 22 02:07:08 husky root: (unknown) 15205 F.... bundle Mar 22 02:07:08 husky root: (unknown) 15872 F.... postgres Mar 22 02:07:08 husky root: root 16622 F.... svlogd Mar 22 02:07:08 husky root: root 17390 f.... tail Mar 22 02:07:08 husky root: root 17500 F.... svlogd Mar 22 02:07:08 husky root: root 17502 F.... svlogd Mar 22 02:07:08 husky root: root 17504 F.... svlogd Mar 22 02:07:08 husky root: root 17505 F.... svlogd Mar 22 02:07:08 husky root: root 17506 F.... svlogd Mar 22 02:07:08 husky root: (unknown) 17507 F.... prometheus Mar 22 02:07:08 husky root: root 17508 F.... svlogd Mar 22 02:07:08 husky root: root 17513 F.... svlogd Mar 22 02:07:08 husky root: root 17514 F.... svlogd Mar 22 02:07:08 husky root: root 17515 F.... svlogd Mar 22 02:07:08 husky root: root 17516 F.... svlogd Mar 22 02:07:08 husky root: root 17519 F.... nginx Mar 22 02:07:08 husky root: root 17522 F.... svlogd Mar 22 02:07:08 husky root: root 17523 F.... svlogd Mar 22 02:07:08 husky root: (unknown) 17524 F.... bundle Mar 22 02:07:08 husky root: root 17526 F.... svlogd Mar 22 02:07:08 husky root: (unknown) 17580 F.... nginx Mar 22 02:07:08 husky root: (unknown) 17581 F.... nginx Mar 22 02:07:08 husky root: (unknown) 17582 F.... nginx Mar 22 02:07:08 husky root: (unknown) 17583 F.... nginx Mar 22 02:07:08 husky root: (unknown) 17584 F.... nginx Mar 22 02:07:08 husky root: (unknown) 17590 F.... postgres Mar 22 02:07:08 husky root: (unknown) 17593 F.... postgres Mar 22 02:07:08 husky root: (unknown) 17651 F.... bundle Mar 22 02:07:08 husky root: (unknown) 18025 F.... postgres Mar 22 02:07:08 husky root: (unknown) 18029 F.... postgres Mar 22 02:07:08 husky root: (unknown) 18030 F.... postgres Mar 22 02:07:08 husky root: (unknown) 18031 F.... postgres Mar 22 02:07:08 husky root: (unknown) 19133 F.... bundle Mar 22 02:07:08 husky root: (unknown) 19294 F.... postgres Mar 22 02:07:08 husky root: (unknown) 21036 F.... postgres Mar 22 02:07:08 husky root: (unknown) 22320 F.... postgres Mar 22 02:07:08 husky root: (unknown) 26275 F.... bundle Mar 22 02:07:08 husky root: (unknown) 26966 F.... postgres Mar 22 02:07:08 husky root: (unknown) 27158 F.... postgres Mar 22 02:07:08 husky root: (unknown) 28458 F.... postgres Mar 22 02:07:08 husky root: /mnt/disk1: root kernel mount /mnt/disk1 Mar 22 02:07:08 husky root: /mnt/disk12: root kernel mount /mnt/disk12 Mar 22 02:07:08 husky root: /mnt/disk13: root kernel mount /mnt/disk13 Mar 22 02:07:08 husky root: /mnt/disk14: root kernel mount /mnt/disk14 Mar 22 02:07:08 husky root: /mnt/disk2: root kernel mount /mnt/disk2 Mar 22 02:07:08 husky root: /mnt/disk3: root kernel mount /mnt/disk3 Mar 22 02:07:08 husky root: /mnt/disk4: root kernel mount /mnt/disk4 Mar 22 02:07:08 husky root: /mnt/disk5: root kernel mount /mnt/disk5 Mar 22 02:07:08 husky root: /mnt/disk8: root kernel mount /mnt/disk8 Mar 22 02:07:08 husky root: /mnt/disk9: root kernel mount /mnt/disk9 Mar 22 02:07:08 husky root: /mnt/user: root kernel mount /mnt/user Mar 22 02:07:08 husky root: zoggy 5542 ..c.. smbd Mar 22 02:07:08 husky root: root 9980 f.c.. smbd Mar 22 02:07:08 husky root: /mnt/user0: root kernel mount /mnt/user0 Mar 22 02:07:08 husky root: Active pids left on /dev/md* Mar 22 02:07:08 husky root: USER PID ACCESS COMMAND Mar 22 02:07:08 husky root: /dev/md1: root kernel mount /mnt/disk1 Mar 22 02:07:08 husky root: /dev/md12: root kernel mount /mnt/disk12 Mar 22 02:07:08 husky root: /dev/md13: root kernel mount /mnt/disk13 Mar 22 02:07:08 husky root: /dev/md14: root kernel mount /mnt/disk14 Mar 22 02:07:08 husky root: /dev/md2: root kernel mount /mnt/disk2 Mar 22 02:07:08 husky root: /dev/md3: root kernel mount /mnt/disk3 Mar 22 02:07:08 husky root: /dev/md4: root kernel mount /mnt/disk4 Mar 22 02:07:08 husky root: /dev/md5: root kernel mount /mnt/disk5 Mar 22 02:07:08 husky root: /dev/md8: root kernel mount /mnt/disk8 Mar 22 02:07:08 husky root: /dev/md9: root kernel mount /mnt/disk9 Mar 22 02:07:08 husky root: Generating diagnostics... Mar 22 02:07:12 husky root: Capture diagnostics to /boot/logs