Dockers crasing/stalling/vanising


inabon

Recommended Posts

HI guys after update to latest version i am having an issue with all dockers.

I leave them working doing their thing (nextcloud, letsencrypt,maira,radarr,sab,jackett,transmission) I wake up and log in to unraid dashboard and all dockers are gone from the top. when i go to docker settings blank template by blank by blank template i mean no settings for dockers, when i go to dockers same thing not even dockers need to be started warning.

here unraid log for the period.

Oct 3 07:14:39 nas kernel: 7-...!: (0 ticks this GP) idle=864/0/0 softirq=1457840/1457840 fqs=0 
Oct 3 07:14:39 nas kernel: (detected by 6, t=60002 jiffies, g=814908, c=814907, q=151977)
Oct 3 07:14:39 nas kernel: Sending NMI from CPU 6 to CPUs 7:
Oct 3 07:14:39 nas kernel: NMI backtrace for cpu 7 skipped: idling at mwait_idle+0x52/0x6a
Oct 3 07:14:39 nas kernel: rcu_sched kthread starved for 60003 jiffies! g814908 c814907 f0x0 RCU_GP_WAIT_FQS(3) ->state=0x402 ->cpu=7
Oct 3 07:14:39 nas kernel: RCU grace-period kthread stack dump:
Oct 3 07:14:39 nas kernel: rcu_sched I 0 10 2 0x80000000
Oct 3 07:14:39 nas kernel: Call Trace:
Oct 3 07:14:39 nas kernel: ? __schedule+0x4e0/0x53b
Oct 3 07:14:39 nas kernel: ? sync_sched_exp_handler+0x91/0x91
Oct 3 07:14:39 nas kernel: schedule+0x5b/0x6c
Oct 3 07:14:39 nas kernel: schedule_timeout+0x1cc/0x20c
Oct 3 07:14:39 nas kernel: ? collect_expired_timers+0x92/0x92
Oct 3 07:14:39 nas kernel: rcu_gp_kthread+0x3c1/0x70a
Oct 3 07:14:39 nas kernel: kthread+0x10b/0x113
Oct 3 07:14:39 nas kernel: ? kthread_flush_work_fn+0x9/0x9
Oct 3 07:14:39 nas kernel: ret_from_fork+0x35/0x40
Oct 3 07:17:39 nas kernel: INFO: rcu_sched detected stalls on CPUs/tasks:
Oct 3 07:17:39 nas kernel: 7-...!: (0 ticks this GP) idle=0c0/0/0 softirq=1457840/1457840 fqs=1 
Oct 3 07:17:39 nas kernel: (detected by 4, t=240007 jiffies, g=814908, c=814907, q=175359)
Oct 3 07:17:39 nas kernel: Sending NMI from CPU 4 to CPUs 7:
Oct 3 07:17:39 nas kernel: NMI backtrace for cpu 7 skipped: idling at mwait_idle+0x52/0x6a
Oct 3 07:17:39 nas kernel: rcu_sched kthread starved for 180004 jiffies! g814908 c814907 f0x0 RCU_GP_WAIT_FQS(3) ->state=0x402 ->cpu=7
Oct 3 07:17:39 nas kernel: RCU grace-period kthread stack dump:
Oct 3 07:17:39 nas kernel: rcu_sched I 0 10 2 0x80000000
Oct 3 07:17:39 nas kernel: Call Trace:
Oct 3 07:17:39 nas kernel: ? __schedule+0x4e0/0x53b
Oct 3 07:17:39 nas kernel: ? sync_sched_exp_handler+0x91/0x91
Oct 3 07:17:39 nas kernel: schedule+0x5b/0x6c
Oct 3 07:17:39 nas kernel: schedule_timeout+0x1cc/0x20c
Oct 3 07:17:39 nas kernel: ? collect_expired_timers+0x92/0x92
Oct 3 07:17:39 nas kernel: rcu_gp_kthread+0x3c1/0x70a
Oct 3 07:17:39 nas kernel: kthread+0x10b/0x113
Oct 3 07:17:39 nas kernel: ? kthread_flush_work_fn+0x9/0x9
Oct 3 07:17:39 nas kernel: ret_from_fork+0x35/0x40
Oct 3 07:18:34 nas shutdown[23863]: shutting down for system reboot
Oct 3 07:18:39 nas kernel: INFO: rcu_sched detected stalls on CPUs/tasks:
Oct 3 07:18:39 nas kernel: 7-...!: (0 ticks this GP) idle=264/0/0 softirq=1457840/1457840 fqs=0 
Oct 3 07:18:39 nas kernel: (detected by 0, t=60002 jiffies, g=814909, c=814908, q=187988)
Oct 3 07:18:39 nas kernel: Sending NMI from CPU 0 to CPUs 7:
Oct 3 07:18:39 nas kernel: NMI backtrace for cpu 7 skipped: idling at mwait_idle+0x52/0x6a
Oct 3 07:18:39 nas kernel: rcu_sched kthread starved for 60003 jiffies! g814909 c814908 f0x0 RCU_GP_WAIT_FQS(3) ->state=0x402 ->cpu=7
Oct 3 07:18:39 nas kernel: RCU grace-period kthread stack dump:
Oct 3 07:18:39 nas kernel: rcu_sched I 0 10 2 0x80000000
Oct 3 07:18:39 nas kernel: Call Trace:
Oct 3 07:18:39 nas kernel: ? __schedule+0x4e0/0x53b
Oct 3 07:18:39 nas kernel: ? sync_sched_exp_handler+0x91/0x91
Oct 3 07:18:39 nas kernel: schedule+0x5b/0x6c
Oct 3 07:18:39 nas kernel: schedule_timeout+0x1cc/0x20c
Oct 3 07:18:39 nas kernel: ? collect_expired_timers+0x92/0x92
Oct 3 07:18:39 nas kernel: rcu_gp_kthread+0x3c1/0x70a
Oct 3 07:18:39 nas kernel: kthread+0x10b/0x113
Oct 3 07:18:39 nas kernel: ? kthread_flush_work_fn+0x9/0x9
Oct 3 07:18:39 nas kernel: ret_from_fork+0x35/0x40
Oct 3 07:18:54 nas init: Switching to runlevel: 6
Oct 3 07:19:00 nas init: Trying to re-exec init
Oct 3 07:19:03 nas emhttpd: req (7): cmdStop=apply&csrf_token=****************
Oct 3 07:19:03 nas emhttpd: Spinning up all drives...
Oct 3 07:19:03 nas emhttpd: shcmd (546): /usr/sbin/hdparm -S0 /dev/sdb
Oct 3 07:19:03 nas kernel: mdcmd (42): nocheck 
Oct 3 07:19:03 nas kernel: md: nocheck_array: check not active
Oct 3 07:19:03 nas kernel: mdcmd (43): spinup 0
Oct 3 07:19:03 nas kernel: mdcmd (44): spinup 1
Oct 3 07:19:03 nas kernel: mdcmd (45): spinup 2
Oct 3 07:19:03 nas kernel: mdcmd (46): spinup 3
Oct 3 07:19:03 nas root: 
Oct 3 07:19:03 nas root: /dev/sdb:
Oct 3 07:19:03 nas root: setting standby to 0 (off)
Oct 3 07:19:03 nas emhttpd: shcmd (547): /usr/sbin/hdparm -S0 /dev/sdg
Oct 3 07:19:03 nas root: 
Oct 3 07:19:03 nas root: /dev/sdg:
Oct 3 07:19:03 nas root: setting standby to 0 (off)
Oct 3 07:19:04 nas emhttpd: Stopping services...
Oct 3 07:19:32 nas nginx: 2018/10/03 07:19:32 [error] 8935#8935: *47898 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.168.1.96, server: , request: "GET /plugins/dynamix.docker.manager/include/DockerContainers.php HTTP/1.1", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "nas.loscarrerasnet", referrer: "http://nas.loscarrerasnet/Docker"
Oct 3 07:20:33 nas root: Status of all loop devices
Oct 3 07:20:33 nas root: /dev/loop1: [2049]:4 (/boot/bzfirmware)
Oct 3 07:20:33 nas root: /dev/loop2: [0031]:108191 (/mnt/cache/system/docker/docker.img)
Oct 3 07:20:33 nas root: /dev/loop0: [2049]:3 (/boot/bzmodules)
Oct 3 07:20:33 nas root: Active pids left on /mnt/*
Oct 3 07:20:33 nas root: USER PID ACCESS COMMAND
Oct 3 07:20:33 nas root: /mnt/cache: root kernel mount /mnt/cache
Oct 3 07:20:33 nas root: root 9878 F.... shfs
Oct 3 07:20:33 nas root: root 17181 ..c.. find
Oct 3 07:20:33 nas root: /mnt/disk1: root kernel mount /mnt/disk1
Oct 3 07:20:33 nas root: root 9878 F.... shfs
Oct 3 07:20:33 nas root: /mnt/disk2: root kernel mount /mnt/disk2
Oct 3 07:20:33 nas root: /mnt/disk3: root kernel mount /mnt/disk3
Oct 3 07:20:33 nas root: /mnt/disks: root kernel mount /
Oct 3 07:20:33 nas root: root 1 .rce. init
Oct 3 07:20:33 nas root: root 2 .rc.. kthreadd
Oct 3 07:20:33 nas root: root 3 .rc.. rcu_gp
Oct 3 07:20:33 nas root: root 4 .rc.. rcu_par_gp
Oct 3 07:20:33 nas root: root 6 .rc.. kworker/0:0H
Oct 3 07:20:33 nas root: root 8 .rc.. mm_percpu_wq
Oct 3 07:20:33 nas root: root 9 .rc.. ksoftirqd/0
Oct 3 07:20:33 nas root: root 10 .rc.. rcu_sched
Oct 3 07:20:33 nas root: root 11 .rc.. rcu_bh
Oct 3 07:20:33 nas root: root 12 .rc.. migration/0
Oct 3 07:20:33 nas root: root 13 .rc.. cpuhp/0
Oct 3 07:20:33 nas root: root 14 .rc.. cpuhp/1
Oct 3 07:20:33 nas root: root 15 .rc.. migration/1
Oct 3 07:20:33 nas root: root 16 .rc.. ksoftirqd/1
Oct 3 07:20:33 nas root: root 18 .rc.. kworker/1:0H-kbl
Oct 3 07:20:33 nas root: root 19 .rc.. cpuhp/2
Oct 3 07:20:33 nas root: root 20 .rc.. migration/2
Oct 3 07:20:33 nas root: root 21 .rc.. ksoftirqd/2
Oct 3 07:20:33 nas root: root 23 .rc.. kworker/2:0H-kbl
Oct 3 07:20:33 nas root: root 24 .rc.. cpuhp/3
Oct 3 07:20:33 nas root: root 25 .rc.. migration/3
Oct 3 07:20:33 nas root: root 26 .rc.. ksoftirqd/3
Oct 3 07:20:33 nas root: root 28 .rc.. kworker/3:0H-kbl
Oct 3 07:20:33 nas root: root 29 .rc.. cpuhp/4
Oct 3 07:20:33 nas root: root 30 .rc.. migration/4
Oct 3 07:20:33 nas root: root 31 .rc.. ksoftirqd/4
Oct 3 07:20:33 nas root: root 33 .rc.. kworker/4:0H-kbl
Oct 3 07:20:33 nas root: root 34 .rc.. cpuhp/5
Oct 3 07:20:33 nas root: root 35 .rc.. migration/5
Oct 3 07:20:33 nas root: root 36 .rc.. ksoftirqd/5
Oct 3 07:20:33 nas root: root 38 .rc.. kworker/5:0H-kbl
Oct 3 07:20:33 nas root: root 39 .rc.. cpuhp/6
Oct 3 07:20:33 nas root: root 40 .rc.. migration/6
Oct 3 07:20:33 nas root: root 41 .rc.. ksoftirqd/6
Oct 3 07:20:33 nas root: root 43 .rc.. kworker/6:0H-kbl
Oct 3 07:20:33 nas root: root 44 .rc.. cpuhp/7
Oct 3 07:20:33 nas root: root 45 .rc.. migration/7
Oct 3 07:20:33 nas root: root 46 .rc.. ksoftirqd/7
Oct 3 07:20:33 nas root: root 48 .rc.. kworker/7:0H-kbl
Oct 3 07:20:33 nas root: root 50 .rc.. netns
Oct 3 07:20:33 nas root: root 68 .rc.. kworker/3:1-rcu_
Oct 3 07:20:33 nas root: root 93 .rc.. kworker/7:1-even
Oct 3 07:20:33 nas root: root 334 .rc.. oom_reaper
Oct 3 07:20:33 nas root: root 335 .rc.. writeback
Oct 3 07:20:33 nas root: root 337 .rc.. kcompactd0
Oct 3 07:20:33 nas root: root 338 .rc.. ksmd
Oct 3 07:20:33 nas root: root 339 .rc.. khugepaged
Oct 3 07:20:33 nas root: root 340 .rc.. crypto
Oct 3 07:20:33 nas root: root 341 .rc.. kintegrityd
Oct 3 07:20:33 nas root: root 343 .rc.. kblockd
Oct 3 07:20:33 nas root: root 474 .rc.. ata_sff
Oct 3 07:20:33 nas root: root 496 .rc.. edac-poller
Oct 3 07:20:33 nas root: root 497 .rc.. devfreq_wq
Oct 3 07:20:33 nas root: root 635 .rc.. kswapd0
Oct 3 07:20:33 nas root: root 760 .rc.. kthrotld
Oct 3 07:20:33 nas root: root 882 .rc.. vfio-irqfd-clea
Oct 3 07:20:33 nas root: root 913 .rce. docker-proxy
Oct 3 07:20:33 nas root: root 928 .rce. docker-proxy
Oct 3 07:20:33 nas root: root 988 .rc.. ipv6_addrconf
Oct 3 07:20:33 nas root: root 989 Frce. docker-containe
Oct 3 07:20:33 nas root: root 1020 .rc.. scsi_eh_0
Oct 3 07:20:33 nas root: root 1021 .rc.. scsi_tmf_0
Oct 3 07:20:33 nas root: root 1022 .rc.. usb-storage
Oct 3 07:20:33 nas root: root 1057 .rc.. kworker/1:1H-kbl
Oct 3 07:20:33 nas root: root 1187 frce. udevd
Oct 3 07:20:33 nas root: root 1264 .rc.. loop0
Oct 3 07:20:33 nas root: root 1265 .rc.. kworker/7:1H-kbl
Oct 3 07:20:33 nas root: root 1266 .rc.. kworker/3:1H-xfs
Oct 3 07:20:33 nas root: root 1267 .rc.. loop1
Oct 3 07:20:33 nas root: root 1268 .rc.. kworker/0:1H-kbl
Oct 3 07:20:33 nas root: root 1278 .rc.. kworker/6:1H-kbl
Oct 3 07:20:33 nas root: root 1294 .rc.. kworker/5:1H-kbl
Oct 3 07:20:33 nas root: root 1307 .rc.. kworker/4:1H-kbl
Oct 3 07:20:33 nas root: root 1314 .rc.. kworker/2:1H-kbl
Oct 3 07:20:33 nas root: root 1329 .rc.. scsi_eh_1
Oct 3 07:20:33 nas root: root 1330 .rc.. scsi_tmf_1
Oct 3 07:20:33 nas root: root 1331 .rc.. scsi_eh_2
Oct 3 07:20:33 nas root: root 1332 .rc.. scsi_tmf_2
Oct 3 07:20:33 nas root: root 1333 .rc.. scsi_eh_3
Oct 3 07:20:33 nas root: root 1334 .rc.. scsi_tmf_3
Oct 3 07:20:33 nas root: root 1335 .rc.. scsi_eh_4
Oct 3 07:20:33 nas root: root 1336 .rc.. scsi_tmf_4
Oct 3 07:20:33 nas root: root 1337 .rc.. scsi_eh_5
Oct 3 07:20:33 nas root: root 1338 .rc.. scsi_tmf_5
Oct 3 07:20:33 nas root: root 1383 .rc.. poll_mpt2sas0_s
Oct 3 07:20:33 nas root: root 1437 .rce. rsyslogd
Oct 3 07:20:33 nas root: root 1469 .rce. haveged
Oct 3 07:20:33 nas root: root 1487 .rc.. bond0
Oct 3 07:20:33 nas root: messagebus 1538 Frce. dbus-daemon
Oct 3 07:20:33 nas root: rpc 1547 Frce. rpcbind
Oct 3 07:20:33 nas root: rpc 1552 Frce. rpc.statd
Oct 3 07:20:33 nas root: ntp 1582 .rce. ntpd
Oct 3 07:20:33 nas root: root 1589 Frce. acpid
Oct 3 07:20:33 nas root: root 1603 .rce. crond
Oct 3 07:20:33 nas root: daemon 1607 Frce. atd
Oct 3 07:20:33 nas root: root 1614 Frce. nmbd
Oct 3 07:20:33 nas root: root 1616 Frce. smbd
Oct 3 07:20:33 nas root: root 1619 Frce. smbd-notifyd
Oct 3 07:20:33 nas root: root 1620 Frce. cleanupd
Oct 3 07:20:33 nas root: root 1622 Frce. winbindd
Oct 3 07:20:33 nas root: root 1624 Frce. winbindd
Oct 3 07:20:33 nas root: root 6162 .rc.. kworker/6:0-even
Oct 3 07:20:33 nas root: root 7535 Frce. winbindd
Oct 3 07:20:33 nas root: root 8383 .rc.. kworker/2:3-even
Oct 3 07:20:33 nas root: root 8510 .rce. sshd
Oct 3 07:20:33 nas root: root 8518 .rce. php
Oct 3 07:20:33 nas root: root 8647 Frce. inetd
Oct 3 07:20:33 nas root: root 8664 .rc.. md
Oct 3 07:20:33 nas root: root 8665 .rc.. mdrecoveryd
Oct 3 07:20:33 nas root: root 8675 .rc.. spinupd
Oct 3 07:20:33 nas root: root 8677 .rc.. spinupd
Oct 3 07:20:33 nas root: root 8678 .rc.. spinupd
Oct 3 07:20:33 nas root: root 8679 .rc.. spinupd
Oct 3 07:20:33 nas root: avahi 8778 .rce. avahi-daemon
Oct 3 07:20:33 nas root: avahi 8779 .rce. avahi-daemon
Oct 3 07:20:33 nas root: root 8788 Frce. avahi-dnsconfd
Oct 3 07:20:33 nas root: root 8834 Frce. emhttpd
Oct 3 07:20:33 nas root: root 8934 Frce. nginx
Oct 3 07:20:33 nas root: nobody 8935 Frce. nginx
Oct 3 07:20:33 nas root: root 8967 .rc.. unraidd
Oct 3 07:20:33 nas root: root 9614 Frce. diskload
Oct 3 07:20:33 nas root: root 9653 .rc.. xfsalloc
Oct 3 07:20:33 nas root: root 9654 .rc.. xfs_mru_cache
Oct 3 07:20:33 nas root: root 9655 .rc.. xfs-buf/md1
Oct 3 07:20:33 nas root: root 9656 .rc.. xfs-data/md1
Oct 3 07:20:33 nas root: root 9657 .rc.. xfs-conv/md1
Oct 3 07:20:33 nas root: root 9658 .rc.. xfs-cil/md1
Oct 3 07:20:33 nas root: root 9659 .rc.. xfs-reclaim/md1
Oct 3 07:20:33 nas root: root 9660 .rc.. xfs-log/md1
Oct 3 07:20:33 nas root: root 9661 .rc.. xfs-eofblocks/m
Oct 3 07:20:33 nas root: root 9662 .rc.. xfsaild/md1
Oct 3 07:20:33 nas root: root 9674 .rc.. xfs-buf/md2
Oct 3 07:20:33 nas root: root 9675 .rc.. xfs-data/md2
Oct 3 07:20:33 nas root: root 9676 .rc.. xfs-conv/md2
Oct 3 07:20:33 nas root: root 9677 .rc.. xfs-cil/md2
Oct 3 07:20:33 nas root: root 9678 .rc.. xfs-reclaim/md2
Oct 3 07:20:33 nas root: root 9679 .rc.. xfs-log/md2
Oct 3 07:20:33 nas root: root 9680 .rc.. xfs-eofblocks/m
Oct 3 07:20:33 nas root: root 9681 .rc.. xfsaild/md2
Oct 3 07:20:33 nas root: root 9693 .rc.. xfs-buf/md3
Oct 3 07:20:33 nas root: root 9694 .rc.. xfs-data/md3
Oct 3 07:20:33 nas root: root 9695 .rc.. xfs-conv/md3
Oct 3 07:20:33 nas root: root 9696 .rc.. xfs-cil/md3
Oct 3 07:20:33 nas root: root 9697 .rc.. xfs-reclaim/md3
Oct 3 07:20:33 nas root: root 9698 .rc.. xfs-log/md3
Oct 3 07:20:33 nas root: root 9699 .rc.. xfs-eofblocks/m
Oct 3 07:20:33 nas root: root 9700 .rc.. xfsaild/md3
Oct 3 07:20:33 nas root: root 9743 .rc.. btrfs-worker
Oct 3 07:20:33 nas root: root 9745 .rc.. btrfs-worker-hi
Oct 3 07:20:33 nas root: root 9746 .rc.. btrfs-delalloc
Oct 3 07:20:33 nas root: root 9747 .rc.. btrfs-flush_del
Oct 3 07:20:33 nas root: root 9748 .rc.. btrfs-cache
Oct 3 07:20:33 nas root: root 9749 .rc.. btrfs-submit
Oct 3 07:20:33 nas root: root 9750 .rc.. btrfs-fixup
Oct 3 07:20:33 nas root: root 9751 .rc.. btrfs-endio
Oct 3 07:20:33 nas root: root 9752 .rc.. btrfs-endio-met
Oct 3 07:20:33 nas root: root 9753 .rc.. btrfs-endio-met
Oct 3 07:20:33 nas root: root 9754 .rc.. btrfs-endio-rai
Oct 3 07:20:33 nas root: root 9755 .rc.. btrfs-endio-rep
Oct 3 07:20:33 nas root: root 9756 .rc.. btrfs-rmw
Oct 3 07:20:33 nas root: root 9757 .rc.. btrfs-endio-wri
Oct 3 07:20:33 nas root: root 9758 .rc.. btrfs-freespace
Oct 3 07:20:33 nas root: root 9759 .rc.. btrfs-delayed-m
Oct 3 07:20:33 nas root: root 9760 .rc.. btrfs-readahead
Oct 3 07:20:33 nas root: root 9761 .rc.. btrfs-qgroup-re
Oct 3 07:20:33 nas root: root 9762 .rc.. btrfs-extent-re
Oct 3 07:20:33 nas root: root 9816 .rc.. btrfs-cleaner
Oct 3 07:20:33 nas root: root 9817 .rc.. btrfs-transacti
Oct 3 07:20:33 nas root: root 9859 Frce. shfs
Oct 3 07:20:33 nas root: root 9878 Frce. shfs
Oct 3 07:20:33 nas root: root 10091 .rc.. loop2
Oct 3 07:20:33 nas root: root 10103 .rc.. btrfs-worker
Oct 3 07:20:33 nas root: root 10104 .rc.. btrfs-worker-hi
Oct 3 07:20:33 nas root: root 10105 .rc.. btrfs-delalloc
Oct 3 07:20:33 nas root: root 10106 .rc.. btrfs-flush_del
Oct 3 07:20:33 nas root: root 10107 .rc.. btrfs-cache
Oct 3 07:20:33 nas root: root 10108 .rc.. btrfs-submit
Oct 3 07:20:33 nas root: root 10109 .rc.. btrfs-fixup
Oct 3 07:20:33 nas root: root 10110 .rc.. btrfs-endio
Oct 3 07:20:33 nas root: root 10111 .rc.. btrfs-endio-met
Oct 3 07:20:33 nas root: root 10112 .rc.. btrfs-endio-met
Oct 3 07:20:33 nas root: root 10113 .rc.. btrfs-endio-rai
Oct 3 07:20:33 nas root: root 10114 .rc.. btrfs-endio-rep
Oct 3 07:20:33 nas root: root 10115 .rc.. btrfs-rmw
Oct 3 07:20:33 nas root: root 10116 .rc.. btrfs-endio-wri
Oct 3 07:20:33 nas root: root 10117 .rc.. btrfs-freespace
Oct 3 07:20:33 nas root: root 10118 .rc.. btrfs-delayed-m
Oct 3 07:20:33 nas root: root 10119 .rc.. btrfs-readahead
Oct 3 07:20:33 nas root: root 10120 .rc.. btrfs-qgroup-re
Oct 3 07:20:33 nas root: root 10121 .rc.. btrfs-extent-re
Oct 3 07:20:33 nas root: root 10208 .rc.. btrfs-cleaner
Oct 3 07:20:33 nas root: root 10209 .rc.. btrfs-transacti
Oct 3 07:20:33 nas root: root 10222 Frce. dockerd
Oct 3 07:20:33 nas root: root 10241 Frce. docker-containe
Oct 3 07:20:33 nas root: root 13204 .rc.. kworker/0:3-even
Oct 3 07:20:33 nas root: root 13605 .rc.. kworker/4:0-xfs-
Oct 3 07:20:33 nas root: root 14898 Frce. docker
Oct 3 07:20:33 nas root: root 15093 Frce. sleep
Oct 3 07:20:33 nas root: root 16507 Frce. docker_load
Oct 3 07:20:33 nas root: root 16791 .rce. docker-proxy
Oct 3 07:20:33 nas root: root 16803 .rce. docker-proxy
Oct 3 07:20:33 nas root: root 16898 Frce. docker-containe
Oct 3 07:20:33 nas root: root 17141 .rce. sh
Oct 3 07:20:33 nas root: root 17144 frce. mover
Oct 3 07:20:33 nas root: root 17158 .rce. mover.php
Oct 3 07:20:33 nas root: root 17168 frce. mover.old
Oct 3 07:20:33 nas root: root 17181 fr.e. find
Oct 3 07:20:33 nas root: root 17182 .rce. move
Oct 3 07:20:33 nas root: root 17204 .rc.. kworker/4:1-even
Oct 3 07:20:33 nas root: root 17226 .rc.. kworker/1:0-even
Oct 3 07:20:33 nas root: root 17294 .rc.. kworker/2:0-even
Oct 3 07:20:33 nas root: root 17623 .rce. docker-proxy
Oct 3 07:20:33 nas root: root 17742 Frce. docker-containe
Oct 3 07:20:33 nas root: root 17809 .rc.. kworker/u16:0-bt
Oct 3 07:20:33 nas root: root 18299 .rce. docker-proxy
Oct 3 07:20:33 nas root: root 18354 Frce. docker-containe
Oct 3 07:20:33 nas root: root 19245 Frce. docker-containe
Oct 3 07:20:33 nas root: root 19589 .rce. docker-proxy
Oct 3 07:20:33 nas root: root 19863 Frce. docker-containe
Oct 3 07:20:33 nas root: root 20444 .rce. docker-proxy
Oct 3 07:20:33 nas root: root 20457 .rce. docker-proxy
Oct 3 07:20:33 nas root: root 20506 Frce. docker-containe
Oct 3 07:20:33 nas root: root 21112 .rc.. kworker/u16:1+ev
Oct 3 07:20:33 nas root: root 21113 .rce. docker-proxy
Oct 3 07:20:33 nas root: root 21211 Frce. docker-containe
Oct 3 07:20:33 nas root: root 23496 Frce. smbd
Oct 3 07:20:33 nas root: root 23540 .rc.. kworker/0:1-rcu_
Oct 3 07:20:33 nas root: root 23569 Frce. sh
Oct 3 07:20:33 nas root: root 23570 Frce. docker
Oct 3 07:20:33 nas root: root 23590 Frce. sh
Oct 3 07:20:33 nas root: root 23593 .rce. lsof
Oct 3 07:20:33 nas root: root 23594 Frce. awk
Oct 3 07:20:33 nas root: root 23595 Frce. awk
Oct 3 07:20:33 nas root: root 23607 .rce. lsof
Oct 3 07:20:33 nas root: root 23609 Frce. sh
Oct 3 07:20:33 nas root: root 23610 Frce. docker
Oct 3 07:20:33 nas root: root 23651 Frce. sh
Oct 3 07:20:33 nas root: root 23652 Frce. docker
Oct 3 07:20:33 nas root: root 23712 Frce. sh
Oct 3 07:20:33 nas root: root 23714 Frce. docker
Oct 3 07:20:33 nas root: root 23739 Frce. sh
Oct 3 07:20:33 nas root: root 23743 .rce. lsof
Oct 3 07:20:33 nas root: root 23744 Frce. awk
Oct 3 07:20:33 nas root: root 23745 Frce. awk
Oct 3 07:20:33 nas root: root 23756 .rce. lsof
Oct 3 07:20:33 nas root: root 23804 .rc.. kworker/u16:2-bt
Oct 3 07:20:33 nas root: root 23865 .rc.. kworker/u16:3-bt
Oct 3 07:20:33 nas root: root 23866 .rc.. kworker/u16:4-bt
Oct 3 07:20:33 nas root: root 23867 .rc.. kworker/u16:5-bt
Oct 3 07:20:33 nas root: root 23868 .rc.. kworker/u16:6+ev
Oct 3 07:20:33 nas root: root 23873 Frce. emhttpd
Oct 3 07:20:33 nas root: root 23875 Frce. sh
Oct 3 07:20:33 nas root: root 23876 Frce. tail
Oct 3 07:20:33 nas root: root 23883 .rc.. kworker/4:2-even
Oct 3 07:20:33 nas root: root 23887 .rc.. kworker/u17:0
Oct 3 07:20:33 nas root: root 23918 frce. rc.6
Oct 3 07:20:33 nas root: root 23928 frce. rc.local_shutdo
Oct 3 07:20:33 nas root: root 23958 Frce. sh
Oct 3 07:20:33 nas root: root 23959 Frce. rc.docker
Oct 3 07:20:33 nas root: root 23969 Frce. rc.docker
Oct 3 07:20:33 nas root: root 23970 Frce. docker
Oct 3 07:20:33 nas root: root 24030 Frce. smbd
Oct 3 07:20:33 nas root: root 24044 .rce. logger
Oct 3 07:20:33 nas root: root 25219 .rc.. kworker/6:2-even
Oct 3 07:20:33 nas root: root 25225 .rc.. kworker/1:1-even
Oct 3 07:20:33 nas root: root 25307 .rc.. kworker/5:1-even
Oct 3 07:20:33 nas root: root 31113 .rc.. kworker/5:0-even
Oct 3 07:20:33 nas root: root 31339 .rc.. kworker/u17:2-bt
Oct 3 07:20:33 nas root: root 31340 .rc.. kworker/u17:4-bt
Oct 3 07:20:33 nas root: root 31574 .rc.. kworker/3:2-even
Oct 3 07:20:33 nas root: root 31581 .rc.. kworker/7:0-even
Oct 3 07:20:33 nas root: /mnt/user: root kernel mount /mnt/user
Oct 3 07:20:33 nas root: root 17182 f.... move
Oct 3 07:20:33 nas root: nobody 19182 F.c.. mysqld
Oct 3 07:20:33 nas root: nobody 20304 F...m Plex Media Serv
Oct 3 07:20:33 nas root: root 20651 F.... php-fpm7
Oct 3 07:20:33 nas root: root 20653 F.... nginx
Oct 3 07:20:33 nas root: nobody 20717 F.... nginx
Oct 3 07:20:33 nas root: nobody 20718 F.... nginx
Oct 3 07:20:33 nas root: nobody 20719 F.... nginx
Oct 3 07:20:33 nas root: nobody 20720 F.... nginx
Oct 3 07:20:33 nas root: nobody 21141 F.c.. Plex Script Hos
Oct 3 07:20:33 nas root: nobody 21320 F.... sabnzbdplus
Oct 3 07:20:33 nas root: nobody 21632 F...m mono
Oct 3 07:20:33 nas root: root 21744 F.... nginx
Oct 3 07:20:33 nas root: root 21746 F.... php-fpm7
Oct 3 07:20:33 nas root: root 21748 F.... fail2ban-client
Oct 3 07:20:33 nas root: nobody 21796 F.... nginx
Oct 3 07:20:33 nas root: nobody 21797 F.... nginx
Oct 3 07:20:33 nas root: nobody 21798 F.... nginx
Oct 3 07:20:33 nas root: nobody 21799 F.... nginx
Oct 3 07:20:33 nas root: nobody 21800 F.... nginx
Oct 3 07:20:33 nas root: nobody 21952 F...m Plex DLNA Serve
Oct 3 07:20:33 nas root: nobody 21954 F.... Plex Tuner Serv
Oct 3 07:20:33 nas root: /mnt/user0: root kernel mount /mnt/user0
Oct 3 07:20:33 nas root: Active pids left on /dev/md*
Oct 3 07:20:33 nas root: USER PID ACCESS COMMAND
Oct 3 07:20:33 nas root: /dev/md1: root kernel mount /mnt/disk1
Oct 3 07:20:33 nas root: root 9878 F.... shfs
Oct 3 07:20:33 nas root: /dev/md2: root kernel mount /mnt/disk2
Oct 3 07:20:33 nas root: /dev/md3: root kernel mount /mnt/disk3
Oct 3 07:20:33 nas root: Generating diagnostics...
Oct 3 07:21:39 nas kernel: INFO: rcu_sched detected stalls on CPUs/tasks:
Oct 3 07:21:39 nas kernel: 7-...!: (0 ticks this GP) idle=9c8/0/0 softirq=1457840/1457840 fqs=1 
Oct 3 07:21:39 nas kernel: (detected by 1, t=240007 jiffies, g=814909, c=814908, q=210655)
Oct 3 07:21:39 nas kernel: Sending NMI from CPU 1 to CPUs 7:
Oct 3 07:21:39 nas kernel: NMI backtrace for cpu 7 skipped: idling at mwait_idle+0x52/0x6a
Oct 3 07:21:39 nas kernel: rcu_sched kthread starved for 180005 jiffies! g814909 c814908 f0x0 RCU_GP_WAIT_FQS(3) ->state=0x402 ->cpu=7
Oct 3 07:21:39 nas kernel: RCU grace-period kthread stack dump:
Oct 3 07:21:39 nas kernel: rcu_sched I 0 10 2 0x80000000
Oct 3 07:21:39 nas kernel: Call Trace:
Oct 3 07:21:39 nas kernel: ? __schedule+0x4e0/0x53b
Oct 3 07:21:39 nas kernel: ? sync_sched_exp_handler+0x91/0x91
Oct 3 07:21:39 nas kernel: schedule+0x5b/0x6c
Oct 3 07:21:39 nas kernel: schedule_timeout+0x1cc/0x20c
Oct 3 07:21:39 nas kernel: ? collect_expired_timers+0x92/0x92
Oct 3 07:21:39 nas kernel: rcu_gp_kthread+0x3c1/0x70a
Oct 3 07:21:39 nas kernel: kthread+0x10b/0x113
Oct 3 07:21:39 nas kernel: ? kthread_flush_work_fn+0x9/0x9
Oct 3 07:21:39 nas kernel: ret_from_fork+0x35/0x40
Oct 3 07:22:39 nas kernel: INFO: rcu_sched detected stalls on CPUs/tasks:
Oct 3 07:22:39 nas kernel: 7-...!: (0 ticks this GP) idle=f30/0/0 softirq=1457840/1457840 fqs=0 
Oct 3 07:22:39 nas kernel: (detected by 2, t=60002 jiffies, g=814910, c=814909, q=206478)
Oct 3 07:22:39 nas kernel: Sending NMI from CPU 2 to CPUs 7:
Oct 3 07:22:39 nas kernel: NMI backtrace for cpu 7 skipped: idling at mwait_idle+0x52/0x6a
Oct 3 07:22:39 nas kernel: rcu_sched kthread starved for 60003 jiffies! g814910 c814909 f0x0 RCU_GP_WAIT_FQS(3) ->state=0x402 ->cpu=7
Oct 3 07:22:39 nas kernel: RCU grace-period kthread stack dump:
Oct 3 07:22:39 nas kernel: rcu_sched I 0 10 2 0x80000000
Oct 3 07:22:39 nas kernel: Call Trace:
Oct 3 07:22:39 nas kernel: ? __schedule+0x4e0/0x53b
Oct 3 07:22:39 nas kernel: ? sync_sched_exp_handler+0x91/0x91
Oct 3 07:22:39 nas kernel: schedule+0x5b/0x6c
Oct 3 07:22:39 nas kernel: schedule_timeout+0x1cc/0x20c
Oct 3 07:22:39 nas kernel: ? collect_expired_timers+0x92/0x92
Oct 3 07:22:39 nas kernel: rcu_gp_kthread+0x3c1/0x70a
Oct 3 07:22:39 nas kernel: kthread+0x10b/0x113
Oct 3 07:22:39 nas kernel: ? kthread_flush_work_fn+0x9/0x9
Oct 3 07:22:39 nas kernel: ret_from_fork+0x35/0x40

 

When I send it to reboot takes forever to do so and attached is the screen.

 

I do not think it is a bad board but i am open to suggestions please. 

WhatsApp Image 2018-10-03 at 7.35.15 AM.jpeg

Link to comment

Why do you have a 100G docker image? Most often I see these large docker images because people have misconfigured dockers that are filling up their docker image, so they keep increasing its size hoping to fix the problem. It won't.

 

I've never seen anybody that needed more than 20G if they had things setup right. Many people could probably live with a lot less than 10G.

Link to comment

to be honest that is how unraid set it up i never touched the docker image. I just added dockers and made them work. 

to be clear docker image is where all dockers are right? and in the system they are in appdata? which i have it as cache preffer so it should use all the space i have. again i never speciefied anything for dockers just installed dockers and let them do their thing.

Link to comment
2 hours ago, inabon said:

to be honest that is how unraid set it up i never touched the docker image. I just added dockers and made them work. 

to be clear docker image is where all dockers are right? and in the system they are in appdata? which i have it as cache preffer so it should use all the space i have. again i never speciefied anything for dockers just installed dockers and let them do their thing.

 

The default was originally 10G. Don't know if that was changed or not. I can't imagine they would make 100G the default. That would waste space on a disk that is typically smaller and more expensive (SSD). And it would only hide problems with misconfigured dockers since it would take longer for the problems with a full image to become evident.

 

Each docker container is like a little OS, typically with the purpose of executing a single installed application. That little OS and the application are what is stored in the docker image. The appdata for each container is the "working storage" of the application. Usually a container will have access to other storage on Unraid (volume mappings), such as your downloads or your media files.

 

Where the problem comes in is when the application is configured to use some path that isn't in appdata or other mapped storage. In that case, anything saved to that path is in the docker image where it can't really be accessed from outside the docker, and where it will fill up and possibly corrupt the docker image if it accumulates, such as with downloads.

 

I really recommend a smaller docker image, 20G should be more than enough. You can stop docker service, delete and recreate the image, and reinstall all containers just as they were before with the Previous Apps feature in Apps (Community Applications).

 

That won't fix your problem, but it might make it easier to diagnose.

Link to comment
38 minutes ago, trurl said:

 

The default was originally 10G. Don't know if that was changed or not. I can't imagine they would make 100G the default. That would waste space on a disk that is typically smaller and more expensive (SSD). And it would only hide problems with misconfigured dockers since it would take longer for the problems with a full image to become evident.

 

Each docker container is like a little OS, typically with the purpose of executing a single installed application. That little OS and the application are what is stored in the docker image. The appdata for each container is the "working storage" of the application. Usually a container will have access to other storage on Unraid (volume mappings), such as your downloads or your media files.

 

Where the problem comes in is when the application is configured to use some path that isn't in appdata or other mapped storage. In that case, anything saved to that path is in the docker image where it can't really be accessed from outside the docker, and where it will fill up and possibly corrupt the docker image if it accumulates, such as with downloads.

 

I really recommend a smaller docker image, 20G should be more than enough. You can stop docker service, delete and recreate the image, and reinstall all containers just as they were before with the Previous Apps feature in Apps (Community Applications).

 

That won't fix your problem, but it might make it easier to diagnose.

done

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.