Out Of Memory errors detected on your server?


unRaide

Recommended Posts

Two days ago the Fix Common Problems plugin started reporting the following error:

Quote

Your server has run out of memory, and processes (potentially required) are being killed off. You should post your diagnostics and ask for assistance on the unRaid forums

I rebooted the server yesterday and the error went away temporarily but it’s back again 😩. Per the suggestion I’ve attached my diagnostics logs and hoping for some help figuring this out. 
 

My server has 64GB off memory and looking at the dashboard it consistently givers around 50%. 
 

Thanks

unraider-diagnostics-20191219-0508.zip

Link to comment

Most likely Crashplan or Filebot is the culprit. You need to limit the memory that pos can see in its Docker. Someone else posted how to do that, but I'm on mobile so can't find and post link for you. Here is a python process it victimized at the time your mem6was all used up:

 

 

Dec 18 14:32:44 UnRaider kernel: [  13711]    99 13711  9653899  9000662 77455360        0             0 python

Dec 18 14:32:44 UnRaider kernel: [  17648]    99 17648  2554308   406096  4460544        0             0 CrashPlanServic

 

Here's top memory use after OOM Killer:

 

18886 nobody    20   0   20.2g 157668   1828 S   0.0   0.2   2:40.57 java

10509 root      20   0 9445528   8.2g  21656 S  81.2  13.0   1000:54 qemu-syst+
10433 root      20   0   13.2g  12.7g  21704 S  50.0  20.2 884:48.24 qemu-syst+

17648 nobody    20   0    9.8g   1.0g   3612 S   0.0   1.7  97:16.19 CrashPlan+

 


root     17294  0.0  0.0  10736  5532 ?        Sl   03:51   0:01  |   \_ containerd-shim -namespace moby -workdir /var/lib/docker/containerd/daemon/io.containerd.runtime.v1.linux/moby/18fc1f76d87ba3ee433bbcef53435107635431cb04be2024c5405982ef42a781 -address /var/run/docker/containerd/containerd.sock -containerd-binary /usr/bin/containerd -runtime-root /var/run/docker/runtime-runc
root     17323  0.0  0.0  31652  4736 ?        Ss   03:51   0:00  |   |   \_ /usr/bin/python3 -u /sbin/my_init
root     18801  0.0  0.0    196    12 ?        S    03:51   0:00  |   |       \_ /usr/bin/runsvdir -P /etc/service
root     18813  0.0  0.0    176     4 ?        Ss   03:51   0:00  |   |           \_ runsv cron
root     18829  0.0  0.0  26752   848 ?        S    03:51   0:00  |   |           |   \_ /usr/sbin/cron -f
root     18814  0.0  0.0    176    20 ?        Ss   03:51   0:00  |   |           \_ runsv syslog-forwarder
root     18839  0.0  0.0   7480    80 ?        S    03:51   0:00  |   |           |   \_ tail -f -n 0 /var/log/syslog
root     18815  0.0  0.0    176     4 ?        Ss   03:51   0:00  |   |           \_ runsv syslog-ng
root     18842  0.0  0.0  65844  2932 ?        S    03:51   0:00  |   |           |   \_ syslog-ng -F -p /var/run/syslog-ng.pid --no-caps
root     18816  0.0  0.0    176    20 ?        Ss   03:51   0:00  |   |           \_ runsv X11rdp
nobody   18838  0.0  0.0  70516  9496 ?        S    03:51   0:00  |   |           |   \_ X11rdp :1 -bs -ac -nolisten tcp -geometry 1280x720 -depth 16 -uds
root     18817  0.0  0.0    176    24 ?        Ss   03:51   0:00  |   |           \_ runsv guacd
root     18833  0.0  0.0  78160  9956 ?        S    03:51   0:00  |   |           |   \_ /usr/local/sbin/guacd -f
root     18818  0.0  0.0    176    20 ?        Ss   03:51   0:00  |   |           \_ runsv openbox
nobody   18835  0.0  0.0 147836  2516 ?        S    03:51   0:00  |   |           |   \_ /usr/bin/openbox --startup /usr/lib/x86_64-linux-gnu/openbox-autostart OPENBOX
root     18819  0.0  0.0    176     4 ?        Ss   03:51   0:00  |   |           \_ runsv tomcat7
root     18837  0.1  0.3 2789840 235192 ?      Sl   03:51   1:14  |   |           |   \_ /usr/lib/jvm/java-7-openjdk-amd64/bin/java -Djava.util.logging.config.file=/var/lib/tomcat7/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.awt.headless=true -Xmx128m -XX:+UseConcMarkSweepGC -Djava.endorsed.dirs=/usr/share/tomcat7/endorsed -classpath /usr/share/tomcat7/bin/bootstrap.jar:/usr/share/tomcat7/bin/tomcat-juli.jar -Dcatalina.base=/var/lib/tomcat7 -Dcatalina.home=/usr/share/tomcat7 -Djava.io.tmpdir=/tmp/tomcat7-tomcat7-tmp org.apache.catalina.startup.Bootstrap start
root     18820  0.0  0.0    176    36 ?        Ss   03:51   0:00  |   |           \_ runsv xrdp
root     18828  0.0  0.0  22604   484 ?        S    03:51   0:00  |   |           |   \_ /usr/sbin/xrdp --nodaemon
root     18821  0.0  0.0    176    16 ?        Ss   03:51   0:00  |   |           \_ runsv xrdp-sesman
root     18824  0.0  0.0  35052   432 ?        S    03:51   0:00  |   |           |   \_ /usr/sbin/xrdp-sesman --nodaemon
root     18822  0.0  0.0    176    20 ?        Ss   03:51   0:00  |   |           \_ runsv filebot
root     18836  0.0  0.0  21096   236 ?        S    03:51   0:00  |   |           |   \_ /bin/bash ./run
root     24529  0.0  0.0 259060 10804 ?        Sl   03:51   0:37  |   |           |       \_ /usr/bin/python3 /files/monitor.py /files/FileBot.conf
root     18823  0.0  0.0    176    16 ?        Ss   03:51   0:00  |   |           \_ runsv filebot-ui
root     18831  0.0  0.0  21104   240 ?        S    03:51   0:00  |   |               \_ /bin/bash ./run
nobody   18849  0.0  0.0   4448    84 ?        S    03:51   0:00  |   |                   \_ /bin/sh /usr/bin/filebot
nobody   18886  0.2  0.2 21211968 157668 ?     Sl   03:51   2:40  |   |                       \_ java -Dsun.java2d.xrender=false -Dunixfs=false -DuseGVFS=true -DuseExtendedFileAttributes=true -DuseCreationDate=false -Djava.net.useSystemProxies=true -Djna.nosys=false -Djna.nounpack=true -Dapplication.deployment=deb -Dnet.filebot.gio.GVFS=/gvfs -Dapplication.dir=/nobody/.filebot -Djava.io.tmpdir=/nobody/.filebot/temp -Dnet.filebot.AcoustID.fpcalc=/usr/share/filebot/fpcalc -jar /usr/share/filebot/FileBot.jar

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.