How to debug out of memory kill child issue


Recommended Posts

I keep having my 1 and only VM get shutdown due to an out of memory issue. I don’t know how to debug this to find the root cause. Can anyone point me into the direction of this? Here is a segment of my log that shows where the error occurred. 192...88 is the IP of my VM, before that you se the “out of memory”. I don’t know how to find out which docker container, if it is a docker container that is hogging all the RAM enough to shut down my VM.

 

On another note, this is why i was wanting to setup some notifications for unRAID to be able to send me information on when RAM or CPU is maxing out so I can go log in immediately and see what is going on. If anyone has pointers on this it would help too. 

 

Nov 6 10:42:12 EDITH kernel: [ 9700] 99 9700 1561 16 53248 0 0 date
Nov 6 10:42:12 EDITH kernel: [ 9895] 0 9895 52 6 28672 0 0 s6-notifyonchec
Nov 6 10:42:12 EDITH kernel: [ 9896] 0 9896 111 1 28672 0 0 s6-ftrigrd
Nov 6 10:42:12 EDITH kernel: [ 10072] 0 10072 42 1 28672 0 0 exec
Nov 6 10:42:12 EDITH kernel: [ 10102] 0 10102 21284 1568 98304 0 -999 runc
Nov 6 10:42:12 EDITH kernel: [ 10114] 0 10114 4579 1713 94208 0 0 runc:[2:INIT]
Nov 6 10:42:12 EDITH kernel: [ 10333] 0 10333 612 189 45056 0 0 sleep
Nov 6 10:42:12 EDITH kernel: [ 10334] 0 10334 397 30 45056 0 0 tailstatusfile
Nov 6 10:42:12 EDITH kernel: Out of memory: Kill process 5323 (php-fpm7) score 24 or sacrifice child
Nov 6 10:42:12 EDITH kernel: Killed process 5323 (php-fpm7) total-vm:562992kB, anon-rss:278860kB, file-rss:240kB, shmem-rss:23128kB
Nov 6 10:42:12 EDITH kernel: oom_reaper: reaped process 5323 (php-fpm7), now anon-rss:0kB, file-rss:0kB, shmem-rss:23128kB
Nov 6 10:43:15 EDITH kernel: CIFS VFS: Server 192.168.2.88 has not responded in 120 seconds. Reconnecting...
Nov 6 16:00:52 EDITH root: error: //login: missing csrf_token
Nov 6 16:00:54 EDITH root: error: //login: missing csrf_token
Nov 6 16:02:18 EDITH kernel: br0: port 2(vnet0) entered blocking state
Nov 6 16:02:18 EDITH kernel: br0: port 2(vnet0) entered disabled state
Nov 6 16:02:18 EDITH kernel: device vnet0 entered promiscuous mode
Nov 6 16:02:18 EDITH kernel: br0: port 2(vnet0) entered blocking state
Nov 6 16:02:18 EDITH kernel: br0: port 2(vnet0) entered forwarding state
Nov 6 16:02:19 EDITH kernel: usb 4-1: reset full-speed USB device number 2 using ohci-pci
Nov 6 16:02:19 EDITH kernel: usb 4-1: reset full-speed USB device number 2 using ohci-pci
Nov 6 16:02:20 EDITH avahi-daemon[3651]: Joining mDNS multicast group on interface vnet0.IPv6 with address fe80::fc54:ff:fe5a:fb5d.
Nov 6 16:02:20 EDITH avahi-daemon[3651]: New relevant interface vnet0.IPv6 for mDNS.
Nov 6 16:02:20 EDITH avahi-daemon[3651]: Registering new address record for fe80::fc54:ff:fe5a:fb5d on vnet0.*.
Nov 6 16:02:21 EDITH kernel: usb 4-1: reset full-speed USB device number 2 using ohci-pci
Nov 6 16:02:22 EDITH kernel: usb 4-1: reset full-speed USB device number 2 using ohci-pci
Nov 6 16:02:24 EDITH kernel: usb 4-1: reset full-speed USB device number 2 using ohci-pci
Nov 6 16:02:25 EDITH kernel: usb 4-1: reset full-speed USB device number 2 using ohci-pci

 

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.