cfloener Posted February 28, 2016 Share Posted February 28, 2016 I keep seeing OOM in my log files but not sure why. I can see Plex giving OOM error so I completely deleted all of Plex and reloaded it but still keep getting the errors. I also noticed an ATA error on must of my drives after my last reboot, not sure if it something I need to address. Thanks for any help.. Feb 27 12:19:24 UnRaid emhttp: import 7 cache device: sdf Feb 27 12:19:24 UnRaid emhttp: check_pool: /sbin/btrfs filesystem show 3672c10b-df0b-4cfa-994d-ab532703de5c 2>&1 Feb 27 12:19:25 UnRaid emhttp: cacheUUID: 3672c10b-df0b-4cfa-994d-ab532703de5c Feb 27 12:19:25 UnRaid emhttp: cacheNumDevices: 2 Feb 27 12:19:25 UnRaid emhttp: cacheTotDevices: 2 Feb 27 12:19:25 UnRaid emhttp: cacheNumMissing: 0 Feb 27 12:19:25 UnRaid emhttp: cacheNumMisplaced: 0 Feb 27 12:19:25 UnRaid emhttp: cacheNumExtra: 0 Feb 27 12:19:25 UnRaid emhttp: import flash device: sda Feb 27 12:19:26 UnRaid logger: Starting apcupsd power management: /sbin/apcupsd Feb 27 12:19:26 UnRaid emhttp: Spinning up all drives... Feb 27 12:19:26 UnRaid emhttp: shcmd (6): /usr/sbin/hdparm -S0 /dev/sdd &> /dev/null Feb 27 12:19:26 UnRaid kernel: mdcmd (7): spinup 0 Feb 27 12:19:26 UnRaid kernel: mdcmd (: spinup 1 Feb 27 12:19:26 UnRaid kernel: mdcmd (9): spinup 2 Feb 27 12:19:26 UnRaid kernel: mdcmd (10): spinup 3 Feb 27 12:19:26 UnRaid kernel: mdcmd (11): spinup 4 Feb 27 12:19:26 UnRaid kernel: mdcmd (12): spinup 5 Feb 27 12:19:26 UnRaid kernel: md: disk0: ATA_OP e3 ioctl error: -5 Feb 27 12:19:26 UnRaid kernel: md: disk3: ATA_OP e3 ioctl error: -5 Feb 27 12:19:26 UnRaid kernel: md: disk5: ATA_OP e3 ioctl error: -5 Feb 27 12:19:26 UnRaid kernel: md: disk4: ATA_OP e3 ioctl error: -5 Feb 27 12:19:26 UnRaid emhttp: shcmd (7): /usr/sbin/hdparm -S0 /dev/sdf &> /dev/null Feb 27 12:19:26 UnRaid apcupsd[6214]: apcupsd 3.14.13 (02 February 2015) slackware startup succeeded Feb 27 12:19:26 UnRaid apcupsd[6214]: NIS server startup succeeded Feb 27 12:19:27 UnRaid emhttp: autostart enabled Feb 27 12:19:27 UnRaid kernel: mdcmd (13): set md_num_stripes 2448 Feb 27 12:19:27 UnRaid kernel: mdcmd (14): set md_write_limit 1104 Feb 27 12:19:27 UnRaid kernel: mdcmd (15): set md_sync_window 1104 Feb 27 12:19:27 UnRaid kernel: mdcmd (16): set spinup_group 0 0 Feb 27 12:19:27 UnRaid kernel: mdcmd (17): set spinup_group 1 0 Feb 27 12:19:27 UnRaid kernel: mdcmd (18): set spinup_group 2 0 Feb 27 12:19:27 UnRaid kernel: mdcmd (19): set spinup_group 3 0 Feb 27 12:19:27 UnRaid kernel: mdcmd (20): set spinup_group 4 0 Feb 27 12:19:27 UnRaid kernel: mdcmd (21): set spinup_group 5 0 Feb 27 12:19:27 UnRaid emhttp: Start array... Feb 27 12:19:27 UnRaid kernel: mdcmd (22): start STOPPED Feb 27 12:19:27 UnRaid kernel: unraid: allocating 70877K for 2448 stripes (6 disks) Feb 27 12:19:27 UnRaid kernel: md1: running, size: 1953514552 blocks Feb 27 12:19:27 UnRaid kernel: md2: running, size: 1953514552 blocks Feb 27 12:19:27 UnRaid kernel: md3: running, size: 3907018532 blocks Feb 27 12:19:27 UnRaid kernel: md4: running, size: 3907018532 blocks Feb 27 12:19:27 UnRaid kernel: md5: running, size: 3907018532 blocks Feb 27 12:19:28 UnRaid emhttp: shcmd (: udevadm settle Feb 27 12:19:28 UnRaid emhttp: Mounting disks... Feb 28 02:40:03 UnRaid kernel: hdhomerun_recor invoked oom-killer: gfp_mask=0x10200da, order=0, oom_score_adj=0 Feb 28 02:40:03 UnRaid kernel: hdhomerun_recor cpuset=b5b80cad4a6db965591a53f4b7a81c6b4aea89c7bd8910b6b4d9ad4a552dde3c mems_allowed=0 Feb 28 02:40:03 UnRaid kernel: CPU: 5 PID: 7971 Comm: hdhomerun_recor Not tainted 4.1.17-unRAID #1 Feb 28 02:40:03 UnRaid kernel: Hardware name: To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0, BIOS 2501 04/08/2014 Feb 28 02:40:03 UnRaid kernel: 0000000000000000 ffff8806c55938e8 ffffffff815f1df0 0000000000000000 Feb 28 02:40:03 UnRaid kernel: ffff88081a4a6ce0 ffff8806c5593998 ffffffff815ee36c ffff8806c55939c8 Feb 28 02:40:03 UnRaid kernel: ffffffff810f6d09 ffff88081702d640 0000000000000003 ffff8806c55939e8 Feb 28 02:40:03 UnRaid kernel: Call Trace: Feb 28 02:40:03 UnRaid kernel: [<ffffffff815f1df0>] dump_stack+0x4c/0x6e Feb 28 02:40:03 UnRaid kernel: [<ffffffff815ee36c>] dump_header+0x7a/0x20b Feb 28 02:40:03 UnRaid kernel: [<ffffffff810f6d09>] ? mem_cgroup_iter+0x2fd/0x3fb Feb 28 02:40:03 UnRaid kernel: [<ffffffff813552f3>] ? ___ratelimit+0xcf/0xe0 Feb 28 02:40:03 UnRaid kernel: [<ffffffff810b3c72>] oom_kill_process+0xb7/0x37b Feb 28 02:40:03 UnRaid kernel: [<ffffffff810b43c7>] __out_of_memory+0x441/0x463 Feb 28 02:40:03 UnRaid kernel: [<ffffffff810b4528>] out_of_memory+0x4f/0x66 Feb 28 02:40:03 UnRaid kernel: [<ffffffff810b852c>] __alloc_pages_nodemask+0x722/0x7b6 Feb 28 02:40:03 UnRaid kernel: [<ffffffff810e4a34>] alloc_pages_current+0xb4/0xd5 Feb 28 02:40:03 UnRaid kernel: [<ffffffff810b1a7e>] __page_cache_alloc+0x88/0x95 Feb 28 02:40:03 UnRaid kernel: [<ffffffff810b1b51>] pagecache_get_page+0xc6/0x153 Feb 28 02:40:03 UnRaid kernel: [<ffffffff8111cdf3>] ? inode_to_bdi+0x22/0x45 Feb 28 02:40:03 UnRaid kernel: [<ffffffff810b1d8c>] grab_cache_page_write_begin+0x24/0x3b Feb 28 02:40:03 UnRaid kernel: [<ffffffff8122055c>] fuse_perform_write+0x18c/0x45c Feb 28 02:40:03 UnRaid kernel: [<ffffffff811121eb>] ? file_remove_suid+0x34/0xa5 Feb 28 02:40:03 UnRaid kernel: [<ffffffff812209c5>] fuse_file_write_iter+0x199/0x1dc Feb 28 02:40:03 UnRaid kernel: [<ffffffff810fd91a>] __vfs_write+0x8f/0xb8 Feb 28 02:40:03 UnRaid kernel: [<ffffffff810fde99>] vfs_write+0xad/0x165 Feb 28 02:40:03 UnRaid kernel: [<ffffffff810fe5e9>] SyS_write+0x42/0x86 Feb 28 02:40:03 UnRaid kernel: [<ffffffff815f74ee>] system_call_fastpath+0x12/0x71 Feb 28 02:40:03 UnRaid kernel: [<ffffffff815f74cb>] ? system_call_after_swapgs+0x38/0x49 Feb 28 02:40:03 UnRaid kernel: Mem-Info: Feb 28 02:40:03 UnRaid kernel: active_anon:6288418 inactive_anon:15604 isolated_anon:0 Feb 28 02:40:03 UnRaid kernel: active_file:1745 inactive_file:2437 isolated_file:32 Feb 28 02:40:03 UnRaid kernel: unevictable:1672854 dirty:382 writeback:142 unstable:0 Feb 28 02:40:03 UnRaid kernel: slab_reclaimable:110241 slab_unreclaimable:20146 Feb 28 02:40:03 UnRaid kernel: mapped:14080 shmem:85313 pagetables:18341 bounce:0 Feb 28 02:40:03 UnRaid kernel: free:38773 free_pcp:381 free_cma:0 Feb 28 02:40:03 UnRaid kernel: Node 0 DMA free:15744kB min:8kB low:8kB high:12kB active_anon:112kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15988kB managed:15904kB mlocked:0kB dirty:0kB writeback:0kB mapped:16kB shmem:112kB slab_reclaimable:0kB slab_unreclaimable:32kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes Feb 28 02:40:03 UnRaid kernel: lowmem_reserve[]: 0 2896 32062 32062 Feb 28 02:40:03 UnRaid kernel: Node 0 DMA32 free:118644kB min:2060kB low:2572kB high:3088kB active_anon:1083768kB inactive_anon:5964kB active_file:512kB inactive_file:556kB unevictable:1606484kB isolated(anon):0kB isolated(file):0kB present:3042072kB managed:2967136kB mlocked:1606484kB dirty:108kB writeback:4kB mapped:4316kB shmem:31132kB slab_reclaimable:121444kB slab_unreclaimable:9540kB kernel_stack:1216kB pagetables:4908kB unstable:0kB bounce:0kB free_pcp:128kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:7964 all_unreclaimable? yes Feb 28 02:40:03 UnRaid kernel: lowmem_reserve[]: 0 0 29166 29166 Feb 28 02:40:03 UnRaid kernel: Node 0 Normal free:20704kB min:20776kB low:25968kB high:31164kB active_anon:24069792kB inactive_anon:56452kB active_file:6468kB inactive_file:9192kB unevictable:5084932kB isolated(anon):0kB isolated(file):128kB present:30392316kB managed:29866192kB mlocked:5084932kB dirty:1420kB writeback:564kB mapped:51988kB shmem:310008kB slab_reclaimable:319520kB slab_unreclaimable:71012kB kernel_stack:6256kB pagetables:68456kB unstable:0kB bounce:0kB free_pcp:1396kB local_pcp:120kB free_cma:0kB writeback_tmp:0kB pages_scanned:94860 all_unreclaimable? yes Feb 28 02:40:03 UnRaid kernel: lowmem_reserve[]: 0 0 0 0 Feb 28 02:40:03 UnRaid kernel: Node 0 DMA: 0*4kB 0*8kB 2*16kB (UM) 1*32kB (U) 1*64kB (U) 2*128kB (UM) 2*256kB (UM) 1*512kB (M) 2*1024kB (UM) 2*2048kB (UM) 2*4096kB (MR) = 15744kB Feb 28 02:40:03 UnRaid kernel: Node 0 DMA32: 983*4kB (UEM) 820*8kB (UE) 1091*16kB (UEM) 567*32kB (UE) 315*64kB (UEM) 92*128kB (UEM) 28*256kB (UE) 12*512kB (UEM) 27*1024kB (EM) 0*2048kB 0*4096kB = 118988kB Feb 28 02:40:03 UnRaid kernel: Node 0 Normal: 4282*4kB (UR) 9*8kB (R) 13*16kB (R) 9*32kB (R) 6*64kB (R) 2*128kB (R) 2*256kB (R) 2*512kB (R) 1*1024kB (R) 0*2048kB 0*4096kB = 20896kB Feb 28 02:40:03 UnRaid kernel: 89697 total pagecache pages Feb 28 02:40:03 UnRaid kernel: 0 pages in swap cache Feb 28 02:40:03 UnRaid kernel: Swap cache stats: add 0, delete 0, find 0/0 Feb 28 02:40:03 UnRaid kernel: Free swap = 0kB Feb 28 02:40:03 UnRaid kernel: Total swap = 0kB Feb 28 02:40:03 UnRaid kernel: 8362594 pages RAM Feb 28 02:40:03 UnRaid kernel: 0 pages HighMem/MovableOnly Feb 28 02:40:03 UnRaid kernel: 150286 pages reserved Feb 28 02:40:03 UnRaid kernel: Out of memory: Kill process 31127 (Plex Media Scan) score 751 or sacrifice child Feb 28 02:40:03 UnRaid kernel: Killed process 31127 (Plex Media Scan) total-vm:24889872kB, anon-rss:24632100kB, file-rss:60kB unraid-diagnostics-20160228-0919.zip Quote Link to comment
RobJ Posted March 1, 2016 Share Posted March 1, 2016 I don't have much experience here, especially with the VM parts, so I'm going to be guessing a little. But hopefully, I may mention something that will spark the right idea for you to check. It all seemed to be going fine until 2:40am, when hdhomerun OOM'd (which I'm sure you know means OutOfMemory). So the question is, how can you be out of memory with 32GB of RAM? It looks to me as if the VM has 24GB to itself, not sure though. That leaves 8GB for the rest, which should still be more than enough. The fact that it is hdhomerun though that reports the OOM makes me wonder if the HdHomerun tuner was recording and saving to a location in RAM, not on disk. So much of unRAID does run in RAM, although looking like it is running from disk. I would check the save location, including temp save locations, make sure it is truly to a physical disk location, not a path that actually is in RAM. Sorry, that's the only idea I can come up with. Quote Link to comment
cfloener Posted March 1, 2016 Author Share Posted March 1, 2016 I don't have much experience here, especially with the VM parts, so I'm going to be guessing a little. But hopefully, I may mention something that will spark the right idea for you to check. It all seemed to be going fine until 2:40am, when hdhomerun OOM'd (which I'm sure you know means OutOfMemory). So the question is, how can you be out of memory with 32GB of RAM? It looks to me as if the VM has 24GB to itself, not sure though. That leaves 8GB for the rest, which should still be more than enough. The fact that it is hdhomerun though that reports the OOM makes me wonder if the HdHomerun tuner was recording and saving to a location in RAM, not on disk. So much of unRAID does run in RAM, although looking like it is running from disk. I would check the save location, including temp save locations, make sure it is truly to a physical disk location, not a path that actually is in RAM. Sorry, that's the only idea I can come up with. I checked my VM's and while i have a total of 4 VM (only one running) each have about 6gig of RAM assigned to them, not sure if that is what your seeing. I can delete the other VM's in the event the system is reserving the ram for the other VM's. I checked the HDHomerun and it is writing to /user/HDhomerun, I did have that folder as part of folder caching but I have now removed it for testing. I guess I will remove some unused VM's and with folder caching removed from the HDHomerun folder I will have to see what happens. Thank you for the response. Quote Link to comment
itimpi Posted March 1, 2016 Share Posted March 1, 2016 I checked the HDHomerun and it is writing to /user/HDhomerun, I did have that folder as part of folder caching but I have now removed it for testing. If that is really the path you have set that will explain your problem as /user is in RAM. I guess I will remove some unused VM's and with folder caching removed from the HDHomerun folder I will have to see what happens. VM's that are not active do not use any resources. Quote Link to comment
cfloener Posted March 1, 2016 Author Share Posted March 1, 2016 I checked the HDHomerun and it is writing to /user/HDhomerun, I did have that folder as part of folder caching but I have now removed it for testing. If that is really the path you have set that will explain your problem as /user is in RAM. Ok moved the path from /user to disk, I will check again tonight and see if i get the same errors. Quote Link to comment
gubbgnutten Posted March 2, 2016 Share Posted March 2, 2016 Ok moved the path from /user to disk, I will check again tonight and see if i get the same errors. User shares are perfectly fine to use if you have them enabled, but they are located at /mnt/user, not /user. Quote Link to comment
cfloener Posted March 2, 2016 Author Share Posted March 2, 2016 Ok moved the path from /user to disk, I will check again tonight and see if i get the same errors. User shares are perfectly fine to use if you have them enabled, but they are located at /mnt/user, not /user. Just a typo, it should have been mnt/user Quote Link to comment
cfloener Posted March 2, 2016 Author Share Posted March 2, 2016 Still getting the Out of memory error, also have some hardware error that i'm not sure what it is. Mar 2 02:06:23 UnRaid kernel: mce: [Hardware Error]: Machine check events logged Mar 2 02:08:16 UnRaid kernel: qemu-system-x86 invoked oom-killer: gfp_mask=0xd0, order=0, oom_score_adj=0 Mar 2 02:08:16 UnRaid kernel: qemu-system-x86 cpuset=emulator mems_allowed=0 Mar 2 02:08:16 UnRaid kernel: CPU: 2 PID: 6926 Comm: qemu-system-x86 Not tainted 4.1.17-unRAID #1 Mar 2 02:08:16 UnRaid kernel: Hardware name: To be filled by O.E.M. To be filled by O.E.M./SABERTOOTH 990FX R2.0, BIOS 2501 04/08/2014 Mar 2 02:08:16 UnRaid kernel: 0000000000000000 ffff8807fd6576f8 ffffffff815f1df0 0000000000000000 Mar 2 02:08:16 UnRaid kernel: ffff880819733aa0 ffff8807fd6577a8 ffffffff815ee36c ffff8807fd657758 Mar 2 02:08:16 UnRaid kernel: ffffffff810f6d09 ffff88010023c000 01ff8807fd657718 ffff8807fd657758 Mar 2 02:08:16 UnRaid kernel: Call Trace: Mar 2 02:08:16 UnRaid kernel: [<ffffffff815f1df0>] dump_stack+0x4c/0x6e Mar 2 02:08:16 UnRaid kernel: [<ffffffff815ee36c>] dump_header+0x7a/0x20b Mar 2 02:08:16 UnRaid kernel: [<ffffffff810f6d09>] ? mem_cgroup_iter+0x2fd/0x3fb Mar 2 02:08:16 UnRaid kernel: [<ffffffff810fac83>] ? vmpressure+0x1c/0x6f Mar 2 02:08:16 UnRaid kernel: [<ffffffff813552f3>] ? ___ratelimit+0xcf/0xe0 Mar 2 02:08:16 UnRaid kernel: [<ffffffff810b3c72>] oom_kill_process+0xb7/0x37b Mar 2 02:08:16 UnRaid kernel: [<ffffffff810b3977>] ? oom_badness+0xb6/0x100 Mar 2 02:08:16 UnRaid kernel: [<ffffffff810b43c7>] __out_of_memory+0x441/0x463 Mar 2 02:08:16 UnRaid kernel: [<ffffffff810b4528>] out_of_memory+0x4f/0x66 Mar 2 02:08:16 UnRaid kernel: [<ffffffff810b852c>] __alloc_pages_nodemask+0x722/0x7b6 Mar 2 02:08:16 UnRaid kernel: [<ffffffff810e4a34>] alloc_pages_current+0xb4/0xd5 Mar 2 02:08:16 UnRaid kernel: [<ffffffff810b4c4f>] __get_free_pages+0x9/0x36 Mar 2 02:08:16 UnRaid kernel: [<ffffffff8110ca78>] __pollwait+0x59/0xc8 Mar 2 02:08:16 UnRaid kernel: [<ffffffff81131828>] eventfd_poll+0x28/0x4f Mar 2 02:08:16 UnRaid kernel: [<ffffffff81131800>] ? SyS_timerfd_gettime+0x144/0x144 Mar 2 02:08:16 UnRaid kernel: [<ffffffff8110dba2>] do_sys_poll+0x228/0x479 Mar 2 02:08:16 UnRaid kernel: [<ffffffff8110ca1f>] ? poll_initwait+0x3f/0x3f Mar 2 02:08:16 UnRaid kernel: [<ffffffff8110cc3c>] ? poll_select_copy_remaining+0xf4/0xf4 Mar 2 02:08:16 UnRaid kernel: [<ffffffff8110cc3c>] ? poll_select_copy_remaining+0xf4/0xf4 Mar 2 02:08:16 UnRaid kernel: [<ffffffff8110cc3c>] ? poll_select_copy_remaining+0xf4/0xf4 Mar 2 02:08:16 UnRaid kernel: [<ffffffff8110cc3c>] ? poll_select_copy_remaining+0xf4/0xf4 Mar 2 02:08:16 UnRaid kernel: [<ffffffff8110cc3c>] ? poll_select_copy_remaining+0xf4/0xf4 Mar 2 02:08:16 UnRaid kernel: [<ffffffff8110cc3c>] ? poll_select_copy_remaining+0xf4/0xf4 Mar 2 02:08:16 UnRaid kernel: [<ffffffff8110cc3c>] ? poll_select_copy_remaining+0xf4/0xf4 Mar 2 02:08:16 UnRaid kernel: [<ffffffff8110cc3c>] ? poll_select_copy_remaining+0xf4/0xf4 Mar 2 02:08:16 UnRaid kernel: [<ffffffff8110cc3c>] ? poll_select_copy_remaining+0xf4/0xf4 Mar 2 02:08:16 UnRaid kernel: [<ffffffff8110dfae>] SyS_ppoll+0xba/0x148 Mar 2 02:08:16 UnRaid kernel: [<ffffffff815f74ee>] system_call_fastpath+0x12/0x71 Mar 2 02:08:16 UnRaid kernel: Mem-Info: Mar 2 02:08:16 UnRaid kernel: active_anon:6247009 inactive_anon:18439 isolated_anon:0 Mar 2 02:08:16 UnRaid kernel: active_file:1186 inactive_file:3854 isolated_file:74 Mar 2 02:08:16 UnRaid kernel: unevictable:1685622 dirty:345 writeback:38 unstable:0 Mar 2 02:08:16 UnRaid kernel: slab_reclaimable:130645 slab_unreclaimable:21387 Mar 2 02:08:16 UnRaid kernel: mapped:14565 shmem:92219 pagetables:18873 bounce:0 Mar 2 02:08:16 UnRaid kernel: free:38739 free_pcp:638 free_cma:0 Mar 2 02:08:16 UnRaid kernel: Node 0 DMA free:15744kB min:8kB low:8kB high:12kB active_anon:112kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15988kB managed:15904kB mlocked:0kB dirty:0kB writeback:0kB mapped:16kB shmem:112kB slab_reclaimable:0kB slab_unreclaimable:32kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes Mar 2 02:08:16 UnRaid kernel: lowmem_reserve[]: 0 2896 32062 32062 Mar 2 02:08:16 UnRaid kernel: Node 0 DMA32 free:118672kB min:2060kB low:2572kB high:3088kB active_anon:1018000kB inactive_anon:6268kB active_file:424kB inactive_file:3300kB unevictable:1618596kB isolated(anon):0kB isolated(file):0kB present:3042072kB managed:2967136kB mlocked:1618596kB dirty:316kB writeback:152kB mapped:4608kB shmem:32872kB slab_reclaimable:171344kB slab_unreclaimable:8348kB kernel_stack:1408kB pagetables:5944kB unstable:0kB bounce:0kB free_pcp:1468kB local_pcp:248kB free_cma:0kB writeback_tmp:0kB pages_scanned:29668 all_unreclaimable? yes Mar 2 02:08:16 UnRaid kernel: lowmem_reserve[]: 0 0 29166 29166 Mar 2 02:08:16 UnRaid kernel: Node 0 Normal free:20540kB min:20776kB low:25968kB high:31164kB active_anon:23969924kB inactive_anon:67488kB active_file:4320kB inactive_file:12116kB unevictable:5123892kB isolated(anon):0kB isolated(file):296kB present:30392316kB managed:29866192kB mlocked:5123892kB dirty:1064kB writeback:0kB mapped:53636kB shmem:335892kB slab_reclaimable:351236kB slab_unreclaimable:77168kB kernel_stack:9024kB pagetables:69548kB unstable:0kB bounce:0kB free_pcp:1084kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:105256 all_unreclaimable? yes Mar 2 02:08:16 UnRaid kernel: lowmem_reserve[]: 0 0 0 0 Mar 2 02:08:16 UnRaid kernel: Node 0 DMA: 0*4kB 0*8kB 2*16kB (UM) 1*32kB (U) 1*64kB (U) 2*128kB (UM) 2*256kB (UM) 1*512kB (M) 2*1024kB (UM) 2*2048kB (UM) 2*4096kB (MR) = 15744kB Mar 2 02:08:16 UnRaid kernel: Node 0 DMA32: 1057*4kB (UEM) 1030*8kB (UEM) 1826*16kB (UE) 763*32kB (UEM) 261*64kB (UEM) 131*128kB (UM) 51*256kB (UM) 12*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 118772kB Mar 2 02:08:16 UnRaid kernel: Node 0 Normal: 4624*4kB (UEM) 104*8kB (UEM) 0*16kB 2*32kB (R) 0*64kB 1*128kB (R) 1*256kB (R) 1*512kB (R) 1*1024kB (R) 0*2048kB 0*4096kB = 21312kB Mar 2 02:08:16 UnRaid kernel: 97756 total pagecache pages Mar 2 02:08:16 UnRaid kernel: 0 pages in swap cache Mar 2 02:08:16 UnRaid kernel: Swap cache stats: add 0, delete 0, find 0/0 Mar 2 02:08:16 UnRaid kernel: Free swap = 0kB Mar 2 02:08:16 UnRaid kernel: Total swap = 0kB Mar 2 02:08:16 UnRaid kernel: 8362594 pages RAM Mar 2 02:08:16 UnRaid kernel: 0 pages HighMem/MovableOnly Mar 2 02:08:16 UnRaid kernel: 150286 pages reserved Mar 2 02:08:16 UnRaid kernel: [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name Mar 2 02:08:16 UnRaid kernel: [ 1063] 0 1063 5451 663 15 3 0 -1000 udevd Mar 2 02:08:16 UnRaid kernel: [ 1296] 0 1296 58398 638 25 3 0 0 rsyslogd Mar 2 02:08:16 UnRaid kernel: [ 1448] 1 1448 1714 425 8 3 0 0 rpc.portmap Mar 2 02:08:16 UnRaid kernel: [ 1452] 32 1452 3209 479 12 3 0 0 rpc.statd Mar 2 02:08:16 UnRaid kernel: [ 1462] 0 1462 1615 407 9 3 0 0 inetd Mar 2 02:08:16 UnRaid kernel: [ 1472] 0 1472 6016 797 16 3 0 -1000 sshd Mar 2 02:08:16 UnRaid kernel: [ 1485] 0 1485 24852 1201 21 3 0 0 ntpd Mar 2 02:08:16 UnRaid kernel: [ 1493] 0 1493 1096 406 7 3 0 0 acpid Mar 2 02:08:16 UnRaid kernel: [ 1506] 81 1506 4359 51 12 3 0 0 dbus-daemon Mar 2 02:08:16 UnRaid kernel: [ 1508] 0 1508 1617 421 8 3 0 0 crond Mar 2 02:08:16 UnRaid kernel: [ 1510] 0 1510 1615 25 8 3 0 0 atd Mar 2 02:08:16 UnRaid kernel: [ 1526] 0 1526 3339 1584 11 3 0 0 cpuload Mar 2 02:08:16 UnRaid kernel: [ 3633] 0 3633 48349 1446 94 3 0 0 nmbd Mar 2 02:08:16 UnRaid kernel: [ 3635] 0 3635 67739 3567 132 3 0 0 smbd Mar 2 02:08:16 UnRaid kernel: [ 6149] 0 6149 22743 1369 19 3 0 0 emhttp Mar 2 02:08:16 UnRaid kernel: [ 6156] 0 6156 1618 450 8 3 0 0 agetty Mar 2 02:08:16 UnRaid kernel: [ 6157] 0 6157 1618 450 8 3 0 0 agetty Mar 2 02:08:16 UnRaid kernel: [ 6158] 0 6158 1618 449 8 3 0 0 agetty Mar 2 02:08:16 UnRaid kernel: [ 6159] 0 6159 1618 425 7 3 0 0 agetty Mar 2 02:08:16 UnRaid kernel: [ 6160] 0 6160 1618 449 7 3 0 0 agetty Mar 2 02:08:16 UnRaid kernel: [ 6161] 0 6161 1618 450 8 3 0 0 agetty Mar 2 02:08:16 UnRaid kernel: [ 6214] 0 6214 20727 552 15 3 0 0 apcupsd Mar 2 02:08:16 UnRaid kernel: [ 6373] 0 6373 55131 419 18 3 0 0 shfs Mar 2 02:08:16 UnRaid kernel: [ 6384] 0 6384 376783 2978 58 4 0 0 shfs Mar 2 02:08:16 UnRaid kernel: [ 6580] 0 6580 2375 1162 9 3 0 0 inotifywait Mar 2 02:08:16 UnRaid kernel: [ 6581] 0 6581 2341 554 9 3 0 0 watcher Mar 2 02:08:16 UnRaid kernel: [ 6636] 0 6636 215369 3147 81 3 0 0 libvirtd Mar 2 02:08:16 UnRaid kernel: [ 6828] 61 6828 8613 707 21 3 0 0 avahi-daemon Mar 2 02:08:16 UnRaid kernel: [ 6829] 61 6829 8547 60 21 3 0 0 avahi-daemon Mar 2 02:08:16 UnRaid kernel: [ 6837] 0 6837 3186 392 11 3 0 0 avahi-dnsconfd Mar 2 02:08:16 UnRaid kernel: [ 6909] 99 6909 3852 554 12 3 0 0 dnsmasq Mar 2 02:08:16 UnRaid kernel: [ 6910] 0 6910 3819 44 12 3 0 0 dnsmasq Mar 2 02:08:16 UnRaid kernel: [ 6913] 0 6913 249961 6263 61 6 0 0 docker Mar 2 02:08:16 UnRaid kernel: [ 6926] 0 6926 2797645 1689128 3550 14 0 0 qemu-system-x86 Mar 2 02:08:16 UnRaid kernel: [10247] 0 10247 78421 8749 151 3 0 0 smbd Mar 2 02:08:16 UnRaid kernel: [11663] 0 11663 74633 4776 144 3 0 0 smbd Mar 2 02:08:16 UnRaid kernel: [23094] 0 23094 74780 5103 144 3 0 0 smbd Mar 2 02:08:16 UnRaid kernel: [30694] 0 30694 74631 4446 144 3 0 0 smbd Mar 2 02:08:16 UnRaid kernel: [21112] 0 21112 10959 2220 24 3 0 0 snmpd Mar 2 02:08:16 UnRaid kernel: [21175] 99 21175 70153 3785 135 3 0 0 smbd Mar 2 02:08:16 UnRaid kernel: [18057] 0 18057 74654 4486 143 3 0 0 smbd Mar 2 02:08:16 UnRaid kernel: [18383] 0 18383 74411 3797 142 3 0 0 smbd Mar 2 02:08:16 UnRaid kernel: [18086] 0 18086 3355 1599 11 3 0 0 cache_dirs Mar 2 02:08:16 UnRaid kernel: [ 2754] 0 2754 8468 1387 20 3 0 0 my_init Mar 2 02:08:16 UnRaid kernel: [ 2791] 0 2791 49 3 3 2 0 0 runsvdir Mar 2 02:08:16 UnRaid kernel: [ 2792] 0 2792 44 1 3 2 0 0 runsv Mar 2 02:08:16 UnRaid kernel: [ 2793] 0 2793 44 1 3 2 0 0 runsv Mar 2 02:08:16 UnRaid kernel: [ 2794] 0 2794 44 1 3 2 0 0 runsv Mar 2 02:08:16 UnRaid kernel: [ 2795] 0 2795 44 1 3 2 0 0 runsv Mar 2 02:08:16 UnRaid kernel: [ 2796] 0 2796 44 4 3 2 0 0 runsv Mar 2 02:08:16 UnRaid kernel: [ 2797] 0 2797 2293 23 7 3 0 0 tail Mar 2 02:08:16 UnRaid kernel: [ 2798] 0 2798 7111 61 17 3 0 0 cron Mar 2 02:08:16 UnRaid kernel: [ 2800] 0 2800 16437 370 36 3 0 0 syslog-ng Mar 2 02:08:16 UnRaid kernel: [ 2807] 99 2807 39861 259 80 3 0 0 hdhomerun_recor Mar 2 02:08:16 UnRaid kernel: [30722] 0 30722 7058 1201 17 3 0 0 my_init Mar 2 02:08:16 UnRaid kernel: [32104] 0 32104 49 5 3 2 0 0 runsvdir Mar 2 02:08:16 UnRaid kernel: [32105] 0 32105 44 1 3 2 0 0 runsv Mar 2 02:08:16 UnRaid kernel: [32106] 0 32106 44 1 3 2 0 0 runsv Mar 2 02:08:16 UnRaid kernel: [32107] 0 32107 44 1 3 2 0 0 runsv Mar 2 02:08:16 UnRaid kernel: [32108] 0 32108 44 1 3 2 0 0 runsv Mar 2 02:08:16 UnRaid kernel: [32109] 0 32109 44 1 3 2 0 0 runsv Mar 2 02:08:16 UnRaid kernel: [32110] 0 32110 1870 19 8 3 0 0 tail Mar 2 02:08:16 UnRaid kernel: [32111] 0 32111 6688 67 18 3 0 0 cron Mar 2 02:08:16 UnRaid kernel: [32112] 0 32112 15917 380 34 3 0 0 syslog-ng Mar 2 02:08:16 UnRaid kernel: [32113] 999 32113 1112 19 6 3 0 0 start_pms Mar 2 02:08:16 UnRaid kernel: [32295] 999 32295 154268 44665 318 4 0 0 Plex Media Serv Mar 2 02:08:16 UnRaid kernel: [ 980] 999 980 461530 18725 151 5 0 0 python Mar 2 02:08:16 UnRaid kernel: [23887] 0 23887 74641 4590 143 3 0 0 smbd Mar 2 02:08:16 UnRaid kernel: [23888] 0 23888 74703 4536 143 3 0 0 smbd Mar 2 02:08:16 UnRaid kernel: [26949] 0 26949 49 1 3 2 0 0 s6-svscan Mar 2 02:08:16 UnRaid kernel: [26974] 0 26974 49 1 3 2 0 0 s6-supervise Mar 2 02:08:16 UnRaid kernel: [27210] 0 27210 49 1 3 2 0 0 s6-supervise Mar 2 02:08:16 UnRaid kernel: [ 7218] 0 7218 12795 87 29 3 0 0 su Mar 2 02:08:16 UnRaid kernel: [ 7241] 99 7241 1256745 140733 570 9 0 0 mono-sgen Mar 2 02:08:16 UnRaid kernel: [21100] 0 21100 74316 4571 144 3 0 0 smbd Mar 2 02:08:16 UnRaid kernel: [12148] 999 12148 6006415 5940021 11725 26 0 0 Plex Media Scan Mar 2 02:08:16 UnRaid kernel: [18179] 0 18179 2159 196 9 3 0 0 timeout Mar 2 02:08:16 UnRaid kernel: [18180] 0 18180 2982 580 11 3 0 0 find Mar 2 02:08:16 UnRaid kernel: [18312] 0 18312 331 1 5 3 0 0 run Mar 2 02:08:16 UnRaid kernel: [18330] 0 18330 1091 187 7 3 0 0 sleep Mar 2 02:08:16 UnRaid kernel: Out of memory: Kill process 12148 (Plex Media Scan) score 724 or sacrifice child Mar 2 02:08:16 UnRaid kernel: Killed process 12148 (Plex Media Scan) total-vm:24025660kB, anon-rss:23759784kB, file-rss:300kB Mar 2 02:08:53 UnRaid kernel: mce: [Hardware Error]: Machine check events logged Quote Link to comment
itimpi Posted March 2, 2016 Share Posted March 2, 2016 Ok moved the path from /user to disk, I will check again tonight and see if i get the same errors. User shares are perfectly fine to use if you have them enabled, but they are located at /mnt/user, not /user. Just a typo, it should have been mnt/user I assume you actually meant "/mnt/user" ? Just a thought - do you also have a user share on the path. i.e. something like "/mnt/user/sharename". If not then it will still end up in RAM as it only ends up pointing to the physical disks when it matches a folder (share) name on the disks. Quote Link to comment
cfloener Posted March 2, 2016 Author Share Posted March 2, 2016 Ok moved the path from /user to disk, I will check again tonight and see if i get the same errors. User shares are perfectly fine to use if you have them enabled, but they are located at /mnt/user, not /user. Just a typo, it should have been mnt/user I assume you actually meant "/mnt/user" ? Just a thought - do you also have a user share on the path. i.e. something like "/mnt/user/sharename". If not then it will still end up in RAM as it only ends up pointing to the physical disks when it matches a folder (share) name on the disks. My normal share point for this is /mnt/user/HDHOMERUN/ and was getting OOM errors, yesterday I changed it to /mnt/disk4/HDHOMERUN and still got the OOM errors. I have now moved it back to /mnt/user/HDHOMERUN/. Not 100% sure what is causing the OOM errors now. Quote Link to comment
RobJ Posted March 2, 2016 Share Posted March 2, 2016 Still getting the Out of memory error, also have some hardware error that i'm not sure what it is. Mar 2 02:06:23 UnRaid kernel: mce: [Hardware Error]: Machine check events logged Machine check events always seem hard to diagnose and fix. Seems coincidental with the OOM's, but MCE's are hardware related, and OOM's are software related. I'd start with a thorough Memtest'ing. MCE could be general motherboard issue, RAM, power, addon card, heat? ... Sorry, not a happy machine. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.