- Minor
hello,
this night i got two OOM in my syslog, which was reported by the fix common problems plugins.
Both were on 01:11 when no known task with high memory usage was running:
*edit* there was running a backup with xz and high compression running... but there wasn't any OOM in the past.
Aug 18 01:10:22 Unraid-1 kernel: xz invoked oom-killer: gfp_mask=0x140dca(GFP_HIGHUSER_MOVABLE|__GFP_COMP|__GFP_ZERO), order=0, oom_score_adj=0 Aug 18 01:10:22 Unraid-1 kernel: CPU: 2 PID: 3973545 Comm: xz Tainted: P U W O 6.8.12-Unraid #3 Aug 18 01:10:22 Unraid-1 kernel: Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./H470M-ITX/ac, BIOS L1.22 12/07/2020 Aug 18 01:10:22 Unraid-1 kernel: Call Trace: Aug 18 01:10:22 Unraid-1 kernel: <TASK> Aug 18 01:10:22 Unraid-1 kernel: dump_stack_lvl+0x47/0x63 Aug 18 01:10:22 Unraid-1 kernel: dump_header+0x45/0x18e Aug 18 01:10:22 Unraid-1 kernel: oom_kill_process+0x7d/0x184 Aug 18 01:10:22 Unraid-1 kernel: out_of_memory+0x39c/0x3ce Aug 18 01:10:22 Unraid-1 kernel: __alloc_pages_slowpath.constprop.0+0x749/0x928 Aug 18 01:10:22 Unraid-1 kernel: __alloc_pages+0x120/0x1d6 Aug 18 01:10:22 Unraid-1 kernel: alloc_pages_mpol+0xbc/0x1e1 Aug 18 01:10:22 Unraid-1 kernel: vma_alloc_folio+0x55/0x8a Aug 18 01:10:22 Unraid-1 kernel: __handle_mm_fault+0x67e/0xf0e Aug 18 01:10:22 Unraid-1 kernel: handle_mm_fault+0x17a/0x269 Aug 18 01:10:22 Unraid-1 kernel: do_user_addr_fault+0x28f/0x493 Aug 18 01:10:22 Unraid-1 kernel: exc_page_fault+0xf9/0x116 Aug 18 01:10:22 Unraid-1 kernel: asm_exc_page_fault+0x22/0x30 Aug 18 01:10:22 Unraid-1 kernel: RIP: 0033:0x1487e3ebc064 Aug 18 01:10:22 Unraid-1 kernel: Code: 00 0f 1f 44 00 00 c5 fe 6f 4e 20 f7 c1 00 0e 00 00 75 65 49 89 c9 48 8d 4c 16 ff 48 83 ce 3f 4a 8d 7c 0e 01 48 29 f1 48 ff c6 <f3> a4 c4 c1 7e 7f 00 c4 c1 7e 7f 48 20 c5 f8 77 c3 66 66 2e 0f 1f Aug 18 01:10:22 Unraid-1 kernel: RSP: 002b:00001487c9fffd18 EFLAGS: 00010212 Aug 18 01:10:22 Unraid-1 kernel: RAX: 0000148612ff8010 RBX: 0000000000004000 RCX: 0000000000003010 Aug 18 01:10:22 Unraid-1 kernel: RDX: 0000000000004000 RSI: 000014861e7f9000 RDI: 0000148612ff9000 Aug 18 01:10:22 Unraid-1 kernel: RBP: 00000000051f8000 R08: 0000148612ff8010 R09: fffffffff4800000 Aug 18 01:10:22 Unraid-1 kernel: R10: 00000000051ec4a9 R11: 0000000000000000 R12: 00000000051f8000 Aug 18 01:10:22 Unraid-1 kernel: R13: 00001487c9fffd88 R14: 00001487c9fffe98 R15: 0000148614000c60 Aug 18 01:10:22 Unraid-1 kernel: </TASK> Aug 18 01:10:22 Unraid-1 kernel: Mem-Info: Aug 18 01:10:22 Unraid-1 kernel: active_anon:191850 inactive_anon:7170169 isolated_anon:0 Aug 18 01:10:22 Unraid-1 kernel: active_file:1595 inactive_file:31527 isolated_file:128 Aug 18 01:10:22 Unraid-1 kernel: unevictable:44889 dirty:200 writeback:0 Aug 18 01:10:22 Unraid-1 kernel: slab_reclaimable:384771 slab_unreclaimable:128111 Aug 18 01:10:22 Unraid-1 kernel: mapped:169027 shmem:484347 pagetables:56316 Aug 18 01:10:22 Unraid-1 kernel: sec_pagetables:0 bounce:0 Aug 18 01:10:22 Unraid-1 kernel: kernel_misc_reclaimable:0 Aug 18 01:10:22 Unraid-1 kernel: free:61099 free_pcp:296 free_cma:0 Aug 18 01:10:22 Unraid-1 kernel: Node 0 active_anon:767400kB inactive_anon:28680676kB active_file:6380kB inactive_file:126108kB unevictable:179556kB isolated(anon):0kB isolated(file):512kB mapped:676108kB dirty:800kB writeback:0kB shmem:1937388kB shmem_thp:28672kB shmem_pmdmapped:0kB anon_thp:4698112kB writeback_tmp:0kB kernel_stack:74352kB pagetables:225264kB sec_pagetables:0kB all_unreclaimable? no Aug 18 01:10:22 Unraid-1 kernel: Node 0 DMA free:15368kB boost:0kB min:28kB low:40kB high:52kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15368kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Aug 18 01:10:22 Unraid-1 kernel: lowmem_reserve[]: 0 2087 31728 31728 31728 Aug 18 01:10:22 Unraid-1 kernel: Node 0 DMA32 free:123068kB boost:0kB min:4444kB low:6580kB high:8716kB reserved_highatomic:0KB active_anon:1792kB inactive_anon:1956820kB active_file:32kB inactive_file:592kB unevictable:27836kB writepending:152kB present:2266104kB managed:2173112kB mlocked:0kB bounce:0kB free_pcp:1172kB local_pcp:0kB free_cma:0kB Aug 18 01:10:22 Unraid-1 kernel: lowmem_reserve[]: 0 0 29640 29640 29640 Aug 18 01:10:22 Unraid-1 kernel: Node 0 Normal free:105960kB boost:185700kB min:248804kB low:279152kB high:309500kB reserved_highatomic:0KB active_anon:765608kB inactive_anon:26723856kB active_file:6992kB inactive_file:125512kB unevictable:151720kB writepending:648kB present:30924800kB managed:30351844kB mlocked:96kB bounce:0kB free_pcp:12kB local_pcp:0kB free_cma:0kB Aug 18 01:10:22 Unraid-1 kernel: lowmem_reserve[]: 0 0 0 0 0 Aug 18 01:10:22 Unraid-1 kernel: Node 0 DMA: 2*4kB (U) 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15368kB Aug 18 01:10:22 Unraid-1 kernel: Node 0 DMA32: 59*4kB (UME) 134*8kB (UE) 158*16kB (UE) 256*32kB (UME) 275*64kB (UME) 164*128kB (UME) 119*256kB (UME) 62*512kB (UME) 10*1024kB (UME) 0*2048kB 0*4096kB = 123068kB Aug 18 01:10:22 Unraid-1 kernel: Node 0 Normal: 434*4kB (UM) 143*8kB (UM) 2247*16kB (UME) 2107*32kB (UME) 2*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 106384kB Aug 18 01:10:22 Unraid-1 kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Aug 18 01:10:22 Unraid-1 kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Aug 18 01:10:22 Unraid-1 kernel: 517778 total pagecache pages Aug 18 01:10:22 Unraid-1 kernel: 0 pages in swap cache Aug 18 01:10:22 Unraid-1 kernel: Free swap = 0kB Aug 18 01:10:22 Unraid-1 kernel: Total swap = 0kB Aug 18 01:10:22 Unraid-1 kernel: 8301724 pages RAM Aug 18 01:10:22 Unraid-1 kernel: 0 pages HighMem/MovableOnly Aug 18 01:10:22 Unraid-1 kernel: 166643 pages reserved Aug 18 01:10:22 Unraid-1 kernel: 0 pages cma reserved
and
Aug 18 01:10:22 Unraid-1 kernel: oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/docker/e568745d3ae566c2242cfdcdae592c0f7d9e23274e3e003b65a98a532f0d44af,task=Altus,pid=3017191,uid=99 Aug 18 01:10:22 Unraid-1 kernel: Out of memory: Killed process 3017191 (Altus) total-vm:1186470024kB, anon-rss:15564kB, file-rss:512kB, shmem-rss:8kB, UID:99 pgtables:692kB oom_score_adj:300 Aug 18 01:10:22 Unraid-1 kernel: xz invoked oom-killer: gfp_mask=0x140dca(GFP_HIGHUSER_MOVABLE|__GFP_COMP|__GFP_ZERO), order=0, oom_score_adj=0 Aug 18 01:10:22 Unraid-1 kernel: CPU: 3 PID: 3972211 Comm: xz Tainted: P U W O 6.8.12-Unraid #3 Aug 18 01:10:22 Unraid-1 kernel: Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./H470M-ITX/ac, BIOS L1.22 12/07/2020 Aug 18 01:10:22 Unraid-1 kernel: Call Trace: Aug 18 01:10:22 Unraid-1 kernel: <TASK> Aug 18 01:10:22 Unraid-1 kernel: dump_stack_lvl+0x47/0x63 Aug 18 01:10:22 Unraid-1 kernel: dump_header+0x45/0x18e Aug 18 01:10:22 Unraid-1 kernel: oom_kill_process+0x7d/0x184 Aug 18 01:10:22 Unraid-1 kernel: out_of_memory+0x39c/0x3ce Aug 18 01:10:22 Unraid-1 kernel: __alloc_pages_slowpath.constprop.0+0x749/0x928 Aug 18 01:10:22 Unraid-1 kernel: __alloc_pages+0x120/0x1d6 Aug 18 01:10:22 Unraid-1 kernel: alloc_pages_mpol+0xbc/0x1e1 Aug 18 01:10:22 Unraid-1 kernel: vma_alloc_folio+0x55/0x8a Aug 18 01:10:22 Unraid-1 kernel: __handle_mm_fault+0x67e/0xf0e Aug 18 01:10:22 Unraid-1 kernel: handle_mm_fault+0x17a/0x269 Aug 18 01:10:22 Unraid-1 kernel: do_user_addr_fault+0x28f/0x493 Aug 18 01:10:22 Unraid-1 kernel: exc_page_fault+0xf9/0x116 Aug 18 01:10:22 Unraid-1 kernel: asm_exc_page_fault+0x22/0x30 Aug 18 01:10:22 Unraid-1 kernel: RIP: 0033:0x1487e3ebc0c7 Aug 18 01:10:22 Unraid-1 kernel: Code: 5e 83 08 00 01 74 9c 83 f9 c0 0f 87 7e fe ff ff c5 fe 6f 4e 20 48 29 fe 48 83 c7 3f 49 8d 0c 10 48 83 e7 c0 48 01 fe 48 29 f9 <f3> a4 c4 c1 7e 7f 00 c4 c1 7e 7f 48 20 c5 f8 77 c3 0f 1f 84 00 00 Aug 18 01:10:22 Unraid-1 kernel: RSP: 002b:00001487ca7ffcd8 EFLAGS: 00010206 Aug 18 01:10:22 Unraid-1 kernel: RAX: 00001486bfa95a0d RBX: 00001486a4000d60 RCX: 000000000000d80f Aug 18 01:10:22 Unraid-1 kernel: RDX: 000000000000ee02 RSI: 00001486a1f130cb RDI: 00001486bfa97000 Aug 18 01:10:22 Unraid-1 kernel: RBP: 00001486a4000c88 R08: 00001486bfa95a0d R09: 0000000001d6caa6 Aug 18 01:10:22 Unraid-1 kernel: R10: 000000000411fd6e R11: 0000000000000000 R12: 00001487ca7ffe90 Aug 18 01:10:22 Unraid-1 kernel: R13: 00001487e3f73a3c R14: 000000000a2959bd R15: 000000000c002460 Aug 18 01:10:22 Unraid-1 kernel: </TASK> Aug 18 01:10:22 Unraid-1 kernel: Mem-Info: Aug 18 01:10:22 Unraid-1 kernel: active_anon:191919 inactive_anon:7149920 isolated_anon:0 Aug 18 01:10:22 Unraid-1 kernel: active_file:1726 inactive_file:50131 isolated_file:489 Aug 18 01:10:22 Unraid-1 kernel: unevictable:44889 dirty:353 writeback:0 Aug 18 01:10:22 Unraid-1 kernel: slab_reclaimable:384728 slab_unreclaimable:128185 Aug 18 01:10:22 Unraid-1 kernel: mapped:168873 shmem:484471 pagetables:55806 Aug 18 01:10:22 Unraid-1 kernel: sec_pagetables:0 bounce:0 Aug 18 01:10:22 Unraid-1 kernel: kernel_misc_reclaimable:0 Aug 18 01:10:22 Unraid-1 kernel: free:60100 free_pcp:3282 free_cma:0 Aug 18 01:10:22 Unraid-1 kernel: Node 0 active_anon:767676kB inactive_anon:28599680kB active_file:6904kB inactive_file:200524kB unevictable:179556kB isolated(anon):0kB isolated(file):1956kB mapped:675492kB dirty:1412kB writeback:0kB shmem:1937884kB shmem_thp:28672kB shmem_pmdmapped:0kB anon_thp:4698112kB writeback_tmp:0kB kernel_stack:73604kB pagetables:223224kB sec_pagetables:0kB all_unreclaimable? no Aug 18 01:10:22 Unraid-1 kernel: Node 0 DMA free:15368kB boost:0kB min:28kB low:40kB high:52kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15368kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Aug 18 01:10:22 Unraid-1 kernel: lowmem_reserve[]: 0 2087 31728 31728 31728 Aug 18 01:10:22 Unraid-1 kernel: Node 0 DMA32 free:122176kB boost:0kB min:4444kB low:6580kB high:8716kB reserved_highatomic:0KB active_anon:1792kB inactive_anon:1959272kB active_file:0kB inactive_file:448kB unevictable:27836kB writepending:204kB present:2266104kB managed:2173112kB mlocked:0kB bounce:0kB free_pcp:756kB local_pcp:0kB free_cma:0kB Aug 18 01:10:22 Unraid-1 kernel: lowmem_reserve[]: 0 0 29640 29640 29640 Aug 18 01:10:22 Unraid-1 kernel: Node 0 Normal free:102856kB boost:185700kB min:248804kB low:279152kB high:309500kB reserved_highatomic:0KB active_anon:765884kB inactive_anon:26640732kB active_file:6844kB inactive_file:200612kB unevictable:151720kB writepending:1208kB present:30924800kB managed:30351844kB mlocked:96kB bounce:0kB free_pcp:12372kB local_pcp:0kB free_cma:0kB Aug 18 01:10:22 Unraid-1 kernel: lowmem_reserve[]: 0 0 0 0 0 Aug 18 01:10:22 Unraid-1 kernel: Node 0 DMA: 2*4kB (U) 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15368kB Aug 18 01:10:22 Unraid-1 kernel: Node 0 DMA32: 38*4kB (UME) 113*8kB (UME) 177*16kB (UME) 229*32kB (UME) 274*64kB (UME) 163*128kB (UME) 118*256kB (UME) 63*512kB (UME) 10*1024kB (UME) 0*2048kB 0*4096kB = 122320kB Aug 18 01:10:22 Unraid-1 kernel: Node 0 Normal: 1861*4kB (M) 69*8kB (M) 2098*16kB (UME) 1923*32kB (UME) 3*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 103292kB Aug 18 01:10:22 Unraid-1 kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Aug 18 01:10:22 Unraid-1 kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Aug 18 01:10:22 Unraid-1 kernel: 536936 total pagecache pages Aug 18 01:10:22 Unraid-1 kernel: 0 pages in swap cache Aug 18 01:10:22 Unraid-1 kernel: Free swap = 0kB Aug 18 01:10:22 Unraid-1 kernel: Total swap = 0kB Aug 18 01:10:22 Unraid-1 kernel: 8301724 pages RAM Aug 18 01:10:22 Unraid-1 kernel: 0 pages HighMem/MovableOnly Aug 18 01:10:22 Unraid-1 kernel: 166643 pages reserved Aug 18 01:10:22 Unraid-1 kernel: 0 pages cma reserved Aug 18 01:10:22 Unraid-1 kernel: Tasks state (memory values in pages):
i didn't changed anything to pre 7.0.0 releases and i never got OOM in the last 4 years.