Server not accessible - what next?

[ScoHo]

All of a sudden I couldn't get to any of my shares, and tried to access via the web client, with no success.  So I hooked up a monitor and keyboard to the box and it's just a black screen.  I hit a few buttons on the keyboard and still nothing.

 

So before I restart by hitting the power button, is there anything I can do to see what happened, or any way to avoid a parity build when it restarts?

 

Running v4.7.

 

[lionelhutz]

Not likely. Try just tapping the power button and it may power down correctly. I'm pretty sure the newer versions attempt to capture a power button press and properly shut-down the array.

 

Peter

[ScoHo]

I've now had this happen to me 3 times since upgrading my unRAID box 3 weeks ago.  Running an ASUS M4A785-M, Sempron 140.  Using the same memory I had in the old box (1 GB).  The other thing that changed at the same time is I installed the Crashplan engine on the new box.  Is 1GB not enough memory?  Is there any way to debug something like this?

[ScoHo]

I just found this thread on creating a tail syslog, so I will try that.

 

http://lime-technology.com/forum/index.php?topic=9880.0

[Falcon]

I have also problems with memory after I have installed Crashplan. It become worse after a selected a lot of new files.

 

I have 2 GB Memory and found this in my syslog

 

As you can see it kills tasks to free memory, but it kills itself too...

 

Apr 15 04:55:46 Fileserver kernel: Out of memory: kill process 2815 (java) score 401 or a child

Apr 15 04:55:46 Fileserver kernel: Killed process 2815 (java)

Apr 15 04:55:47 Fileserver kernel: cache_dirs invoked oom-killer: gfp_mask=0xd0, order=1, oom_adj=0

Apr 15 04:55:47 Fileserver kernel: Pid: 3011, comm: cache_dirs Not tainted 2.6.32.9-unRAID #8

Apr 15 04:55:47 Fileserver kernel: Call Trace:

Apr 15 04:55:47 Fileserver kernel:  [<c104ab61>] oom_kill_process+0x59/0x1cd

Apr 15 04:55:47 Fileserver kernel:  [<c104afb9>] __out_of_memory+0xef/0x102

Apr 15 04:55:47 Fileserver kernel:  [<c104b02a>] out_of_memory+0x5e/0x83

Apr 15 04:55:47 Fileserver kernel:  [<c104cfe9>] __alloc_pages_nodemask+0x375/0x42f

Apr 15 04:55:47 Fileserver kernel:  [<c104d0b2>] __get_free_pages+0xf/0x21

Apr 15 04:55:47 Fileserver kernel:  [<c1022c2e>] copy_process+0xa4/0xdff

Apr 15 04:55:47 Fileserver kernel:  [<c1023b1e>] do_fork+0x11d/0x251

Apr 15 04:55:47 Fileserver kernel:  [<c11370cc>] ? copy_to_user+0x33/0x3c

Apr 15 04:55:47 Fileserver kernel:  [<c1001626>] sys_clone+0x24/0x2b

Apr 15 04:55:47 Fileserver kernel:  [<c1002935>] syscall_call+0x7/0xb

Apr 15 04:55:47 Fileserver kernel: Mem-Info:

Apr 15 04:55:47 Fileserver kernel: DMA per-cpu:

Apr 15 04:55:47 Fileserver kernel: CPU    0: hi:    0, btch:  1 usd:  0

Apr 15 04:55:47 Fileserver kernel: CPU    1: hi:    0, btch:  1 usd:  0

Apr 15 04:55:47 Fileserver kernel: Normal per-cpu:

Apr 15 04:55:47 Fileserver kernel: CPU    0: hi:  186, btch:  31 usd:  0

Apr 15 04:55:47 Fileserver kernel: CPU    1: hi:  186, btch:  31 usd:  0

Apr 15 04:55:47 Fileserver kernel: HighMem per-cpu:

Apr 15 04:55:47 Fileserver kernel: CPU    0: hi:  186, btch:  31 usd:  0

Apr 15 04:55:47 Fileserver kernel: CPU    1: hi:  186, btch:  31 usd:  0

Apr 15 04:55:47 Fileserver kernel: active_anon:43607 inactive_anon:24536 isolated_anon:0

Apr 15 04:55:47 Fileserver kernel:  active_file:8410 inactive_file:8430 isolated_file:260

Apr 15 04:55:47 Fileserver kernel:  unevictable:350083 dirty:0 writeback:0 unstable:0

Apr 15 04:55:47 Fileserver kernel:  free:35297 slab_reclaimable:7617 slab_unreclaimable:20128

Apr 15 04:55:47 Fileserver kernel:  mapped:3459 shmem:40 pagetables:376 bounce:0

Apr 15 04:55:47 Fileserver kernel: DMA free:3560kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:372kB isolated(anon):0kB isolated(file):0kB present:15800kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:876kB slab_unreclaimable:11056kB kernel_stack:40kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no

Apr 15 04:55:47 Fileserver kernel: lowmem_reserve[]: 0 867 2014 2014

Apr 15 04:55:47 Fileserver kernel: Normal free:135372kB min:3732kB low:4664kB high:5596kB active_anon:27680kB inactive_anon:45076kB active_file:33740kB inactive_file:33716kB unevictable:428212kB isolated(anon):0kB isolated(file):912kB present:887976kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:29592kB slab_unreclaimable:69456kB kernel_stack:1072kB pagetables:280kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:195 all_unreclaimable? no

Apr 15 04:55:47 Fileserver kernel: lowmem_reserve[]: 0 0 9179 9179

Apr 15 04:55:47 Fileserver kernel: HighMem free:2256kB min:512kB low:1744kB high:2980kB active_anon:146748kB inactive_anon:53068kB active_file:0kB inactive_file:4kB unevictable:971748kB isolated(anon):0kB isolated(file):0kB present:1174948kB mlocked:0kB dirty:0kB writeback:0kB mapped:13832kB shmem:160kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:1224kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no

Apr 15 04:55:47 Fileserver kernel: lowmem_reserve[]: 0 0 0 0

Apr 15 04:55:47 Fileserver kernel: DMA: 20*4kB 57*8kB 93*16kB 2*32kB 1*64kB 3*128kB 4*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3560kB

Apr 15 04:55:47 Fileserver kernel: Normal: 33165*4kB 163*8kB 14*16kB 9*32kB 2*64kB 2*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 135372kB

Apr 15 04:55:47 Fileserver kernel: HighMem: 534*4kB 9*8kB 1*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2256kB

Apr 15 04:55:47 Fileserver kernel: 367207 total pagecache pages

Apr 15 04:55:47 Fileserver kernel: 0 pages in swap cache

Apr 15 04:55:47 Fileserver kernel: Swap cache stats: add 0, delete 0, find 0/0

Apr 15 04:55:47 Fileserver kernel: Free swap  = 0kB

Apr 15 04:55:47 Fileserver kernel: Total swap = 0kB

Apr 15 04:55:47 Fileserver kernel: 523872 pages RAM

Apr 15 04:55:47 Fileserver kernel: 296050 pages HighMem

Apr 15 04:55:47 Fileserver kernel: 5543 pages reserved

Apr 15 04:55:47 Fileserver kernel: 26950 pages shared

Apr 15 04:55:47 Fileserver kernel: 461848 pages non-shared

Apr 15 04:55:47 Fileserver kernel: Out of memory: kill process 1636 (rpc.statd) score 225 or a child

Apr 15 04:55:47 Fileserver kernel: Killed process 1636 (rpc.statd)

Apr 15 04:55:47 Fileserver kernel: cache_dirs invoked oom-killer: gfp_mask=0xd0, order=1, oom_adj=0

Apr 15 04:55:47 Fileserver kernel: Pid: 3016, comm: cache_dirs Not tainted 2.6.32.9-unRAID #8

Apr 15 04:55:47 Fileserver kernel: Call Trace:

Apr 15 04:55:47 Fileserver kernel:  [<c104ab61>] oom_kill_process+0x59/0x1cd

Apr 15 04:55:47 Fileserver kernel:  [<c104afb9>] __out_of_memory+0xef/0x102

Apr 15 04:55:47 Fileserver kernel:  [<c104b02a>] out_of_memory+0x5e/0x83

Apr 15 04:55:47 Fileserver kernel:  [<c104cfe9>] __alloc_pages_nodemask+0x375/0x42f

Apr 15 04:55:47 Fileserver kernel:  [<c104d0b2>] __get_free_pages+0xf/0x21

Apr 15 04:55:47 Fileserver kernel:  [<c1022c2e>] copy_process+0xa4/0xdff

Apr 15 04:55:47 Fileserver kernel:  [<c1023b1e>] do_fork+0x11d/0x251

Apr 15 04:55:47 Fileserver kernel:  [<c11370cc>] ? copy_to_user+0x33/0x3c

Apr 15 04:55:47 Fileserver kernel:  [<c1001626>] sys_clone+0x24/0x2b

Apr 15 04:55:47 Fileserver kernel:  [<c1002935>] syscall_call+0x7/0xb

Apr 15 04:55:47 Fileserver kernel: Mem-Info:

Apr 15 04:55:47 Fileserver kernel: DMA per-cpu:

Apr 15 04:55:47 Fileserver kernel: CPU    0: hi:    0, btch:  1 usd:  0

Apr 15 04:55:47 Fileserver kernel: CPU    1: hi:    0, btch:  1 usd:  0

Apr 15 04:55:47 Fileserver kernel: Normal per-cpu:

Apr 15 04:55:47 Fileserver kernel: CPU    0: hi:  186, btch:  31 usd:  0

Apr 15 04:55:47 Fileserver kernel: CPU    1: hi:  186, btch:  31 usd:  0

Apr 15 04:55:47 Fileserver kernel: HighMem per-cpu:

Apr 15 04:55:47 Fileserver kernel: CPU    0: hi:  186, btch:  31 usd:  0

Apr 15 04:55:47 Fileserver kernel: CPU    1: hi:  186, btch:  31 usd:  0

Apr 15 04:55:47 Fileserver kernel: active_anon:43638 inactive_anon:24505 isolated_anon:0

Apr 15 04:55:47 Fileserver kernel:  active_file:8490 inactive_file:8482 isolated_file:196

Apr 15 04:55:47 Fileserver kernel:  unevictable:350083 dirty:0 writeback:0 unstable:0

Apr 15 04:55:47 Fileserver kernel:  free:35193 slab_reclaimable:7634 slab_unreclaimable:20128

Apr 15 04:55:47 Fileserver kernel:  mapped:3459 shmem:40 pagetables:376 bounce:0

Apr 15 04:55:47 Fileserver kernel: DMA free:3560kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:372kB isolated(anon):0kB isolated(file):0kB present:15800kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:876kB slab_unreclaimable:11056kB kernel_stack:40kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no

Apr 15 04:55:47 Fileserver kernel: lowmem_reserve[]: 0 867 2014 2014

Apr 15 04:55:47 Fileserver kernel: Normal free:135080kB min:3732kB low:4664kB high:5596kB active_anon:27680kB inactive_anon:45076kB active_file:33960kB inactive_file:33924kB unevictable:428212kB isolated(anon):0kB isolated(file):784kB present:887976kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:29660kB slab_unreclaimable:69456kB kernel_stack:1072kB pagetables:280kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no

Apr 15 04:55:47 Fileserver kernel: lowmem_reserve[]: 0 0 9179 9179

Apr 15 04:55:47 Fileserver kernel: HighMem free:2132kB min:512kB low:1744kB high:2980kB active_anon:146872kB inactive_anon:52944kB active_file:0kB inactive_file:4kB unevictable:971748kB isolated(anon):0kB isolated(file):0kB present:1174948kB mlocked:0kB dirty:0kB writeback:0kB mapped:13832kB shmem:160kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:1224kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no

Apr 15 04:55:47 Fileserver kernel: lowmem_reserve[]: 0 0 0 0

Apr 15 04:55:47 Fileserver kernel: DMA: 20*4kB 57*8kB 93*16kB 2*32kB 1*64kB 3*128kB 4*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3560kB

Apr 15 04:55:47 Fileserver kernel: Normal: 33102*4kB 162*8kB 14*16kB 10*32kB 1*64kB 2*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 135080kB

Apr 15 04:55:47 Fileserver kernel: HighMem: 507*4kB 7*8kB 1*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2132kB

Apr 15 04:55:47 Fileserver kernel: 367282 total pagecache pages

Apr 15 04:55:47 Fileserver kernel: 0 pages in swap cache

Apr 15 04:55:47 Fileserver kernel: Swap cache stats: add 0, delete 0, find 0/0

Apr 15 04:55:47 Fileserver kernel: Free swap  = 0kB

Apr 15 04:55:47 Fileserver kernel: Total swap = 0kB

Apr 15 04:55:47 Fileserver kernel: 523872 pages RAM

Apr 15 04:55:47 Fileserver kernel: 296050 pages HighMem

Apr 15 04:55:47 Fileserver kernel: 5543 pages reserved

Apr 15 04:55:47 Fileserver kernel: 26978 pages shared

Apr 15 04:55:47 Fileserver kernel: 461895 pages non-shared

Apr 15 04:55:47 Fileserver kernel: Out of memory: kill process 1632 (rpc.portmap) score 218 or a child

Apr 15 04:55:47 Fileserver kernel: Killed process 1632 (rpc.portmap)

Apr 15 06:17:17 Fileserver sshd[23240]: error: Could not get shadow information for root

Apr 15 06:17:17 Fileserver sshd[23240]: Accepted password for root from 10.13.10.100 port 49699 ssh2

Apr 15 06:17:17 Fileserver sshd[23298]: lastlog_filetype: Couldn't stat /var/log/lastlog: No such file or directory

Apr 15 06:17:17 Fileserver sshd[23298]: lastlog_openseek: /var/log/lastlog is not a file or directory!

Apr 15 06:17:17 Fileserver sshd[23298]: lastlog_filetype: Couldn't stat /var/log/lastlog: No such file or directory

Apr 15 06:17:17 Fileserver sshd[23298]: lastlog_openseek: /var/log/lastlog is not a file or directory!

Apr 15 06:17:44 Fileserver sshd[23240]: error: connect_to 127.0.0.1 port 4243: failed.