Lots of errors in syslog, high memory usage, disk spin-ups


Recommended Posts

I installed new disk (WD20EARX) yesterday evening, started new screen session, then preclear script and then went to bed. In the morning I've noticed that all my drives (except parity) were spun up and my syslog was (and still constantly is) littered with these same lines:

Oct 13 08:47:08 Tower kernel: smbd: page allocation failure: order:4, mode:0x4020
Oct 13 08:47:08 Tower kernel: Pid: 21703, comm: smbd Not tainted 3.4.11-unRAID #1
Oct 13 08:47:08 Tower kernel: Call Trace:
Oct 13 08:47:08 Tower kernel:  [] warn_alloc_failed+0xbd/0xcf
Oct 13 08:47:08 Tower kernel:  [] __alloc_pages_nodemask+0x47c/0x4a5
Oct 13 08:47:08 Tower kernel:  [] __get_free_pages+0xf/0x21
Oct 13 08:47:08 Tower kernel:  [] __kmalloc+0x2c/0xf0
Oct 13 08:47:08 Tower kernel:  [] pskb_expand_head+0xc1/0x224
Oct 13 08:47:08 Tower kernel:  [] ? timerqueue_del+0x49/0x56
Oct 13 08:47:08 Tower kernel:  [] __pskb_pull_tail+0x41/0x21e
Oct 13 08:47:08 Tower kernel:  [] ? netif_skb_features+0x84/0x8e
Oct 13 08:47:08 Tower kernel:  [] dev_hard_start_xmit+0x213/0x31b
Oct 13 08:47:08 Tower kernel:  [] sch_direct_xmit+0x54/0x13f
Oct 13 08:47:08 Tower kernel:  [] dev_queue_xmit+0xfe/0x286
Oct 13 08:47:08 Tower kernel:  [] neigh_resolve_output+0x135/0x15b
Oct 13 08:47:08 Tower kernel:  [] ? eth_rebuild_header+0x53/0x53
Oct 13 08:47:08 Tower kernel:  [] ip_finish_output+0x22d/0x258
Oct 13 08:47:08 Tower kernel:  [] ip_output+0x93/0x9a
Oct 13 08:47:08 Tower kernel:  [] ip_local_out+0x1b/0x1e
Oct 13 08:47:08 Tower kernel:  [] ip_queue_xmit+0x2ad/0x2ee
Oct 13 08:47:08 Tower kernel:  [] ? __skb_clone+0x22/0xbf
Oct 13 08:47:08 Tower kernel:  [] tcp_transmit_skb+0x4d3/0x508
Oct 13 08:47:08 Tower kernel:  [] tcp_write_xmit+0x2f2/0x3ec
Oct 13 08:47:08 Tower kernel:  [] __tcp_push_pending_frames+0x18/0x6f
Oct 13 08:47:08 Tower kernel:  [] do_tcp_sendpages+0x463/0x490
Oct 13 08:47:08 Tower kernel:  [] tcp_sendpage+0x51/0x66
Oct 13 08:47:08 Tower kernel:  [] ? do_tcp_sendpages+0x490/0x490
Oct 13 08:47:08 Tower kernel:  [] inet_sendpage+0x82/0x9c
Oct 13 08:47:08 Tower kernel:  [] ? inet_dgram_connect+0x5e/0x5e
Oct 13 08:47:08 Tower kernel:  [] kernel_sendpage+0x1a/0x2d
Oct 13 08:47:08 Tower kernel:  [] sock_sendpage+0x27/0x2c
Oct 13 08:47:08 Tower kernel:  [] pipe_to_sendpage+0x5a/0x6c
Oct 13 08:47:08 Tower kernel:  [] ? kernel_sendpage+0x2d/0x2d
Oct 13 08:47:08 Tower kernel:  [] splice_from_pipe_feed+0x54/0xc4
Oct 13 08:47:08 Tower kernel:  [] ? splice_from_pipe_begin+0x10/0x10
Oct 13 08:47:08 Tower kernel:  [] __splice_from_pipe+0x36/0x55
Oct 13 08:47:08 Tower kernel:  [] ? splice_from_pipe_begin+0x10/0x10
Oct 13 08:47:08 Tower kernel:  [] splice_from_pipe+0x51/0x64
Oct 13 08:47:08 Tower kernel:  [] ? default_file_splice_write+0x2c/0x2c
Oct 13 08:47:08 Tower kernel:  [] generic_splice_sendpage+0x13/0x15
Oct 13 08:47:08 Tower kernel:  [] ? splice_from_pipe_begin+0x10/0x10
Oct 13 08:47:08 Tower kernel:  [] do_splice_from+0x57/0x61
Oct 13 08:47:08 Tower kernel:  [] direct_splice_actor+0x17/0x1c
Oct 13 08:47:08 Tower kernel:  [] splice_direct_to_actor+0xbe/0x16a
Oct 13 08:47:08 Tower kernel:  [] ? do_splice_from+0x61/0x61
Oct 13 08:47:08 Tower kernel:  [] do_splice_direct+0x4b/0x62
Oct 13 08:47:08 Tower kernel:  [] do_sendfile+0x157/0x19f
Oct 13 08:47:08 Tower kernel:  [] sys_sendfile64+0x3c/0x7c
Oct 13 08:47:08 Tower kernel:  [] syscall_call+0x7/0xb
Oct 13 08:47:08 Tower kernel:  [] ? alloc_node_mem_map+0x70/0x8a
Oct 13 08:47:08 Tower kernel: Mem-Info:
Oct 13 08:47:08 Tower kernel: DMA per-cpu:
Oct 13 08:47:08 Tower kernel: CPU    0: hi:    0, btch:   1 usd:   0
Oct 13 08:47:08 Tower kernel: CPU    1: hi:    0, btch:   1 usd:   0
Oct 13 08:47:08 Tower kernel: Normal per-cpu:
Oct 13 08:47:08 Tower kernel: CPU    0: hi:  186, btch:  31 usd:   0
Oct 13 08:47:08 Tower kernel: CPU    1: hi:  186, btch:  31 usd: 162
Oct 13 08:47:08 Tower kernel: HighMem per-cpu:
Oct 13 08:47:08 Tower kernel: CPU    0: hi:  186, btch:  31 usd:  26
Oct 13 08:47:08 Tower kernel: CPU    1: hi:  186, btch:  31 usd:  53
Oct 13 08:47:08 Tower kernel: active_anon:3771 inactive_anon:23 isolated_anon:0
Oct 13 08:47:08 Tower kernel:  active_file:20377 inactive_file:732785 isolated_file:0
Oct 13 08:47:08 Tower kernel:  unevictable:47966 dirty:4342 writeback:18956 unstable:0
Oct 13 08:47:08 Tower kernel:  free:118064 slab_reclaimable:15655 slab_unreclaimable:6352
Oct 13 08:47:08 Tower kernel:  mapped:2063 shmem:40 pagetables:163 bounce:0
Oct 13 08:47:08 Tower kernel: DMA free:3552kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:24kB inactive_file:11960kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15788kB mlocked:0kB dirty:104kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:260kB slab_unreclaimable:92kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Oct 13 08:47:08 Tower kernel: lowmem_reserve[]: 0 867 3731 3731
Oct 13 08:47:08 Tower kernel: Normal free:5196kB min:3732kB low:4664kB high:5596kB active_anon:40kB inactive_anon:0kB active_file:45812kB inactive_file:671092kB unevictable:24kB isolated(anon):0kB isolated(file):0kB present:887960kB mlocked:0kB dirty:17364kB writeback:75824kB mapped:4kB shmem:0kB slab_reclaimable:62360kB slab_unreclaimable:25316kB kernel_stack:752kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Oct 13 08:47:08 Tower kernel: lowmem_reserve[]: 0 0 22913 22913
Oct 13 08:47:08 Tower kernel: HighMem free:463508kB min:512kB low:3592kB high:6676kB active_anon:15044kB inactive_anon:92kB active_file:35672kB inactive_file:2248156kB unevictable:191840kB isolated(anon):0kB isolated(file):0kB present:2932952kB mlocked:0kB dirty:0kB writeback:0kB mapped:8248kB shmem:160kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:652kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Oct 13 08:47:08 Tower kernel: lowmem_reserve[]: 0 0 0 0
Oct 13 08:47:08 Tower kernel: DMA: 24*4kB 16*8kB 10*16kB 9*32kB 9*64kB 2*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3552kB
Oct 13 08:47:08 Tower kernel: Normal: 1227*4kB 20*8kB 2*16kB 1*32kB 1*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 5196kB
Oct 13 08:47:08 Tower kernel: HighMem: 13015*4kB 17161*8kB 10143*16kB 2930*32kB 229*64kB 5*128kB 1*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 463508kB
Oct 13 08:47:08 Tower kernel: 801236 total pagecache pages
Oct 13 08:47:08 Tower kernel: 0 pages in swap cache
Oct 13 08:47:08 Tower kernel: Swap cache stats: add 0, delete 0, find 0/0
Oct 13 08:47:08 Tower kernel: Free swap  = 0kB
Oct 13 08:47:08 Tower kernel: Total swap = 0kB
Oct 13 08:47:08 Tower kernel: 1172976 pages RAM
Oct 13 08:47:08 Tower kernel: 944642 pages HighMem
Oct 13 08:47:08 Tower kernel: 215223 pages reserved
Oct 13 08:47:08 Tower kernel: 470571 pages shared
Oct 13 08:47:08 Tower kernel: 373908 pages non-shared

Full syslog here: http://cl.ly/3N2W2z3g0S0U. Manually spinning down disks helps for few minutes or few hours, but sooner or later this block of log reappears and disks spin up (all except parity). I've tried turning off spin-up groups (because I had problem with strange spin-ups before on 4.7 and that helped), changing chache_dirs settings (because it looks like there's something eating a lot of memory and cache_dirs was all I could think of) and restarting Samba by changing mover settings (because there is something about smbd failure in the first line). That can also be caused by preclear script (latest version 1.13), but it's still few hours until it ends or my screen installation (I've downloaded screen, aaa_terminfo and utempter packages and put them in flash/extra folder).

 

But the funny thing is, not counting spin ups, everything is working fine - streming media from the array works, same as preclear script, WebGUI, I have telnet access, yet there is clearly something wrong going on :-(

 

Please advise.

Link to comment
  • 1 month later...

I had a similar issue..

Then found this thread:

 

http://lime-technology.com/forum/index.php?topic=3999.0

 

First, run this command to see the current "min_free_kbytes" value.

 

cat /proc/sys/vm/min_free_kbytes

 

and go to this page http://dd.qc.ca/people.redhat.com/kernel/min_free_kbytes.html and figure out what it should be..

then run this

 

echo #### > /proc/sys/vm/min_free_kbytes

#### should be the number shown for your memory from the web page above.

For example, if you have 4GB of ram, #### should be 8192

 

I have 16GB of ram. I think my original value was maybe somewhere in 3000, forgot to write it down..

I set min_free_kbytes to 16384. Also added that command line to go file to set that everytime it boots up.

 

After that, I am not getting any kind of page allocation error in my log file..

 

I posted this another thread, but can someone explain what min_free_kbytes is for? and why unraid doe not set it to the default value as shown in that web page?

Link to comment

Did not try without addons as I have never not had them running and I have never seen the errors while pre-clearing before.  i have the latest rc and have installed the latest samba.  I have just put the min freekbytes command in and tested again did not see error do will monitor.  Posted my Error for reference

 

Dec 6 05:27:45 Tower kernel: smbd: page allocation failure: order:5, mode:0x4020

Dec 6 05:27:45 Tower kernel: Pid: 20779, comm: smbd Not tainted 3.4.11-unRAID #1 (Errors)

Dec 6 05:27:45 Tower kernel: Call Trace: (Errors)

Dec 6 05:27:45 Tower kernel: [<c1062eb6>] warn_alloc_failed+0xbd/0xcf (Errors)

Dec 6 05:27:45 Tower kernel: [<c106372e>] __alloc_pages_nodemask+0x47c/0x4a5 (Errors)

Dec 6 05:27:45 Tower kernel: [<c10637ad>] __get_free_pages+0xf/0x21 (Errors)

Dec 6 05:27:45 Tower kernel: [<c10821c8>] __kmalloc+0x2c/0xf0 (Errors)

Dec 6 05:27:45 Tower kernel: [<c11a6f31>] ? timerqueue_del+0x49/0x56 (Errors)

Dec 6 05:27:45 Tower kernel: [<c12a0072>] pskb_expand_head+0xc1/0x224 (Errors)

Dec 6 05:27:45 Tower kernel: [<c12a054b>] __pskb_pull_tail+0x41/0x21e (Errors)

Dec 6 05:27:45 Tower kernel: [<c12a4421>] ? netif_skb_features+0x84/0x8e (Errors)

Dec 6 05:27:45 Tower kernel: [<c12a788f>] dev_hard_start_xmit+0x213/0x31b (Errors)

Dec 6 05:27:45 Tower kernel: [<f84a37b1>] ? e1000_xmit_frame+0x743/0x793 [e1000] (Errors)

Dec 6 05:27:45 Tower kernel: [<c12b6184>] sch_direct_xmit+0x54/0x13f (Errors)

Dec 6 05:27:45 Tower kernel: [<c12a7a95>] dev_queue_xmit+0xfe/0x286 (Errors)

Dec 6 05:27:45 Tower kernel: [<c12c34f7>] ip_finish_output+0x220/0x258 (Errors)

Dec 6 05:27:45 Tower kernel: [<c12c35c2>] ip_output+0x93/0x9a (Errors)

Dec 6 05:27:45 Tower kernel: [<c12c2a5a>] ip_local_out+0x1b/0x1e (Errors)

Dec 6 05:27:45 Tower kernel: [<c12c2f3e>] ip_queue_xmit+0x2ad/0x2ee (Errors)

Dec 6 05:27:45 Tower kernel: [<c129e519>] ? __skb_clone+0x22/0xbf (Errors)

Dec 6 05:27:45 Tower kernel: [<c12d27b6>] tcp_transmit_skb+0x4d3/0x508 (Errors)

Dec 6 05:27:45 Tower kernel: [<c12d4993>] tcp_write_xmit+0x2f2/0x3ec (Errors)

Dec 6 05:27:45 Tower kernel: [<c12d4ab5>] tcp_push_one+0x28/0x2c (Errors)

Dec 6 05:27:45 Tower kernel: [<c12ca110>] do_tcp_sendpages+0x34f/0x490 (Errors)

Dec 6 05:27:45 Tower kernel: [<c12ca2a2>] tcp_sendpage+0x51/0x66 (Errors)

Dec 6 05:27:45 Tower kernel: [<c12ca251>] ? do_tcp_sendpages+0x490/0x490 (Errors)

Dec 6 05:27:45 Tower kernel: [<c12e20eb>] inet_sendpage+0x82/0x9c (Errors)

Dec 6 05:27:45 Tower kernel: [<c12e2069>] ? inet_dgram_connect+0x5e/0x5e (Errors)

Dec 6 05:27:45 Tower kernel: [<c1299586>] kernel_sendpage+0x1a/0x2d (Errors)

Dec 6 05:27:45 Tower kernel: [<c12995c0>] sock_sendpage+0x27/0x2c (Errors)

Dec 6 05:27:45 Tower kernel: [<c109e7ca>] pipe_to_sendpage+0x5a/0x6c (Errors)

Dec 6 05:27:45 Tower kernel: [<c1299599>] ? kernel_sendpage+0x2d/0x2d (Errors)

Dec 6 05:27:45 Tower kernel: [<c109e830>] splice_from_pipe_feed+0x54/0xc4 (Errors)

Dec 6 05:27:45 Tower kernel: [<c109e770>] ? splice_from_pipe_begin+0x10/0x10 (Errors)

Dec 6 05:27:45 Tower kernel: [<c109ee9d>] __splice_from_pipe+0x36/0x55 (Errors)

Dec 6 05:27:45 Tower kernel: [<c109e770>] ? splice_from_pipe_begin+0x10/0x10 (Errors)

Dec 6 05:27:45 Tower kernel: [<c109f004>] splice_from_pipe+0x51/0x64 (Errors)

Dec 6 05:27:45 Tower kernel: [<c109f043>] ? default_file_splice_write+0x2c/0x2c (Errors)

Dec 6 05:27:45 Tower kernel: [<c109f056>] generic_splice_sendpage+0x13/0x15 (Errors)

Dec 6 05:27:45 Tower kernel: [<c109e770>] ? splice_from_pipe_begin+0x10/0x10 (Errors)

Dec 6 05:27:45 Tower kernel: [<c109f198>] do_splice_from+0x57/0x61 (Errors)

Dec 6 05:27:45 Tower kernel: [<c109f1b9>] direct_splice_actor+0x17/0x1c (Errors)

Dec 6 05:27:45 Tower kernel: [<c109f761>] splice_direct_to_actor+0xbe/0x16a (Errors)

Dec 6 05:27:45 Tower kernel: [<c109f1a2>] ? do_splice_from+0x61/0x61 (Errors)

Dec 6 05:27:45 Tower kernel: [<c109f858>] do_splice_direct+0x4b/0x62 (Errors)

Dec 6 05:27:45 Tower kernel: [<c1084cc7>] do_sendfile+0x157/0x19f (Errors)

Dec 6 05:27:45 Tower kernel: [<c1084d4b>] sys_sendfile64+0x3c/0x7c (Errors)

Dec 6 05:27:45 Tower kernel: [<c131fbb5>] syscall_call+0x7/0xb (Errors)

Dec 6 05:27:45 Tower kernel: Mem-Info:

Dec 6 05:27:45 Tower kernel: DMA per-cpu:

Dec 6 05:27:45 Tower kernel: CPU 0: hi: 0, btch: 1 usd: 0

Dec 6 05:27:45 Tower kernel: Normal per-cpu:

Dec 6 05:27:45 Tower kernel: CPU 0: hi: 186, btch: 31 usd: 139

Dec 6 05:27:45 Tower kernel: HighMem per-cpu:

Dec 6 05:27:45 Tower kernel: CPU 0: hi: 186, btch: 31 usd: 185

Dec 6 05:27:45 Tower kernel: active_anon:35210 inactive_anon:27 isolated_anon:0

Dec 6 05:27:45 Tower kernel: active_file:55321 inactive_file:716981 isolated_file:0

Dec 6 05:27:45 Tower kernel: unevictable:124380 dirty:0 writeback:0 unstable:0

Dec 6 05:27:45 Tower kernel: free:4121 slab_reclaimable:7702 slab_unreclaimable:3535

Dec 6 05:27:45 Tower kernel: mapped:6109 shmem:44 pagetables:450 bounce:0

Dec 6 05:27:45 Tower kernel: DMA free:3556kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:232kB inactive_file:10656kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15764kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:1424kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no

Dec 6 05:27:45 Tower kernel: lowmem_reserve[]: 0 869 3787 3787

Dec 6 05:27:45 Tower kernel: Normal free:5720kB min:3736kB low:4668kB high:5604kB active_anon:2304kB inactive_anon:0kB active_file:48372kB inactive_file:665696kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:890008kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:29384kB slab_unreclaimable:14132kB kernel_stack:1520kB pagetables:116kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:16 all_unreclaimable? no

Dec 6 05:27:45 Tower kernel: lowmem_reserve[]: 0 0 23349 23349

Dec 6 05:27:45 Tower kernel: HighMem free:7208kB min:512kB low:3648kB high:6784kB active_anon:138536kB inactive_anon:108kB active_file:172680kB inactive_file:2191572kB unevictable:497520kB isolated(anon):0kB isolated(file):0kB present:2988708kB mlocked:0kB dirty:0kB writeback:0kB mapped:24432kB shmem:176kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:1684kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:5 all_unreclaimable? no

Dec 6 05:27:45 Tower kernel: lowmem_reserve[]: 0 0 0 0

Dec 6 05:27:45 Tower kernel: DMA: 3*4kB 1*8kB 1*16kB 6*32kB 6*64kB 3*128kB 2*256kB 2*512kB 1*1024kB 0*2048kB 0*4096kB = 3556kB

Dec 6 05:27:45 Tower kernel: Normal: 30*4kB 12*8kB 10*16kB 99*32kB 32*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 5720kB

Dec 6 05:27:45 Tower kernel: HighMem: 150*4kB 48*8kB 7*16kB 91*32kB 2*64kB 0*128kB 0*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 7208kB

Dec 6 05:27:45 Tower kernel: 896742 total pagecache pages

Dec 6 05:27:45 Tower kernel: 0 pages in swap cache

Dec 6 05:27:45 Tower kernel: Swap cache stats: add 0, delete 0, find 0/0

Dec 6 05:27:45 Tower kernel: Free swap = 0kB

Dec 6 05:27:45 Tower kernel: Total swap = 0kB

Dec 6 05:27:45 Tower kernel: 1179632 pages RAM

Dec 6 05:27:45 Tower kernel: 951298 pages HighMem

Dec 6 05:27:45 Tower kernel: 207474 pages reserved

Dec 6 05:27:45 Tower kernel: 185658 pages shared

Dec 6 05:27:45 Tower kernel: 791713 pages non-shared

Link to comment

Nope came back as soon as I started transfering a file to my windows machine via smb.  2 Preclears still going.  If I stop the preclears no errors at all no matter what I transfer.  If I read the free command correclty I have affectivly 2.8Gb of ram cached that can be allocated as required so why the out of ram errors??  This time looks both an smb error as well as a unraid error.

 

root@Tower:/# free -l

            total      used      free    shared    buffers    cached

Mem:      3888632    3846724      41908          0    711940    2842224

Low:        870192    854104      16088

High:      3018440    2992620      25820

-/+ buffers/cache:    292560    3596072

Swap:            0          0          0

 

Dec 6 09:29:48 Tower kernel: smbd: page allocation failure: order:5, mode:0x4020

Dec 6 09:29:48 Tower kernel: Pid: 9720, comm: smbd Not tainted 3.4.11-unRAID #1 (Errors)

Dec 6 09:29:48 Tower kernel: Call Trace: (Errors)

Dec 6 09:29:48 Tower kernel: [<c1062eb6>] warn_alloc_failed+0xbd/0xcf (Errors)

Dec 6 09:29:48 Tower kernel: [<c106372e>] __alloc_pages_nodemask+0x47c/0x4a5 (Errors)

Dec 6 09:29:48 Tower kernel: [<c10637ad>] __get_free_pages+0xf/0x21 (Errors)

Dec 6 09:29:48 Tower kernel: [<c10821c8>] __kmalloc+0x2c/0xf0 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a0072>] pskb_expand_head+0xc1/0x224 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a054b>] __pskb_pull_tail+0x41/0x21e (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a4421>] ? netif_skb_features+0x84/0x8e (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a788f>] dev_hard_start_xmit+0x213/0x31b (Errors)

Dec 6 09:29:48 Tower kernel: [<f84a37b1>] ? e1000_xmit_frame+0x743/0x793 [e1000] (Errors)

Dec 6 09:29:48 Tower kernel: [<c12b6184>] sch_direct_xmit+0x54/0x13f (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a7a95>] dev_queue_xmit+0xfe/0x286 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12c34f7>] ip_finish_output+0x220/0x258 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12c35c2>] ip_output+0x93/0x9a (Errors)

Dec 6 09:29:48 Tower kernel: [<c12c2a5a>] ip_local_out+0x1b/0x1e (Errors)

Dec 6 09:29:48 Tower kernel: [<c12c2f3e>] ip_queue_xmit+0x2ad/0x2ee (Errors)

Dec 6 09:29:48 Tower kernel: [<c129e519>] ? __skb_clone+0x22/0xbf (Errors)

Dec 6 09:29:48 Tower kernel: [<c12d27b6>] tcp_transmit_skb+0x4d3/0x508 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12d4993>] tcp_write_xmit+0x2f2/0x3ec (Errors)

Dec 6 09:29:48 Tower kernel: [<c12d4ab5>] tcp_push_one+0x28/0x2c (Errors)

Dec 6 09:29:48 Tower kernel: [<c12ca110>] do_tcp_sendpages+0x34f/0x490 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12ca2a2>] tcp_sendpage+0x51/0x66 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12ca251>] ? do_tcp_sendpages+0x490/0x490 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12e20eb>] inet_sendpage+0x82/0x9c (Errors)

Dec 6 09:29:48 Tower kernel: [<c12e2069>] ? inet_dgram_connect+0x5e/0x5e (Errors)

Dec 6 09:29:48 Tower kernel: [<c1299586>] kernel_sendpage+0x1a/0x2d (Errors)

Dec 6 09:29:48 Tower kernel: [<c12995c0>] sock_sendpage+0x27/0x2c (Errors)

Dec 6 09:29:48 Tower kernel: [<c109e7ca>] pipe_to_sendpage+0x5a/0x6c (Errors)

Dec 6 09:29:48 Tower kernel: [<c1299599>] ? kernel_sendpage+0x2d/0x2d (Errors)

Dec 6 09:29:48 Tower kernel: [<c109e830>] splice_from_pipe_feed+0x54/0xc4 (Errors)

Dec 6 09:29:48 Tower kernel: [<c109e770>] ? splice_from_pipe_begin+0x10/0x10 (Errors)

Dec 6 09:29:48 Tower kernel: [<c109ee9d>] __splice_from_pipe+0x36/0x55 (Errors)

Dec 6 09:29:48 Tower kernel: [<c109e770>] ? splice_from_pipe_begin+0x10/0x10 (Errors)

Dec 6 09:29:48 Tower kernel: [<c109f004>] splice_from_pipe+0x51/0x64 (Errors)

Dec 6 09:29:48 Tower kernel: [<c109f043>] ? default_file_splice_write+0x2c/0x2c (Errors)

Dec 6 09:29:48 Tower kernel: [<c109f056>] generic_splice_sendpage+0x13/0x15 (Errors)

Dec 6 09:29:48 Tower kernel: [<c109e770>] ? splice_from_pipe_begin+0x10/0x10 (Errors)

Dec 6 09:29:48 Tower kernel: [<c109f198>] do_splice_from+0x57/0x61 (Errors)

Dec 6 09:29:48 Tower kernel: [<c109f1b9>] direct_splice_actor+0x17/0x1c (Errors)

Dec 6 09:29:48 Tower kernel: [<c109f761>] splice_direct_to_actor+0xbe/0x16a (Errors)

Dec 6 09:29:48 Tower kernel: [<c109f1a2>] ? do_splice_from+0x61/0x61 (Errors)

Dec 6 09:29:48 Tower kernel: [<c109f858>] do_splice_direct+0x4b/0x62 (Errors)

Dec 6 09:29:48 Tower kernel: [<c1084cc7>] do_sendfile+0x157/0x19f (Errors)

Dec 6 09:29:48 Tower kernel: [<c1084d4b>] sys_sendfile64+0x3c/0x7c (Errors)

Dec 6 09:29:48 Tower kernel: [<c131fbb5>] syscall_call+0x7/0xb (Errors)

Dec 6 09:29:48 Tower kernel: Mem-Info:

Dec 6 09:29:48 Tower kernel: DMA per-cpu:

Dec 6 09:29:48 Tower kernel: CPU 0: hi: 0, btch: 1 usd: 0

Dec 6 09:29:48 Tower kernel: Normal per-cpu:

Dec 6 09:29:48 Tower kernel: CPU 0: hi: 186, btch: 31 usd: 27

Dec 6 09:29:48 Tower kernel: HighMem per-cpu:

Dec 6 09:29:48 Tower kernel: CPU 0: hi: 186, btch: 31 usd: 44

Dec 6 09:29:48 Tower kernel: active_anon:34522 inactive_anon:27 isolated_anon:0

Dec 6 09:29:48 Tower kernel: active_file:107807 inactive_file:518650 isolated_file:32

Dec 6 09:29:48 Tower kernel: unevictable:124465 dirty:10786 writeback:11521 unstable:0

Dec 6 09:29:48 Tower kernel: free:146271 slab_reclaimable:11599 slab_unreclaimable:4032

Dec 6 09:29:48 Tower kernel: mapped:6210 shmem:44 pagetables:485 bounce:0

Dec 6 09:29:48 Tower kernel: DMA free:3616kB min:140kB low:172kB high:208kB active_anon:0kB inactive_anon:0kB active_file:280kB inactive_file:10708kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15764kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:1264kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no

Dec 6 09:29:48 Tower kernel: lowmem_reserve[]: 0 869 3787 3787

Dec 6 09:29:48 Tower kernel: Normal free:60124kB min:8048kB low:10060kB high:12072kB active_anon:36kB inactive_anon:0kB active_file:50476kB inactive_file:593848kB unevictable:0kB isolated(anon):0kB isolated(file):128kB present:890008kB mlocked:0kB dirty:43144kB writeback:46084kB mapped:4kB shmem:0kB slab_reclaimable:45132kB slab_unreclaimable:16120kB kernel_stack:1624kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no

Dec 6 09:29:48 Tower kernel: lowmem_reserve[]: 0 0 23349 23349

Dec 6 09:29:48 Tower kernel: HighMem free:521344kB min:512kB low:7268kB high:14024kB active_anon:138052kB inactive_anon:108kB active_file:380472kB inactive_file:1470044kB unevictable:497860kB isolated(anon):0kB isolated(file):0kB present:2988708kB mlocked:0kB dirty:0kB writeback:0kB mapped:24836kB shmem:176kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:1940kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no

Dec 6 09:29:48 Tower kernel: lowmem_reserve[]: 0 0 0 0

Dec 6 09:29:48 Tower kernel: DMA: 10*4kB 17*8kB 7*16kB 4*32kB 6*64kB 4*128kB 1*256kB 2*512kB 1*1024kB 0*2048kB 0*4096kB = 3616kB

Dec 6 09:29:48 Tower kernel: Normal: 6651*4kB 2788*8kB 693*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 60124kB

Dec 6 09:29:48 Tower kernel: HighMem: 7714*4kB 6315*8kB 4164*16kB 3291*32kB 2128*64kB 860*128kB 73*256kB 2*512kB 0*1024kB 1*2048kB 0*4096kB = 521344kB

Dec 6 09:29:48 Tower kernel: 750982 total pagecache pages

Dec 6 09:29:48 Tower kernel: 0 pages in swap cache

Dec 6 09:29:48 Tower kernel: Swap cache stats: add 0, delete 0, find 0/0

Dec 6 09:29:48 Tower kernel: Free swap = 0kB

Dec 6 09:29:48 Tower kernel: Total swap = 0kB

Dec 6 09:29:48 Tower kernel: 1179632 pages RAM

Dec 6 09:29:48 Tower kernel: 951298 pages HighMem

Dec 6 09:29:48 Tower kernel: 207474 pages reserved

Dec 6 09:29:48 Tower kernel: 439515 pages shared

Dec 6 09:29:48 Tower kernel: 397462 pages non-shared

Dec 6 09:29:48 Tower kernel: unraidd: page allocation failure: order:3, mode:0x4020

Dec 6 09:29:48 Tower kernel: Pid: 9790, comm: unraidd Not tainted 3.4.11-unRAID #1 (Errors)

Dec 6 09:29:48 Tower kernel: Call Trace: (Errors)

Dec 6 09:29:48 Tower kernel: [<c1062eb6>] warn_alloc_failed+0xbd/0xcf (Errors)

Dec 6 09:29:48 Tower kernel: [<c106372e>] __alloc_pages_nodemask+0x47c/0x4a5 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a0072>] ? pskb_expand_head+0xc1/0x224 (Errors)

Dec 6 09:29:48 Tower kernel: [<c10637ad>] __get_free_pages+0xf/0x21 (Errors)

Dec 6 09:29:48 Tower kernel: [<c10821c8>] __kmalloc+0x2c/0xf0 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a0072>] pskb_expand_head+0xc1/0x224 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a054b>] __pskb_pull_tail+0x41/0x21e (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a4421>] ? netif_skb_features+0x84/0x8e (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a788f>] dev_hard_start_xmit+0x213/0x31b (Errors)

Dec 6 09:29:48 Tower kernel: [<c12b6184>] sch_direct_xmit+0x54/0x13f (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a7a95>] dev_queue_xmit+0xfe/0x286 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12c34f7>] ip_finish_output+0x220/0x258 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12c35c2>] ip_output+0x93/0x9a (Errors)

Dec 6 09:29:48 Tower kernel: [<c12c2a5a>] ip_local_out+0x1b/0x1e (Errors)

Dec 6 09:29:48 Tower kernel: [<c12c2f3e>] ip_queue_xmit+0x2ad/0x2ee (Errors)

Dec 6 09:29:48 Tower kernel: [<c129e519>] ? __skb_clone+0x22/0xbf (Errors)

Dec 6 09:29:48 Tower kernel: [<c12d27b6>] tcp_transmit_skb+0x4d3/0x508 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12d4993>] tcp_write_xmit+0x2f2/0x3ec (Errors)

Dec 6 09:29:48 Tower kernel: [<c12d4ad1>] __tcp_push_pending_frames+0x18/0x6f (Errors)

Dec 6 09:29:48 Tower kernel: [<c12d1888>] tcp_rcv_established+0x501/0x575 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12d6978>] tcp_v4_do_rcv+0x47/0x13a (Errors)

Dec 6 09:29:48 Tower kernel: [<c12d6e4e>] tcp_v4_rcv+0x3e3/0x665 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12bf240>] ip_local_deliver_finish+0xba/0x192 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12bf379>] ip_local_deliver+0x61/0x66 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12bef01>] ip_rcv_finish+0x23d/0x253 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12bf150>] ip_rcv+0x239/0x26f (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a5189>] __netif_receive_skb+0x223/0x259 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a6767>] netif_receive_skb+0x66/0x6c (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a682b>] napi_skb_finish+0x1e/0x34 (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a6c98>] napi_gro_receive+0xe7/0xef (Errors)

Dec 6 09:29:48 Tower kernel: [<f84a0c39>] e1000_receive_skb+0x46/0x4c [e1000] (Errors)

Dec 6 09:29:48 Tower kernel: [<f84a13ae>] e1000_clean_rx_irq+0x2b7/0x357 [e1000] (Errors)

Dec 6 09:29:48 Tower kernel: [<f84a4061>] e1000_clean+0x3c/0x198 [e1000] (Errors)

Dec 6 09:29:48 Tower kernel: [<c12a6d6e>] net_rx_action+0x59/0x12c (Errors)

Dec 6 09:29:48 Tower kernel: [<c1027056>] __do_softirq+0x6b/0xe5 (Errors)

Dec 6 09:29:48 Tower kernel: [<c1026feb>] ? irq_enter+0x41/0x41 (Errors)

Dec 6 09:29:48 Tower kernel: <IRQ> [<c1026e9f>] ? irq_exit+0x32/0x58

Dec 6 09:29:48 Tower kernel: [<c1003506>] ? do_IRQ+0x7c/0x90 (Errors)

Dec 6 09:29:48 Tower kernel: [<c13208e9>] ? common_interrupt+0x29/0x30 (Errors)

Dec 6 09:29:48 Tower kernel: [<f8b4c611>] ? copy_data+0xbd/0xf3 [md_mod] (Errors)

Dec 6 09:29:48 Tower kernel: [<f8b4cf9a>] ? handle_stripe+0x562/0xcfb [md_mod] (Errors)

Dec 6 09:29:48 Tower kernel: [<f8b4d7aa>] ? unraidd+0x77/0xb8 [md_mod] (Errors)

Dec 6 09:29:48 Tower kernel: [<f8b4a925>] ? md_thread+0xcc/0xe3 [md_mod] (Errors)

Dec 6 09:29:48 Tower kernel: [<c1035eac>] ? wake_up_bit+0x5b/0x5b (Errors)

Dec 6 09:29:48 Tower kernel: [<f8b4a859>] ? import_device+0x147/0x147 [md_mod] (Errors)

Dec 6 09:29:48 Tower kernel: [<c1035bb4>] ? kthread+0x67/0x6c (Errors)

Dec 6 09:29:48 Tower kernel: [<c1035b4d>] ? kthread_freezable_should_stop+0x49/0x49 (Errors)

Dec 6 09:29:48 Tower kernel: [<c13208f6>] ? kernel_thread_helper+0x6/0xd (Errors)

Dec 6 09:29:48 Tower kernel: Mem-Info:

Dec 6 09:29:48 Tower kernel: DMA per-cpu:

Dec 6 09:29:48 Tower kernel: CPU 0: hi: 0, btch: 1 usd: 0

Dec 6 09:29:48 Tower kernel: Normal per-cpu:

Dec 6 09:29:48 Tower kernel: CPU 0: hi: 186, btch: 31 usd: 19

Dec 6 09:29:48 Tower kernel: HighMem per-cpu:

Dec 6 09:29:48 Tower kernel: CPU 0: hi: 186, btch: 31 usd: 44

Dec 6 09:29:48 Tower kernel: active_anon:34561 inactive_anon:27 isolated_anon:0

Dec 6 09:29:48 Tower kernel: active_file:107807 inactive_file:512380 isolated_file:32

Dec 6 09:29:48 Tower kernel: unevictable:124465 dirty:13763 writeback:8193 unstable:0

Dec 6 09:29:48 Tower kernel: free:152416 slab_reclaimable:11590 slab_unreclaimable:4040

Dec 6 09:29:48 Tower kernel: mapped:6191 shmem:44 pagetables:523 bounce:0

Dec 6 09:29:48 Tower kernel: DMA free:3552kB min:140kB low:172kB high:208kB active_anon:0kB inactive_anon:0kB active_file:280kB inactive_file:10708kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15764kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:1264kB slab_unreclaimable:40kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no

Dec 6 09:29:48 Tower kernel: lowmem_reserve[]: 0 869 3787 3787

Dec 6 09:29:48 Tower kernel: Normal free:86008kB min:8048kB low:10060kB high:12072kB active_anon:36kB inactive_anon:0kB active_file:50476kB inactive_file:567884kB unevictable:0kB isolated(anon):0kB isolated(file):128kB present:890008kB mlocked:0kB dirty:55052kB writeback:32772kB mapped:4kB shmem:0kB slab_reclaimable:45096kB slab_unreclaimable:16120kB kernel_stack:1696kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no

Dec 6 09:29:48 Tower kernel: lowmem_reserve[]: 0 0 23349 23349

Dec 6 09:29:48 Tower kernel: HighMem free:520104kB min:512kB low:7268kB high:14024kB active_anon:138208kB inactive_anon:108kB active_file:380472kB inactive_file:1470928kB unevictable:497860kB isolated(anon):0kB isolated(file):0kB present:2988708kB mlocked:0kB dirty:0kB writeback:0kB mapped:24760kB shmem:176kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:2092kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no

Dec 6 09:29:48 Tower kernel: lowmem_reserve[]: 0 0 0 0

Dec 6 09:29:48 Tower kernel: DMA: 10*4kB 17*8kB 7*16kB 4*32kB 7*64kB 3*128kB 1*256kB 2*512kB 1*1024kB 0*2048kB 0*4096kB = 3552kB

Dec 6 09:29:48 Tower kernel: Normal: 10244*4kB 4097*8kB 758*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 86008kB

Dec 6 09:29:48 Tower kernel: HighMem: 7434*4kB 6310*8kB 4161*16kB 3290*32kB 2128*64kB 860*128kB 73*256kB 2*512kB 0*1024kB 1*2048kB 0*4096kB = 520104kB

Dec 6 09:29:48 Tower kernel: 744723 total pagecache pages

Dec 6 09:29:48 Tower kernel: 0 pages in swap cache

Dec 6 09:29:48 Tower kernel: Swap cache stats: add 0, delete 0, find 0/0

Dec 6 09:29:48 Tower kernel: Free swap = 0kB

Dec 6 09:29:48 Tower kernel: Total swap = 0kB

Dec 6 09:29:48 Tower kernel: 1179632 pages RAM

Dec 6 09:29:48 Tower kernel: 951298 pages HighMem

Dec 6 09:29:48 Tower kernel: 207474 pages reserved

Dec 6 09:29:48 Tower kernel: 433880 pages shared

Dec 6 09:29:48 Tower kernel: 397715 pages non-shared

 

Link to comment

Actually, many people recommend setting min_free_kbytes value to 65536.

 

http://www.acc.umu.se/~maswan/linux-netperf.txt

http://russ.garrett.co.uk/2009/01/01/linux-kernel-tuning/

http://askubuntu.com/questions/41778/computer-freezing-on-almost-full-ram-possibly-disk-cache-problem

 

 

I'd try that and see if that changes anything..

 

I say this because I did too get this error whenever I have an activity through smb (read/write) while running pre_clear in screen

Link to comment

My pre-clears just finished so I tested that the new line in my go file worked which it did from a reboot.  I have a no correct parity check running as I am about to replace my 3tb parity with a 4tb parity.  After parity has been built on this new parity drive I will be adding a new 4tb drive into the array then running a preclear on the old 3tb parity drive, during this preclear run I will couple of check that I get no more errors by reading a writing some blu-ray iso files during preclear and see what transpires.  Thank you muchly for the info.

Link to comment

I can confirm after the modification above I have run a preclear while I read 100Gb from the array and wrote 25gb to the array and not a single error.  4tb drive is now parity with another 4tb drive as data drive in the array.  old 3tb parity is currenlty preclearing although it must be missreporting as it is currenlty doing the zero writes and is reporting

 

316911968256 bytes (317 GB) copied, 1624.12 s, 195 MB/s

 

Will see how it goes.

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.