nginx running out of shared memory


Recommended Posts

Hi there, I'm running 6.8.

 

I noticed all the live updating to the Dashboard webpage stopped working (no disk utilization bars updating, stuff like that) and under the Memory section the log bar was red+full. Here's are the types of messages in the logs:

 

Quote

Dec 12 12:31:09 Truesource nginx: 2019/12/12 12:31:09 [error] 25449#25449: nchan: Out of shared memory while allocating channel /cpuload. Increase nchan_max_reserved_memory.
Dec 12 12:31:09 Truesource nginx: 2019/12/12 12:31:09 [error] 25449#25449: *330240 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/cpuload?buffer_length=1 HTTP/1.1", host: "localhost"
Dec 12 12:31:10 Truesource nginx: 2019/12/12 12:31:10 [crit] 25449#25449: ngx_slab_alloc() failed: no memory
Dec 12 12:31:10 Truesource nginx: 2019/12/12 12:31:10 [error] 25449#25449: shpool alloc failed
Dec 12 12:31:10 Truesource nginx: 2019/12/12 12:31:10 [error] 25449#25449: nchan: Out of shared memory while allocating channel /disks. Increase nchan_max_reserved_memory.
Dec 12 12:31:10 Truesource nginx: 2019/12/12 12:31:10 [error] 25449#25449: *330244 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/disks?buffer_length=1 HTTP/1.1", host: "localhost"
Dec 12 12:31:10 Truesource nginx: 2019/12/12 12:31:10 [crit] 25449#25449: ngx_slab_alloc() failed: no memory
Dec 12 12:31:10 Truesource nginx: 2019/12/12 12:31:10 [error] 25449#25449: shpool alloc failed

I did a few searches and found sometimes the wrong web browser can cause this. I'm using Brave  Version 1.1.20 Chromium: 79.0.3945.74 (Official Build) (64-bit). I tried completely rebooting the client machine to see if the errors cleaned up. I'm going to leave the browser down overnight and see if any sort of self-healing occurs.

 

I'm attempting to use the gui to generate a diagnostics zip. It's been running for about 5 hours. If I can't get it to complete, what's the most useful information I can hand pull from the command line? Syslogs have seized up at size 70MB of error messages similar to the above with a final message that only partially got written to disk. Haven't had anything new in syslog since 12:31 am this morning. I can hand-execute the diagnostics steps and post something, just let me know if what may be useful. In the meantime, I've attached a snapshot of the memory section on the Dashboard.

 

Thank you for any help you can offer.

Annotation 2019-12-13 063345.png

Link to comment
  • 4 weeks later...
  • 3 weeks later...
  • 6 months later...

Anything come out of this ?  I have the max red bar on memory for the log and just keep getting this in the log ...

 

Aug 24 10:28:38 Vishnu nginx: 2020/08/24 10:28:38 [crit] 22944#22944: ngx_slab_alloc() failed: no memory
Aug 24 10:28:38 Vishnu nginx: 2020/08/24 10:28:38 [error] 22944#22944: shpool alloc failed
Aug 24 10:28:38 Vishnu nginx: 2020/08/24 10:28:38 [error] 22944#22944: nchan: Out of shared memory while allocating channel /dockerload. Increase nchan_max_reserved_memory.
Aug 24 10:28:38 Vishnu nginx: 2020/08/24 10:28:38 [error] 22944#22944: *444191 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/dockerload?buffer_length=0 HTTP/1.1", host: "localhost"

Link to comment
  • 2 weeks later...
  • 2 months later...

Same problem here. 

 

System log is suddenly full of these messages: 

Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [alert] 7525#7525: worker process 21758 exited on signal 11
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [crit] 21883#21883: ngx_slab_alloc() failed: no memory
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [error] 21883#21883: shpool alloc failed
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [error] 21883#21883: nchan: Out of shared memory while allocating channel /var. Increase nchan_max_reserved_memory.
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [alert] 21883#21883: *483824 header already sent while keepalive, client: 192.168.2.165, server: 0.0.0.0:80
Nov 29 10:05:45 Monsterservern kernel: nginx[21883]: segfault at 0 ip 0000000000000000 sp 00007fff9d8f5f58 error 14 in nginx[400000+22000]
Nov 29 10:05:45 Monsterservern kernel: Code: Bad RIP value.
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [alert] 7525#7525: worker process 21883 exited on signal 11
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [crit] 21884#21884: ngx_slab_alloc() failed: no memory
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [error] 21884#21884: shpool alloc failed
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [error] 21884#21884: nchan: Out of shared memory while allocating channel /disks. Increase nchan_max_reserved_memory.
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [error] 21884#21884: *483826 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/disks?buffer_length=1 HTTP/1.1", host: "localhost"
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [crit] 21884#21884: ngx_slab_alloc() failed: no memory
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [error] 21884#21884: shpool alloc failed
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [error] 21884#21884: nchan: Out of shared memory while allocating channel /cpuload. Increase nchan_max_reserved_memory.
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [error] 21884#21884: *483827 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/cpuload?buffer_length=1 HTTP/1.1", host: "localhost"
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [crit] 21884#21884: ngx_slab_alloc() failed: no memory
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [error] 21884#21884: shpool alloc failed
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [error] 21884#21884: nchan: Out of shared memory while allocating channel /dockerload. Increase nchan_max_reserved_memory.
Nov 29 10:05:45 Monsterservern nginx: 2020/11/29 10:05:45 [alert] 21884#21884: *483828 header already sent while keepalive, client: 192.168.2.165, server: 0.0.0.0:80
Nov 29 10:05:45 Monsterservern kernel: nginx[21884]: segfault at 0 ip 0000000000000000 sp 00007fff9d8f5f58 error 14 in nginx[400000+22000]

On the dashboard the memory for the log is 100% full. 

monsterservern-diagnostics-20201129-1235.zip

Link to comment
  • 3 weeks later...

I was just having an issue with what I thought was my USB stick, and after a long day of re-establishing my Unraid server on a new USB stick, I still seem to have issues. A little bit more digging and come to find out, I have a log at 100% and it is getting blasted with:

ngx_slab_alloc() failed: no memory
Dec 21 04:36:50 Kioshi nginx: 2020/12/21 04:36:50 [error] 12904#12904: shpool alloc failed
Dec 21 04:36:50 Kioshi nginx: 2020/12/21 04:36:50 [error] 12904#12904: nchan: Out of shared memory while allocating channel /disks. Increase nchan_max_reserved_memory.
Dec 21 04:36:50 Kioshi nginx: 2020/12/21 04:36:50 [error] 12904#12904: *3142714 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/disks?buffer_length=1 HTTP/1.1", host: "localhost"
Dec 21 04:36:50 Kioshi nginx: 2020/12/21 04:36:50 [crit] 12904#12904: ngx_slab_alloc() failed: no memory
Dec 21 04:36:50 Kioshi nginx: 2020/12/21 04:36:50 [error] 12904#12904: shpool alloc failed
Dec 21 04:36:50 Kioshi nginx: 2020/12/21 04:36:50 [error] 12904#12904: nchan: Out of shared memory while allocating channel /cpuload. Increase nchan_max_reserved_memory.
Dec 21 04:36:50 Kioshi nginx: 2020/12/21 04:36:50 [error] 12904#12904: *3142715 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/cpuload?buffer_length=1 HTTP/1.1", host: "localhost"

So you are telling us to update to an RC version of Unraid and this issue will magically go away? Why did this just randomly start happening? I have been on 6.8.3 since it was released and just now I am having these issues? Something isn't adding up. Can you please explain further?

Link to comment
  • 4 weeks later...

I'm having this problem too!

Jan 21 10:41:37 unraid nginx: 2021/01/21 10:41:37 [alert] 13333#13333: worker process 13334 exited on signal 6

repeats about 400,000 times between 1041 and 1331, and then just numerous numerous repeats of 

Jan 21 13:31:19 unraid nginx: 2021/01/21 13:31:19 [crit] 32524#32524: ngx_slab_alloc() failed: no memory
Jan 21 13:31:19 unraid nginx: 2021/01/21 13:31:19 [error] 32524#32524: shpool alloc failed
Jan 21 13:31:19 unraid nginx: 2021/01/21 13:31:19 [error] 32524#32524: nchan: Out of shared memory while allocating channel /var. Increase nchan_max_reserved_memory.
Jan 21 13:31:19 unraid nginx: 2021/01/21 13:31:19 [alert] 32524#32524: *9212036 header already sent while keepalive, client: 192.168.2.156, server: 0.0.0.0:80
Jan 21 13:31:19 unraid kernel: nginx[32524]: segfault at 0 ip 0000000000000000 sp 00007fff47105b28 error 14 in nginx[400000+21000]
Jan 21 13:31:19 unraid kernel: Code: Bad RIP value.
Jan 21 13:31:19 unraid nginx: 2021/01/21 13:31:19 [alert] 13333#13333: worker process 32524 exited on signal 11
Jan 21 13:31:19 unraid nginx: 2021/01/21 13:31:19 [crit] 32527#32527: ngx_slab_alloc() failed: no memory
Jan 21 13:31:19 unraid nginx: 2021/01/21 13:31:19 [error] 32527#32527: shpool alloc failed
Jan 21 13:31:19 unraid nginx: 2021/01/21 13:31:19 [error] 32527#32527: nchan: Out of shared memory while allocating channel /disks. Increase nchan_max_reserved_memory.
Jan 21 13:31:19 unraid nginx: 2021/01/21 13:31:19 [error] 32527#32527: *9212037 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/disks?buffer_length=1 HTTP/1.1", host: "localhost"
Jan 21 13:31:19 unraid nginx: 2021/01/21 13:31:19 [crit] 32527#32527: ngx_slab_alloc() failed: no memory
Jan 21 13:31:19 unraid nginx: 2021/01/21 13:31:19 [error] 32527#32527: shpool alloc failed
Jan 21 13:31:19 unraid nginx: 2021/01/21 13:31:19 [error] 32527#32527: nchan: Out of shared memory while allocating channel /shares. Increase nchan_max_reserved_memory.
Jan 21 13:31:19 unraid nginx: 2021/01/21 13:31:19 [error] 32527#32527: *9212038 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/shares?buffer_length=1 HTTP/1.1", host: "localhost"
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [crit] 32527#32527: ngx_slab_alloc() failed: no memory
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [error] 32527#32527: shpool alloc failed
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [error] 32527#32527: nchan: Out of shared memory while allocating channel /cpuload. Increase nchan_max_reserved_memory.
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [error] 32527#32527: *9212039 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/cpuload?buffer_length=1 HTTP/1.1", host: "localhost"
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [crit] 32527#32527: ngx_slab_alloc() failed: no memory
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [error] 32527#32527: shpool alloc failed
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [error] 32527#32527: nchan: Out of shared memory while allocating channel /cpuload. Increase nchan_max_reserved_memory.
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [alert] 32527#32527: *9212040 header already sent while keepalive, client: 192.168.2.156, server: 0.0.0.0:80
Jan 21 13:31:20 unraid kernel: nginx[32527]: segfault at 0 ip 0000000000000000 sp 00007fff47105b28 error 14 in nginx[400000+21000]
Jan 21 13:31:20 unraid kernel: Code: Bad RIP value.
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [alert] 13333#13333: worker process 32527 exited on signal 11
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [crit] 32534#32534: ngx_slab_alloc() failed: no memory
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [error] 32534#32534: shpool alloc failed
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [error] 32534#32534: nchan: Out of shared memory while allocating channel /var. Increase nchan_max_reserved_memory.
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [alert] 32534#32534: *9212041 header already sent while keepalive, client: 192.168.2.100, server: 0.0.0.0:80
Jan 21 13:31:20 unraid kernel: nginx[32534]: segfault at 0 ip 0000000000000000 sp 00007fff47105b28 error 14 in nginx[400000+21000]
Jan 21 13:31:20 unraid kernel: Code: Bad RIP value.
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [alert] 13333#13333: worker process 32534 exited on signal 11
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [crit] 32535#32535: ngx_slab_alloc() failed: no memory
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [error] 32535#32535: shpool alloc failed
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [error] 32535#32535: nchan: Out of shared memory while allocating channel /cpuload. Increase nchan_max_reserved_memory.
Jan 21 13:31:20 unraid nginx: 2021/01/21 13:31:20 [alert] 32535#32535: *9212042 header already sent while keepalive, client: 192.168.2.100, server: 0.0.0.0:80
Jan 21 13:31:20 unraid kernel: nginx[32535]: segfault at 0 ip 0000000000000000 sp 00007fff47105b28 error 14 in nginx[400000+21000]
Jan 21 13:31:20 unraid kernel: Code: Bad RIP value.

continuing until my logs file is full.

Link to comment
  • 1 month later...

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.