• Logspam = 100% full /var/log, things stop working in WebUI


    NeoMatrixJR
    • Closed

    Getting a lot of this spammed to my logs:
     

    Apr 13 15:08:44 THECONSTRUCT nginx: 2020/04/13 15:08:44 [crit] 27570#27570: ngx_slab_alloc() failed: no memory
    Apr 13 15:08:44 THECONSTRUCT nginx: 2020/04/13 15:08:44 [error] 27570#27570: shpool alloc failed
    Apr 13 15:08:44 THECONSTRUCT nginx: 2020/04/13 15:08:44 [error] 27570#27570: nchan: Out of shared memory while allocating channel /cpuload. Increase nchan_max_reserved_memory.
    Apr 13 15:08:44 THECONSTRUCT nginx: 2020/04/13 15:08:44 [error] 27570#27570: *1454591 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/cpuload?buffer_length=1 HTTP/1.1", host: "localhost"
    Apr 13 15:08:45 THECONSTRUCT nginx: 2020/04/13 15:08:45 [crit] 27570#27570: ngx_slab_alloc() failed: no memory
    Apr 13 15:08:45 THECONSTRUCT nginx: 2020/04/13 15:08:45 [error] 27570#27570: shpool alloc failed
    Apr 13 15:08:45 THECONSTRUCT nginx: 2020/04/13 15:08:45 [error] 27570#27570: nchan: Out of shared memory while allocating channel /dockerload. Increase nchan_max_reserved_memory.
    Apr 13 15:08:45 THECONSTRUCT nginx: 2020/04/13 15:08:45 [error] 27570#27570: *1454592 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/dockerload?buffer_length=0 HTTP/1.1", host: "localhost"
    Apr 13 15:08:45 THECONSTRUCT nginx: 2020/04/13 15:08:45 [crit] 27570#27570: ngx_slab_alloc() failed: no memory
    Apr 13 15:08:45 THECONSTRUCT nginx: 2020/04/13 15:08:45 [error] 27570#27570: shpool alloc failed
    Apr 13 15:08:45 THECONSTRUCT nginx: 2020/04/13 15:08:45 [error] 27570#27570: nchan: Out of shared memory while allocating channel /cpuload. Increase nchan_max_reserved_memory.
    Apr 13 15:08:45 THECONSTRUCT nginx: 2020/04/13 15:08:45 [error] 27570#27570: *1454593 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/cpuload?buffer_length=1 HTTP/1.1", host: "localhost"
    Apr 13 15:08:46 THECONSTRUCT nginx: 2020/04/13 15:08:46 [crit] 27570#27570: ngx_slab_alloc() failed: no memory
    Apr 13 15:08:46 THECONSTRUCT nginx: 2020/04/13 15:08:46 [error] 27570#27570: shpool alloc failed
    Apr 13 15:08:46 THECONSTRUCT nginx: 2020/04/13 15:08:46 [error] 27570#27570: nchan: Out of shared memory while allocating channel /disks. Increase nchan_max_reserved_memory.
    Apr 13 15:08:46 THECONSTRUCT nginx: 2020/04/13 15:08:46 [error] 27570#27570: *1454594 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/disks?buffer_length=1 HTTP/1.1", host: "localhost"
    Apr 13 15:08:46 THECONSTRUCT nginx: 2020/04/13 15:08:46 [crit] 27570#27570: ngx_slab_alloc() failed: no memory
    Apr 13 15:08:46 THECONSTRUCT nginx: 2020/04/13 15:08:46 [error] 27570#27570: shpool alloc failed
    Apr 13 15:08:46 THECONSTRUCT nginx: 2020/04/13 15:08:46 [error] 27570#27570: nchan: Out of shared memory while allocating channel /shares. Increase nchan_max_reserved_memory.
    Apr 13 15:08:46 THECONSTRUCT nginx: 2020/04/13 15:08:46 [error] 27570#27570: *1454595 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/shares?buffer_length=1 HTTP/1.1", host: "localhost"
    Apr 13 15:08:46 THECONSTRUCT nginx: 2020/04/13 15:08:46 [crit] 27570#27570: ngx_slab_alloc() failed: no memory
    Apr 13 15:08:46 THECONSTRUCT nginx: 2020/04/13 15:08:46 [error] 27570#27570: shpool alloc failed
    Apr 13 15:08:46 THECONSTRUCT nginx: 2020/04/13 15:08:46 [error] 27570#27570: nchan: Out of shared memory while allocating channel /cpuload. Increase nchan_max_reserved_memory.
    Apr 13 15:08:46 THECONSTRUCT nginx: 2020/04/13 15:08:46 [error] 27570#27570: *1454596 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/cpuload?buffer_length=1 HTTP/1.1", host: "localhost"
    Apr 13 15:08:47 THECONSTRUCT nginx: 2020/04/13 15:08:47 [crit] 27570#27570: ngx_slab_alloc() failed: no memory
    Apr 13 15:08:47 THECONSTRUCT nginx: 2020/04/13 15:08:47 [error] 27570#27570: shpool alloc failed
    Apr 13 15:08:47 THECONSTRUCT nginx: 2020/04/13 15:08:47 [error] 27570#27570: nchan: Out of shared memory while allocating channel /cpuload. Increase nchan_max_reserved_memory.
    Apr 13 15:08:47 THECONSTRUCT nginx: 2020/04/13 15:08:47 [error] 27570#27570: *1454597 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/cpuload?buffer_length=1 HTTP/1.1", host: "localhost"
    Apr 13 15:08:47 THECONSTRUCT nginx: 2020/04/13 15:08:47 [crit] 27570#27570: ngx_slab_alloc() failed: no memory
    Apr 13 15:08:47 THECONSTRUCT nginx: 2020/04/13 15:08:47 [error] 27570#27570: shpool alloc failed
    Apr 13 15:08:47 THECONSTRUCT nginx: 2020/04/13 15:08:47 [error] 27570#27570: nchan: Out of shared memory while allocating channel /dockerload. Increase nchan_max_reserved_memory.
    Apr 13 15:08:47 THECONSTRUCT nginx: 2020/04/13 15:08:47 [error] 27570#27570: *1454598 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/dockerload?buffer_length=0 HTTP/1.1", host: "localhost"
    Apr 13 15:08:48 THECONSTRUCT nginx: 2020/04/13 15:08:48 [crit] 27570#27570: ngx_slab_alloc() failed: no memory
    Apr 13 15:08:48 THECONSTRUCT nginx: 2020/04/13 15:08:48 [error] 27570#27570: shpool alloc failed
    Apr 13 15:08:48 THECONSTRUCT nginx: 2020/04/13 15:08:48 [error] 27570#27570: nchan: Out of shared memory while allocating channel /disks. Increase nchan_max_reserved_memory.
    Apr 13 15:08:48 THECONSTRUCT nginx: 2020/04/13 15:08:48 [error] 27570#27570: *1454599 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/disks?buffer_length=1 HTTP/1.1", host: "localhost"
    Apr 13 15:08:48 THECONSTRUCT nginx: 2020/04/13 15:08:48 [crit] 27570#27570: ngx_slab_alloc() failed: no memory
    Apr 13 15:08:48 THECONSTRUCT nginx: 2020/04/13 15:08:48 [error] 27570#27570: shpool alloc failed
    Apr 13 15:08:48 THECONSTRUCT nginx: 2020/04/13 15:08:48 [error] 27570#27570: nchan: Out of shared memory while allocating channel /cpuload. Increase nchan_max_reserved_memory.
    Apr 13 15:08:48 THECONSTRUCT nginx: 2020/04/13 15:08:48 [error] 27570#27570: *1454600 nchan: error publishing message (HTTP status code 507), client: unix:, server: , request: "POST /pub/cpuload?buffer_length=1 HTTP/1.1", host: "localhost"

    Eventually this leads to /var/log being 100% full.  After that, webUI slows to a crawl or becomes unusable in some areas until I delete syslog.1. 

    This can be slowed by doing:

    /etc/rc.d/rc.nginx restart
    /etc/rc.d/rc.nginx reload

    but eventually it kicks off the logspam again.  Not sure what's causing it.

    I'm trying to gather diagnostics at this time but it's either failing or taking WAAAY to long.  Will post if I'm able to get them downloaded.  Otherwise, ask for specific files and I'll grab them.




    User Feedback

    Recommended Comments



    Join the conversation

    You can post now and register later. If you have an account, sign in now to post with your account.
    Note: Your post will require moderator approval before it will be visible.

    Guest
    Add a comment...

    ×   Pasted as rich text.   Restore formatting

      Only 75 emoji are allowed.

    ×   Your link has been automatically embedded.   Display as a link instead

    ×   Your previous content has been restored.   Clear editor

    ×   You cannot paste images directly. Upload or insert images from URL.


  • Status Definitions

     

    Open = Under consideration.

     

    Solved = The issue has been resolved.

     

    Solved version = The issue has been resolved in the indicated release version.

     

    Closed = Feedback or opinion better posted on our forum for discussion. Also for reports we cannot reproduce or need more information. In this case just add a comment and we will review it again.

     

    Retest = Please retest in latest release.


    Priority Definitions

     

    Minor = Something not working correctly.

     

    Urgent = Server crash, data loss, or other showstopper.

     

    Annoyance = Doesn't affect functionality but should be fixed.

     

    Other = Announcement or other non-issue.