During the last two weeks or so, my unRAID server has started to shut down all shares due to shfs using too much memory.
Here is a snippet from an earlier log where shfs ended up using so much memory that it was shut down:
QuoteMar 20 23:42:20 nas kernel: Out of memory: Kill process 4305 (shfs) score 482 or sacrifice child
Mar 20 23:42:20 nas rsyslogd: file '/var/log/syslog'[4] write error - see https://www.rsyslog.com/solving-rsyslog-write-errors/ for help OS error: No space left on device [v8.1908.0 try https://www.rsyslog.com/e/2027 ]
Mar 20 23:42:20 nas kernel: Killed process 4305 (shfs) total-vm:38210132kB, anon-rss:31803700kB, file-rss:4kB, shmem-rss:1132kB
My quickest way of reproducing it so far has been to turn on my minio docker container and run backups to it from other machines. That way shfs builds its memory usage with several gigabytes in a matter of minutes.
I've uninstalled all plugins but Unassigned Devices, which I need for my VM's, in an attempt to see if that was the cause.
The attached diagnostics is from today, after I uninstalled all plugins, and limited the amount of running VMs and docker containers. It hasn't crashed yet in this log but it is only a matter of time, seeing as shfs was using 20 GB of memory and growing.
By disabling most of my docker containers and turning off some VMs, I am able to run the system for a few days before the shares are cut off, but I really hope to find a fix rather quickly.
Recommended Comments
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.