Skip to content
View in the app

A better way to browse. Learn more.

Unraid

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.

Very high cpu by shfs, whats going on? (Diagnostics included)

Featured Replies

I'm hoping someone can help me out. I've recently noticed shfs taking a ton of CPU. In my searches, I found reference to a caching plugin that can cause this issue, but I don't have that plugin installed. What else could I look at?

 

truffle-diagnostics-20211228-0903.zip

Edited by flyize

  • flyize changed the title to Very high cpu by shfs, whats going on? (Diagnostics included)
  • Author

Attaching another diag from today, in hopes that someone can shed some light on this. Whatever is going on is crushing the server.

truffle-diagnostics-20211229-1313.zip

im battling this myself, dug through a bunch of old threads and still no answers. I'm not using the folder cache plugin people have talked about in the past.

  • Author

I saw your post in the other thread. Hopefully someone will have an idea. I've got a 20 core Xeon CPU that's getting absolutely crushed at times.

  • Author

While probably not the best answer, I'm going to try 6.10 RC2. This is driving me crazy.

Have you checked how much CPU usage was IOWAIT? If that's the majority of it, then your solution is faster disks or interface, because IOWAIT is the CPU waiting for disks, not actual work being done. It's included in the usage because that portion of the CPU can't work on anything else while it's waiting.

  • Author

I did some quick Googles and came up blank. How do I see IOWAIT?

top command in the console. wa number on the cpu line

way too high

Screenshot 2021-12-30 215914.png

9 hours ago, sage2050 said:

way too high

Show the cpu detail line, also, 70% is meaningless without core count, as it's only 70% of one core, so the total cpu % could be minuscule if this was on a threadripper or other high core count CPU.

  • Author

Here's what I see. Unraid was reporting ~75% utilization when I snapped this screenshot.

 

image.png.1335b26c0f701dead13a38293b63d637.png

The % is nothing as it's only a core and a half on a 20 core system.

 

On your diagnostics originally posted, 

 

It looks like your currently running a parity check

Dec 27 11:20:27 Truffle emhttpd: unclean shutdown detected

65% CPU usage

 

A home assistant VM 200% usage

 

SHFS is taking 126%

Ubuntu VM 47%

NZBGet is currently unpacking something 54%

Plex is running @54%

A trim is currently in operation 21% **********

And you have a tab sitting on the docker page in advanced view - 12%

 

Tautulli, Sonarr, Ombi etc are also all taking ~20% each

 

So, there's nothing out of the ordinary at all in terms of CPU usage.  But, as noted this is IOWAIT

 

Now, you're running a trim operation on the filesystem every hour.  This is extreme.  You only need to run it say weekly and only during times when nothing else is going on.  While a trim is in operation the system will massively compete for IO time to the SSD's, and when trim has the CPU cycles, nothing else is allowed at all to utilize the IO to any device

 

There average time it is taking to do the trims across all the supported filesystems / devices is ~4 minutes.  But, with the perfect storm you've got at the moment its been running for 13 minutes on just the first device it finds (since nothing has been logged yet), so responsiveness is horrendous

 

As an aside, the best way in my opinion to look at IO wait is via the NetData container as you'll be able to see it graphed nicely over time

 

Set your trim frequency to be something sane.

  • Author

Oh wow. Thank you!

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

Account

Navigation

Search

Search

Configure browser push notifications

Chrome (Android)
  1. Tap the lock icon next to the address bar.
  2. Tap Permissions → Notifications.
  3. Adjust your preference.
Chrome (Desktop)
  1. Click the padlock icon in the address bar.
  2. Select Site settings.
  3. Find Notifications and adjust your preference.