Hi there.

In the last week I've seen a couple of scenarios where my server became slow, I've saw I'm having higher IO waits each time. Mostly related to docker. First I was thinking on the influxdb one, then the issue was when I've started the ARK server docker.. on saturday was with PLEX...

Today I've got some time and decided to look in detail.

I had my docker image on the array and the app data share as a Cache prefered one. Found some similar issues here and decided to move the docker file and the /mnt/user/appdata to /mnt/cache as well.

Re-configured the docker engine to use this location, started the containers and voilá... super light speed on all of them and almost zero IO wait!!

15 minutes later, decided to log-in into the Minecraft server and then start to see a bit of IO... then a bit more.. and then... boom, system almost unusable! (see netdata screenshot). I was running an iotop on a terminal and started to see 99% IO process there, some shs, some java (from the minecraft server I guess), etc.

Managed to extract the diagnostic zip and then gad to stop all containers.

 

I see it's something related to the dockers, something related to the cache or mech drives.. but can't find the specific detail yet.

 

Also, maybe not directly relatedas it was 1 month ago and the IO issue I'm dealing with is from 2-3 days ago, but changed from the internal SATA controller on my ASUS Motherboard to a LSI 9210-8i as I was having increasing udma crc error count in the past months. With this one, I didn't receive new crc errors.

 

Although not new at all to Linux systems, still don't get used to dockers, so any help and advices are highly appreciated!!

 

Tks!

 

mtrunraid-diagnostics-20210315-1915.zip

Hi guys.

Any feedback?

I've tried to diagnose the issue to a specific Docker, stopping and starting them with specific load. Although could not do it 100%, the culprit candidates are changing roles every once.

Also, removed the docker image, create a new one and re-created the dockers using the user template. Thought it was working but I got same behavior once started Minecraft and then later, even with just NetData one.

I'm not sure if FS type on new drives could be... but is a long process to change them, so appreciate your support to focus the troubleshooting a bit more.

 

Thanks!