It seems like my webgui has gotten slower, and the last few days it takes well over 10 seconds to load pages.  Not sure what's going on here and the only real thing I could find to check was the Avahi user missing, but I don't believe mine is.

 

Posted diag below.

Any help is appreciated.

skynet-diagnostics-20171212-1204.zip

@Squidcan confirm but pretty sure this going on for many hours is not normal:

 

Dec 11 23:55:25 SkyNet root: ransomware protection:Waiting For deletion of bait files to complete
Dec 11 23:55:55 SkyNet root: ransomware protection:Waiting For deletion of bait files to complete
Dec 11 23:56:25 SkyNet root: ransomware protection:Waiting For deletion of bait files to complete
...
...
Dec 12 04:19:26 SkyNet root: ransomware protection:Waiting For deletion of bait files to complete
Dec 12 04:19:56 SkyNet root: ransomware protection:Waiting For deletion of bait files to complete
Dec 12 04:20:26 SkyNet root: ransomware protection:Waiting For deletion of bait files to complete
...
...
Dec 12 12:02:29 SkyNet root: ransomware protection:Waiting For deletion of bait files to complete
Dec 12 12:02:59 SkyNet root: ransomware protection:Waiting For deletion of bait files to complete
Dec 12 12:03:29 SkyNet root: ransomware protection:Waiting For deletion of bait files to complete

 

4 minutes ago, johnnie.black said:

@Squidcan confirm but pretty sure this going on for many hours is not normal:

Yea I saw that right after I posted that and immediately wondered about it, but not sure how to fix that to be honest.  I've been rebooting the server a bit over the lat couple days, so I'm not sure that had any affect, though I may try it again now.

 

Edit:  Not now actually, parity running.

Edited December 12, 20178 yr by lordbob75

You can try booting in safe mode.

Just now, johnnie.black said:

You can try booting in safe mode.

OK, I will give that a shot if I can't get it to delete them normally.

Rebooting to safe mode then back to regular seemed to free up the webgui and make it more responsive, but I'm not seeing the bait files get deleted.  Not sure if the plugin is taking a while to do it or if it's not able to.  The log has stopped adding the line on waiting to delete them, but it also implies it's done deleting them.

All plugins will be disable in safe mode, that's why it's a good way to test if the issue is plugin related.

Yeah, @ 15:34 it started up right and then crashed and exited for some reason.

Dec 10 15:34:14 SkyNet root: ransomware protection:Deleting previously set ransomware bait files

 

On all subsequent stops and starts of the array the background process to delete never restarted, but the main process still thought it was running hence the logging every 30 seconds

 

Switching Recreate Bait Files on startup to NO and then rebooting should fix stop all of the nonsense.

 

Best guess as to what's going on (without actually sitting in front of the machine) is

• Flash drive corruption (notably /boot/config/plugins/ransomware.protection/filelist)
• Or a segfault / general protection error that caused the crash which would be a pain to find

  2 minutes ago, lordbob75 said:

  Rebooting to safe mode

  Safe mode disables plugins.

2 minutes ago, Squid said:

Yeah, @ 15:34 it started up right and then crashed and exited for some reason.

 

Dec 10 15:34:14 SkyNet root: ransomware protection:Deleting previously set ransomware bait files

 

 

On all subsequent stops and starts of the array the background process to delete never restarted, but the main process still thought it was running hence the logging every 30 seconds

 

Switching Recreate Bait Files on startup to NO and then rebooting should fix stop all of the nonsense.

 

Best guess as to what's going on (without actually sitting in front of the machine) is

• Flash drive corruption (notably /boot/config/plugins/ransomware.protection/filelist)
• Or a segfault / general protection error that caused the crash which would be a pain to find

  Safe mode disables plugins.

Thanks for chiming in.  I have switched it to use existing files, but it hasn't seemed to make a difference after rebooting (though it seems to stop the service and speed up the gui).  How do I get rid of the old files?  Should I just search for all of them and delete them manually?

Disable the service and delete them manually.  

 

BTW, if you choose, you can't uninstall the plugin via the "normal" way in the state that its in (whatever is causing the problem), as it will automatically delete any and all bait files and put you in the same boat.  You'd have to delete /boot/config/plugins/newransomwarebait.plg then reboot then manually delete again.

1 hour ago, Squid said:

Disable the service and delete them manually.  

 

BTW, if you choose, you can't uninstall the plugin via the "normal" way in the state that its in (whatever is causing the problem), as it will automatically delete any and all bait files and put you in the same boat.  You'd have to delete /boot/config/plugins/newransomwarebait.plg then reboot then manually delete again.

Looks like I was successfully able to disable the service, delete the files, then remove the plugin.

 

Will probably re-install it later today.  I take it I should NOT have it re-create the bait files at every startup?

Well the GUI is better than before but it's still heavily hanging when I do app installs and when loading folder lists, stuff like that.

Definitely not overusing it here, so not sure why it's still laggy.

To be more specific, when I install an app from community applications, the page just loads and goes unresponsive until the container is successfully installed.

Nothing loads on the page besides the top gui menu, and chrome will throw unresponsive errors after a few minutes.

 

Definitely something else going on here since I've removed the ransomeware plugin but it's still happening.

Edited December 13, 20178 yr by lordbob75

Wow, so it was the IPMI sensor plugin that was doing it...  Will report this on his thread since I like the plugin but that lag is just insufferable.

 

Edit: 

 

Edited December 13, 20178 yr by lordbob75

Last update, removing the ipmi plugin resolved some of the issues, but I continued to get lag while installing apps and things like that.

 

This morning I awoke to my server cache in read only mode, and after dealing with that I was lead to believe the issue was actually my 1st (and oldest) cache drive.  I ended up pulling it out and rebuilt the cache with my 2 newer, larger drives and the issues disappeared.  I believe my old cache drive was failing or something but SMART did not appear to be working correctly so it reported as normal.  Either way it was a paltry 60G, so I removed it and the webgui is back to being nice and snappy.

 

Thanks for all the assistance with the path that lead to this, would have had to deal with it eventually.

@johnnie.black I was able to get most of this resolved, however the UI still hangs when installing apps (and some pages still take longer than expected to load).  I've tried removing some of the stuff I recently added but had no luck with it.  Still haven't reinstalled the ransomware plugin but everything else appears to be working normally at this point.

 

Attached diag below.

skynet-diagnostics-20171215-2315.zip

Edited December 16, 20178 yr by lordbob75

You can try redoing your flashdrive.

1 minute ago, johnnie.black said:

You can try redoing your flashdrive.

OK, I guess I could give it a shot.  Not having much luck finding a guide on how to do it though.  Do I need to pickup a new flash drive and copy the old one to it?  Or plug it into my pc, back it up, rebuild it like a new one, then copy certain things back over to it?

Backup current flash

Format and reinstall a new download of unRAID

Restore only super.dat and you key from the old flash, both are on the config folder

Start the array and start re-installing your plugins, dockers, etc, do it one a at time and keep checking the performance.

1 minute ago, johnnie.black said:

Backup current flash

Format and reinstall a new download of unRAID

Restore only super.dat and you key from the old flash, both are on the config folder

Start the array and start re-installing your plugins, dockers, etc, do it one a at time and keep checking the performance.

Excellent, thanks.  (worth adding to wiki?)

Will give this a shot in the morning and hopefully resolve this.

 

Is there a way to test flash drive performance or something to find out if the flash is bad?

When the flash is bad you usually see the errors on the syslog.

10 hours ago, johnnie.black said:

When the flash is bad you usually see the errors on the syslog.

Checked this and didn't really see any errors.

 

I also stopped the array and noticed that the slowness persisted, so I'm very tempted to say it's definitely the flash.

 

I've rebuilt the flash drive this morning and the GUI is a lot snappier.  Will pay attention as I get everything re-installed but hopefully it's resolved.

Aha, looks like it's the preclear plugin, not what I expected at all.