About once a month my server just goes completely offline and the only fix is an unclean reboot

[s449]

This started happening maybe 3 months ago. Possibly since the 6.9 upgrade. I'll notice Plex is offline. Then I try to log into my server's UI and any docker containers inside and outside the network and none of them load. If I try to SSH into my server it says the host is down. No errors or warnings on my push notification app. My server is never doing any tasks or anything to cause it, it seems to be just idling.

The only fix I've found is I log into the IPMI interface and reboot my server. Everything is always fine when I reboot but because it's an unclean shutdown it starts a parity check which is a little annoying.

I downloaded my diagnostics right after reboot. Can anyone see what the problem could be?

apollo-diagnostics-20210509-0752.zip

[JorgeB]

Enable this then post that log after a crash.

[s449]

7 hours ago, JorgeB said:

Enable this then post that log after a crash.

Sounds good! I enabled syslog:

 

 

I'll post again next time it happens. Thanks for the help!

[s449]

On 5/10/2021 at 1:26 AM, JorgeB said:

Enable this then post that log after a crash.

 

Hello! Looks like it happened again. A lot sooner than usual. Attached are the logs with syslog server enabled.

 

Thanks!!

 

apollo-diagnostics-20210515-2151.zip

[JorgeB]

3 hours ago, s449 said:

Attached are the logs with syslog server enabled.

You need to post the other syslog, the one from the syslog server.

[s449]

4 minutes ago, JorgeB said:

You need to post the other syslog, the one from the syslog server.

Oh oops sorry! Attached that.

syslog-127.0.0.1.log

[JorgeB]

Log server is not working correctly, check configuration.

[s449]

On 5/16/2021 at 2:21 AM, JorgeB said:

Log server is not working correctly, check configuration.

 

The configuration is the one I posted above: 

 

Is there anything I should change?

 

Thanks!

[JorgeB]

I never used it, compare with the configuration in the link.

[John_M]

2 hours ago, s449 said:

Is there anything I should change?

 

Enabling the Mirror to Flash option is the easiest way to get it to work. The other options are for exporting the llocal log to an external server or for receiving logs from other servers.

[s449]

37 minutes ago, John_M said:

 

Enabling the Mirror to Flash option is the easiest way to get it to work. The other options are for exporting the llocal log to an external server or for receiving logs from other servers.

Thank you for the response! I enabled mirror to flash. So I assume once this happens again, I can grab the log file from the flash and post it here.

[John_M]

Just now, s449 said:

So I assume once this happens again, I can grab the log file from the flash and post it here.

 

Yes, exactly.