Help Diagnosing Random Reboots

[rotting-argument3785]

Recently, my server has been restarting overnight for no apparent reason, and showing unclean shutdown. I ran the syslog and unable to interpret the information to see what triggered the shutdown. How can I tell what is the triggering event? From the log I can see that my windows backup is failing for what ever reason and then the system just reboots. Any thoughts, not sure if the clock issue or unraid not being up to date would cause this.

 

Oct 31 03:08:24 Megatron  smbd[24964]: [2023/10/31 03:08:24.555958,  0] ../../source3/smbd/files.c:1199(synthetic_pathref)
Oct 31 03:08:24 Megatron  smbd[24964]:   synthetic_pathref: opening [WindowsImageBackup/DESKTOP-KHL8AAF/Backup 2023-10-31 070004/9bc65493-3d8d-4963-800d-fc70754de4ba.vhdx.mrt] failed
Oct 31 03:23:39 Megatron  smbd[32460]: [2023/10/31 03:23:39.449572,  0] ../../source3/smbd/files.c:1199(synthetic_pathref)
Oct 31 03:23:39 Megatron  smbd[32460]:   synthetic_pathref: opening [WindowsImageBackup/DESKTOP-KHL8AAF/Backup 2023-10-31 070004/Esp.vhdx.mrt] failed
Oct 31 04:40:02 Megatron root: Fix Common Problems Version 2023.10.08a
Oct 31 04:40:02 Megatron root: Fix Common Problems: Warning: Unraid OS not up to date
Oct 31 05:15:36 Megatron  ntpd[1524]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized
Oct 31 05:15:36 Megatron  rsyslogd: action 'action-2-builtin:omfwd' resumed (module 'builtin:omfwd') [v8.2102.0 try https://www.rsyslog.com/e/2359 ]
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sdm
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sdj
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sdk
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sdh
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sdg
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sdd
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sde
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sdb
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sdc
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sdn
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sdq
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sdo
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sdl
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sdi
Oct 31 05:40:31 Megatron  emhttpd: spinning down /dev/sdp

[JorgeB]

If the server is rebooting on its own, instead of crashing or hanging, it's almost always a hardware issue, and those usually don't leave anything logged.

[rotting-argument3785]

Just did some more digging, fix common problems just found this - any idea why this would happen all of a sudden? Its been working without issue for almost a whole year now.

 

Oct 31 09:08:35 Megatron root: Fix Common Problems Version 2023.10.08a
Oct 31 09:08:37 Megatron root: Fix Common Problems: Error: Machine Check Events detected on your server
Oct 31 09:08:37 Megatron root: mcelog: ERROR: AMD Processor family 25: mcelog does not support this processor.  Please use the edac_mce_amd module instead.
Oct 31 09:08:37 Megatron root: CPU is unsupported

[JorgeB]

Any hardware can go bad at any time, start by running memtest.

[rotting-argument3785]

memtest returned no errors, but system wouldn't boot due to CPU temp for some reason. Disabled that in bios and boots, fine and idle's around 47. Ordered a beefier Noctua to see if that helps with the temps also wondering if that is was caused the random reboots.

[itimpi]

3 hours ago, rotting-argument3785 said:

also wondering if that is was caused the random reboots.

A CPU overheating would definitely cause random crashes as the system shuts itself down due to thermal overload to protect the CPU.

[rotting-argument3785]

So had a few consecutive days of no reboots and then two days straight with 3 reboots total. Looks like one of my m.2 cache drives kicked the bucket and no longer working. Time to RMA hopefully that was the culprit.