Unraid not starting: "Kernel panic - not syncing : stack-protector : Kernel stack is corrupted"

[Loggy]

Hi team,

 

I've run into an issue resulting in my Unraid server not being able to start up. 

The process seems to end with the message:

"---[ end Kernel panic - not syncing : stack-protector : Kernel stack is corrupted in : gen_codes+0x94/0xa7 ]---"

 

This started happening after an ungraceful shutdown and now I cant seem to get back into the OS.

 

I have tried starting Unraid in safe mode.

I have tried rebuilding the USB key and manually restoring the config file.

I have tried changing to a new USB key and copying over the license file.

 

I need some more ideas, as I'm not experienced enough to know how to troubleshoot this!

If there is any information / logs I can gather, I'm just not sure how to go about that without access to the OS.

 

As it stands the server is offline with no way to get back on.

 

Thanks in advance!

 

 

[Loggy]

Further troubleshooting based on researching the error messages, all with the same result:

• Tried another new USB flash disk with a fresh install of Unraid (no config at all from existing system). 
• Tried removing 1 stick of memory.
• Tried removing GPU.
• Tried removing HBA card.
• Tried removing all SATA drives.

Image of the error I'm getting is attached.

[EDACerton]

Have you tried running a memtest? I would start there if you can’t even get a freshly imaged flash drive to boot. 

[Loggy]

6 hours ago, EDACerton said:

Have you tried running a memtest? I would start there if you can’t even get a freshly imaged flash drive to boot. 

 

Thanks for the suggestion.  

I have just finished running memtest86 with no errors.

 

Any suggestions on what I should test next?

[JorgeB]

If a new flash drive with a stock Unraid install doesn't work it suggests some hardware issue.

[Loggy]

47 minutes ago, JorgeB said:

If a new flash drive with a stock Unraid install doesn't work it suggests some hardware issue.

 

Hmmmm.... Considering I tried booting it with simply the motherboard, RAM & CPU installed I guess that points at motherboard or CPU, considering the memory test results.  I'll have to look into how to best troubleshoot from here!  Unfortunately I don't have another CPU that's compatible that I could swap in.

[Loggy]

In terms of closing out this support thread, I can now update with resolution.  Again, thank you all for the assistance with troubleshooting.

 

I ended up going through a motherboard RMA, with it being replaced like for like despite no fault with the board being found.  However this did not resolve the issue.

 

I then went through a CPU RMA on the i7-13700k, with it being found faulty.  Once replaced, everything was back up and running fine!

 

Very glad to have my Unraid machine back...as it took close to 6 months to resolve! CPU was the culprit...no idea how it became faulty after 6 months of solid operation...But fingers crossed I don't experience something like that again! 😀