Server crashes with repeated "get_swap_device: Bad swap file entry 3ffffffffffff"

[dudly0]

I've searched other Unraid forums and saw two similar items, but none of the topics covered described my specific scenario or fixed the issues I'm seeing.

 

I'm trying to debug an issue with my Unraid server where it won't stay online and active for longer than 5-10 minutes without hitting the error that constantly repeats over and over on the plugged in monitor (See attached screenshot), "get_swap_device: Bad swap file entry 3ffffffffffff." When it happens, I can no longer login to the Unraid web GUI, I cannot reach the SMB shares, and I cannot do literally anything on the terminal (I've pressed CTRL+C & other various key combinations, to no avail). The message is spamming the screen very rapidly and I'm unable to use the keyboard for anything once it shows up.

Here's what I've done so far to diagnose the best I can:

1. I replaced the USB device as it wasn't happy when I plugged it in to my Windows machine. Doesn't seem to have made much of a stability difference other than my ability to now see the error message in the terminal window described above.
2. I've started the array in safe mode with no plugins enabled, waited overnight for the parity process to run, but the server was frozen by morning. If I had to guess it was about 8 hours in before it froze and was unresponsive. **Note** This was done with the old USB device
3. I've updated the Unraid OS from version 6.12.3 to 6.12.4. Still seeing the freeze. **Note** This was using the new USB device
4. The only other thing of note that I saw prior to the freeze was in the Dashboard menu, I saw under the System widget the LOG was taking up 100% of the system.
5. I also haven't downloaded/installed anything new for at least 5 or so months, just randomly appeared today so I highly doubt I have a new application that's causing the mess. I saw in other forums the Network Statistics app causing issues, but I don't have that installed.
6. I am also unable to run memtest+ prior to Unraid booting. Every time I use the keyboard to select that option (both on old USB device and new USB device) the server reboots to the main screen and starts the boot process over again. Not sure what to make of this yet, but I don't believe it's related yet.

 

Any help in other diagnostic attempts is greatly appreciated.

[JorgeB]

Enable the syslog server and post that after a crash together with the diagnostics, diags can be after rebooting.

[itimpi]

Do you have the swap file plugin installed?     Just asking as by default Unraid does not use a swapfile.  

 

43 minutes ago, dudly0 said:

I am also unable to run memtest+ prior to Unraid booting. Every time I use the keyboard to select that option (both on old USB device and new USB device) the server reboots to the main screen and starts the boot process over again. Not sure what to make of this yet, but I don't believe it's related yet.

 

This is normal if you boot in UEFI mode.     You need to either boot in legacy mode to get the Unraid supplied version to run, or download a version from memtest86.com that can boot in UEFI mode.

[dudly0]

Thanks JorgeB and itimpi,

 

I've enabled the syslog server to write to USB and will post when it crashes again with the logs.

 

I do not have the swap file plugin installed either. I do however boot using UEFI mode so I will likely need to run in legacy mode or download a version from memtest86.com if we need to go that route (I'm still not convinced it's RAM related just yet).

[itimpi]

10 minutes ago, dudly0 said:

so I will likely need to run in legacy mode or download a version from memtest86.com if we need to go that route

I would get the memtest86.com version anyway.     It is a much more recent version so probably does any test better.    It unfortunately is not included as standard with Unraid for Licencing reasons.

[dudly0]

Attached is my syslog file for debugging. I've also attached the diagnostics following the crash and reboot.

syslog anonymized-threadripper-diagnostics-20230922-1346.zip

[JorgeB]

Btrfs is detecting data corruption and there are several apps segfaulting, start by running memtest.

[dudly0]

Thanks JorgeB,

 

I was able to download the latest memtest86 as itimpi recommended. I ran it and wouldn't you know that it failed miserably with 10,000+ errors.

 

I had some spare RAM lying around and replaced what was installed in the server. Things are back up and running smoothly.

 

Thank you for your help!