February 22, 20206 yr I've run into an issue lately where I'm having somewhat frequent random halts of my server. It's headless so I can't really see the screen output, but I'd imagine there must be some sort of a dump or something available? It's still on and running, but the system stops responding to network communication or anything. I'm attaching the latest diagnostics after restarting the system in hopes there might be something. Any information on how I could best diagnose this? atlantis-diagnostics-20200222-1250.zip
February 23, 20206 yr Author Hmm, that's a nice touch. I'll try that out with a local log. I am guessing something will give me a hint if it happens again. If not, then I'll have to look at remote logging it. Thanks for the tip, hopefully I can isolate this bugger.
March 1, 20206 yr Author Ok, so I finally got a change to dig through the logs after it happened again recently while I was away. I believe I've got a pinpoint of the time though, and I grabbed the relevant logs prior to the manual restart by me at the IPMI interface. Attaching the log here in hopes someone can tell me if there is something known issue or that looks to be a cause? I don't see anything that jumped out other than what looks like some error messages that I don't fully understand - never been great on the hardware side. unraid-failure.log
March 1, 20206 yr Author This is a screenshot as well that I grabbed from the KVM interface. Unfortunately I'm running issues trying to run the damn IPMI software so I can actually see the screen, but the screenshot at least shows some of the details. I was actually just on the system now via ssh and it happened again. Was just sitting there not even doing anything in particular, then it kicked out the kernel panic message. user@atlantis:/mnt/user/downloads$ Message from syslogd@atlantis at Mar 1 15:34:54 ... kernel:Kernel panic - not syncing: Fatal exception in interrupt packet_write_wait: Connection to UNKNOWN port 65535: Broken pipe Also including the latest diagnostics output from right now after it came back up. atlantis-diagnostics-20200301-1556.zip Edited March 1, 20206 yr by 1activegeek
March 2, 20206 yr Community Expert Nothing on the log, though there are some unrelated ATA errors, you could try safe mode for a couple of days to rule out any plugins, also a good idea to disable NIC bonding for testing.
March 7, 20206 yr Author So I had posted this issue a few weeks ago: - and now, it seems it's happened again. Was there something in those logs or the new logs attached here that would lead you in a specific hardware issue direction? This is now the second time this seems to have happened on me. Though it does appear this time that it says the file system is unmountable, not mounted RO. I'm thinking I've got something hardware related that is broken or somehow not working as intended, but I'm not the best at being able to diagnose hardware in this sense. atlantis-diagnostics-20200306-1852.zip
March 7, 20206 yr Community Expert Don't see any clues here, but diags are right after rebooting, whatever happened likely happened before this, assuming that before the pool was re-formatted I agree there's likely some hardware issue, look for a firmware update for the NVMe device.
March 8, 20206 yr Author Ok, thanks for the indication. In the meantime, I might actually swap out the NVMe for the 2x 500GB SSDs I was using previously. If these prove to work fine, then I'll assume the NVMe is the problem. There have just been too many random halts and 2 corruptions of the file system lately for me to ignore this as just pure coincidence. Appreciate the guidance - crossing my fingers it's just a bum NVMe drive and I can get it swapped by Intel under warranty.
Archived
This topic is now archived and is closed to further replies.