wgstarks Posted December 1, 2021 Share Posted December 1, 2021 I had an OOM event last night that caused my server to freeze up completely. Had to hard reset the server. Now I'm seeing several issues with the webui after several reboots. The dashboard isn't showing any cpu activity. None of my connected dives are showing in UD. There are two external drives connected and I can access them via SMB and SSH. Could not download a diagnostics via the tools menu. Had to use SSH to get it. brunnhilde-diagnostics-20211201-0754.zip Not sure what to try from here. Would really appreciate any advice. Quote Link to comment
wgstarks Posted December 1, 2021 Author Share Posted December 1, 2021 Tried a file system repair on flash but that didn't find any issue and didn't correct any of the issues. Thought about restoring from My Servers backup but couldn't figure out how to select the backup version to restore from? If I'm understanding the My Servers page it looks like the backup shown was taken after this problem started. Quote Link to comment
JonathanM Posted December 1, 2021 Share Posted December 1, 2021 16 minutes ago, wgstarks said: Thought about restoring from My Servers backup but couldn't figure out how to select the backup version to restore from? If I'm understanding the My Servers page it looks like the backup shown was taken after this problem started. The my servers backup is current only, which isn't a real backup IMHO, but versioning is hard when there are real issues with restoring old backups coming with a risk of losing data. I recommend not relying on the my servers backup for anything but commissioning a new USB stick on a perfectly running server. Manual backups are still needed for situations where previous versions would be beneficial. I don't have any insight into your actual current issue though. How does it act in safe mode? I recommend disabling array auto start, disable VM and docker services, then start enabling things one at a time assessing stability at each step. I suspect the same event that caused the OOM is trying to continue, like a large processing job in a container or something. Quote Link to comment
wgstarks Posted December 1, 2021 Author Share Posted December 1, 2021 Booting into safe mode restored the display of UD devices but CPU activity is still showing zero on dashboard. As soon as I boot back in a normal mode I lose the UD devices again even with array start and dockers disabled. Quote Link to comment
JonathanM Posted December 1, 2021 Share Posted December 1, 2021 5 minutes ago, wgstarks said: Booting into safe mode restored the display of UD devices but CPU activity is still showing zero on dashboard. As soon as I boot back in a normal mode I lose the UD devices again even with array start and dockers disabled. That implies one of your plugins is causing an issue. Quote Link to comment
wgstarks Posted December 1, 2021 Author Share Posted December 1, 2021 If I delete the UD plugin I the webui shows the unassigned devices but I'm not sure UD is causing the issue. Removing the plugin and doing a clean install doesn't resolve anything. And so far nothing has corrected the dashboard issues. I might try restoring from the My Servers backup to see if that helps. Quote Link to comment
wgstarks Posted December 1, 2021 Author Share Posted December 1, 2021 Well that was a waste of time since the Unraid Creator app doesn't work.🤨 Tried just replacing the bz files but that didn't change anything. Quote Link to comment
wgstarks Posted December 1, 2021 Author Share Posted December 1, 2021 Is there any way to mount the unassigned devices in unRAID from the command line? At least that way I could copy the data on them to a share that I could assign to the affected dockers. Quote Link to comment
trurl Posted December 1, 2021 Share Posted December 1, 2021 30 minutes ago, wgstarks said: mount the unassigned devices in unRAID from the command line? You can see the commands UD uses in syslog if you have an old one to look at where it was working. What filesystem? https://wiki.unraid.net/Copy_files_from_a_NTFS_drive Quote Link to comment
wgstarks Posted December 1, 2021 Author Share Posted December 1, 2021 5 minutes ago, trurl said: What filesystem? IIRC its XFS. Quote Link to comment
Squid Posted December 2, 2021 Share Posted December 2, 2021 Make sure that safari is up to date. Clear out your cookies etc. Try a different browser. 1 Quote Link to comment
tjb_altf4 Posted December 2, 2021 Share Posted December 2, 2021 This might save your bacon from future OOM events Quote Link to comment
wgstarks Posted December 2, 2021 Author Share Posted December 2, 2021 42 minutes ago, Squid said: Make sure that safari is up to date. Clear out your cookies etc. Try a different browser. OMG. I wasted most of the day restoring and restarting because of a browser issue. Safari is up to date but I’ll need to update to 6.10 for full compatibility. The server freeze really had me thinking that the display issues must be related. Starting to look like all the issues happening at the same time is just really bad karma. 😆 Quote Link to comment
wgstarks Posted December 2, 2021 Author Share Posted December 2, 2021 7 minutes ago, tjb_altf4 said: This might save your bacon from future OOM events I’ll check that out. Definitely cheaper than more memory. Quote Link to comment
Squid Posted December 2, 2021 Share Posted December 2, 2021 1 hour ago, wgstarks said: Safari is up to date but I’ll need to update to 6.10 for full compatibility. Safari has always been a "challenge" for the OS unfortunately. Quote Link to comment
wgstarks Posted December 2, 2021 Author Share Posted December 2, 2021 One thing I see from this is that I need to setup a versioned backup for flash. Is there a simple script that I could run in User Scripts to do this? Quote Link to comment
wgstarks Posted December 2, 2021 Author Share Posted December 2, 2021 Now my Flash share is empty via SMB. I can connect but there's nothing there and files that I write to it disappear. Quote Link to comment
Squid Posted December 2, 2021 Share Posted December 2, 2021 Diagnostics should now be working via the other browser... Quote Link to comment
wgstarks Posted December 2, 2021 Author Share Posted December 2, 2021 3 minutes ago, Squid said: Diagnostics should now be working via the other browser... Attached brunnhilde-diagnostics-20211201-2142.zip Quote Link to comment
Squid Posted December 2, 2021 Share Posted December 2, 2021 Dec 1 21:30:57 Brunnhilde emhttpd: shcmd (152): smbcontrol smbd close-share 'flash' With everything else you've been dealing with today, I'd guess either corruption or it's not seated quite right. (But, I've never seen that error before) Reboot. Quote Link to comment
wgstarks Posted December 2, 2021 Author Share Posted December 2, 2021 1 hour ago, Squid said: Dec 1 21:30:57 Brunnhilde emhttpd: shcmd (152): smbcontrol smbd close-share 'flash' With everything else you've been dealing with today, I'd guess either corruption or it's not seated quite right. (But, I've never seen that error before) Reboot. No change. I can actually see one item UEFI~. Quote Link to comment
trurl Posted December 2, 2021 Share Posted December 2, 2021 Do you have a flash backup? Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.