I woke up this morning with my server not working and unable to access the web gui or ssh. I had to hard reset to get it back up. I was monitoring the system logs and it froze up again. I waited a couple minutes and the logs started showing again and I noticed some out of memory errors as well as it killing some ffmpeg processes. I believe it's either frigate or plex, both are set to use hardware transcoding using a GTX-1080. They have both been running fine until last night. I can't narrow it down, can somebody help me figure what container is eating the ram, and how I might solve it?

 

Edit: I've narrowed it down to frigate, I think. I'm not sure why frigate started crashing my server now after running fine for weeks though. I'll bring my logs over to the frigate repo. If anyone here has run into similar ffmpeg crashes in frigate on unraid that would still be helpful.

 

mycelium-diagnostics-20240116-0959.zip

Edited January 16, 20242 yr by jordandrako
More info

hi @jordandrako,

 

just wondering if you found any solutions to this?

 

i'm using frigate docker, and i also have this out of memory killing a ffmpeg process.

fix common problems reported the out of memory error, my system didn't crash. maybe because i don't have plex or anything else that does transcoding.

strangely i actually didn't notice any issues with frigate either.

 

but i would like to find out how to fix this before it causes bigger problems.

 

I never narrowed it down completely, but I did bandaid the problem. I believe the issue was caused by one of my reolink doorbells with a poor wifi signal causing the ffmpeg process to crash and hang, and for some reason it kept eating ram. I changed from rtsp to flv (look at reolink specific config on the frigate docs), which decreased the crashing severity, and limited the amount of ram frigate can use so if a memory leak does happen, it doesn't take all the server's ram and crash it.

ah, ok... that makes sense.

i do have a camera that i have to occasionally restart. It seems to have poor wifi signal and is sometimes dropping frames, even though other devices in that same location shows good signal.

i guess i'll have to get another camera and see how it goes then.

 

thanks!