Hi,

Fix common problems is telling me I have an out of memory error, and to post here asking for help.

This only started yesterday. I haven't noticed any disruption...yet.

Any advice would be appreciated.

Diagnostics attached.

Thanks in advance.

tower-diagnostics-20250601-2248.zip

I'm still getting this error, but still haven't noticed any issues. Any advice?

You ran out of RAM and litellm was killed.

Did you reboot since? FCP will keep warning an out of memory event happened until a reboot.

Edited July 29, 2025Jul 29 by Kilrah

Oh ok.
Yeah I have rebooted since the first post - 25 days ago. Probably something similar happened again since then.

I've attached new diagnostics if you don't mind taking a look?

tower-diagnostics-20250729-2019.zip

Yep, same one. Looks like you're trying to load models that are too big in that litellm thing for the RAM you have considering the other stuff you run.

Ok that makes sense. I didn't realise running big models used a lot of RAM - I thought it all happened in the cloud lol. I'll do some testing with different models and try to work out what the server can handle.

Thanks for your help.

There are containers you can set up as just being a frontend for a cloud service but yeah usually the whole point is to run them locally with all the hardware requirements that entails.

I only use ones like ChatGPT, Claude, and Gemini though. I use OpenWebui to access them all from a single interface. I avoided the local ones like Llama etc. because my server isn't very powerful...I guess that didn't work haha.