Hi ,

 

I had an out of memory message the second time within a few weeks, so I am posting my diagnostics as suggested by the FixCommonProblems plugin and asking for support.

- Before downloading the diagnostics file, I stopped and restarted docker via settings. But I did not rebooted, yet.

 

Honestly private life kept me busy so I was not able to maintain and configure my machine using the same amount of time, like I invested when setting up unraid and configured it the last two years.

 

So any help in finding the (root) cause of that issue is highly appreciated.

 

BR, T

cloudii-diagnostics-20250518-2218.zip

Edited May 18, 20251 yr by AfterWorkDYIadmin

12 hours ago, AfterWorkDYIadmin said:

Hi ,

 

I had an out of memory message the second time within a few weeks, so I am posting my diagnostics as suggested by the FixCommonProblems plugin and asking for support.

- Before downloading the diagnostics file, I stopped and restarted docker via settings. But I did not rebooted, yet.

 

Honestly private life kept me busy so I was not able to maintain and configure my machine using the same amount of time, like I invested when setting up unraid and configured it the last two years.

 

So any help in finding the (root) cause of that issue is highly appreciated.

 

BR, T

cloudii-diagnostics-20250518-2218.zip 218.2 kB · 0 downloads

 

post the output of ps -auxf taking care to remove any passwords if you have VPN containers and the like

On 5/19/2025 at 11:20 AM, Michael_P said:

 

post the output of ps -auxf taking care to remove any passwords if you have VPN containers and the like

Hi @Michael_P ,

thanks for your feedback. Took me some days because lot's of things going on here :-D

as far as I can see there were no passwords or so in the log.

It does not help me , but maybe it helps to identify the issue or next steps to investigate.

ps -auxf.txt

32 minutes ago, AfterWorkDYIadmin said:

Hi @Michael_P ,

thanks for your feedback. Took me some days because lot's of things going on here :-D

as far as I can see there were no passwords or so in the log.

It does not help me , but maybe it helps to identify the issue or next steps to investigate.

ps -auxf.txt

Looks like a case of just too much going on at once and the reaper just pulled Docker from the top of the list - if it happens again, you can limit the RAM available to the containers or change their config so any file storage is on disk instead of RAM (especially jellyfin). Reboot if you haven't already to clear the log

@Michael_P thanks again.

I will further monitor, but it seems it occasionally happens every 3 days or so.

Besides 32GB RAM I also have the 2x1 TB SSD-Cache Pool.

Thinking about adding another 32GB RAM, but when I look at the dashboard, I often see enough free RAM....

==> Is it somehow possible to send any kind of notification or regularly sending RAM usage by using a cron job or only at a certain trashold ? (running also HomeAssistant with mqtt + nodered....)

I might go to limiting RAM Available in the beginning... so in case of excessive RAM usage, I might receive errors or log info within the containers itself instead of failing whole docker process, correct?

I read somewhere else that it might be useful to enable a SWAP file. Would you recommend that ?

==> Would it be helpful to make use of SWAP ?

2 hours ago, Michael_P said:

change their config so any file storage is on disk instead of RAM (especially jellyfin).

by "disk instead of RAM" you mean changing the config in Jellyfin itself?

there I have set the cache directorires (i.e. for transcoding) already to a config subfolder which should be on cache (ssd) already.

==> or might there be something else to configure?

Edited May 30, 20251 yr by AfterWorkDYIadmin

You shouldn't need a swap file, you have plenty of RAM for what you're doing - you just have to make sure your container's folders are correctly mapped to disk, and they are limited to whatever arbitrary amount you want to set.

jellyfin and immich are pretty big hogs if not configured correctly (watch a couple movies at the same time and bang, OOM) - HA can get wonky too, but I don't use it so I can't help you there.

From the log in your OP, on the 13th and 18th the host ran OOM at about the same time - 0337 and 0343 respectively - so you can also see if there's a scheduled process in any of your containers kicking off around that time (maybe every 5 days, too?)

Actually I am running my daily backup routine using https://forums.unraid.net/topic/97958-rsync-incremental-backup/ at 0300 which might take some time.

I am not sure what changed since it was fine running the whole last year, I guess it is related to some dockers file amounts / cache files, which might result in the user scripts heavy RAM load while comparing and creating hard links or userscripts logging.

# backup source to destination

backup_jobs=(

# source # destination

"/boot" "/mnt/user/Backups/_Unraid/boot"

"/mnt/cache/appdata" "/mnt/user/Backups/_Unraid/appdata"

"/mnt/cache/domains" "/mnt/user/Backups/_Unraid/domains"

"/mnt/user/D1234" "/mnt/user/Backups/_Unraid/D1234"

"/mnt/user/f1234" "/mnt/user/Backups/_Unraid/f1234"

)

# keep backups of the last X days

keep_days=30

# keep multiple backups of one day for X days

keep_days_multiple=1

# keep backups of the last X months

keep_months=24

# keep backups of the last X years

keep_years=5

# keep the most recent X failed backups

keep_fails=3

# rsync options which are used while creating the full and incremental backup

rsync_options=(

# --dry-run

--numeric-ids # do not map uid/gid to user/group name

--archive # same as --recursive --links --perms --times --group --owner --devices --specials

--human-readable # output numbers in a human-readable format

--itemize-changes # output a change-summary for all updates

--exclude="[Tt][Ee][Mm][Pp]/*" # exclude dirs with the name "temp" or "Temp" or "TEMP"

--exclude="[Tt][Mm][Pp]/*" # exclude dirs with the name "tmp" or "Tmp" or "TMP"

--exclude="/mnt/fotos_videos/immich/photos/encoded-video"

--exclude="/mnt/fotos_videos/immich/photos/thumbs"

--exclude="/mnt/cache/appdata/jellyfin/artist"

--exclude="/mnt/cache/appdata/jellyfin/cache"

--exclude="/mnt/cache/appdata/photoprism/cache"

--exclude="/mnt/cache/appdata/photoprism/sidecar"

--exclude="/mnt/cache/appdata/*krusader/home/.local/share/Trash"

# --exclude="Cache/*" # exclude dirs with the name "Cache"

)

Edited June 2, 20251 yr by AfterWorkDYIadmin

8 hours ago, AfterWorkDYIadmin said:

Actually I am running my daily backup routine using https://forums.unraid.net/topic/97958-rsync-incremental-backup/ at 0300 which might take some time

Bump the time up an hour and see if the OOM follows it