@TheFullTimer I had a similar (somewhat same) problem with ollama or dockers using gpu in general and found your thread. But just with ollama a had those exit 137 occurrences which were pain to analyze.
In my case the solution was so simple, I could slap myself (hard) ... My unraid executes several user scripts and of course those being recommened during the initial setup for using nvidia gpus, in detail one by SpaceInvaderOne (https://github.com/SpaceinvaderOne/nvidia_powersave).
Fun fact: It has been a talk to gemma3:12b giving me the right idea where to look at - oh crap, of course! 😄
tl;dr: Check your nvidia powersave user script if any installed. Otherwise just skip the following.