marcus.glen

Thank you everyone. This was a classic case of not seeing the wood for the trees. I didn't see the advance toggle and was just trying to add parameters myself. Totally fixed in 30 seconds once i saw that. Feeling a bit of a fool but its good to be learning something completely new again.

Thank you MrSir for the reply. It was late in the day and i should have been clearer and said i'm using the open source driver from the nvidia driver app.Like i said the system sees the card but Ollama will only use CPU. Here's the full config. Can you see something blindingly obvious? I was just thinking as you both have got it working you may have been through the same pain and the solution is simple and not wipe it all and start again. Thanks for looking anyway.

having spent all weekend and this evening i can say yes, i'm using OpenWebUI, Ollama and local AI. Now if there is just some way for ollama to not use my CPU and use my new RTX 5090 instead I would be something approaching a happy man. I've watched every video I can find, added numerous suggested parameters and restarted more times than i can remember. It still the same, the driver app sees the card, ollama goes, "feck that i'm having your CPU cores." For the love of all that is holy, have you seen a post or a guide that forces it to use my GPU? I'm using the open driver, latest version of unraid and the last of my will to live.