droyster

Has anyone gotten nvidia drivers working on this? I'm not an arch user and haven't been able to get nvidia drivers going. I'd like to do some ML stuff from this container. The normal flags aren't workign for me NVIDIA_VISIBLE_DEVICES=GPU-0db5fc02-ac0d-fb2a-e9b2-539cd10d7d89 NVIDIA_DRIVER_CAPABILITIES=all

@GavinCampbell sorry to revive this, but is it possible to have multiple GPUS used by 1 docker container? I'm trying to run ollama https://github.com/ollama/ollama/issues/2672#issuecomment-1959505845 which does support multiple GPUs, but don't want to buy another GPU if I can't support it in unraid with nvidia plugin and docker

How do i do that? I didn’t see an option in the docker settings advanced mode. It’s not clear either what share it’s going to

I have a custom docker image that I pushed to a private registry hosted on my unraid. When I try to pull it to run it, it fails root@Tower:~# docker pull 192.168.68.66:5000/custom-api Using default tag: latest latest: Pulling from custom-api 7a2c55901189: Pull complete 755e535b54a3: Pull complete 24ff69e0a1e4: Pull complete 76a627ca5e65: Pull complete 35817692a87e: Pull complete 84b6a42e847a: Pull complete 4639b7cd68e5: Pull complete a7bc10701a5b: Pull complete 7d32a9230f8f: Pull complete 8c35a1861813: Extracting [==================================================>] 2.49GB/2.49GB e3f63d7242f5: Download complete afa75cca3a04: Download complete 8f0ccef32324: Download complete 469f02edddbd: Download complete 79888f2914bd: Download complete b32a369a63d3: Download complete 5792e3e68184: Download complete 97e61a288a0d: Download complete f31987ceea11: Download complete 8d286a1efb00: Download complete 4f4fb700ef54: Download complete 0c9c63757e0c: Download complete 26c8e2ec5849: Download complete 51acd6a0318c: Download complete c1c3b8501831: Download complete 693e0da3f716: Download complete 7356c1f4dd44: Download complete 845c3f80ac94: Download complete 840d8b935722: Download complete 1097ac656e1a: Download complete dc8b1a2cb224: Download complete 838559668292: Download complete f2e1c73d8a4a: Download complete 92ce1d577cd7: Download complete failed to register layer: write /usr/local/cuda-12.1/targets/x86_64-linux/lib/libcublas_static.a: no space left on device It's 22GB image based on nvidia/runtime with extra inference libraries. It's a RAG app I'm building. I want to try to make it smaller, but for now I just want to get it to run at all. It also complained once about not having room in a folder /mnt/user/system/docker/... get image blobs (I think) Thanks Tower Diagnostics 20240513.zip

Okay so I figured it all out. Not unraid problem at all. Each stick of ram worked on any slot individually, but it wouldn't work with all 4 installed. After some research it looks like my AMD 3700x chip sometimes has issues with 4 sticks of ram. It would consistently fail with all 4. Now I actually put 64 GB in 2 x 32GB and everything is working fine. Might have to become an intel guy after all this... Thanks for the support

I sucessfully ran memtest and it's got a bunch of failures. Does that mean the bzfirmware failures are because it offloaded the firmware to ram and because of hardware issues the checksums don't match because of missing/bad addresses?

Will try that and report back. thanks! Can I copy the config folder over across minor releases? I believe this config folder is from 6.12.4 and I'm upgrading to 6.12.10 could that cause issues or has that been pretty stable?

MS-DOS (FAT) is an option for Format, but I also have these scheme options. What should scheme be?

when formatting on a mac do you know what scheme to use?

that worked! I think the issue is that my server was trying to boot from the flash drive not the Partition 1, hence the bad root path error. By selecting the right partition I got past the kernel crash, but failed on the bz errors. I copied my config folder into the flash drive and then selected the correct partition and got these bz errors. My research says I need to just recreate the USB stick using the tool again and then copy the config over? Is that right?

I bought a new stick and installed the newest unraid on it and I'm getting the same error. i am using one of these after reading someone saying they had success with them. I used the mac unraid creation tool and made sure to select the write drive. I don't see any error lights on my MOBO when booting. I unplugged all of my drives for now. All i have plugged in is my GPU, CPU and RAM. What should I try next? Thanks again

I installed an RTX 4060 ti. I have a 750 watt PSU so I don't know if that's the issue. I had to move some drives with everything powered down. Then I tried to boot and got a kernel panic. I made a backup of my drive and then installed 6.12.10 and copied config over Worked briefly. Woke up next morning and everything had crashed Made 6.12.9 clean install (didn't copy config this time) Still kernel panic Any help greatly appreciated. It didn't produce more logs to my flash drive this time because I can't get far enough to enable it

try seeing if your server will run without panicking with all docker containers shut down, then turn them on one by one and wait a day between each to give it time to panic

server has been running consistently for days now. Not positive what fixed it, but I changed my drive storage to `auto` and I turned off every docker container, but my plex one. I did see some errors in the docker logs. Since doing those 2 steps things seem fine

i have logs here of when docker crashed again. anything stand out here? I'm going to try replacing the ram, but I'm wondering if these logs have anything useful syslog_crash.zip