Evedoescomputerstuff

First. Do VMs work with no GPU and VNC selected? If they do, PCI ACS Override + Multifunction. ACS override is a GUI setting, multifunction can only be enabled for the VM by editing the XML. You may have to play with which ACS override setting to use and the multifunction setting in the XML.

I'd love an explanation, this has been plaguing me for like a week out of the blue and since it's not *actually* broken I haven't waded through all the forum posts to find out why this happens but I am curious! Mainly since I get errors in the log before I even launch the VNC viewer in my browser, yet everything works.... It's just interesting.

At this point since it's fixed, surely you don't want to mess around. However, i'm very curious about the processor now. Since unRAID was unable to boot did you ever try another OS during this process? Mainly just wondering if the processor somehow went bad or theres actually an incompatibility with unRAID? Been planning on trying unRAID with some Ryzen builds (you know the drill, old desktop becomes another server) now that the prices keep falling.

Can we try to see if this is some weird hardware problem unrelated to unraid? Have you ever been able to boot another OS or live image on this machine?

This is probably not the right answer but can you try re-creating your VMs (not their vdisks ) from scratch?

Rad. It's not *exactly* a bug but definitely not intuitive as it could be. The addition of 'optional' devices is sweet.

Yeah, you need to pass through the NVMe PCI-E device directly, not just map the vdisk location to it. In other words, you don't want to be using a vdisk.

That's strange. Can you try CRU to force the resolution / refresh? Display Port? If none of this works, for sanity, do you have another 4K 60hz capable display you can try? Anything to get a different EDID will be helpful.

Did a reboot fix it and allow you to boot the VM again? With USB I agree things can be finnicky, a slightly more surefire system (and one that supports hotplug) is finding a 'group' of USB ports on your unRAID machine that can be passed through as a USB controller. Those ports will become unavailable to unRAID or other things on your server, but will in ideal circumstances, function as regular hotpluggable USB ports to the VM. I highly recommend considering copying the 'xml' (you don't need to use XML for most VM config tasks) at each stage as you're working through making the VM. It makes it much easier to revert to something that did work. Furthermore, as you're figuring this out, copying the vdisk image file for your VM at various stages is useful as well. It's a snapshot of the computer essentially and makes trying something out hassle free as you can always restore the working image. This is actually one of the reasons I *really* like the VM system (once it works, passing stuff through is always going to be a bit of trial and error), snapshotting and quickly switching through images can be helpful if you're trying things liable to break an OS, or if you're developing something for a specific config. As mentioned by others, passing through an iGPU isn't as trivial as it you'd think due to how IOMMU assignments get sliced up and parted out so to speak. That's why a supported dGPU is often easier to make work in a VM.

I'm not an expert, hopefully one of the more seasoned unRAID VM users will chime in. The only other thing I noticed was "pc-i440fx-6.2" . I've been using QXL with much better results when dealing with physical hardware. Try that. Searching on the forums leads to a few other people dealing with the same error.

I have a p400 in one of my unraid builds passed through to a VM for basic desktop accel (it used to be for transcoding). Works great. The vBios is probably what you're missing since you didn't mention it and it's easy to overlook. I just grabbed a vbios from TechPowerUp. The Quadro cards aren't as 'AIB'd' to death like consumer cards so finding a compatible vbios is easy. If you for some reason can't find your card on TechPowerUp, you might have to dump the vBios yourself. There's a script that allegedly works but hasn't for me in the past. The *easiest* way to reliably extract it is to toss it in a computer, boot up windows and use GPU-Z to save it to a file. Place the resulting file on your server in one of your shares (like isos alongside your OS install images), then on the VM config GUI in the GPU section, locate your bios file. If you're using it for transcode that means the GPU works (in theory) and that you probably have the same nvidia drivers for Unraid as I do. I don't *think* you need the Unraid nvidia plugin just to pass the GPU through but I figured I'd mention it since it is running in my setup. The p400 I have is most likely the same as yours and I was actually blown away at how easy it was to get working with a tiny bit of tinkering. As for passing iGPUs? I haven't played with it but that sounds like way too much of a headache. GPU prices are crashing so depending on what your goal is for pass through, something cheap might work wonders and be significantly easier to get working. I tried TrueNAS Scale on the first RC (so please take this with a grain of salt) and didn't like it. Docker configuration sucked, charts were meh, portainer helped a bit. I was getting really bizarre slow downs and lockups without much logic behind them and felt as though with my more 'JBOD' storage arrangement that it wasn't right for me. If you don't need ZFS and you already use unRAID, I can't think of a major reason to switch over IMO.

Curious too as i'm looking at Epyc builds.

Not an expert by any stretch but multifunction may help you here. The GUI doesn't have an option for it (so you'll have to edit XML, and if you use the GUI to make any changes, re-edit your XML) . In the XML, you're looking for the address block below your rom file, add to the end of it before the /> multifunction='on' <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x07' slot='0x00' function='0x0'/> </source> <rom file='/mnt/user/vm/Gigabyte.GT610.1024.130107.rom'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x07' slot='0x00' function='0x1'/> </source> <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/> </hostdev> should be <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x07' slot='0x00' function='0x0'/> </source> <rom file='/mnt/user/vm/Gigabyte.GT610.1024.130107.rom'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0' multifunction='on'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x07' slot='0x00' function='0x1'/> </source> <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/> </hostdev> Do you need the built in VNC? I've found having it as a device causes problems for my VMs with real GPUs occasionally.

I've had random SMB issues like this before, especially dealing with specific hardware / software combos. Can you try to make another unraid user with read access to the media share?

AVAHI is harder than it seems to get running on some containers, at least with the tiny bit I played with it. Sucks but what can you do. Sort of related, a docker that can essentially act as an internal reverse proxy that supports broadcasting a bunch of .local mDNS domains and then routing said requests would be absurdly useful. Does that exist?

Going to test.domain.nl (ignoring the :123) doesn't work?

Kernel 5.19.3 + Mesa drivers from ppa:oibaf/graphics-drivers seems to work with the newest ubuntu LTS at least provisionally. Haven't tested anything heavy but my screen works and apparently I have hw accel. If you're trying to get this to work, try this. Install Ubuntu in GPU safe mode with just the VNC passed. Get it installed and do the kernel upgrade + mesa drivers. Then pass your GPU + HDMI audio, manually adding in multifunction. As a bonus, edit grub to allow the menu display by default, this will give you an easy road back in to 'recovery' / cli mode if a change breaks your GPU. Can't get both mouse and keyboard passed (either by doing the GUI config, and then re-editing the xml) and ALSO have display show up no idea why? I get conflicts over ports and stuff. Mouse and Keyboard sucessfully passed to other VMs however. It's not a *massive* deal since I don't plan on having physical HID devices connected in the long run. RealVNC server is my choice for control with a passed through GPU. Install it, then "libcanberra-gtk-module" (for some reason it's missing for me after these steps) , then configure it, then disable Wayland. Wayland presents major issues for RealVNC and on the KB+M control front (like synergy / barrier) there isn't a decent option yet. EDIT: Correct Kernel is 5.19.3 sorry for the confusion. https://github.com/pimlie/ubuntu-mainline-kernel.sh is what I used. You're probably better to do it yourself but this worked for me. Uniengine benchmarking works. GPU still shows up as a non specific AMD device in lshw but presents correctly to software I guess? Driver: amdgpu OpenGL 4.6 OS: Ubuntu 22.04.1 LTS Kernel: 5.19.3-051903-generic

pci=noaer works *more*, the 6500xt has a problem on Ubuntu but I'm getting closer. https://gitlab.freedesktop.org/drm/amd/-/issues/1933 Displays the exact error as this. Working on it now to see what I can do on a newer kernel / mesa version I assume this is beyond the Unraid community's help but do let me know if there's another option.

I should have mentioned unsafe interrupts, already have those on. I haven't tried pci=noaer though.

Alright, I've been trying for 2 days now to get my 6500XT passed through to VMs successfully (and reliably). I've tried various fixes like multifunction, hiding the relevant devices from VFIO, etc. Tried 6.9 and now 6.10 . I've been able to get video out of the GPU to boot specific OSes (Debian 11 worked for example, but no hardware acceleration) and occasionally I've been able to get it to show up in LSPCI in said VM. I've dumped the bios on an actual windows machine as well, the card does indeed work. I figured okay, Ubuntu LTS has AMD driver support so I'll try that. VM boots, and gives me ubuntu's boot options (through the GPU's video out), however hitting "try / install" causes a VFIO error which leaves the screen on "Tianocore" (the last frame is always left hanging on the GPU's output). Doing safemode, I obviously get further but that isn't going to really help my situation as the notification I get as safemode launches is that the AMD drivers won't be loaded. qemu-system-x86_64: vfio_err_notifier_handler(0000:05:00.0) Unrecoverable error detected. Please collect any data possible and then kill the guest qemu-system-x86_64: vfio_err_notifier_handler(0000:05:00.1) Unrecoverable error detected. Please collect any data possible and then kill the guest What else can I try? I can post VM configs but I've tried a bunch of different ones by this point. Also, curiously, there's 4 relevant devices for my GPU in VFIO, but only 2 have little check boxes. I did attempt to add the remaining 2 manually (following the style of the 2 which I was able to enable via the GUI) to my vfio config file but it didn't make a difference. First 2 here, the "Upstream" and "Downstream" have no checkbox. IOMMU group 31:[1002:1478] 03:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Upstream Port of PCI Express Switch (rev c1) IOMMU group 32:[1002:1479] 04:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch IOMMU group 33: [1002:743f] 05:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Navi 24 [Radeon RX 6400 / 6500 XT] (rev c1) IOMMU group 34: [1002:ab28] 05:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Navi 21/23 HDMI/DP Audio Controller Is it possible I need to write the xml config for the VM to include the first 2 devices? How would that look? X99 Jingyue board if that helps. 12c V3 Xeon. This isn't my primary GPU (I have an old AMD card in there and it seems to only output console to that, not the 6500xt so I believe Unraid's OS is correctly preferring the crappy card)