Hey team,

 

I'm having issues creating a gaming VM, I have followed this guide here https://forums.serverbuilds.net/t/guide-remote-gaming-on-unraid/4248/301.

I am able to get the VM up and running with just the virtual GPU, access by RDP and Anydesk is available.

When I try to passthrough my 1060 the VM starts but the monitor I have connected to the GPU shows no signal and one of the CPU's assign to the VM is pinned at 100%.

I have tried looking at most, if not all of space invader ones videos on VM's, looking on forums, other websites, tried the different BIOS and machine types and even different vBIOS for my GPU to no avail. Anyone have a fix?

  

On 4/2/2024 at 12:26 AM, bmartino1 said:

you will not be able to use the unraid nvdia driver if you have it bound.

the card will need to be bound via iommu to use in a vm properly.

you will need to edit the xml config to fix thr graphic and audio of the g card.

see space invaders video

*this is the secret sauce fix... ^ Thank you Space Invader 

 

You will need to edit the xml near the bottom and fix your audio to be the next function and to stay on the correct bus.

Optional but helpful edits:
#################################

 

Main > flash drive > to add to your grub option:
video=vesafb:off,efifb:off,simplefb:off,astdrmfb initcall_blacklist=sysfb_init pci=noaer pcie_aspm=off

 

We want to make sure the 1060 is fully set to vfio in use driver and that nothing touch it's FB to passit for full use in the VM. We also don't want unraid to control the power setting to it, the vm will handle that. This is why the advance eidt options...

example grub config that i run for my unraid same gpu:

Current Grub boot command:

kernel /bzimage
append initrd=/bzroot nvme_core.default_ps_max_latency_us=5500 default_hugepagesz=1G hugepagesz=1G pcie_acs_override=downstream,multifunction transparent_hugepage=always video=vesafb:off,efifb:off,simplefb:off,astdrmfb initcall_blacklist=sysfb_init pci=noaer pcie_aspm=off

 

I also recommend adding this to your vfio modprobe to assist with the GPU passing.
tools > system drivers > inuse drop down set to all

scroll to vfio.conf hit the pencil at the right and add this for your system:

*don't forget to save it at the right...
 

we want to edit this config and rebuild the modules and rebuild:

/etc/modprobe.d/vfio.conf

 

softdep nouveau pre: vfio-pci
softdep nvidia pre: vfio-pci
softdep nvidiafb pre: vfio-pci
softdep nvidia_drm pre: vfio-pci
softdep drm pre: vfio-pci

options vfio-pci ids=(your vifds here...) disable_idle_d3=1 enable_sriov disable_denylist disable_vga=1

 

reboot
#########################

lspci -v will tell you what in use drivers there are running in you want to see vfio under the 3090 and audio device.
Fix your xml edits to add mutifunciton to the video portion of the Gcard and fix the bus to match the gcard audio function.

 

On 4/4/2024 at 11:16 AM, bmartino1 said:

Verifying IOMMU parameters

 

dmesg | grep -e DMAR -e IOMMU

Intel will show something similar:

 

There should be a line that looks like "DMAR: IOMMU enabled".

If there is no output, something is wrong.

 

Verify IOMMU interrupt remapping is enabled

 

It is not possible to use PCI passthrough without interrupt remapping. Device assignment will fail with 'Failed to assign device "[device name]": Operation not permitted' or 'Interrupt Remapping hardware not found, passing devices to unprivileged domains is insecure.'.

All systems using an Intel processor and chipset that have support for Intel Virtualization Technology for Directed I/O (VT-d), but do not have support for interrupt remapping will see such an error. Interrupt remapping support is provided in newer processors and chipsets (both AMD and Intel).

To identify if your system has support for interrupt remapping:

 

dmesg | grep 'remapping'

 

If you see one of the following lines:

AMD-Vi: Interrupt remapping enabled

DMAR-IR: Enabled IRQ remapping in x2apic mode ('x2apic' can be different on old CPUs, but should still work)

then remapping is supported.

If your system doesn't support interrupt remapping, you can allow unsafe interrupts
^enabled under unraid VM settings...

Edited April 6, 20242 yr by bmartino1

  

On 4/3/2024 at 4:10 PM, bmartino1 said:

 

I run amd and stubed my 6600xt.
My friend runs a amd and stubed his 3060.

we have stubbed and used a 3090 in testing an know that this works.

step 1: confirm iommu and hvm:

Dashboard top right info:

next step verify stubed GPU:

/Tools/SysDevs

Tools > system devices

?iommu slot 1?
confirm with 2 green dots by gcard and view vfio bind log:

 

step 2 vm tab.
confirm gui settings:

 

add vm> linux 
confirm machine type:

must be q35 (can work with ifx but issues. must be version 7 or above.)

 

confirm graphic options:

 

gui must be set before xml edits!
in my case its a amd card.

 

create vm. edit xml
find keybaord and set proper xml edits.

at end of gcard add mutifunction

next one is audi/hdmi driver.
set to same buss and add function 1...

^this is the bare minimum. other optional are side fixes, enhancements and checks to stop error and ease g-card for transition to use in vm.

 

 

 

Please post your entire XML code to verify your options and settings.