steve1977 Posted February 5, 2023 Share Posted February 5, 2023 My VM is running out of space due to too many Steam games I would like to put the Steam games on a separate disk. Thinking to passthrough a NVME Disk to the VM and then move all Steam games to it. Is this possible and how to do it? Quote Link to comment
steve1977 Posted February 5, 2023 Author Share Posted February 5, 2023 Attaching log file tower-diagnostics-20230205-2007.zip Quote Link to comment
JorgeB Posted February 5, 2023 Share Posted February 5, 2023 Tools -> System Devices Bind the NVMe to VFIO, reboot, edit the VM and it should now be available in the additional PCI devices section. Quote Link to comment
steve1977 Posted February 5, 2023 Author Share Posted February 5, 2023 Thanks. Unfortunately, it is greyed out. And even if it wasn't greyed out, it is in iommu group 17 together with other disks. Quote Link to comment
JorgeB Posted February 5, 2023 Share Posted February 5, 2023 Then it cannot be passed-through physically, you can create a vdisk on it. Quote Link to comment
steve1977 Posted February 5, 2023 Author Share Posted February 5, 2023 I could change my hardware setup that the nvme has a dedicated sata, so it would not be together with others. But I'd assume it may still be greyed out (e.g., I have my cache disk on a dedicated controller, but it is also greyed out). Do I need to passthrough the disk that it is not greyed out? Or unmount it? Quote Link to comment
JorgeB Posted February 5, 2023 Share Posted February 5, 2023 To be able to pass-through a device it must be on its own IOMMU group, greyed-out usually means it's in use by Unraid. Quote Link to comment
ghost82 Posted February 5, 2023 Share Posted February 5, 2023 (edited) 1 hour ago, steve1977 said: I have my cache disk on a dedicated controller, but it is also greyed out Because it's in use by the host, as said. There are different scenarios: 1. by phisically attaching the nvme to a dedicated controller you are able to isolate it, no other disks in use by the host are connected to this controller --> bind this controller to vfio and use it in a vm; this will pass through both the controller and the disk (and everything that it's attached to this controller, if not in use by the host) (preferred solution) 2. you are not able to isolate the nvme, the nvme is attached to a controller with something else in use by the host --> pass the disk with by-id, this will create an emulated controller and use the nvme disk (2nd choice) 3. you are not able to isolate the nvme, the nvme is attached to a controller with something else in use by the host --> create a vdisk on the nvme, this will create an emulated controller and use the vdisk on the nvme disk (3rd choice) Edited February 5, 2023 by ghost82 1 Quote Link to comment
steve1977 Posted February 5, 2023 Author Share Posted February 5, 2023 Thanks, let me understand option 2 as this is what I was trying to do. "Pass the disk" means to enable to passthrough featiure in UD? Quote Link to comment
ghost82 Posted February 5, 2023 Share Posted February 5, 2023 (edited) You should be able to do it just by following this video: https://www.youtube.com/watch?v=QaB9HhpbDAI Start from minute 8, 27th second Just type from unraid terminal: ls /dev/disk/by-id to identify your nvme disk (spaceinvadersone uses a sata disk with prefix "ata-", yours will probably be "nvme-") Edited February 5, 2023 by ghost82 Quote Link to comment
steve1977 Posted February 6, 2023 Author Share Posted February 6, 2023 Thanks a lot. Maybe a stupid question. Does the secondary disk that I'd like to passhtrough to a VM directly need to be formatted as NTFS or can be in XFS? Quote Link to comment
ghost82 Posted February 7, 2023 Share Posted February 7, 2023 (edited) Windows doesn't support natively xfs, you should be better to format the disk with a windows supported format, i.e. ntfs. XFS partitions can be accessed from windows with third party softwares, for example paradox, linux reader, etc. Edited February 7, 2023 by ghost82 Quote Link to comment
steve1977 Posted February 7, 2023 Author Share Posted February 7, 2023 Great, thanks! Quote Link to comment
steve1977 Posted February 11, 2023 Author Share Posted February 11, 2023 I am still stuggling to get it running. Let me share what I did and the error message I am seeing: 1) I formatted the disk and set as "passed through" in unassigned devices 2) I bind the disk to vfio under system devices and restart Unraid 3) I add the disk under "other PCI devices" to the VM Cannot start the VM and see following error messasage: "Execution Error: internal error: process exited while connecting to monitor: 2023-02-[removed] qemu-system-x86_64: -device {"driver":"vfio-pci","host":"0000:06:00.0","id":"hostdev2","bus":"pci.6","addr":"0x0"}: vfio 0000:06:00.0: failed to add PCI capability 0x11[0x50]@0xb0: table & pba overlap, or they don't fit in BARs, or don't align" Any thoughts? Quote Link to comment
steve1977 Posted February 12, 2023 Author Share Posted February 12, 2023 Attaching diagnostic log tower-diagnostics-20230212-1355.zip Quote Link to comment
ghost82 Posted February 12, 2023 Share Posted February 12, 2023 Replace with this: <!-- WARNING: THIS IS AN AUTO-GENERATED FILE. CHANGES TO IT ARE LIKELY TO BE OVERWRITTEN AND LOST. Changes to this xml configuration should be made using: virsh edit 4b3bfbe8-922b-3557-068e-2feb5c741c52 or other application using the libvirt API. --> <domain type='kvm'> <name>Windows 11 (Gaming)</name> <uuid>4b3bfbe8-922b-3557-068e-2feb5c741c52</uuid> <metadata> <vmtemplate xmlns="unraid" name="Windows 11" icon="windows11.png" os="windowstpm"/> </metadata> <memory unit='KiB'>16777216</memory> <currentMemory unit='KiB'>16777216</currentMemory> <memoryBacking> <nosharepages/> </memoryBacking> <vcpu placement='static'>16</vcpu> <cputune> <vcpupin vcpu='0' cpuset='6'/> <vcpupin vcpu='1' cpuset='24'/> <vcpupin vcpu='2' cpuset='7'/> <vcpupin vcpu='3' cpuset='25'/> <vcpupin vcpu='4' cpuset='8'/> <vcpupin vcpu='5' cpuset='26'/> <vcpupin vcpu='6' cpuset='9'/> <vcpupin vcpu='7' cpuset='27'/> <vcpupin vcpu='8' cpuset='10'/> <vcpupin vcpu='9' cpuset='28'/> <vcpupin vcpu='10' cpuset='11'/> <vcpupin vcpu='11' cpuset='29'/> <vcpupin vcpu='12' cpuset='12'/> <vcpupin vcpu='13' cpuset='30'/> <vcpupin vcpu='14' cpuset='13'/> <vcpupin vcpu='15' cpuset='31'/> </cputune> <os> <type arch='x86_64' machine='pc-q35-7.1'>hvm</type> <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd</loader> <nvram>/etc/libvirt/qemu/nvram/4b3bfbe8-922b-3557-068e-2feb5c741c52_VARS-pure-efi-tpm.fd</nvram> </os> <features> <acpi/> <apic/> <hyperv mode='custom'> <relaxed state='on'/> <vapic state='on'/> <spinlocks state='on' retries='8191'/> <vendor_id state='on' value='none'/> </hyperv> </features> <cpu mode='host-passthrough' check='none' migratable='on'> <topology sockets='1' dies='1' cores='8' threads='2'/> <cache mode='passthrough'/> </cpu> <clock offset='localtime'> <timer name='hypervclock' present='yes'/> <timer name='hpet' present='no'/> </clock> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/local/sbin/qemu</emulator> <disk type='file' device='disk'> <driver name='qemu' type='raw' cache='writeback'/> <source file='/mnt/disks/Samsung_SSD_870_QVO_2TB_S5SUNG0N702589F/Windows 10 Pro/vdisk1.img'/> <target dev='hdc' bus='virtio'/> <boot order='1'/> <address type='pci' domain='0x0000' bus='0x03' slot='0x00' function='0x0'/> </disk> <controller type='usb' index='0' model='ich9-ehci1'> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/> </controller> <controller type='usb' index='0' model='ich9-uhci1'> <master startport='0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/> </controller> <controller type='usb' index='0' model='ich9-uhci2'> <master startport='2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1' multifunction='on'/> </controller> <controller type='usb' index='0' model='ich9-uhci3'> <master startport='4'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/> </controller> <controller type='pci' index='3' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='3' port='0x12'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x2'/> </controller> <controller type='pci' index='4' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='4' port='0x13'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x3'/> </controller> <controller type='pci' index='5' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='5' port='0x14'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x4'/> </controller> <controller type='virtio-serial' index='0'> <address type='pci' domain='0x0000' bus='0x02' slot='0x00' function='0x0'/> </controller> <controller type='sata' index='0'> <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/> </controller> <controller type='pci' index='0' model='pcie-root'/> <controller type='pci' index='1' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='1' port='0x8'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0' multifunction='on'/> </controller> <controller type='pci' index='2' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='2' port='0x9'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <controller type='pci' index='6' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='6' port='0xa'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> </controller> <interface type='bridge'> <mac address='52:54:00:81:1b:fe'/> <source bridge='br0'/> <model type='virtio-net'/> <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/> </interface> <serial type='pty'> <target type='isa-serial' port='0'> <model name='isa-serial'/> </target> </serial> <console type='pty'> <target type='serial' port='0'/> </console> <channel type='unix'> <target type='virtio' name='org.qemu.guest_agent.0'/> <address type='virtio-serial' controller='0' bus='0' port='1'/> </channel> <input type='tablet' bus='usb'> <address type='usb' bus='0' port='1'/> </input> <input type='mouse' bus='ps2'/> <input type='keyboard' bus='ps2'/> <tpm model='tpm-tis'> <backend type='emulator' version='2.0' persistent_state='yes'/> </tpm> <audio id='1' type='none'/> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x17' slot='0x00' function='0x0'/> </source> <rom file='/mnt/disks/Samsung_SSD_870_QVO_2TB_S5SUNG0N702589F/Windows 10 Pro/1060.rom'/> <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0' multifunction='on'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x17' slot='0x00' function='0x1'/> </source> <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x1'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x06' slot='0x00' function='0x0'/> </source> <alias name='ua-sm2262'/> <address type='pci' domain='0x0000' bus='0x06' slot='0x00' function='0x0'/> </hostdev> <memballoon model='none'/> </devices> <qemu:override> <qemu:device alias='ua-sm2262'> <qemu:frontend> <qemu:property name='x-msix-relocation' type='string' value='bar2'/> </qemu:frontend> </qemu:device> </qemu:override> </domain> Quote Link to comment
steve1977 Posted February 12, 2023 Author Share Posted February 12, 2023 Unfortunately, still gives me the same error (although what feels like after a much longer time). Quote Link to comment
ghost82 Posted February 12, 2023 Share Posted February 12, 2023 Try this: <domain type='kvm'> <name>Windows 11 (Gaming)</name> <uuid>4b3bfbe8-922b-3557-068e-2feb5c741c52</uuid> <metadata> <vmtemplate xmlns="unraid" name="Windows 11" icon="windows11.png" os="windowstpm"/> </metadata> <memory unit='KiB'>16777216</memory> <currentMemory unit='KiB'>16777216</currentMemory> <memoryBacking> <nosharepages/> </memoryBacking> <vcpu placement='static'>16</vcpu> <cputune> <vcpupin vcpu='0' cpuset='6'/> <vcpupin vcpu='1' cpuset='24'/> <vcpupin vcpu='2' cpuset='7'/> <vcpupin vcpu='3' cpuset='25'/> <vcpupin vcpu='4' cpuset='8'/> <vcpupin vcpu='5' cpuset='26'/> <vcpupin vcpu='6' cpuset='9'/> <vcpupin vcpu='7' cpuset='27'/> <vcpupin vcpu='8' cpuset='10'/> <vcpupin vcpu='9' cpuset='28'/> <vcpupin vcpu='10' cpuset='11'/> <vcpupin vcpu='11' cpuset='29'/> <vcpupin vcpu='12' cpuset='12'/> <vcpupin vcpu='13' cpuset='30'/> <vcpupin vcpu='14' cpuset='13'/> <vcpupin vcpu='15' cpuset='31'/> </cputune> <os> <type arch='x86_64' machine='pc-q35-7.1'>hvm</type> <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd</loader> <nvram>/etc/libvirt/qemu/nvram/4b3bfbe8-922b-3557-068e-2feb5c741c52_VARS-pure-efi-tpm.fd</nvram> </os> <features> <acpi/> <apic/> <hyperv mode='custom'> <relaxed state='on'/> <vapic state='on'/> <spinlocks state='on' retries='8191'/> <vendor_id state='on' value='none'/> </hyperv> </features> <cpu mode='host-passthrough' check='none' migratable='on'> <topology sockets='1' dies='1' cores='8' threads='2'/> <cache mode='passthrough'/> </cpu> <clock offset='localtime'> <timer name='hypervclock' present='yes'/> <timer name='hpet' present='no'/> </clock> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/local/sbin/qemu</emulator> <disk type='file' device='disk'> <driver name='qemu' type='raw' cache='writeback'/> <source file='/mnt/disks/Samsung_SSD_870_QVO_2TB_S5SUNG0N702589F/Windows 10 Pro/vdisk1.img'/> <target dev='hdc' bus='virtio'/> <boot order='1'/> <address type='pci' domain='0x0000' bus='0x03' slot='0x00' function='0x0'/> </disk> <controller type='usb' index='0' model='ich9-ehci1'> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/> </controller> <controller type='usb' index='0' model='ich9-uhci1'> <master startport='0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/> </controller> <controller type='usb' index='0' model='ich9-uhci2'> <master startport='2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1' multifunction='on'/> </controller> <controller type='usb' index='0' model='ich9-uhci3'> <master startport='4'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/> </controller> <controller type='pci' index='3' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='3' port='0x12'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x2'/> </controller> <controller type='pci' index='4' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='4' port='0x13'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x3'/> </controller> <controller type='pci' index='5' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='5' port='0x14'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x4'/> </controller> <controller type='virtio-serial' index='0'> <address type='pci' domain='0x0000' bus='0x02' slot='0x00' function='0x0'/> </controller> <controller type='sata' index='0'> <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/> </controller> <controller type='pci' index='0' model='pcie-root'/> <controller type='pci' index='1' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='1' port='0x8'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0' multifunction='on'/> </controller> <controller type='pci' index='2' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='2' port='0x9'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <controller type='pci' index='6' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='6' port='0xa'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> </controller> <interface type='bridge'> <mac address='52:54:00:81:1b:fe'/> <source bridge='br0'/> <model type='virtio-net'/> <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/> </interface> <serial type='pty'> <target type='isa-serial' port='0'> <model name='isa-serial'/> </target> </serial> <console type='pty'> <target type='serial' port='0'/> </console> <channel type='unix'> <target type='virtio' name='org.qemu.guest_agent.0'/> <address type='virtio-serial' controller='0' bus='0' port='1'/> </channel> <input type='tablet' bus='usb'> <address type='usb' bus='0' port='1'/> </input> <input type='mouse' bus='ps2'/> <input type='keyboard' bus='ps2'/> <tpm model='tpm-tis'> <backend type='emulator' version='2.0' persistent_state='yes'/> </tpm> <audio id='1' type='none'/> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x17' slot='0x00' function='0x0'/> </source> <rom file='/mnt/disks/Samsung_SSD_870_QVO_2TB_S5SUNG0N702589F/Windows 10 Pro/1060.rom'/> <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0' multifunction='on'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x17' slot='0x00' function='0x1'/> </source> <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x1'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x06' slot='0x00' function='0x0'/> </source> <address type='pci' domain='0x0000' bus='0x06' slot='0x00' function='0x0'/> </hostdev> <memballoon model='none'/> </devices> <qemu:override> <qemu:device alias='hostdev2'> <qemu:frontend> <qemu:property name='x-msix-relocation' type='string' value='bar2'/> </qemu:frontend> </qemu:device> </qemu:override> </domain> Quote Link to comment
steve1977 Posted February 12, 2023 Author Share Posted February 12, 2023 Unfortunately still not 😞 Quote Link to comment
ghost82 Posted February 12, 2023 Share Posted February 12, 2023 this one, I missed a thing: <!-- WARNING: THIS IS AN AUTO-GENERATED FILE. CHANGES TO IT ARE LIKELY TO BE OVERWRITTEN AND LOST. Changes to this xml configuration should be made using: virsh edit 4b3bfbe8-922b-3557-068e-2feb5c741c52 or other application using the libvirt API. --> <domain type='kvm' xmlns:qemu='http://libvirt.org/schemas/domain/qemu/1.0'> <name>Windows 11 (Gaming)</name> <uuid>4b3bfbe8-922b-3557-068e-2feb5c741c52</uuid> <metadata> <vmtemplate xmlns="unraid" name="Windows 11" icon="windows11.png" os="windowstpm"/> </metadata> <memory unit='KiB'>16777216</memory> <currentMemory unit='KiB'>16777216</currentMemory> <memoryBacking> <nosharepages/> </memoryBacking> <vcpu placement='static'>16</vcpu> <cputune> <vcpupin vcpu='0' cpuset='6'/> <vcpupin vcpu='1' cpuset='24'/> <vcpupin vcpu='2' cpuset='7'/> <vcpupin vcpu='3' cpuset='25'/> <vcpupin vcpu='4' cpuset='8'/> <vcpupin vcpu='5' cpuset='26'/> <vcpupin vcpu='6' cpuset='9'/> <vcpupin vcpu='7' cpuset='27'/> <vcpupin vcpu='8' cpuset='10'/> <vcpupin vcpu='9' cpuset='28'/> <vcpupin vcpu='10' cpuset='11'/> <vcpupin vcpu='11' cpuset='29'/> <vcpupin vcpu='12' cpuset='12'/> <vcpupin vcpu='13' cpuset='30'/> <vcpupin vcpu='14' cpuset='13'/> <vcpupin vcpu='15' cpuset='31'/> </cputune> <os> <type arch='x86_64' machine='pc-q35-7.1'>hvm</type> <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd</loader> <nvram>/etc/libvirt/qemu/nvram/4b3bfbe8-922b-3557-068e-2feb5c741c52_VARS-pure-efi-tpm.fd</nvram> </os> <features> <acpi/> <apic/> <hyperv mode='custom'> <relaxed state='on'/> <vapic state='on'/> <spinlocks state='on' retries='8191'/> <vendor_id state='on' value='none'/> </hyperv> </features> <cpu mode='host-passthrough' check='none' migratable='on'> <topology sockets='1' dies='1' cores='8' threads='2'/> <cache mode='passthrough'/> </cpu> <clock offset='localtime'> <timer name='hypervclock' present='yes'/> <timer name='hpet' present='no'/> </clock> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/local/sbin/qemu</emulator> <disk type='file' device='disk'> <driver name='qemu' type='raw' cache='writeback'/> <source file='/mnt/disks/Samsung_SSD_870_QVO_2TB_S5SUNG0N702589F/Windows 10 Pro/vdisk1.img'/> <target dev='hdc' bus='virtio'/> <boot order='1'/> <address type='pci' domain='0x0000' bus='0x03' slot='0x00' function='0x0'/> </disk> <controller type='usb' index='0' model='ich9-ehci1'> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/> </controller> <controller type='usb' index='0' model='ich9-uhci1'> <master startport='0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/> </controller> <controller type='usb' index='0' model='ich9-uhci2'> <master startport='2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1' multifunction='on'/> </controller> <controller type='usb' index='0' model='ich9-uhci3'> <master startport='4'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/> </controller> <controller type='pci' index='3' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='3' port='0x12'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x2'/> </controller> <controller type='pci' index='4' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='4' port='0x13'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x3'/> </controller> <controller type='pci' index='5' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='5' port='0x14'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x4'/> </controller> <controller type='virtio-serial' index='0'> <address type='pci' domain='0x0000' bus='0x02' slot='0x00' function='0x0'/> </controller> <controller type='sata' index='0'> <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/> </controller> <controller type='pci' index='0' model='pcie-root'/> <controller type='pci' index='1' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='1' port='0x8'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0' multifunction='on'/> </controller> <controller type='pci' index='2' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='2' port='0x9'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <controller type='pci' index='6' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='6' port='0xa'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> </controller> <interface type='bridge'> <mac address='52:54:00:81:1b:fe'/> <source bridge='br0'/> <model type='virtio-net'/> <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/> </interface> <serial type='pty'> <target type='isa-serial' port='0'> <model name='isa-serial'/> </target> </serial> <console type='pty'> <target type='serial' port='0'/> </console> <channel type='unix'> <target type='virtio' name='org.qemu.guest_agent.0'/> <address type='virtio-serial' controller='0' bus='0' port='1'/> </channel> <input type='tablet' bus='usb'> <address type='usb' bus='0' port='1'/> </input> <input type='mouse' bus='ps2'/> <input type='keyboard' bus='ps2'/> <tpm model='tpm-tis'> <backend type='emulator' version='2.0' persistent_state='yes'/> </tpm> <audio id='1' type='none'/> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x17' slot='0x00' function='0x0'/> </source> <rom file='/mnt/disks/Samsung_SSD_870_QVO_2TB_S5SUNG0N702589F/Windows 10 Pro/1060.rom'/> <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0' multifunction='on'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x17' slot='0x00' function='0x1'/> </source> <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x1'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x06' slot='0x00' function='0x0'/> </source> <alias name='ua-sm2262'/> <address type='pci' domain='0x0000' bus='0x06' slot='0x00' function='0x0'/> </hostdev> <memballoon model='none'/> </devices> <qemu:override> <qemu:device alias='ua-sm2262'> <qemu:frontend> <qemu:property name='x-msix-relocation' type='string' value='bar2'/> </qemu:frontend> </qemu:device> </qemu:override> </domain> Quote Link to comment
steve1977 Posted February 12, 2023 Author Share Posted February 12, 2023 Thanks. There is progress 🙂 I can now start the VM. However, I cannot access the VM via splashtop after starting. I am running it headless, so no other way to check what's going on. Any idea how to troubleshoot? Quote Link to comment
steve1977 Posted February 17, 2023 Author Share Posted February 17, 2023 Any more thoughts? Quote Link to comment
steve1977 Posted March 5, 2023 Author Share Posted March 5, 2023 I have set up everything again from scratch (new VM, newly set up Unraid). Unfortunately, still facing the same issue 😞 I have bind the GPU as well as the NVME disk in system devices. I restarted Unraid. I have passed through the NVME and added it under "other PCI" (ticked in VM settings). Unfortunately, this still gives me the error message below: internal error: qemu unexpectedly closed the monitor: qxl_send_events: spice-server bug: guest stopped, ignoring 2023-03-[removed] qemu-system-x86_64: -device {"driver":"vfio-pci","host":"0000:06:00.0","id":"hostdev0","bus":"pci.5","addr":"0x0"}: vfio 0000:06:00.0: failed to add PCI capability 0x11[0x50]@0xb0: table & pba overlap, or they don't fit in BARs, or don't align After unselecting the NVME disk from "other PCI", the VM stops working completely. I need to set it up agai from scratch to get it working again. Any more thoughts for me? Quote Link to comment
steve1977 Posted March 12, 2023 Author Share Posted March 12, 2023 Any more thoughts and help. I have bind the NVME disk. But when I pass it through (click the button) to the VM, the VM no longer starts. In fact, it doesn't work even if I untick the NVME. I then have to fuilly set up a new VM from scratch. Then it works (but without the NVME passed through). Any idea what else I can do to pass through the NVME as secondary disk to the VM? Or is my only solution to create another image instead of a direct passthrough? Quote Link to comment
ghost82 Posted March 12, 2023 Share Posted March 12, 2023 Apart from what I wrote I have nothing more to add...I hope it's only a user error and that it could work. If you want, contact me in private and I can have a look remotely. I'm located in Italy so take into account gmt +1 Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.