Jump to content
  • [6.12.3] GPU Passthrough to VMs stopped working correctly


    Zeze21
    • Urgent

    Hello there,

     

    I have noticed that the GPU passthrough is broken ever since upgrading to 6.12.3. This gives me quite q few hedaaches, especially since it "sometimes" (sorry i don't have a better word for it since i am no native speaker - so please, if you can find it in your hearts, forgive me). But it does not work "randomly".

    So what's the deal:

    there are 4 gpus in my system 2x 1030 1x 2070 Super and 1x 3060

    My usual setup is: 

    1x 1030 for unraid itself

    1x 1030 for the vm of my wife (windows 11 VM which my wife remotely connects to)

    1x 2070 for my vm (windows 11 VM which i connect to - this is my "workstation")

    1x 3060 for stable diffusion (why this one - well it has 12 gb ram so i can actually produce larger images)

     

    Here comes the headache:

    While both the 1030 work for my wife and my vm, the 2070 and the 3060 do not. And i can not for the life of me figure out why or how to fix this.

    They work however if i pass them through as secondary GPUs with the VNC as primary one.

    If i don't I also get the message that Guest Agent is not installed (which it most certainly is)

     

    Here are some details:

    The VM Engine Settings:

    VM-Manager
    ERWEITERTE ANSICHT
    VMs aktivieren:
    
    Ja
    Libvirt-Version:
    8.7.0
    QEMU-Version:
    7.1.0
    Libvirt-Speicherpfad:
    /mnt/user/system/libvirt/libvirt.img
    Standard VM-Speicherpfad:
    /mnt/user/domains/
    Standard ISO-Speicherpfad:
    /mnt/user/isos/
    Standard Windows VirtIO-Treiber-ISO (Optional):
    
    virtio-win-0.1.229-1.iso
      Entfernen
    Standard Netzwerkquelle:
    
    br0
    Beim Herunterfahren des Hosts:
    
    VMs in den Ruhezustand versetzen (hibernate)
    Timeout für das Herunterfahren einer VM:
    60
    Konsolen-Optionen:
    
    Sowohl Web & Virt-Manager Fernansicht
    PCIe-ACS erzwingen:
    
    Beide
    VFIO Unsichere Unterbrechungen zulassen:
    
    Ja
    Libvirt Volumen-Information
    Btrfs-Dateisystem anzeigen:
    Label: none  uuid: 1631fcfa-7e7c-4395-ad1c-e904d11f28b2
    	Total devices 1 FS bytes used 3.78MiB
    	devid    1 size 100.00GiB used 174.38MiB path /dev/loop3
    
    Btrfs Scrub-Status:
    UUID:             1631fcfa-7e7c-4395-ad1c-e904d11f28b2
    	no stats available
    Total to scrub:   4.00MiB
    Rate:             0.00B/s
    Error summary:    no errors found
     
    Dateisystemfehler korrigieren
    Libvirt wake on lanStatus: Running
    Enable Wake On Lan:
    
    Yes
     
    Libvirt Virtual BMCStatus: Stopped
    Enable Virtual BMC:
    
    No

     

    My VM XML with the 2070 in running state:

    See first Answer to this.

    My VM Log:

    text  error  warn  system  array  login  
    
    -no-hpet \
    -no-shutdown \
    -boot strict=on \
    -device '{"driver":"qemu-xhci","p2":15,"p3":15,"id":"usb","bus":"pci.0","addr":"0x7"}' \
    -device '{"driver":"ahci","id":"sata0","bus":"pci.0","addr":"0x4"}' \
    -device '{"driver":"virtio-serial-pci","id":"virtio-serial0","bus":"pci.0","addr":"0x3"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/domains/Windows 11/vdisk1.img","node-name":"libvirt-2-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-2-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-2-storage"}' \
    -device '{"driver":"virtio-blk-pci","bus":"pci.0","addr":"0x5","drive":"libvirt-2-format","id":"virtio-disk2","bootindex":1,"write-cache":"on"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/isos/virtio-win-0.1.229-1.iso","node-name":"libvirt-1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \
    -device '{"driver":"ide-cd","bus":"sata0.1","drive":"libvirt-1-format","id":"sata0-0-1"}' \
    -netdev tap,fd=44,id=hostnet0 \
    -device '{"driver":"rtl8139","netdev":"hostnet0","id":"net0","mac":"52:54:00:d4:12:7e","bus":"pci.0","addr":"0x2"}' \
    -chardev pty,id=charserial0 \
    -device '{"driver":"isa-serial","chardev":"charserial0","id":"serial0","index":0}' \
    -chardev socket,id=charchannel0,fd=42,server=on,wait=off \
    -device '{"driver":"virtserialport","bus":"virtio-serial0.0","nr":1,"chardev":"charchannel0","id":"channel0","name":"org.qemu.guest_agent.0"}' \
    -chardev 'socket,id=chrtpm,path=/run/libvirt/qemu/swtpm/8-Windows 11-swtpm.sock' \
    -tpmdev emulator,id=tpm-tpm0,chardev=chrtpm \
    -device '{"driver":"tpm-tis","tpmdev":"tpm-tpm0","id":"tpm0"}' \
    -device '{"driver":"usb-tablet","id":"input0","bus":"usb.0","port":"1"}' \
    -audiodev '{"id":"audio1","driver":"none"}' \
    -device '{"driver":"vfio-pci","host":"0000:43:00.0","id":"hostdev0","bus":"pci.0","addr":"0x6","romfile":"/mnt/user/isos/vbios/GeForce GT 1030 2.rom"}' \
    -device '{"driver":"vfio-pci","host":"0000:43:00.1","id":"hostdev1","bus":"pci.0","addr":"0x8"}' \
    -sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
    -msg timestamp=on
    char device redirected to /dev/pts/1 (label charserial0)
    2023-08-05T12:40:48.273010Z qemu-system-x86_64: terminating on signal 15 from pid 11566 (/usr/sbin/libvirtd)
    2023-08-05 12:40:48.873+0000: shutting down, reason=destroyed
    2023-08-05 12:41:56.856+0000: Starting external device: TPM Emulator
    /usr/bin/swtpm socket --ctrl 'type=unixio,path=/run/libvirt/qemu/swtpm/9-Windows 11-swtpm.sock,mode=0600' --tpmstate dir=/var/lib/libvirt/swtpm/bed95bbc-2cfd-1316-25d9-aa74fadc0ff0/tpm2,mode=0600 --log 'file=/var/log/swtpm/libvirt/qemu/Windows 11-swtpm.log' --terminate --tpm2
    2023-08-05 12:41:56.922+0000: starting up libvirt version: 8.7.0, qemu version: 7.1.0, kernel: 6.1.38-Unraid, hostname: Server
    LC_ALL=C \
    PATH=/bin:/sbin:/usr/bin:/usr/sbin \
    HOME='/var/lib/libvirt/qemu/domain-9-Windows 11' \
    XDG_DATA_HOME='/var/lib/libvirt/qemu/domain-9-Windows 11/.local/share' \
    XDG_CACHE_HOME='/var/lib/libvirt/qemu/domain-9-Windows 11/.cache' \
    XDG_CONFIG_HOME='/var/lib/libvirt/qemu/domain-9-Windows 11/.config' \
    /usr/local/sbin/qemu \
    -name 'guest=Windows 11,debug-threads=on' \
    -S \
    -object '{"qom-type":"secret","id":"masterKey0","format":"raw","file":"/var/lib/libvirt/qemu/domain-9-Windows 11/master-key.aes"}' \
    -blockdev '{"driver":"file","filename":"/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd","node-name":"libvirt-pflash0-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-pflash0-format","read-only":true,"driver":"raw","file":"libvirt-pflash0-storage"}' \
    -blockdev '{"driver":"file","filename":"/etc/libvirt/qemu/nvram/bed95bbc-2cfd-1316-25d9-aa74fadc0ff0_VARS-pure-efi-tpm.fd","node-name":"libvirt-pflash1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-pflash1-format","read-only":false,"driver":"raw","file":"libvirt-pflash1-storage"}' \
    -machine pc-i440fx-6.2,usb=off,dump-guest-core=off,mem-merge=off,memory-backend=pc.ram,pflash0=libvirt-pflash0-format,pflash1=libvirt-pflash1-format \
    -accel kvm \
    -cpu host,migratable=on,topoext=on,hv-time=on,hv-relaxed=on,hv-vapic=on,hv-spinlocks=0x1fff,hv-vendor-id=none,host-cache-info=on,l3-cache=off \
    -m 15872 \
    -object '{"qom-type":"memory-backend-ram","id":"pc.ram","size":16642998272}' \
    -overcommit mem-lock=off \
    -smp 16,sockets=1,dies=1,cores=8,threads=2 \
    -uuid bed95bbc-2cfd-1316-25d9-aa74fadc0ff0 \
    -display none \
    -no-user-config \
    -nodefaults \
    -chardev socket,id=charmonitor,fd=42,server=on,wait=off \
    -mon chardev=charmonitor,id=monitor,mode=control \
    -rtc base=localtime \
    -no-hpet \
    -no-shutdown \
    -boot strict=on \
    -device '{"driver":"qemu-xhci","p2":15,"p3":15,"id":"usb","bus":"pci.0","addr":"0x7"}' \
    -device '{"driver":"ahci","id":"sata0","bus":"pci.0","addr":"0x4"}' \
    -device '{"driver":"virtio-serial-pci","id":"virtio-serial0","bus":"pci.0","addr":"0x3"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/domains/Windows 11/vdisk1.img","node-name":"libvirt-2-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-2-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-2-storage"}' \
    -device '{"driver":"virtio-blk-pci","bus":"pci.0","addr":"0x5","drive":"libvirt-2-format","id":"virtio-disk2","bootindex":1,"write-cache":"on"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/isos/virtio-win-0.1.229-1.iso","node-name":"libvirt-1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \
    -device '{"driver":"ide-cd","bus":"sata0.1","drive":"libvirt-1-format","id":"sata0-0-1"}' \
    -netdev tap,fd=43,id=hostnet0 \
    -device '{"driver":"rtl8139","netdev":"hostnet0","id":"net0","mac":"52:54:00:d4:12:7e","bus":"pci.0","addr":"0x2"}' \
    -chardev pty,id=charserial0 \
    -device '{"driver":"isa-serial","chardev":"charserial0","id":"serial0","index":0}' \
    -chardev socket,id=charchannel0,fd=41,server=on,wait=off \
    -device '{"driver":"virtserialport","bus":"virtio-serial0.0","nr":1,"chardev":"charchannel0","id":"channel0","name":"org.qemu.guest_agent.0"}' \
    -chardev 'socket,id=chrtpm,path=/run/libvirt/qemu/swtpm/9-Windows 11-swtpm.sock' \
    -tpmdev emulator,id=tpm-tpm0,chardev=chrtpm \
    -device '{"driver":"tpm-tis","tpmdev":"tpm-tpm0","id":"tpm0"}' \
    -device '{"driver":"usb-tablet","id":"input0","bus":"usb.0","port":"1"}' \
    -audiodev '{"id":"audio1","driver":"none"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.0","id":"hostdev0","bus":"pci.0","addr":"0x6","romfile":"/mnt/user/isos/vbios/GeForce RTX 2070 SUPER.rom"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.1","id":"hostdev1","bus":"pci.0","addr":"0x8"}' \
    -sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
    -msg timestamp=on
    char device redirected to /dev/pts/1 (label charserial0)
    2023-08-05T12:41:59.759905Z qemu-system-x86_64: vfio: Cannot reset device 0000:08:00.1, depends on group 28 which is not owned.
    

    For comparison this is my wife's VM which works with the 1030 in running state:

    <?xml version='1.0' encoding='UTF-8'?>
    <domain type='kvm' id='7'>
      <name>Stephanie</name>
      <uuid>0589c19d-6ec9-bbad-a5c7-5bf300f19604</uuid>
      <description>Stephanies Computer</description>
      <metadata>
        <vmtemplate xmlns="unraid" name="Windows 11" icon="windows11.png" os="windowstpm"/>
      </metadata>
      <memory unit='KiB'>12582912</memory>
      <currentMemory unit='KiB'>12582912</currentMemory>
      <memoryBacking>
        <nosharepages/>
      </memoryBacking>
      <vcpu placement='static'>8</vcpu>
      <cputune>
        <vcpupin vcpu='0' cpuset='12'/>
        <vcpupin vcpu='1' cpuset='28'/>
        <vcpupin vcpu='2' cpuset='13'/>
        <vcpupin vcpu='3' cpuset='29'/>
        <vcpupin vcpu='4' cpuset='14'/>
        <vcpupin vcpu='5' cpuset='30'/>
        <vcpupin vcpu=

     

    The System Devices:

    IOMMU group 0:				[1022:1452] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    IOMMU group 1:				[1022:1453] 00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
    IOMMU group 2:				[1022:1453] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
    IOMMU group 3:				[1022:1452] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    IOMMU group 4:				[1022:1452] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    IOMMU group 5:				[1022:1453] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
    IOMMU group 6:				[1022:1452] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    IOMMU group 7:				[1022:1452] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    IOMMU group 8:				[1022:1454] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
    IOMMU group 9:				[1022:1452] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    IOMMU group 10:				[1022:1454] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
    IOMMU group 11:			 	[1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
     	[1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
    IOMMU group 12:				[1022:1460] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
    [1022:1461] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
    [1022:1462] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
    [1022:1463] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
    [1022:1464] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
    [1022:1465] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
    [1022:1466] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6
    [1022:1467] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
    IOMMU group 13:				[1022:1460] 00:19.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
    [1022:1461] 00:19.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
    [1022:1462] 00:19.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
    [1022:1463] 00:19.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
    [1022:1464] 00:19.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
    [1022:1465] 00:19.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
    [1022:1466] 00:19.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6
    [1022:1467] 00:19.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
    IOMMU group 14:			 	[1022:43ba] 01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset USB 3.1 xHCI Controller (rev 02)
    Bus 001 Device 001 Port 1-0		ID 1d6b:0002 Linux Foundation 2.0 root hub
    Bus 001 Device 002 Port 1-2		ID 0764:0501 Cyber Power System, Inc. CP1500 AVR UPS
    Bus 001 Device 003 Port 1-9		ID 8087:0aa7 Intel Corp. Wireless-AC 3168 Bluetooth
    Bus 002 Device 001 Port 2-0		ID 1d6b:0003 Linux Foundation 3.0 root hub
    IOMMU group 15:			 	[1022:43b6] 01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset SATA Controller (rev 02)
    [2:0:0:0]    disk    ATA      WDC WD101EMAZ-11 0A81  /dev/sdc   10.0TB
    [3:0:0:0]    disk    ATA      WDC WD100EFAX-68 0A83  /dev/sdd   10.0TB
    [4:0:0:0]    disk    ATA      WDC WD100EFAX-68 0A83  /dev/sde   10.0TB
    [5:0:0:0]    disk    ATA      WDC WD100EFAX-68 0A83  /dev/sdf   10.0TB
    [6:0:0:0]    disk    ATA      WDC WD101EFBX-68 0A85  /dev/sdg   10.0TB
    [8:0:0:0]    disk    ATA      WDC WD100EFAX-68 0A83  /dev/sdh   10.0TB
    [9:0:0:0]    disk    ATA      WDC WD101EFBX-68 0A85  /dev/sdi   10.0TB
    [7:0:0:0]    cd/dvd  ATAPI    iHOS104          WL0F  /dev/sr0    491MB
    IOMMU group 16:				[1022:43b1] 01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset PCIe Bridge (rev 02)
    IOMMU group 17:				[1022:43b4] 02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
    IOMMU group 18:				[1022:43b4] 02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
    IOMMU group 19:				[1022:43b4] 02:05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
    IOMMU group 20:				[1022:43b4] 02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
    IOMMU group 21:				[1022:43b4] 02:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
    IOMMU group 22:			 	[1d6a:07b1] 03:00.0 Ethernet controller: Aquantia Corp. AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] (rev 02)
    IOMMU group 23:			 	[8086:1539] 04:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
    IOMMU group 24:			 	[8086:24fb] 05:00.0 Network controller: Intel Corporation Dual Band Wireless-AC 3168NGW [Stone Peak] (rev 10)
    IOMMU group 25:			 	[8086:1539] 06:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
    IOMMU group 26:			 	[10de:1e84] 08:00.0 VGA compatible controller: NVIDIA Corporation TU104 [GeForce RTX 2070 SUPER] (rev a1)
    IOMMU group 27:			 	[10de:10f8] 08:00.1 Audio device: NVIDIA Corporation TU104 HD Audio Controller (rev a1)
    IOMMU group 28:			 	[10de:1ad8] 08:00.2 USB controller: NVIDIA Corporation TU104 USB 3.1 Host Controller (rev a1)
    Dieser Controller ist an vfio gebunden, angeschlossene USB-Geräte sind nicht sichtbar.
    IOMMU group 29:			 	[10de:1ad9] 08:00.3 Serial bus controller: NVIDIA Corporation TU104 USB Type-C UCSI Controller (rev a1)
    IOMMU group 30:			 	[10de:1d01] 09:00.0 VGA compatible controller: NVIDIA Corporation GP108 [GeForce GT 1030] (rev a1)
    IOMMU group 31:			 	[10de:0fb8] 09:00.1 Audio device: NVIDIA Corporation GP108 High Definition Audio Controller (rev a1)
    IOMMU group 32:			 	[1022:145a] 0a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function
    IOMMU group 33:			 	[1022:1456] 0a:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor (PSP) 3.0 Device
    IOMMU group 34:			 	[1022:145c] 0a:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
    Bus 005 Device 001 Port 5-0		ID 1d6b:0002 Linux Foundation 2.0 root hub
    Bus 005 Device 002 Port 5-1		ID 10c4:ea60 Silicon Labs CP210x UART Bridge
    Bus 005 Device 003 Port 5-2		ID 2357:0604 TP-Link TP-Link UB5A Adapter
    Bus 006 Device 001 Port 6-0		ID 1d6b:0003 Linux Foundation 3.0 root hub
    Bus 006 Device 002 Port 6-4		ID 1058:25a3 Western Digital Technologies, Inc. Elements Desktop (WDBWLG)
    Bus 006 Device 003 Port 6-3		ID 1a6e:089a Global Unichip Corp.
    IOMMU group 35:			 	[1022:1455] 0b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function
    IOMMU group 36:			 	[1022:7901] 0b:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
    IOMMU group 37:			 	[1022:1457] 0b:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) HD Audio Controller
    IOMMU group 38:				[1022:1452] 40:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    IOMMU group 39:				[1022:1453] 40:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
    IOMMU group 40:				[1022:1453] 40:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
    IOMMU group 41:				[1022:1453] 40:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
    IOMMU group 42:				[1022:1452] 40:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    IOMMU group 43:				[1022:1452] 40:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    IOMMU group 44:				[1022:1453] 40:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
    IOMMU group 45:				[1022:1452] 40:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    IOMMU group 46:				[1022:1452] 40:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    IOMMU group 47:				[1022:1454] 40:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
    IOMMU group 48:				[1022:1452] 40:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    IOMMU group 49:				[1022:1454] 40:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
    IOMMU group 50:			 	[2646:5017] 41:00.0 Non-Volatile memory controller: Kingston Technology Company, Inc. Device 5017 (rev 03)
    [N:0:1:1]    disk    KINGSTON SNV2S2000G__1                     /dev/nvme0n1  2.00TB
    IOMMU group 51:			 	[2646:5017] 42:00.0 Non-Volatile memory controller: Kingston Technology Company, Inc. Device 5017 (rev 03)
    [N:1:1:1]    disk    KINGSTON SNV2S2000G__1                     /dev/nvme1n1  2.00TB
    IOMMU group 52:			 	[10de:1d01] 43:00.0 VGA compatible controller: NVIDIA Corporation GP108 [GeForce GT 1030] (rev a1)
    IOMMU group 53:			 	[10de:0fb8] 43:00.1 Audio device: NVIDIA Corporation GP108 High Definition Audio Controller (rev a1)
    IOMMU group 54:			 	[10de:2504] 44:00.0 VGA compatible controller: NVIDIA Corporation GA106 [GeForce RTX 3060 Lite Hash Rate] (rev a1)
    IOMMU group 55:			 	[10de:228e] 44:00.1 Audio device: NVIDIA Corporation GA106 High Definition Audio Controller (rev a1)
    IOMMU group 56:			 	[1022:145a] 45:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function
    IOMMU group 57:			 	[1022:1456] 45:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor (PSP) 3.0 Device
    IOMMU group 58:			 	[1022:145c] 45:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
    Bus 007 Device 001 Port 7-0		ID 1d6b:0002 Linux Foundation 2.0 root hub
    Bus 007 Device 002 Port 7-1		ID 0781:5571 SanDisk Corp. Cruzer Fit
    Bus 007 Device 003 Port 7-2		ID 1267:0103 Logic3 / SpectraVideo plc G-720 Keyboard
    Bus 008 Device 001 Port 8-0		ID 1d6b:0003 Linux Foundation 3.0 root hub
    IOMMU group 59:			 	[1022:1455] 46:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function
    IOMMU group 60:			 	[1022:7901] 46:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)

    Syslog and Diagnostics are attached.

    It seems that I am not the only one with this problem.

    This is just to let the developers know that this might be something to look into.

     

    server-syslog-20230805-1355.zip server-diagnostics-20230805-1553.zip




    User Feedback

    Recommended Comments

    <?xml version='1.0' encoding='UTF-8'?>
    <domain type='kvm' id='9'>
      <name>Windows 11</name>
      <uuid>bed95bbc-2cfd-1316-25d9-aa74fadc0ff0</uuid>
      <description>Matthias Pc</description>
      <metadata>
        <vmtemplate xmlns="unraid" name="Windows 11" icon="windows11.png" os="windowstpm"/>
      </metadata>
      <memory unit='KiB'>16252928</memory>
      <currentMemory unit='KiB'>16252928</currentMemory>
      <memoryBacking>
        <nosharepages/>
      </memoryBacking>
      <vcpu placement='static'>16</vcpu>
      <cputune>
        <vcpupin vcpu='0' cpuset='8'/>
        <vcpupin vcpu='1' cpuset='24'/>
        <vcpupin vcpu='2' cpuset='9'/>
        <vcpupin vcpu='3' cpuset='25'/>
        <vcpupin vcpu='4' cpuset='10'/>
        <vcpupin vcpu='5' cpuset='26'/>
        <vcpupin vcpu='6' cpuset='11'/>
        <vcpupin vcpu='7' cpuset='27'/>
        <vcpupin vcpu='8' cpuset='12'/>
        <vcpupin vcpu='9' cpuset='28'/>
        <vcpupin vcpu='10' cpuset='13'/>
        <vcpupin vcpu='11' cpuset='29'/>
        <vcpupin vcpu='12' cpuset='14'/>
        <vcpupin vcpu='13' cpuset='30'/>
        <vcpupin vcpu='14' cpuset='15'/>
        <vcpupin vcpu='15' cpuset='31'/>
      </cputune>
      <resource>
        <partition>/machine</partition>
      </resource>
      <os>
        <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
        <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd</loader>
        <nvram>/etc/libvirt/qemu/nvram/bed95bbc-2cfd-1316-25d9-aa74fadc0ff0_VARS-pure-efi-tpm.fd</nvram>
      </os>
      <features>
        <acpi/>
        <apic/>
        <hyperv mode='custom'>
          <relaxed state='on'/>
          <vapic state='on'/>
          <spinlocks state='on' retries='8191'/>
          <vendor_id state='on' value='none'/>
        </hyperv>
      </features>
      <cpu mode='host-passthrough' check='none' migratable='on'>
        <topology sockets='1' dies='1' cores='8' threads='2'/>
        <cache mode='passthrough'/>
        <feature policy='require' name='topoext'/>
      </cpu>
      <clock offset='localtime'>
        <timer name='hypervclock' present='yes'/>
        <timer name='hpet' present='no'/>
      </clock>
      <on_poweroff>destroy</on_poweroff>
      <on_reboot>restart</on_reboot>
      <on_crash>restart</on_crash>
      <devices>
        <emulator>/usr/local/sbin/qemu</emulator>
        <disk type='file' device='disk'>
          <driver name='qemu' type='raw' cache='writeback'/>
          <source file='/mnt/user/domains/Windows 11/vdisk1.img' index='2'/>
          <backingStore/>
          <target dev='hdc' bus='virtio'/>
          <boot order='1'/>
          <alias name='virtio-disk2'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
        </disk>
        <disk type='file' device='cdrom'>
          <driver name='qemu' type='raw'/>
          <source file='/mnt/user/isos/virtio-win-0.1.229-1.iso' index='1'/>
          <backingStore/>
          <target dev='hdb' bus='sata'/>
          <readonly/>
          <alias name='sata0-0-1'/>
          <address type='drive' controller='0' bus='0' target='0' unit='1'/>
        </disk>
        <controller type='usb' index='0' model='qemu-xhci' ports='15'>
          <alias name='usb'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
        </controller>
        <controller type='pci' index='0' model='pci-root'>
          <alias name='pci.0'/>
        </controller>
        <controller type='sata' index='0'>
          <alias name='sata0'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
        </controller>
        <controller type='virtio-serial' index='0'>
          <alias name='virtio-serial0'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
        </controller>
        <interface type='bridge'>
          <mac address='52:54:00:d4:12:7e'/>
          <source bridge='br0'/>
          <target dev='vnet7'/>
          <model type='rtl8139'/>
          <alias name='net0'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
        </interface>
        <serial type='pty'>
          <source path='/dev/pts/1'/>
          <target type='isa-serial' port='0'>
            <model name='isa-serial'/>
          </target>
          <alias name='serial0'/>
        </serial>
        <console type='pty' tty='/dev/pts/1'>
          <source path='/dev/pts/1'/>
          <target type='serial' port='0'/>
          <alias name='serial0'/>
        </console>
        <channel type='unix'>
          <source mode='bind' path='/var/lib/libvirt/qemu/channel/target/domain-9-Windows 11/org.qemu.guest_agent.0'/>
          <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/>
          <alias name='channel0'/>
          <address type='virtio-serial' controller='0' bus='0' port='1'/>
        </channel>
        <input type='tablet' bus='usb'>
          <alias name='input0'/>
          <address type='usb' bus='0' port='1'/>
        </input>
        <input type='mouse' bus='ps2'>
          <alias name='input1'/>
        </input>
        <input type='keyboard' bus='ps2'>
          <alias name='input2'/>
        </input>
        <tpm model='tpm-tis'>
          <backend type='emulator' version='2.0' persistent_state='yes'/>
          <alias name='tpm0'/>
        </tpm>
        <audio id='1' type='none'/>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x08' slot='0x00' function='0x0'/>
          </source>
          <alias name='hostdev0'/>
          <rom file='/mnt/user/isos/vbios/GeForce RTX 2070 SUPER.rom'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
        </hostdev>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x08' slot='0x00' function='0x1'/>
          </source>
          <alias name='hostdev1'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>
        </hostdev>
        <memballoon model='none'/>
      </devices>
      <seclabel type='dynamic' model='dac' relabel='yes'>
        <label>+0:+100</label>
        <imagelabel>+0:+100</imagelabel>
      </seclabel>
    </domain>

    As promised this is my VM XML in running state with the 2070

    Link to comment

    I am not able review in depth at present but are all virtio drivers installed and latest? virt serial ones are required for gest agent to be reconised also.

    Link to comment

    I have removed and reinstalled all virtio drivers so they should be up to date... I am concerned about this line in the log file:

     

    2023-08-05T12:41:59.759905Z qemu-system-x86_64: vfio: Cannot reset device 0000:08:00.1, depends on group 28 which is not owned

    Link to comment
    6 minutes ago, Zeze21 said:

    I have removed and reinstalled all virtio drivers so they should be up to date... I am concerned about this line in the log file:

     

    2023-08-05T12:41:59.759905Z qemu-system-x86_64: vfio: Cannot reset device 0000:08:00.1, depends on group 28 which is not owned

    do you have all of the 8.x parts passed thru to vm?

    Link to comment

    Apparently i hadn't but unfortunately the guest agent still does not show up as installed, when in fact it is.

     

    -boot strict=on \
    -device '{"driver":"qemu-xhci","p2":15,"p3":15,"id":"usb","bus":"pci.0","addr":"0x7"}' \
    -device '{"driver":"ahci","id":"sata0","bus":"pci.0","addr":"0x4"}' \
    -device '{"driver":"virtio-serial-pci","id":"virtio-serial0","bus":"pci.0","addr":"0x3"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/domains/Windows 11/vdisk1.img","node-name":"libvirt-2-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-2-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-2-storage"}' \
    -device '{"driver":"virtio-blk-pci","bus":"pci.0","addr":"0x5","drive":"libvirt-2-format","id":"virtio-disk2","bootindex":1,"write-cache":"on"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/isos/virtio-win-0.1.229-1.iso","node-name":"libvirt-1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \
    -device '{"driver":"ide-cd","bus":"sata0.1","drive":"libvirt-1-format","id":"sata0-0-1"}' \
    -netdev tap,fd=43,id=hostnet0 \
    -device '{"driver":"rtl8139","netdev":"hostnet0","id":"net0","mac":"52:54:00:d4:12:7e","bus":"pci.0","addr":"0x2"}' \
    -chardev pty,id=charserial0 \
    -device '{"driver":"isa-serial","chardev":"charserial0","id":"serial0","index":0}' \
    -chardev socket,id=charchannel0,fd=41,server=on,wait=off \
    -device '{"driver":"virtserialport","bus":"virtio-serial0.0","nr":1,"chardev":"charchannel0","id":"channel0","name":"org.qemu.guest_agent.0"}' \
    -chardev 'socket,id=chrtpm,path=/run/libvirt/qemu/swtpm/9-Windows 11-swtpm.sock' \
    -tpmdev emulator,id=tpm-tpm0,chardev=chrtpm \
    -device '{"driver":"tpm-tis","tpmdev":"tpm-tpm0","id":"tpm0"}' \
    -device '{"driver":"usb-tablet","id":"input0","bus":"usb.0","port":"1"}' \
    -audiodev '{"id":"audio1","driver":"none"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.0","id":"hostdev0","bus":"pci.0","addr":"0x6","romfile":"/mnt/user/isos/vbios/GeForce RTX 2070 SUPER.rom"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.1","id":"hostdev1","bus":"pci.0","addr":"0x8"}' \
    -sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
    -msg timestamp=on
    char device redirected to /dev/pts/1 (label charserial0)
    2023-08-05T12:41:59.759905Z qemu-system-x86_64: vfio: Cannot reset device 0000:08:00.1, depends on group 28 which is not owned.
    2023-08-05T18:12:29.580567Z qemu-system-x86_64: terminating on signal 15 from pid 11566 (/usr/sbin/libvirtd)
    2023-08-05 18:12:30.181+0000: shutting down, reason=destroyed
    2023-08-05 18:12:52.719+0000: Starting external device: TPM Emulator
    /usr/bin/swtpm socket --ctrl 'type=unixio,path=/run/libvirt/qemu/swtpm/10-Windows 11-swtpm.sock,mode=0600' --tpmstate dir=/var/lib/libvirt/swtpm/bed95bbc-2cfd-1316-25d9-aa74fadc0ff0/tpm2,mode=0600 --log 'file=/var/log/swtpm/libvirt/qemu/Windows 11-swtpm.log' --terminate --tpm2
    2023-08-05 18:12:52.785+0000: starting up libvirt version: 8.7.0, qemu version: 7.1.0, kernel: 6.1.38-Unraid, hostname: Server
    LC_ALL=C \
    PATH=/bin:/sbin:/usr/bin:/usr/sbin \
    HOME='/var/lib/libvirt/qemu/domain-10-Windows 11' \
    XDG_DATA_HOME='/var/lib/libvirt/qemu/domain-10-Windows 11/.local/share' \
    XDG_CACHE_HOME='/var/lib/libvirt/qemu/domain-10-Windows 11/.cache' \
    XDG_CONFIG_HOME='/var/lib/libvirt/qemu/domain-10-Windows 11/.config' \
    /usr/local/sbin/qemu \
    -name 'guest=Windows 11,debug-threads=on' \
    -S \
    -object '{"qom-type":"secret","id":"masterKey0","format":"raw","file":"/var/lib/libvirt/qemu/domain-10-Windows 11/master-key.aes"}' \
    -blockdev '{"driver":"file","filename":"/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd","node-name":"libvirt-pflash0-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-pflash0-format","read-only":true,"driver":"raw","file":"libvirt-pflash0-storage"}' \
    -blockdev '{"driver":"file","filename":"/etc/libvirt/qemu/nvram/bed95bbc-2cfd-1316-25d9-aa74fadc0ff0_VARS-pure-efi-tpm.fd","node-name":"libvirt-pflash1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-pflash1-format","read-only":false,"driver":"raw","file":"libvirt-pflash1-storage"}' \
    -machine pc-i440fx-6.2,usb=off,dump-guest-core=off,mem-merge=off,memory-backend=pc.ram,pflash0=libvirt-pflash0-format,pflash1=libvirt-pflash1-format \
    -accel kvm \
    -cpu host,migratable=on,topoext=on,hv-time=on,hv-relaxed=on,hv-vapic=on,hv-spinlocks=0x1fff,hv-vendor-id=none,host-cache-info=on,l3-cache=off \
    -m 15872 \
    -object '{"qom-type":"memory-backend-ram","id":"pc.ram","size":16642998272}' \
    -overcommit mem-lock=off \
    -smp 16,sockets=1,dies=1,cores=8,threads=2 \
    -uuid bed95bbc-2cfd-1316-25d9-aa74fadc0ff0 \
    -display none \
    -no-user-config \
    -nodefaults \
    -chardev socket,id=charmonitor,fd=42,server=on,wait=off \
    -mon chardev=charmonitor,id=monitor,mode=control \
    -rtc base=localtime \
    -no-hpet \
    -no-shutdown \
    -boot strict=on \
    -device '{"driver":"qemu-xhci","p2":15,"p3":15,"id":"usb","bus":"pci.0","addr":"0x7"}' \
    -device '{"driver":"ahci","id":"sata0","bus":"pci.0","addr":"0x4"}' \
    -device '{"driver":"virtio-serial-pci","id":"virtio-serial0","bus":"pci.0","addr":"0x3"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/domains/Windows 11/vdisk1.img","node-name":"libvirt-2-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-2-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-2-storage"}' \
    -device '{"driver":"virtio-blk-pci","bus":"pci.0","addr":"0x5","drive":"libvirt-2-format","id":"virtio-disk2","bootindex":1,"write-cache":"on"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/isos/virtio-win-0.1.229-1.iso","node-name":"libvirt-1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \
    -device '{"driver":"ide-cd","bus":"sata0.1","drive":"libvirt-1-format","id":"sata0-0-1"}' \
    -netdev tap,fd=43,id=hostnet0 \
    -device '{"driver":"rtl8139","netdev":"hostnet0","id":"net0","mac":"52:54:00:d4:12:7e","bus":"pci.0","addr":"0x2"}' \
    -chardev pty,id=charserial0 \
    -device '{"driver":"isa-serial","chardev":"charserial0","id":"serial0","index":0}' \
    -chardev socket,id=charchannel0,fd=41,server=on,wait=off \
    -device '{"driver":"virtserialport","bus":"virtio-serial0.0","nr":1,"chardev":"charchannel0","id":"channel0","name":"org.qemu.guest_agent.0"}' \
    -chardev 'socket,id=chrtpm,path=/run/libvirt/qemu/swtpm/10-Windows 11-swtpm.sock' \
    -tpmdev emulator,id=tpm-tpm0,chardev=chrtpm \
    -device '{"driver":"tpm-tis","tpmdev":"tpm-tpm0","id":"tpm0"}' \
    -device '{"driver":"usb-tablet","id":"input0","bus":"usb.0","port":"1"}' \
    -audiodev '{"id":"audio1","driver":"none"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.0","id":"hostdev0","bus":"pci.0","addr":"0x6","romfile":"/mnt/user/isos/vbios/GeForce RTX 2070 SUPER.rom"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.1","id":"hostdev1","bus":"pci.0","addr":"0x8"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.2","id":"hostdev2","bus":"pci.0","addr":"0x9"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.3","id":"hostdev3","bus":"pci.0","addr":"0xa"}' \
    -sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
    -msg timestamp=on
    char device redirected to /dev/pts/1 (label charserial0)

     

    Link to comment
    6 minutes ago, Zeze21 said:

    Apparently i hadn't but unfortunately the guest agent still does not show up as installed, when in fact it is.

     

    -boot strict=on \
    -device '{"driver":"qemu-xhci","p2":15,"p3":15,"id":"usb","bus":"pci.0","addr":"0x7"}' \
    -device '{"driver":"ahci","id":"sata0","bus":"pci.0","addr":"0x4"}' \
    -device '{"driver":"virtio-serial-pci","id":"virtio-serial0","bus":"pci.0","addr":"0x3"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/domains/Windows 11/vdisk1.img","node-name":"libvirt-2-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-2-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-2-storage"}' \
    -device '{"driver":"virtio-blk-pci","bus":"pci.0","addr":"0x5","drive":"libvirt-2-format","id":"virtio-disk2","bootindex":1,"write-cache":"on"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/isos/virtio-win-0.1.229-1.iso","node-name":"libvirt-1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \
    -device '{"driver":"ide-cd","bus":"sata0.1","drive":"libvirt-1-format","id":"sata0-0-1"}' \
    -netdev tap,fd=43,id=hostnet0 \
    -device '{"driver":"rtl8139","netdev":"hostnet0","id":"net0","mac":"52:54:00:d4:12:7e","bus":"pci.0","addr":"0x2"}' \
    -chardev pty,id=charserial0 \
    -device '{"driver":"isa-serial","chardev":"charserial0","id":"serial0","index":0}' \
    -chardev socket,id=charchannel0,fd=41,server=on,wait=off \
    -device '{"driver":"virtserialport","bus":"virtio-serial0.0","nr":1,"chardev":"charchannel0","id":"channel0","name":"org.qemu.guest_agent.0"}' \
    -chardev 'socket,id=chrtpm,path=/run/libvirt/qemu/swtpm/9-Windows 11-swtpm.sock' \
    -tpmdev emulator,id=tpm-tpm0,chardev=chrtpm \
    -device '{"driver":"tpm-tis","tpmdev":"tpm-tpm0","id":"tpm0"}' \
    -device '{"driver":"usb-tablet","id":"input0","bus":"usb.0","port":"1"}' \
    -audiodev '{"id":"audio1","driver":"none"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.0","id":"hostdev0","bus":"pci.0","addr":"0x6","romfile":"/mnt/user/isos/vbios/GeForce RTX 2070 SUPER.rom"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.1","id":"hostdev1","bus":"pci.0","addr":"0x8"}' \
    -sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
    -msg timestamp=on
    char device redirected to /dev/pts/1 (label charserial0)
    2023-08-05T12:41:59.759905Z qemu-system-x86_64: vfio: Cannot reset device 0000:08:00.1, depends on group 28 which is not owned.
    2023-08-05T18:12:29.580567Z qemu-system-x86_64: terminating on signal 15 from pid 11566 (/usr/sbin/libvirtd)
    2023-08-05 18:12:30.181+0000: shutting down, reason=destroyed
    2023-08-05 18:12:52.719+0000: Starting external device: TPM Emulator
    /usr/bin/swtpm socket --ctrl 'type=unixio,path=/run/libvirt/qemu/swtpm/10-Windows 11-swtpm.sock,mode=0600' --tpmstate dir=/var/lib/libvirt/swtpm/bed95bbc-2cfd-1316-25d9-aa74fadc0ff0/tpm2,mode=0600 --log 'file=/var/log/swtpm/libvirt/qemu/Windows 11-swtpm.log' --terminate --tpm2
    2023-08-05 18:12:52.785+0000: starting up libvirt version: 8.7.0, qemu version: 7.1.0, kernel: 6.1.38-Unraid, hostname: Server
    LC_ALL=C \
    PATH=/bin:/sbin:/usr/bin:/usr/sbin \
    HOME='/var/lib/libvirt/qemu/domain-10-Windows 11' \
    XDG_DATA_HOME='/var/lib/libvirt/qemu/domain-10-Windows 11/.local/share' \
    XDG_CACHE_HOME='/var/lib/libvirt/qemu/domain-10-Windows 11/.cache' \
    XDG_CONFIG_HOME='/var/lib/libvirt/qemu/domain-10-Windows 11/.config' \
    /usr/local/sbin/qemu \
    -name 'guest=Windows 11,debug-threads=on' \
    -S \
    -object '{"qom-type":"secret","id":"masterKey0","format":"raw","file":"/var/lib/libvirt/qemu/domain-10-Windows 11/master-key.aes"}' \
    -blockdev '{"driver":"file","filename":"/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd","node-name":"libvirt-pflash0-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-pflash0-format","read-only":true,"driver":"raw","file":"libvirt-pflash0-storage"}' \
    -blockdev '{"driver":"file","filename":"/etc/libvirt/qemu/nvram/bed95bbc-2cfd-1316-25d9-aa74fadc0ff0_VARS-pure-efi-tpm.fd","node-name":"libvirt-pflash1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-pflash1-format","read-only":false,"driver":"raw","file":"libvirt-pflash1-storage"}' \
    -machine pc-i440fx-6.2,usb=off,dump-guest-core=off,mem-merge=off,memory-backend=pc.ram,pflash0=libvirt-pflash0-format,pflash1=libvirt-pflash1-format \
    -accel kvm \
    -cpu host,migratable=on,topoext=on,hv-time=on,hv-relaxed=on,hv-vapic=on,hv-spinlocks=0x1fff,hv-vendor-id=none,host-cache-info=on,l3-cache=off \
    -m 15872 \
    -object '{"qom-type":"memory-backend-ram","id":"pc.ram","size":16642998272}' \
    -overcommit mem-lock=off \
    -smp 16,sockets=1,dies=1,cores=8,threads=2 \
    -uuid bed95bbc-2cfd-1316-25d9-aa74fadc0ff0 \
    -display none \
    -no-user-config \
    -nodefaults \
    -chardev socket,id=charmonitor,fd=42,server=on,wait=off \
    -mon chardev=charmonitor,id=monitor,mode=control \
    -rtc base=localtime \
    -no-hpet \
    -no-shutdown \
    -boot strict=on \
    -device '{"driver":"qemu-xhci","p2":15,"p3":15,"id":"usb","bus":"pci.0","addr":"0x7"}' \
    -device '{"driver":"ahci","id":"sata0","bus":"pci.0","addr":"0x4"}' \
    -device '{"driver":"virtio-serial-pci","id":"virtio-serial0","bus":"pci.0","addr":"0x3"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/domains/Windows 11/vdisk1.img","node-name":"libvirt-2-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-2-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-2-storage"}' \
    -device '{"driver":"virtio-blk-pci","bus":"pci.0","addr":"0x5","drive":"libvirt-2-format","id":"virtio-disk2","bootindex":1,"write-cache":"on"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/isos/virtio-win-0.1.229-1.iso","node-name":"libvirt-1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \
    -device '{"driver":"ide-cd","bus":"sata0.1","drive":"libvirt-1-format","id":"sata0-0-1"}' \
    -netdev tap,fd=43,id=hostnet0 \
    -device '{"driver":"rtl8139","netdev":"hostnet0","id":"net0","mac":"52:54:00:d4:12:7e","bus":"pci.0","addr":"0x2"}' \
    -chardev pty,id=charserial0 \
    -device '{"driver":"isa-serial","chardev":"charserial0","id":"serial0","index":0}' \
    -chardev socket,id=charchannel0,fd=41,server=on,wait=off \
    -device '{"driver":"virtserialport","bus":"virtio-serial0.0","nr":1,"chardev":"charchannel0","id":"channel0","name":"org.qemu.guest_agent.0"}' \
    -chardev 'socket,id=chrtpm,path=/run/libvirt/qemu/swtpm/10-Windows 11-swtpm.sock' \
    -tpmdev emulator,id=tpm-tpm0,chardev=chrtpm \
    -device '{"driver":"tpm-tis","tpmdev":"tpm-tpm0","id":"tpm0"}' \
    -device '{"driver":"usb-tablet","id":"input0","bus":"usb.0","port":"1"}' \
    -audiodev '{"id":"audio1","driver":"none"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.0","id":"hostdev0","bus":"pci.0","addr":"0x6","romfile":"/mnt/user/isos/vbios/GeForce RTX 2070 SUPER.rom"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.1","id":"hostdev1","bus":"pci.0","addr":"0x8"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.2","id":"hostdev2","bus":"pci.0","addr":"0x9"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.3","id":"hostdev3","bus":"pci.0","addr":"0xa"}' \
    -sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
    -msg timestamp=on
    char device redirected to /dev/pts/1 (label charserial0)

     

    When the vm is running edit and change to xmlview. it should say connected for the xml below.

     

    //channel/target[@name="org.qemu.guest_agent.0"]/@state'

    Link to comment
    <?xml version='1.0' encoding='UTF-8'?>
    <domain type='kvm' id='10'>
      <name>Windows 11</name>
      <uuid>bed95bbc-2cfd-1316-25d9-aa74fadc0ff0</uuid>
      <description>Matthias Pc</description>
      <metadata>
        <vmtemplate xmlns="unraid" name="Windows 11" icon="windows11.png" os="windowstpm"/>
      </metadata>
      <memory unit='KiB'>16252928</memory>
      <currentMemory unit='KiB'>16252928</currentMemory>
      <memoryBacking>
        <nosharepages/>
      </memoryBacking>
      <vcpu placement='static'>16</vcpu>
      <cputune>
        <vcpupin vcpu='0' cpuset='8'/>
        <vcpupin vcpu='1' cpuset='24'/>
        <vcpupin vcpu='2' cpuset='9'/>
        <vcpupin vcpu='3' cpuset='25'/>
        <vcpupin vcpu='4' cpuset='10'/>
        <vcpupin vcpu='5' cpuset='26'/>
        <vcpupin vcpu='6' cpuset='11'/>
        <vcpupin vcpu='7' cpuset='27'/>
        <vcpupin vcpu='8' cpuset='12'/>
        <vcpupin vcpu='9' cpuset='28'/>
        <vcpupin vcpu='10' cpuset='13'/>
        <vcpupin vcpu='11' cpuset='29'/>
        <vcpupin vcpu='12' cpuset='14'/>
        <vcpupin vcpu='13' cpuset='30'/>
        <vcpupin vcpu='14' cpuset='15'/>
        <vcpupin vcpu='15' cpuset='31'/>
      </cputune>
      <resource>
        <partition>/machine</partition>
      </resource>
      <os>
        <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
        <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd</loader>
        <nvram>/etc/libvirt/qemu/nvram/bed95bbc-2cfd-1316-25d9-aa74fadc0ff0_VARS-pure-efi-tpm.fd</nvram>
      </os>
      <features>
        <acpi/>
        <apic/>
        <hyperv mode='custom'>
          <relaxed state='on'/>
          <vapic state='on'/>
          <spinlocks state='on' retries='8191'/>
          <vendor_id state='on' value='none'/>
        </hyperv>
      </features>
      <cpu mode='host-passthrough' check='none' migratable='on'>
        <topology sockets='1' dies='1' cores='8' threads='2'/>
        <cache mode='passthrough'/>
        <feature policy='require' name='topoext'/>
      </cpu>
      <clock offset='localtime'>
        <timer name='hypervclock' present='yes'/>
        <timer name='hpet' present='no'/>
      </clock>
      <on_poweroff>destroy</on_poweroff>
      <on_reboot>restart</on_reboot>
      <on_crash>restart</on_crash>
      <devices>
        <emulator>/usr/local/sbin/qemu</emulator>
        <disk type='file' device='disk'>
          <driver name='qemu' type='raw' cache='writeback'/>
          <source file='/mnt/user/domains/Windows 11/vdisk1.img' index='2'/>
          <backingStore/>
          <target dev='hdc' bus='virtio'/>
          <boot order='1'/>
          <alias name='virtio-disk2'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
        </disk>
        <disk type='file' device='cdrom'>
          <driver name='qemu' type='raw'/>
          <source file='/mnt/user/isos/virtio-win-0.1.229-1.iso' index='1'/>
          <backingStore/>
          <target dev='hdb' bus='sata'/>
          <readonly/>
          <alias name='sata0-0-1'/>
          <address type='drive' controller='0' bus='0' target='0' unit='1'/>
        </disk>
        <controller type='pci' index='0' model='pci-root'>
          <alias name='pci.0'/>
        </controller>
        <controller type='sata' index='0'>
          <alias name='sata0'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
        </controller>
        <controller type='virtio-serial' index='0'>
          <alias name='virtio-serial0'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
        </controller>
        <controller type='usb' index='0' model='qemu-xhci' ports='15'>
          <alias name='usb'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
        </controller>
        <interface type='bridge'>
          <mac address='52:54:00:d4:12:7e'/>
          <source bridge='br0'/>
          <target dev='vnet8'/>
          <model type='rtl8139'/>
          <alias name='net0'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
        </interface>
        <serial type='pty'>
          <source path='/dev/pts/1'/>
          <target type='isa-serial' port='0'>
            <model name='isa-serial'/>
          </target>
          <alias name='serial0'/>
        </serial>
        <console type='pty' tty='/dev/pts/1'>
          <source path='/dev/pts/1'/>
          <target type='serial' port='0'/>
          <alias name='serial0'/>
        </console>
        <channel type='unix'>
          <source mode='bind' path='/var/lib/libvirt/qemu/channel/target/domain-10-Windows 11/org.qemu.guest_agent.0'/>
          <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/>
          <alias name='channel0'/>
          <address type='virtio-serial' controller='0' bus='0' port='1'/>
        </channel>
        <input type='tablet' bus='usb'>
          <alias name='input0'/>
          <address type='usb' bus='0' port='1'/>
        </input>
        <input type='mouse' bus='ps2'>
          <alias name='input1'/>
        </input>
        <input type='keyboard' bus='ps2'>
          <alias name='input2'/>
        </input>
        <tpm model='tpm-tis'>
          <backend type='emulator' version='2.0' persistent_state='yes'/>
          <alias name='tpm0'/>
        </tpm>
        <audio id='1' type='none'/>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x08' slot='0x00' function='0x0'/>
          </source>
          <alias name='hostdev0'/>
          <rom file='/mnt/user/isos/vbios/GeForce RTX 2070 SUPER.rom'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
        </hostdev>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x08' slot='0x00' function='0x1'/>
          </source>
          <alias name='hostdev1'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>
        </hostdev>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x08' slot='0x00' function='0x2'/>
          </source>
          <alias name='hostdev2'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x09' function='0x0'/>
        </hostdev>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x08' slot='0x00' function='0x3'/>
          </source>
          <alias name='hostdev3'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x0a' function='0x0'/>
        </hostdev>
        <memballoon model='none'/>
      </devices>
      <seclabel type='dynamic' model='dac' relabel='yes'>
        <label>+0:+100</label>
        <imagelabel>+0:+100</imagelabel>
      </seclabel>
    </domain>

    It is running but it says disconnected

    Link to comment
    5 minutes ago, Zeze21 said:
    <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/>
          <alias name='channel0'/>

    This shows disconnected. Have installed all the drivers check serial ones in device manager. and run guest agent installer

    Link to comment

    So this is the device manager when i start my vm with a virtual gpu:

    image.png.223c0509344927d6bca7eb355fcea45f.png

    there seems to be no device not installed.

    In the installed Apps:

    image.thumb.png.88a55fc81a9887addc29cd74073b6aef.png

    so i deinstalled the QEMU guest agent:

    image.thumb.png.e84eee423688375e83c1aae947193790.png

    rebooted the vm

    [will update this after reboot and reinstall - actually thinking of trying to find an even newer version of QEMU Guest agent in the depth of this "internet" i keep hearing about. (or is that a bad idea?)]

     

    Link to comment
    20 minutes ago, Zeze21 said:

    So this is the device manager when i start my vm with a virtual gpu:

    image.png.223c0509344927d6bca7eb355fcea45f.png

    there seems to be no device not installed.

    In the installed Apps:

    image.thumb.png.88a55fc81a9887addc29cd74073b6aef.png

    so i deinstalled the QEMU guest agent:

    image.thumb.png.e84eee423688375e83c1aae947193790.png

    rebooted the vm

    [will update this after reboot and reinstall - actually thinking of trying to find an even newer version of QEMU Guest agent in the depth of this "internet" i keep hearing about. (or is that a bad idea?)]

     

    Latest stable is on 229 iso I believe

    Link to comment
    1 hour ago, SimonF said:

    Latest stable is on 229 iso I believe

    Have been using those:

    image.png.4b2d52fd0cbb17af97d5f946636fc825.png

    reinstalled the virtio-serial drivers as well as the guest agent. (btw i forogt to mention - when i ran the VM with the virtual gpu, unraid showed the guest agent as installed.

    did everything as told but unfortunately no change at all:

     

    XML (sorry whenever i try to post as code my browser crashes for whatever reason...)

    <?xml version='1.0' encoding='UTF-8'?>
    <domain type='kvm' id='13'>
      <name>Windows 11</name>
      <uuid>bed95bbc-2cfd-1316-25d9-aa74fadc0ff0</uuid>
      <description>Matthias Pc</description>
      <metadata>
        <vmtemplate xmlns="unraid" name="Windows 11" icon="windows11.png" os="windowstpm"/>
      </metadata>
      <memory unit='KiB'>16252928</memory>
      <currentMemory unit='KiB'>16252928</currentMemory>
      <memoryBacking>
        <nosharepages/>
      </memoryBacking>
      <vcpu placement='static'>16</vcpu>
      <cputune>
        <vcpupin vcpu='0' cpuset='8'/>
        <vcpupin vcpu='1' cpuset='24'/>
        <vcpupin vcpu='2' cpuset='9'/>
        <vcpupin vcpu='3' cpuset='25'/>
        <vcpupin vcpu='4' cpuset='10'/>
        <vcpupin vcpu='5' cpuset='26'/>
        <vcpupin vcpu='6' cpuset='11'/>
        <vcpupin vcpu='7' cpuset='27'/>
        <vcpupin vcpu='8' cpuset='12'/>
        <vcpupin vcpu='9' cpuset='28'/>
        <vcpupin vcpu='10' cpuset='13'/>
        <vcpupin vcpu='11' cpuset='29'/>
        <vcpupin vcpu='12' cpuset='14'/>
        <vcpupin vcpu='13' cpuset='30'/>
        <vcpupin vcpu='14' cpuset='15'/>
        <vcpupin vcpu='15' cpuset='31'/>
      </cputune>
      <resource>
        <partition>/machine</partition>
      </resource>
      <os>
        <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
        <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd</loader>
        <nvram>/etc/libvirt/qemu/nvram/bed95bbc-2cfd-1316-25d9-aa74fadc0ff0_VARS-pure-efi-tpm.fd</nvram>
      </os>
      <features>
        <acpi/>
        <apic/>
        <hyperv mode='custom'>
          <relaxed state='on'/>
          <vapic state='on'/>
          <spinlocks state='on' retries='8191'/>
          <vendor_id state='on' value='none'/>
        </hyperv>
      </features>
      <cpu mode='host-passthrough' check='none' migratable='on'>
        <topology sockets='1' dies='1' cores='8' threads='2'/>
        <cache mode='passthrough'/>
        <feature policy='require' name='topoext'/>
      </cpu>
      <clock offset='localtime'>
        <timer name='hypervclock' present='yes'/>
        <timer name='hpet' present='no'/>
      </clock>
      <on_poweroff>destroy</on_poweroff>
      <on_reboot>restart</on_reboot>
      <on_crash>restart</on_crash>
      <devices>
        <emulator>/usr/local/sbin/qemu</emulator>
        <disk type='file' device='disk'>
          <driver name='qemu' type='raw' cache='writeback'/>
          <source file='/mnt/user/domains/Windows 11/vdisk1.img' index='2'/>
          <backingStore/>
          <target dev='hdc' bus='virtio'/>
          <boot order='1'/>
          <alias name='virtio-disk2'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
        </disk>
        <disk type='file' device='cdrom'>
          <driver name='qemu' type='raw'/>
          <source file='/mnt/user/isos/virtio-win-0.1.229-1.iso' index='1'/>
          <backingStore/>
          <target dev='hdb' bus='sata'/>
          <readonly/>
          <alias name='sata0-0-1'/>
          <address type='drive' controller='0' bus='0' target='0' unit='1'/>
        </disk>
        <controller type='sata' index='0'>
          <alias name='sata0'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
        </controller>
        <controller type='virtio-serial' index='0'>
          <alias name='virtio-serial0'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
        </controller>
        <controller type='pci' index='0' model='pci-root'>
          <alias name='pci.0'/>
        </controller>
        <controller type='usb' index='0' model='qemu-xhci' ports='15'>
          <alias name='usb'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
        </controller>
        <interface type='bridge'>
          <mac address='52:54:00:d4:12:7e'/>
          <source bridge='br0'/>
          <target dev='vnet11'/>
          <model type='rtl8139'/>
          <alias name='net0'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
        </interface>
        <serial type='pty'>
          <source path='/dev/pts/1'/>
          <target type='isa-serial' port='0'>
            <model name='isa-serial'/>
          </target>
          <alias name='serial0'/>
        </serial>
        <console type='pty' tty='/dev/pts/1'>
          <source path='/dev/pts/1'/>
          <target type='serial' port='0'/>
          <alias name='serial0'/>
        </console>
        <channel type='unix'>
          <source mode='bind' path='/var/lib/libvirt/qemu/channel/target/domain-13-Windows 11/org.qemu.guest_agent.0'/>
          <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/>
          <alias name='channel0'/>
          <address type='virtio-serial' controller='0' bus='0' port='1'/>
        </channel>
        <input type='tablet' bus='usb'>
          <alias name='input0'/>
          <address type='usb' bus='0' port='1'/>
        </input>
        <input type='mouse' bus='ps2'>
          <alias name='input1'/>
        </input>
        <input type='keyboard' bus='ps2'>
          <alias name='input2'/>
        </input>
        <tpm model='tpm-tis'>
          <backend type='emulator' version='2.0' persistent_state='yes'/>
          <alias name='tpm0'/>
        </tpm>
        <audio id='1' type='none'/>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x08' slot='0x00' function='0x0'/>
          </source>
          <alias name='hostdev0'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
        </hostdev>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x08' slot='0x00' function='0x1'/>
          </source>
          <alias name='hostdev1'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>
        </hostdev>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x08' slot='0x00' function='0x2'/>
          </source>
          <alias name='hostdev2'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x09' function='0x0'/>
        </hostdev>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x08' slot='0x00' function='0x3'/>
          </source>
          <alias name='hostdev3'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x0a' function='0x0'/>
        </hostdev>
        <memballoon model='none'/>
      </devices>
      <seclabel type='dynamic' model='dac' relabel='yes'>
        <label>+0:+100</label>
        <imagelabel>+0:+100</imagelabel>
      </seclabel>
    </domain>
     

    LOG:
     

    text  error  warn  system  array  login  
    
    -device '{"driver":"ahci","id":"sata0","bus":"pci.0","addr":"0x4"}' \
    -device '{"driver":"virtio-serial-pci","id":"virtio-serial0","bus":"pci.0","addr":"0x3"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/domains/Windows 11/vdisk1.img","node-name":"libvirt-2-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-2-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-2-storage"}' \
    -device '{"driver":"virtio-blk-pci","bus":"pci.0","addr":"0x6","drive":"libvirt-2-format","id":"virtio-disk2","bootindex":1,"write-cache":"on"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/isos/virtio-win-0.1.229-1.iso","node-name":"libvirt-1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \
    -device '{"driver":"ide-cd","bus":"sata0.1","drive":"libvirt-1-format","id":"sata0-0-1"}' \
    -netdev tap,fd=48,id=hostnet0 \
    -device '{"driver":"rtl8139","netdev":"hostnet0","id":"net0","mac":"52:54:00:d4:12:7e","bus":"pci.0","addr":"0x5"}' \
    -chardev pty,id=charserial0 \
    -device '{"driver":"isa-serial","chardev":"charserial0","id":"serial0","index":0}' \
    -chardev socket,id=charchannel0,fd=41,server=on,wait=off \
    -device '{"driver":"virtserialport","bus":"virtio-serial0.0","nr":1,"chardev":"charchannel0","id":"channel0","name":"org.qemu.guest_agent.0"}' \
    -chardev 'socket,id=chrtpm,path=/run/libvirt/qemu/swtpm/12-Windows 11-swtpm.sock' \
    -tpmdev emulator,id=tpm-tpm0,chardev=chrtpm \
    -device '{"driver":"tpm-tis","tpmdev":"tpm-tpm0","id":"tpm0"}' \
    -device '{"driver":"usb-tablet","id":"input0","bus":"usb.0","port":"1"}' \
    -audiodev '{"id":"audio1","driver":"none"}' \
    -vnc 0.0.0.0:1,websocket=5701,audiodev=audio1 \
    -k de \
    -device '{"driver":"qxl-vga","id":"video0","max_outputs":1,"ram_size":67108864,"vram_size":67108864,"vram64_size_mb":0,"vgamem_mb":16,"bus":"pci.0","addr":"0x2"}' \
    -device '{"driver":"virtio-balloon-pci","id":"balloon0","bus":"pci.0","addr":"0x8"}' \
    -sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
    -msg timestamp=on
    char device redirected to /dev/pts/1 (label charserial0)
    qxl_send_events: spice-server bug: guest stopped, ignoring
    2023-08-06T06:49:28.000604Z qemu-system-x86_64: terminating on signal 15 from pid 11566 (/usr/sbin/libvirtd)
    2023-08-06 06:49:28.243+0000: shutting down, reason=shutdown
    2023-08-06 07:28:49.307+0000: Starting external device: TPM Emulator
    /usr/bin/swtpm socket --ctrl 'type=unixio,path=/run/libvirt/qemu/swtpm/13-Windows 11-swtpm.sock,mode=0600' --tpmstate dir=/var/lib/libvirt/swtpm/bed95bbc-2cfd-1316-25d9-aa74fadc0ff0/tpm2,mode=0600 --log 'file=/var/log/swtpm/libvirt/qemu/Windows 11-swtpm.log' --terminate --tpm2
    2023-08-06 07:28:49.390+0000: starting up libvirt version: 8.7.0, qemu version: 7.1.0, kernel: 6.1.38-Unraid, hostname: Server
    LC_ALL=C \
    PATH=/bin:/sbin:/usr/bin:/usr/sbin \
    HOME='/var/lib/libvirt/qemu/domain-13-Windows 11' \
    XDG_DATA_HOME='/var/lib/libvirt/qemu/domain-13-Windows 11/.local/share' \
    XDG_CACHE_HOME='/var/lib/libvirt/qemu/domain-13-Windows 11/.cache' \
    XDG_CONFIG_HOME='/var/lib/libvirt/qemu/domain-13-Windows 11/.config' \
    /usr/local/sbin/qemu \
    -name 'guest=Windows 11,debug-threads=on' \
    -S \
    -object '{"qom-type":"secret","id":"masterKey0","format":"raw","file":"/var/lib/libvirt/qemu/domain-13-Windows 11/master-key.aes"}' \
    -blockdev '{"driver":"file","filename":"/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd","node-name":"libvirt-pflash0-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-pflash0-format","read-only":true,"driver":"raw","file":"libvirt-pflash0-storage"}' \
    -blockdev '{"driver":"file","filename":"/etc/libvirt/qemu/nvram/bed95bbc-2cfd-1316-25d9-aa74fadc0ff0_VARS-pure-efi-tpm.fd","node-name":"libvirt-pflash1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-pflash1-format","read-only":false,"driver":"raw","file":"libvirt-pflash1-storage"}' \
    -machine pc-i440fx-6.2,usb=off,dump-guest-core=off,mem-merge=off,memory-backend=pc.ram,pflash0=libvirt-pflash0-format,pflash1=libvirt-pflash1-format \
    -accel kvm \
    -cpu host,migratable=on,topoext=on,hv-time=on,hv-relaxed=on,hv-vapic=on,hv-spinlocks=0x1fff,hv-vendor-id=none,host-cache-info=on,l3-cache=off \
    -m 15872 \
    -object '{"qom-type":"memory-backend-ram","id":"pc.ram","size":16642998272}' \
    -overcommit mem-lock=off \
    -smp 16,sockets=1,dies=1,cores=8,threads=2 \
    -uuid bed95bbc-2cfd-1316-25d9-aa74fadc0ff0 \
    -display none \
    -no-user-config \
    -nodefaults \
    -chardev socket,id=charmonitor,fd=42,server=on,wait=off \
    -mon chardev=charmonitor,id=monitor,mode=control \
    -rtc base=localtime \
    -no-hpet \
    -no-shutdown \
    -boot strict=on \
    -device '{"driver":"qemu-xhci","p2":15,"p3":15,"id":"usb","bus":"pci.0","addr":"0x7"}' \
    -device '{"driver":"ahci","id":"sata0","bus":"pci.0","addr":"0x4"}' \
    -device '{"driver":"virtio-serial-pci","id":"virtio-serial0","bus":"pci.0","addr":"0x3"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/domains/Windows 11/vdisk1.img","node-name":"libvirt-2-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-2-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-2-storage"}' \
    -device '{"driver":"virtio-blk-pci","bus":"pci.0","addr":"0x5","drive":"libvirt-2-format","id":"virtio-disk2","bootindex":1,"write-cache":"on"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/isos/virtio-win-0.1.229-1.iso","node-name":"libvirt-1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \
    -device '{"driver":"ide-cd","bus":"sata0.1","drive":"libvirt-1-format","id":"sata0-0-1"}' \
    -netdev tap,fd=44,id=hostnet0 \
    -device '{"driver":"rtl8139","netdev":"hostnet0","id":"net0","mac":"52:54:00:d4:12:7e","bus":"pci.0","addr":"0x2"}' \
    -chardev pty,id=charserial0 \
    -device '{"driver":"isa-serial","chardev":"charserial0","id":"serial0","index":0}' \
    -chardev socket,id=charchannel0,fd=41,server=on,wait=off \
    -device '{"driver":"virtserialport","bus":"virtio-serial0.0","nr":1,"chardev":"charchannel0","id":"channel0","name":"org.qemu.guest_agent.0"}' \
    -chardev 'socket,id=chrtpm,path=/run/libvirt/qemu/swtpm/13-Windows 11-swtpm.sock' \
    -tpmdev emulator,id=tpm-tpm0,chardev=chrtpm \
    -device '{"driver":"tpm-tis","tpmdev":"tpm-tpm0","id":"tpm0"}' \
    -device '{"driver":"usb-tablet","id":"input0","bus":"usb.0","port":"1"}' \
    -audiodev '{"id":"audio1","driver":"none"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.0","id":"hostdev0","bus":"pci.0","addr":"0x6"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.1","id":"hostdev1","bus":"pci.0","addr":"0x8"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.2","id":"hostdev2","bus":"pci.0","addr":"0x9"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.3","id":"hostdev3","bus":"pci.0","addr":"0xa"}' \
    -sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
    -msg timestamp=on
    char device redirected to /dev/pts/1 (label charserial0)
      

     

    just to show you:

    image.thumb.png.ca7ecf69011919cbd9f4714621387dbd.png

     

    I don't know if this is of any concern but i can not connect to the vm via rdp or anything else, even though the vm shows up in my router.

    Edited by Zeze21
    Link to comment

    I am willing to do pretty much whatever it take to get this up and running again. This VM is my main Workspace and unfortunately i need it daily. 

    Link to comment

    Ok so... i tried creating a completely new VM. I thought that might help.

     

    Did the following:

     

    Installed Windows 11 with VNC.

    Installed the Drivers (3 of them) then the Guest Agent.

    Then shut down the VM replaced the VNC with the 2070....and....

    No guest agent installed.... i am losing it here... 

    Link to comment

    I did - now I wait for wednesday.

    Since I have mentioned this thread in the request I would like to add additional things:

    New VM XML:

     

    <?xml version='1.0' encoding='UTF-8'?>
    <domain type='kvm'>
      <name>Matthias Pc</name>
      <uuid>0c8d4fb6-3911-0236-a5d5-81e0993d4a1d</uuid>
      <description>Dem Tias sein PC</description>
      <metadata>
        <vmtemplate xmlns="unraid" name="Windows 11" icon="windows11.png" os="windowstpm"/>
      </metadata>
      <memory unit='KiB'>16252928</memory>
      <currentMemory unit='KiB'>16252928</currentMemory>
      <memoryBacking>
        <nosharepages/>
      </memoryBacking>
      <vcpu placement='static'>16</vcpu>
      <cputune>
        <vcpupin vcpu='0' cpuset='8'/>
        <vcpupin vcpu='1' cpuset='24'/>
        <vcpupin vcpu='2' cpuset='9'/>
        <vcpupin vcpu='3' cpuset='25'/>
        <vcpupin vcpu='4' cpuset='10'/>
        <vcpupin vcpu='5' cpuset='26'/>
        <vcpupin vcpu='6' cpuset='11'/>
        <vcpupin vcpu='7' cpuset='27'/>
        <vcpupin vcpu='8' cpuset='12'/>
        <vcpupin vcpu='9' cpuset='28'/>
        <vcpupin vcpu='10' cpuset='13'/>
        <vcpupin vcpu='11' cpuset='29'/>
        <vcpupin vcpu='12' cpuset='14'/>
        <vcpupin vcpu='13' cpuset='30'/>
        <vcpupin vcpu='14' cpuset='15'/>
        <vcpupin vcpu='15' cpuset='31'/>
      </cputune>
      <os>
        <type arch='x86_64' machine='pc-i440fx-7.1'>hvm</type>
        <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd</loader>
        <nvram>/etc/libvirt/qemu/nvram/0c8d4fb6-3911-0236-a5d5-81e0993d4a1d_VARS-pure-efi-tpm.fd</nvram>
      </os>
      <features>
        <acpi/>
        <apic/>
        <hyperv mode='custom'>
          <relaxed state='on'/>
          <vapic state='on'/>
          <spinlocks state='on' retries='8191'/>
          <vendor_id state='on' value='none'/>
        </hyperv>
      </features>
      <cpu mode='host-passthrough' check='none' migratable='on'>
        <topology sockets='1' dies='1' cores='8' threads='2'/>
        <cache mode='passthrough'/>
        <feature policy='require' name='topoext'/>
      </cpu>
      <clock offset='localtime'>
        <timer name='hypervclock' present='yes'/>
        <timer name='hpet' present='no'/>
      </clock>
      <on_poweroff>destroy</on_poweroff>
      <on_reboot>restart</on_reboot>
      <on_crash>restart</on_crash>
      <devices>
        <emulator>/usr/local/sbin/qemu</emulator>
        <disk type='file' device='disk'>
          <driver name='qemu' type='raw' cache='writeback'/>
          <source file='/mnt/user/domains/Matthias Pc/vdisk1.img'/>
          <target dev='hdc' bus='virtio'/>
          <serial>vdisk1</serial>
          <boot order='1'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
        </disk>
        <disk type='file' device='cdrom'>
          <driver name='qemu' type='raw'/>
          <source file='/mnt/user/isos/Windows 11/Win11_German_x64v1.iso'/>
          <target dev='hda' bus='ide'/>
          <readonly/>
          <boot order='2'/>
          <address type='drive' controller='0' bus='0' target='0' unit='0'/>
        </disk>
        <disk type='file' device='cdrom'>
          <driver name='qemu' type='raw'/>
          <source file='/mnt/user/isos/virtio-win-0.1.229-1.iso'/>
          <target dev='hdb' bus='ide'/>
          <readonly/>
          <address type='drive' controller='0' bus='0' target='0' unit='1'/>
        </disk>
        <controller type='virtio-serial' index='0'>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
        </controller>
        <controller type='pci' index='0' model='pci-root'/>
        <controller type='ide' index='0'>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
        </controller>
        <controller type='usb' index='0' model='qemu-xhci' ports='15'>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
        </controller>
        <interface type='bridge'>
          <mac address='52:54:00:88:48:54'/>
          <source bridge='br0'/>
          <model type='rtl8139'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
        </interface>
        <serial type='pty'>
          <target type='isa-serial' port='0'>
            <model name='isa-serial'/>
          </target>
        </serial>
        <console type='pty'>
          <target type='serial' port='0'/>
        </console>
        <channel type='unix'>
          <target type='virtio' name='org.qemu.guest_agent.0'/>
          <address type='virtio-serial' controller='0' bus='0' port='1'/>
        </channel>
        <input type='tablet' bus='usb'>
          <address type='usb' bus='0' port='1'/>
        </input>
        <input type='mouse' bus='ps2'/>
        <input type='keyboard' bus='ps2'/>
        <tpm model='tpm-tis'>
          <backend type='emulator' version='2.0' persistent_state='yes'/>
        </tpm>
        <audio id='1' type='none'/>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x08' slot='0x00' function='0x0'/>
          </source>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
        </hostdev>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x08' slot='0x00' function='0x1'/>
          </source>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
        </hostdev>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x08' slot='0x00' function='0x2'/>
          </source>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>
        </hostdev>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x08' slot='0x00' function='0x3'/>
          </source>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x09' function='0x0'/>
        </hostdev>
        <memballoon model='none'/>
      </devices>
    </domain>

    The Log:

    -device '{"driver":"virtio-blk-pci","bus":"pci.0","addr":"0x3","drive":"libvirt-3-format","id":"virtio-disk2","bootindex":1,"write-cache":"on","serial":"vdisk1"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/isos/Windows 11/Win11_German_x64v1.iso","node-name":"libvirt-2-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-2-format","read-only":true,"driver":"raw","file":"libvirt-2-storage"}' \
    -device '{"driver":"ide-cd","bus":"ide.0","unit":0,"drive":"libvirt-2-format","id":"ide0-0-0","bootindex":2}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/isos/virtio-win-0.1.229-1.iso","node-name":"libvirt-1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \
    -device '{"driver":"ide-cd","bus":"ide.0","unit":1,"drive":"libvirt-1-format","id":"ide0-0-1"}' \
    -netdev tap,fd=44,id=hostnet0 \
    -device '{"driver":"rtl8139","netdev":"hostnet0","id":"net0","mac":"52:54:00:88:48:54","bus":"pci.0","addr":"0x2"}' \
    -chardev pty,id=charserial0 \
    -device '{"driver":"isa-serial","chardev":"charserial0","id":"serial0","index":0}' \
    -chardev socket,id=charchannel0,fd=41,server=on,wait=off \
    -device '{"driver":"virtserialport","bus":"virtio-serial0.0","nr":1,"chardev":"charchannel0","id":"channel0","name":"org.qemu.guest_agent.0"}' \
    -chardev 'socket,id=chrtpm,path=/run/libvirt/qemu/swtpm/22-Matthias Pc-swtpm.sock' \
    -tpmdev emulator,id=tpm-tpm0,chardev=chrtpm \
    -device '{"driver":"tpm-tis","tpmdev":"tpm-tpm0","id":"tpm0"}' \
    -device '{"driver":"usb-tablet","id":"input0","bus":"usb.0","port":"1"}' \
    -audiodev '{"id":"audio1","driver":"none"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.0","id":"hostdev0","bus":"pci.0","addr":"0x5"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.1","id":"hostdev1","bus":"pci.0","addr":"0x6"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.2","id":"hostdev2","bus":"pci.0","addr":"0x8"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.3","id":"hostdev3","bus":"pci.0","addr":"0x9"}' \
    -sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
    -msg timestamp=on
    char device redirected to /dev/pts/1 (label charserial0)
    2023-08-07T12:39:15.831603Z qemu-system-x86_64: terminating on signal 15 from pid 11566 (/usr/sbin/libvirtd)
    2023-08-07 12:39:16.632+0000: shutting down, reason=destroyed
    2023-08-07 19:17:47.296+0000: Starting external device: TPM Emulator
    /usr/bin/swtpm socket --ctrl 'type=unixio,path=/run/libvirt/qemu/swtpm/23-Matthias Pc-swtpm.sock,mode=0600' --tpmstate dir=/var/lib/libvirt/swtpm/0c8d4fb6-3911-0236-a5d5-81e0993d4a1d/tpm2,mode=0600 --log 'file=/var/log/swtpm/libvirt/qemu/Matthias Pc-swtpm.log' --terminate --tpm2
    2023-08-07 19:17:47.362+0000: starting up libvirt version: 8.7.0, qemu version: 7.1.0, kernel: 6.1.38-Unraid, hostname: Server
    LC_ALL=C \
    PATH=/bin:/sbin:/usr/bin:/usr/sbin \
    HOME='/var/lib/libvirt/qemu/domain-23-Matthias Pc' \
    XDG_DATA_HOME='/var/lib/libvirt/qemu/domain-23-Matthias Pc/.local/share' \
    XDG_CACHE_HOME='/var/lib/libvirt/qemu/domain-23-Matthias Pc/.cache' \
    XDG_CONFIG_HOME='/var/lib/libvirt/qemu/domain-23-Matthias Pc/.config' \
    /usr/local/sbin/qemu \
    -name 'guest=Matthias Pc,debug-threads=on' \
    -S \
    -object '{"qom-type":"secret","id":"masterKey0","format":"raw","file":"/var/lib/libvirt/qemu/domain-23-Matthias Pc/master-key.aes"}' \
    -blockdev '{"driver":"file","filename":"/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd","node-name":"libvirt-pflash0-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-pflash0-format","read-only":true,"driver":"raw","file":"libvirt-pflash0-storage"}' \
    -blockdev '{"driver":"file","filename":"/etc/libvirt/qemu/nvram/0c8d4fb6-3911-0236-a5d5-81e0993d4a1d_VARS-pure-efi-tpm.fd","node-name":"libvirt-pflash1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-pflash1-format","read-only":false,"driver":"raw","file":"libvirt-pflash1-storage"}' \
    -machine pc-i440fx-7.1,usb=off,dump-guest-core=off,mem-merge=off,memory-backend=pc.ram,pflash0=libvirt-pflash0-format,pflash1=libvirt-pflash1-format \
    -accel kvm \
    -cpu host,migratable=on,topoext=on,hv-time=on,hv-relaxed=on,hv-vapic=on,hv-spinlocks=0x1fff,hv-vendor-id=none,host-cache-info=on,l3-cache=off \
    -m 15872 \
    -object '{"qom-type":"memory-backend-ram","id":"pc.ram","size":16642998272}' \
    -overcommit mem-lock=off \
    -smp 16,sockets=1,dies=1,cores=8,threads=2 \
    -uuid 0c8d4fb6-3911-0236-a5d5-81e0993d4a1d \
    -display none \
    -no-user-config \
    -nodefaults \
    -chardev socket,id=charmonitor,fd=43,server=on,wait=off \
    -mon chardev=charmonitor,id=monitor,mode=control \
    -rtc base=localtime \
    -no-hpet \
    -no-shutdown \
    -boot strict=on \
    -device '{"driver":"qemu-xhci","p2":15,"p3":15,"id":"usb","bus":"pci.0","addr":"0x7"}' \
    -device '{"driver":"virtio-serial-pci","id":"virtio-serial0","bus":"pci.0","addr":"0x3"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/domains/Matthias Pc/vdisk1.img","node-name":"libvirt-3-storage","cache":{"direct":false,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-3-format","read-only":false,"cache":{"direct":false,"no-flush":false},"driver":"raw","file":"libvirt-3-storage"}' \
    -device '{"driver":"virtio-blk-pci","bus":"pci.0","addr":"0x4","drive":"libvirt-3-format","id":"virtio-disk2","bootindex":1,"write-cache":"on","serial":"vdisk1"}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/isos/Windows 11/Win11_German_x64v1.iso","node-name":"libvirt-2-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-2-format","read-only":true,"driver":"raw","file":"libvirt-2-storage"}' \
    -device '{"driver":"ide-cd","bus":"ide.0","unit":0,"drive":"libvirt-2-format","id":"ide0-0-0","bootindex":2}' \
    -blockdev '{"driver":"file","filename":"/mnt/user/isos/virtio-win-0.1.229-1.iso","node-name":"libvirt-1-storage","auto-read-only":true,"discard":"unmap"}' \
    -blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \
    -device '{"driver":"ide-cd","bus":"ide.0","unit":1,"drive":"libvirt-1-format","id":"ide0-0-1"}' \
    -netdev tap,fd=44,id=hostnet0 \
    -device '{"driver":"rtl8139","netdev":"hostnet0","id":"net0","mac":"52:54:00:88:48:54","bus":"pci.0","addr":"0x2"}' \
    -chardev pty,id=charserial0 \
    -device '{"driver":"isa-serial","chardev":"charserial0","id":"serial0","index":0}' \
    -chardev socket,id=charchannel0,fd=42,server=on,wait=off \
    -device '{"driver":"virtserialport","bus":"virtio-serial0.0","nr":1,"chardev":"charchannel0","id":"channel0","name":"org.qemu.guest_agent.0"}' \
    -chardev 'socket,id=chrtpm,path=/run/libvirt/qemu/swtpm/23-Matthias Pc-swtpm.sock' \
    -tpmdev emulator,id=tpm-tpm0,chardev=chrtpm \
    -device '{"driver":"tpm-tis","tpmdev":"tpm-tpm0","id":"tpm0"}' \
    -device '{"driver":"usb-tablet","id":"input0","bus":"usb.0","port":"1"}' \
    -audiodev '{"id":"audio1","driver":"none"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.0","id":"hostdev0","bus":"pci.0","addr":"0x5"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.1","id":"hostdev1","bus":"pci.0","addr":"0x6"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.2","id":"hostdev2","bus":"pci.0","addr":"0x8"}' \
    -device '{"driver":"vfio-pci","host":"0000:08:00.3","id":"hostdev3","bus":"pci.0","addr":"0x9"}' \
    -sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
    -msg timestamp=on
    char device redirected to /dev/pts/1 (label charserial0)

     

    Link to comment

    Your configuration holds some errors:

     

    For a machine with Windows 11 64Bit on it you will need TPM oder at least TPM emulation. For that you have to use machine type q35 and not pc-i440fx.

     

    Your hardware id should be 12 characters.

     

    Your GPU passthrough is faulty. You have to determine the correct functions, busses and slots and put in the correct numbers for those like mentioned in this video tutorial:

     

     

    Your devices should be in the same IOMMU group. Try enabeling the PCI Access Control Override and the Allow Unsafe Interrupts options in "Settings", "VM Manger".

     

     

    Edited by Jumbo_Erdnuesse
    Link to comment

    I had a similar issue after updating to 6.12.3. Linked below. For me, it was that I was passing thru the GPU but not the audio portion of it. Wasn't an issue until updated to 6.12.3, guess there were some changes with this release. Hope it helps!

     

     

    Link to comment

    Zeze21, I also understand the frustration. I have a hunch about this bug in that it is related to the VM template. In my Unraid box I have 3x Nvidia GT1030 GPUs.


    My problem:
    I cannot run 3x VMs using the Debian or Linux templates concurrently. I can only run two instances of Debian, then the third one has a blank screen. I've even tried passing through the vbios, but it had no impact. I have to pause and force quit that VM.

     

    However, if I set the third VM to Windows 10, it launches fine.


    In other words, I am able to run Debian+Debian+Windows10, but I cannot run Debian+Debian+Debian.

     

    To prove this, I set out to simply get to the UEFI BIOS screen.

    I set up a basic Windows 10 template with these options:

    • i440fx-7.1
    • OVMF
    • 10 MB Vdisk
    • Default VirtIO (doesn't matter, we're just trying to get to QEMU/UEFI)
    • GPU passed through
    • USB Controller passed through

     

    I was then able to get to get video output from the UEFI bios with this template.

     

    However, when I try the same thing with a Debian template, I get a blank screen.

     

    Zeze21, I realize that your time is valuable, but why not try the same thing (or experiment yourself with various minimal VM templates) to see if you can get to UEFI using Windows 10 templates?  If you can confirm my hunch, then it might help the developers fix this bug faster.

     

     

    Link to comment

    Any update on this?

    All of VMs are broken, no GPU Display output to monitor. Accessible through RDP, Anydesk etc but not with sunshine/moonlight unproper function of decode/encode.

     

     

    Link to comment

    I've found that passthrough works without crashes under Batocera. However, in the Windows VM, I consistently get a blue screen, which I was able to observe using RealVNC.

    My graphics card: MSI RTX 2070 Gaming Z 8G.

    However, I should mention that I have only been testing Unraid since this month and don't have a lot of experience with it yet.

    Link to comment


    Join the conversation

    You can post now and register later. If you have an account, sign in now to post with your account.
    Note: Your post will require moderator approval before it will be visible.

    Guest
    Add a comment...

    ×   Pasted as rich text.   Restore formatting

      Only 75 emoji are allowed.

    ×   Your link has been automatically embedded.   Display as a link instead

    ×   Your previous content has been restored.   Clear editor

    ×   You cannot paste images directly. Upload or insert images from URL.


  • Status Definitions

     

    Open = Under consideration.

     

    Solved = The issue has been resolved.

     

    Solved version = The issue has been resolved in the indicated release version.

     

    Closed = Feedback or opinion better posted on our forum for discussion. Also for reports we cannot reproduce or need more information. In this case just add a comment and we will review it again.

     

    Retest = Please retest in latest release.


    Priority Definitions

     

    Minor = Something not working correctly.

     

    Urgent = Server crash, data loss, or other showstopper.

     

    Annoyance = Doesn't affect functionality but should be fixed.

     

    Other = Announcement or other non-issue.

×
×
  • Create New...