Unraid 6.11.5

 

I have a baremetal windows 11 install on an nvme drive that I've passed through to run as a vm. The VM will only stay up for a handful of hours before it unexpectedly hangs and has to be force stopped. When the VM is running, qemu-system-x86 will have extremely high cpu usage on one of the unpinned cores. I've scoured the forums and tried every fix and tip I could find (more cores, fewer cores, more ram, less ram, different drivers etc) and I'm pretty stumped here. XML and Diagnostics here:

 

<?xml version='1.0' encoding='UTF-8'?>
<domain type='kvm'>
  <name>UnraidGaming</name>
  <uuid>97524ffb-c787-8433-634d-fb2ea5ac4442</uuid>
  <metadata>
    <vmtemplate xmlns="unraid" name="Windows 11" icon="windows11.png" os="windowstpm"/>
  </metadata>
  <memory unit='KiB'>16777216</memory>
  <currentMemory unit='KiB'>16777216</currentMemory>
  <memoryBacking>
    <source type='memfd'/>
    <access mode='shared'/>
  </memoryBacking>
  <vcpu placement='static'>8</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='4'/>
    <vcpupin vcpu='1' cpuset='5'/>
    <vcpupin vcpu='2' cpuset='6'/>
    <vcpupin vcpu='3' cpuset='7'/>
    <vcpupin vcpu='4' cpuset='8'/>
    <vcpupin vcpu='5' cpuset='9'/>
    <vcpupin vcpu='6' cpuset='10'/>
    <vcpupin vcpu='7' cpuset='11'/>
  </cputune>
  <os>
    <type arch='x86_64' machine='pc-i440fx-7.1'>hvm</type>
    <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd</loader>
    <nvram>/etc/libvirt/qemu/nvram/97524ffb-c787-8433-634d-fb2ea5ac4442_VARS-pure-efi-tpm.fd</nvram>
    <boot dev='hd'/>
  </os>
  <features>
    <acpi/>
    <apic/>
    <hyperv mode='custom'>
      <relaxed state='on'/>
      <vapic state='on'/>
      <spinlocks state='on' retries='8191'/>
      <vpindex state='on'/>
      <synic state='on'/>
      <stimer state='on'/>
      <vendor_id state='on' value='none'/>
    </hyperv>
  </features>
  <cpu mode='host-passthrough' check='none' migratable='on'>
    <topology sockets='1' dies='1' cores='4' threads='2'/>
    <cache mode='passthrough'/>
  </cpu>
  <clock offset='localtime'>
    <timer name='hpet' present='no'/>
    <timer name='hypervclock' present='yes'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/local/sbin/qemu</emulator>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci2'>
      <master startport='2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci3'>
      <master startport='4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pci-root'/>
    <controller type='virtio-serial' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:95:16:7d'/>
      <source bridge='br0'/>
      <model type='virtio-net'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
    </interface>
    <serial type='pty'>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <channel type='unix'>
      <target type='virtio' name='org.qemu.guest_agent.0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <tpm model='tpm-tis'>
      <backend type='emulator' version='2.0' persistent_state='yes'/>
    </tpm>
    <audio id='1' type='none'/>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
      </source>
      <rom file='/mnt/user/domains/vbios/pny1660S.dump'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0' multifunction='on'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x1'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x1'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x02' slot='0x00' function='0x0'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
    </hostdev>
    <memballoon model='none'/>
  </devices>
</domain>

 

servbot-diagnostics-20230223-0904.zip

Edited February 23, 20233 yr by sage2050
typo

the one thing I hadn't tried yet was using a Q35 machine. This fixed the qemu cpu hog issue at least, going to let it run to see if it remains stable.

 

edit: 3 days later and completely stable on Q35. marking solved.

Edited February 26, 20233 yr by sage2050

turns out the actual problem was virtio-fs. it crashes both i440 and Q35

@sage2050 I'm facing the exact issue you're describing here. (My setup is exactly similar to yours to yours too. Windows on NVMe passed through to the VM) The Windows VM is all okay for an hour or two, And then it suddenly freezes up with 100% cpu usage and only way out is to force stop the VM. And you maybe right about virtio-fs, as this started after I made a share available within the VM via virtio-fs. 

But now that I have removed the share in the VM config, I'm still facing the issue. I have also tried uninstalled WinFsp from the VM. Was there anything else that you did to completely remove virtio-fs ?

10 minutes ago, niranjan94 said:

@sage2050 I'm facing the exact issue you're describing here. (My setup is exactly similar to yours to yours too. Windows on NVMe passed through to the VM) The Windows VM is all okay for an hour or two, And then it suddenly freezes up with 100% cpu usage and only way out is to force stop the VM. And you maybe right about virtio-fs, as this started after I made a share available within the VM via virtio-fs. 

But now that I have removed the share in the VM config, I'm still facing the issue. I have also tried uninstalled WinFsp from the VM. Was there anything else that you did to completely remove virtio-fs ?

 

@SimonF that is probably what I'm missing too ! Thank you so much  
Will try it and update here if any issues. Yes. That was indeed the issue. VM works perfectly now.! Thanks again @SimonF

Edited June 20, 20233 yr by niranjan94
Added result after trying the suggested fix