VM shutdown crashing unRaid


Recommended Posts

Hey Everyone,

 

So recently I've started having issues with my Windows 10 VM. Every time I send a shutdown signal from the VM list to shutdown the VM (or even if I go and shutdown from the windowsitself) it completely crashes unRaid. The webgui becomes unresponsive and I cannot ssh into my tower. I have to force shutdown the server by holding down the power button.

 

This started happening shortly after I setup the GPU pass-through (nvidia GT 710) to the windows VM. Before this, I could shut it down no problem. Not sure if this is related or not.

 

Things I have tried:

 

  • Assign more RAM to the VM (8GB currently) (non gaming VM, just running Blue Iris and a screen capture)
  • Increase vdisk size
  • Increase core count (5 cores assigned, 10 threads)
  • Change initial memory to match max memory (8GB)
  • Turned off Hyper - V
  • Used a GT 710 Graphics ROM BIOS (The GPU was working fine without this)
  • Changed:
    • Disk Cache 'vm.dirty_background_ratio' (%): 1
    • Disk Cache 'vm.dirty_ratio' (%): 2
  • The VM task manager shows 2GB used out of 8GB assigned to it, this can't be a memory issue can it?

 

For the life of me I cannot figure this out. I can't capture any syslog because everything crashes before anything is able to be written.

The only thing that will occasionally show up in the syslog when shutting the VM down is the following:

php-fpm[14569]: [WARNING] [pool www] server reached max_children setting (20), consider raising it

The VM will boot normally and if I shut it down within a few minutes, it shuts down no problem. This only happens when I try to shut it down the following day or when it has been up and running for awhile.

 

System:

Supermicro - X8DTL

Dual L5640's

40GB RAM

 

Windows 10 VM xml

 

Any help would be greatly appreciated. Thank you!

 

Quote

<domain type='kvm'>
  <name>Windows 10</name>
  <uuid>92210a11-aef7-64bf-0f40-d3509f8dd9e4</uuid>
  <metadata>
    <vmtemplate xmlns="unraid" name="Windows 10" icon="windows.png" os="windows10"/>
  </metadata>
  <memory unit='KiB'>8388608</memory>
  <currentMemory unit='KiB'>8388608</currentMemory>
  <memoryBacking>
    <nosharepages/>
  </memoryBacking>
  <vcpu placement='static'>10</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='7'/>
    <vcpupin vcpu='1' cpuset='19'/>
    <vcpupin vcpu='2' cpuset='8'/>
    <vcpupin vcpu='3' cpuset='20'/>
    <vcpupin vcpu='4' cpuset='9'/>
    <vcpupin vcpu='5' cpuset='21'/>
    <vcpupin vcpu='6' cpuset='10'/>
    <vcpupin vcpu='7' cpuset='22'/>
    <vcpupin vcpu='8' cpuset='11'/>
    <vcpupin vcpu='9' cpuset='23'/>
  </cputune>
  <os>
    <type arch='x86_64' machine='pc-i440fx-2.11'>hvm</type>
    <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader>
    <nvram>/etc/libvirt/qemu/nvram/92210a11-aef7-64bf-0f40-d3509f8dd9e4_VARS-pure-efi.fd</nvram>
  </os>
  <features>
    <acpi/>
    <apic/>
  </features>
  <cpu mode='host-passthrough' check='none'>
    <topology sockets='1' cores='5' threads='2'/>
  </cpu>
  <clock offset='localtime'>
    <timer name='rtc' tickpolicy='catchup'/>
    <timer name='pit' tickpolicy='delay'/>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/local/sbin/qemu</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='writeback'/>
      <source file='/mnt/disks/evo/domains/blueiris/vdisk1.img'/>
      <target dev='hdc' bus='virtio'/>
      <boot order='1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <source file='/mnt/user/isos/Win10_1703_English_x64.iso'/>
      <target dev='hda' bus='ide'/>
      <readonly/>
      <boot order='2'/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <source file='/mnt/user/isos/virtio-win-0.1.141-1.iso'/>
      <target dev='hdb' bus='ide'/>
      <readonly/>
      <address type='drive' controller='0' bus='0' target='0' unit='1'/>
    </disk>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci2'>
      <master startport='2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci3'>
      <master startport='4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pci-root'/>
    <controller type='ide' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:17:30:36'/>
      <source bridge='br0'/>
      <model type='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
    </interface>
    <serial type='pty'>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <channel type='unix'>
      <target type='virtio' name='org.qemu.guest_agent.0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x03' slot='0x00' function='0x0'/>
      </source>
      <rom file='/mnt/user/isos/vbios/MSI.GT710.2048.160112.rom'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x03' slot='0x00' function='0x1'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
    </hostdev>
    <memballoon model='virtio'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>
    </memballoon>
  </devices>
</domain>
 

 

 

Edited by FalconX
Link to comment

Update:

I spun a new Win10 VM install with the Nvdia GT 710 pass through (6 cores, 4GB ram). The GPU shows up fine on device manager once windows installed the drivers for it. No issues there.

Left it running overnight again. Logged into the VM this morning, shutdown the VM and unraid webGUI slowly starts to hang, then completely becomes unresponsive. No SSH no GUI.

I had the syslog window open, the only message that came up again:

 

php-fpm[14569]: [WARNING] [pool www] server reached max_children setting (20), consider raising it

 

Tried to log in through IPMI and execute a graceful shutdown but it just froze after this message:

gracefully shutting down php-fpm.................................................failed

force quitting

and then it just hung there for 15 minutes before I forcefully shut it off.

I don't know if I'm leaking memory somewhere, I'm almost certain it has something to do with the GPU passthrough.

 

My next step is to try SeaBIOS instead of OVMF.

 

 

Link to comment
7 hours ago, CloseTurkey said:

Confirmed, reverting to 6.5 fixed my Win 10 VM issue.

 

I only tried shutting down the VM from the web gui which caused unRAID to crash several times, haven't done any further investigation as unfortunately I don't have the time available.

 

My issue was resolved in the VM section I was not getting any luck here.

 

 

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.