meowtime

Oh- I forgot to mention that I stumbled across this when trying to troubleshoot why a USB DAC (Audioengine D1) that is connected to the VM keeps seemingly disconnecting and not working until I reboot the VM. Not entirely sure if it's related or not.

Happening to me also on my OSX VM. Petere_sm... If I'm reading your XML right, it looks like you are only passing through USB devices individually? I'm passing through a PCI usb card to my VM. Here is my xml: <domain type='kvm' id='1' xmlns:qemu='http://libvirt.org/schemas/domain/qemu/1.0'> <name>elcap ovmf clover</name> <uuid>f5be7df3-fa16-487f-a666-4466022ecee6</uuid> <metadata> <vmtemplate xmlns="unraid" name="Linux" icon="linux.png" os="linux"/> </metadata> <memory unit='KiB'>4194304</memory> <currentMemory unit='KiB'>4194304</currentMemory> <memoryBacking> <nosharepages/> </memoryBacking> <vcpu placement='static'>4</vcpu> <cputune> <vcpupin vcpu='0' cpuset='0'/> <vcpupin vcpu='1' cpuset='1'/> <vcpupin vcpu='2' cpuset='2'/> <vcpupin vcpu='3' cpuset='3'/> </cputune> <resource> <partition>/machine</partition> </resource> <os> <type arch='x86_64' machine='pc-q35-2.5'>hvm</type> <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader> <nvram>/etc/libvirt/qemu/nvram/b0c7a34e-9313-bea3-a588-8eb4ae0582fa_VARS-pure-efi.fd</nvram> <boot dev='hd'/> </os> <features> <acpi/> </features> <cpu mode='custom' match='exact'> <model fallback='forbid'>core2duo</model> <vendor>Intel</vendor> </cpu> <clock offset='utc'/> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>destroy</on_crash> <devices> <emulator>/usr/local/sbin/qemu</emulator> <disk type='file' device='disk'> <driver name='qemu' type='raw'/> <source file='/mnt/cache/vm_images/elcapo.img'/> <backingStore/> <target dev='hda' bus='sata'/> <alias name='sata0-0-0'/> <address type='drive' controller='0' bus='0' target='0' unit='0'/> </disk> <controller type='usb' index='0' model='piix3-uhci'> <alias name='usb'/> <address type='pci' domain='0x0000' bus='0x02' slot='0x02' function='0x0'/> </controller> <controller type='sata' index='0'> <alias name='ide'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/> </controller> <controller type='pci' index='0' model='pcie-root'> <alias name='pcie.0'/> </controller> <controller type='pci' index='1' model='dmi-to-pci-bridge'> <model name='i82801b11-bridge'/> <alias name='pci.1'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x1e' function='0x0'/> </controller> <controller type='pci' index='2' model='pci-bridge'> <model name='pci-bridge'/> <target chassisNr='2'/> <alias name='pci.2'/> <address type='pci' domain='0x0000' bus='0x01' slot='0x01' function='0x0'/> </controller> <interface type='bridge'> <mac address='52:54:00:51:66:48'/> <source bridge='br0'/> <target dev='vnet0'/> <model type='e1000-82545em'/> <alias name='net0'/> <address type='pci' domain='0x0000' bus='0x02' slot='0x03' function='0x0'/> </interface> <input type='mouse' bus='ps2'> <alias name='input0'/> </input> <input type='keyboard' bus='ps2'> <alias name='input1'/> </input> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x01' slot='0x00' function='0x0'/> </source> <alias name='hostdev0'/> <address type='pci' domain='0x0000' bus='0x02' slot='0x04' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x01' slot='0x00' function='0x1'/> </source> <alias name='hostdev1'/> <address type='pci' domain='0x0000' bus='0x02' slot='0x05' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x06' slot='0x00' function='0x0'/> </source> <alias name='hostdev2'/> <address type='pci' domain='0x0000' bus='0x02' slot='0x01' function='0x0'/> </hostdev> <memballoon model='none'> <alias name='balloon0'/> </memballoon> </devices> <seclabel type='none' model='none'/> <seclabel type='dynamic' model='dac' relabel='yes'> <label>+0:+100</label> <imagelabel>+0:+100</imagelabel> </seclabel> <qemu:commandline> <qemu:arg value='-device'/> <qemu:arg value='usb-kbd'/> <qemu:arg value='-device'/> <qemu:arg value='usb-mouse'/> <qemu:arg value='-device'/> <qemu:arg value='isa-applesmc,osk=xxxxxxxxxxxxxxxxxxxxx'/> <qemu:arg value='-smbios'/> <qemu:arg value='type=2'/> <qemu:arg value='-cpu'/> <qemu:arg value='core2duo,vendor=GenuineIntel'/> </qemu:commandline> </domain>

I've been playing around with this and have been wondering if anyone could reproduce what I'm experiencing... As a method of stress testing, I use this terminal command to push the cpu (command entered in terminal inside of the VM) : yes > /dev/null & I enter that command once more for each virtual cpu of the machine (so for a VM with 2 vcpus I would enter it twice). If you check Activity Monitor you can see the CPU getting maxed out. You can then kill the process with: killall yes As soon as the guest hits 100% load this way, the machine seems to lock up almost entirely. Or at least mac's screensharing locks up so much that nothing is responsive for a second, and then I lose the vnc connection. I'm still able to force the OS to gracefully shutdown by using Apple Remote Desktop. I'm my expierence with official macs, several different hackintoshs, and ESXI osx guests, I've never seen such a severe lockup when stressing like this. I'm not doing any gpu passthrough, but for people that are I'm curious what this would be like then. Perhaps are there more libvirt configuration paramaters on the cpu that might change something? Would love to hear some thoughts that anyone has! I've tried pinning like the guide: <vcpu placement='static'>2</vcpu> <cputune> <vcpupin vcpu='0' cpuset='3'/> <vcpupin vcpu='1' cpuset='7'/> </cputune> and also stripping that down: <vcpu placement='static'>2</vcpu> My hardware that I'm testing on: Asus P8P67 DELUXE, i7-2600K My full xml also: <domain type='kvm' xmlns:qemu='http://libvirt.org/schemas/domain/qemu/1.0'> <name>vm-temp2</name> <uuid>0add5b24-41ed-412c-876f-91cd643a7283</uuid> <metadata/> <memory unit='KiB'>4194304</memory> <currentMemory unit='KiB'>4194304</currentMemory> <vcpu placement='static'>2</vcpu> <cputune> <vcpupin vcpu='0' cpuset='3'/> <vcpupin vcpu='1' cpuset='7'/> </cputune> <resource> <partition>/machine</partition> </resource> <os> <type arch='x86_64' machine='pc-q35-2.5'>hvm</type> <kernel>/mnt/cache/vm_images/isos/enoch_rev2795_boot</kernel> <boot dev='hd'/> <bootmenu enable='yes'/> </os> <features> <acpi/> </features> <cpu mode='custom' match='exact'> <model fallback='allow'>core2duo</model> </cpu> <clock offset='utc'/> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>destroy</on_crash> <devices> <emulator>/usr/bin/qemu-system-x86_64</emulator> <disk type='file' device='disk'> <driver name='qemu' type='qcow2'/> <source file='/mnt/cache/vm_images/vm-temp2.img'/> <target dev='hda' bus='sata'/> <address type='drive' controller='0' bus='0' target='0' unit='0'/> </disk> <controller type='usb' index='0'> <address type='pci' domain='0x0000' bus='0x02' slot='0x01' function='0x0'/> </controller> <controller type='sata' index='0'> <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/> </controller> <controller type='pci' index='0' model='pcie-root'/> <controller type='pci' index='1' model='dmi-to-pci-bridge'> <model name='i82801b11-bridge'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x1e' function='0x0'/> </controller> <controller type='pci' index='2' model='pci-bridge'> <model name='pci-bridge'/> <target chassisNr='2'/> <address type='pci' domain='0x0000' bus='0x01' slot='0x01' function='0x0'/> </controller> <interface type='bridge'> <mac address='00:16:3e:42:7d:a3'/> <source bridge='br0'/> <model type='e1000-82545em'/> <address type='pci' domain='0x0000' bus='0x02' slot='0x03' function='0x0'/> </interface> <video> <model type='vmvga' vram='16384' heads='1'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0'/> </video> <memballoon model='none'/> </devices> <seclabel type='none' model='none'/> <qemu:commandline> <qemu:arg value='-device'/> <qemu:arg value='usb-kbd'/> <qemu:arg value='-device'/> <qemu:arg value='usb-mouse'/> <qemu:arg value='-device'/> <qemu:arg value='isa-applesmc,osk=xxxxxxxxxxxxxxxxxxxxxxxxxxxxx'/> <qemu:arg value='-smbios'/> <qemu:arg value='type=2'/> </qemu:commandline> </domain>

I could be totally wrong because a ton of this is waaaay over my head, so take this with a grain of salt.... but instead of this: <qemu:arg value='-device'/> <qemu:arg value='ioh3420,bus=pcie.0,addr=1c.0,multifunction=on,port=1,chassis=1,id=root.1'/> <qemu:arg value='-device'/> <qemu:arg value='vfio-pci,host=0000:01:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on' /> <qemu:arg value='-device'/> <qemu:arg value='vfio-pci,host=0000:01:00.1,bus=root.1,addr=00.1'/> Shouldn't it be this (deleting the '0000')? <qemu:arg value='-device'/> <qemu:arg value='ioh3420,bus=pcie.0,addr=1c.0,multifunction=on,port=1,chassis=1,id=root.1'/> <qemu:arg value='-device'/> <qemu:arg value='vfio-pci,host=01:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on' /> <qemu:arg value='-device'/> <qemu:arg value='vfio-pci,host=01:00.1,bus=root.1,addr=00.1'/>

Thank you Frank and Russ. Yep- that wiki is fantastic and a great help. Thanks to you and everyone else who contributed to that! That totally is a good idea and makes sense- didn't consider that. I will definitely do that.

For several reasons, I would like to leave my ESXI in the dust and move on to the more exciting docker/ KVM world. I'm mapping out the workflow of the upgrade and would greatly appreciate and comments or input if anyone happens to have any. Or if you see any glaring errors in my thought process, I would love to hear them! Current hardware: Mobo: MBD-X9SCM-F-O CPU: Intel E3-1220V2 Memory: 2x4GB Kingston DDR3 1333 MHz PSU: SeaSonic 650-Watt SSR-650RM Crucial 64GB SSD (ESXI boot drive) HDN724040ALE640 4TB (parity) HDN724040ALE640 4TB (array) ST3000DM001 3TB (array) ST31000528AS 1TB (array) WD5000AAKS 500GB (cache) Upgrading hardware: CPU: E3-1275v2 Memory: Kingston 4x8GB DDR3 1600MHz PC3 12800 ECC KVR16E11K4/32 Currently I am running "unRAID Server Plus" Version 5.0 virtualized on ESXi 5.5.0. Unraid is installed on a usb drive attached to the virtual machine and the SATA drives are RDM mapped. My reasoning for upgrading the CPU is to gain the faster clock speed and hyperthreading. Also, as I understand it, the Integrated GPU of the E3-1275v2 can serve as unraid's GPU should I decide to add an additional GPU passed though to a VM in the future. While this memory is not included in Supermicro's certified memory list, I'm fairly certain it's compatible based off of reviews/ research of the memory. Planned upgrade steps: 1. run parity check 2. stop array, backup unraid flash drive 3. power down unraid, power down esxi 4. remove esxi boot drive 5. swap in CPU and Memory 6. test new hardware/ memtest86 7. upgrade USB drive to V6 8. boot v6 unraid 9. check/ fix drive assignments, run new permissions Thank you very much!