September 19, 20169 yr Day 7/30 of my unRAID journey. I've setup my first test VM and it's running slower than I expected, given the spec of my machine (see signature) and I'm also getting choppy audio. The audio was really bad until I enabled MSI interupts for both the Nvidia audiocard and videocard (not sure if I was only supposed to do the audiocard), but it's still a bit choppy at times - listenable but not perfect. is there anything else I can do to fix? The machine generally is usuable as well, but I was expecting better performance than the 5211 cpumark that I'm getting, which is lower than the i5-3450 machine I've replaced. Good, in that I can hopefully run 3 VMs at this speed, but I was hoping for each one to fly a bit more. I've followed the tips in the wiki post http://lime-technology.com/wiki/index.php/UnRAID_6/VM_Guest_Support - is there anything I can do? I'm keen to find a solution that doesn't involve pinning isolating CPUs as I don't like the idea of permanently taking CPUs away from a multi-tasking machine. <domain type='kvm' id='3'> <name>Windows 10 - Zeena</name> <uuid>eab430d2-9405-a4fa-ab5d-d3111ffac370</uuid> <metadata> <vmtemplate xmlns="unraid" name="Windows 10" icon="windows.png" os="windows10"/> </metadata> <memory unit='KiB'>8388608</memory> <currentMemory unit='KiB'>8388608</currentMemory> <memoryBacking> <nosharepages/> <locked/> </memoryBacking> <vcpu placement='static'>8</vcpu> <cputune> <vcpupin vcpu='0' cpuset='10'/> <vcpupin vcpu='1' cpuset='11'/> <vcpupin vcpu='2' cpuset='12'/> <vcpupin vcpu='3' cpuset='13'/> <vcpupin vcpu='4' cpuset='24'/> <vcpupin vcpu='5' cpuset='25'/> <vcpupin vcpu='6' cpuset='26'/> <vcpupin vcpu='7' cpuset='27'/> </cputune> <resource> <partition>/machine</partition> </resource> <os> <type arch='x86_64' machine='pc-i440fx-2.5'>hvm</type> <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader> <nvram>/etc/libvirt/qemu/nvram/eab430d2-9405-a4fa-ab5d-d3111ffac370_VARS-pure-efi.fd</nvram> </os> <features> <acpi/> <apic/> <hyperv> <relaxed state='on'/> <vapic state='on'/> <spinlocks state='on' retries='8191'/> <vendor id='none'/> </hyperv> </features> <cpu mode='host-passthrough'> <topology sockets='1' cores='4' threads='2'/> </cpu> <clock offset='localtime'> <timer name='hypervclock' present='yes'/> <timer name='hpet' present='no'/> </clock> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/local/sbin/qemu</emulator> <disk type='file' device='disk'> <driver name='qemu' type='raw' cache='writeback'/> <source file='/mnt/user/domains/Windows 10 - Zeena/vdisk1.img'/> <backingStore/> <target dev='hdc' bus='virtio'/> <boot order='1'/> <alias name='virtio-disk2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> </disk> <disk type='file' device='cdrom'> <driver name='qemu' type='raw'/> <source file='/mnt/user/isos/Operating Systems/Windows10.iso'/> <backingStore/> <target dev='hda' bus='ide'/> <readonly/> <boot order='2'/> <alias name='ide0-0-0'/> <address type='drive' controller='0' bus='0' target='0' unit='0'/> </disk> <disk type='file' device='cdrom'> <driver name='qemu' type='raw'/> <source file='/mnt/user/isos/virtio-win-0.1.118-2.iso'/> <backingStore/> <target dev='hdb' bus='ide'/> <readonly/> <alias name='ide0-0-1'/> <address type='drive' controller='0' bus='0' target='0' unit='1'/> </disk> <controller type='usb' index='0' model='ich9-ehci1'> <alias name='usb'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/> </controller> <controller type='usb' index='0' model='ich9-uhci1'> <alias name='usb'/> <master startport='0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/> </controller> <controller type='usb' index='0' model='ich9-uhci2'> <alias name='usb'/> <master startport='2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/> </controller> <controller type='usb' index='0' model='ich9-uhci3'> <alias name='usb'/> <master startport='4'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/> </controller> <controller type='pci' index='0' model='pci-root'> <alias name='pci.0'/> </controller> <controller type='ide' index='0'> <alias name='ide'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <controller type='virtio-serial' index='0'> <alias name='virtio-serial0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </controller> <interface type='bridge'> <mac address='52:54:00:8e:42:48'/> <source bridge='br0'/> <target dev='vnet0'/> <model type='virtio'/> <alias name='net0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </interface> <serial type='pty'> <source path='/dev/pts/4'/> <target port='0'/> <alias name='serial0'/> </serial> <console type='pty' tty='/dev/pts/4'> <source path='/dev/pts/4'/> <target type='serial' port='0'/> <alias name='serial0'/> </console> <channel type='unix'> <source mode='bind' path='/var/lib/libvirt/qemu/channel/target/domain-Windows 10 - Zeena/org.qemu.guest_agent.0'/> <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/> <alias name='channel0'/> <address type='virtio-serial' controller='0' bus='0' port='1'/> </channel> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x06' slot='0x00' function='0x0'/> </source> <alias name='hostdev0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x06' slot='0x00' function='0x1'/> </source> <alias name='hostdev1'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='no'> <source> <vendor id='0x04d9'/> <product id='0x1503'/> <address bus='3' device='2'/> </source> <alias name='hostdev2'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='no'> <source> <vendor id='0x1bcf'/> <product id='0x0007'/> <address bus='3' device='3'/> </source> <alias name='hostdev3'/> </hostdev> <memballoon model='virtio'> <alias name='balloon0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/> </memballoon> </devices> </domain>
September 20, 20169 yr Try this config: <domain type='kvm' id='3'> <name>Windows 10 - Zeena</name> <uuid>eab430d2-9405-a4fa-ab5d-d3111ffac370</uuid> <metadata> <vmtemplate xmlns="unraid" name="Windows 10" icon="windows.png" os="windows10"/> </metadata> <memory unit='KiB'>8388608</memory> <currentMemory unit='KiB'>8388608</currentMemory> <memoryBacking> <nosharepages/> <locked/> </memoryBacking> <vcpu placement='static'>8</vcpu> <cputune> <vcpupin vcpu='0' cpuset='10'/> <vcpupin vcpu='1' cpuset='11'/> <vcpupin vcpu='2' cpuset='12'/> <vcpupin vcpu='3' cpuset='13'/> <emulatorpin cpuset='24-27'/> </cputune> <resource> <partition>/machine</partition> </resource> <os> <type arch='x86_64' machine='pc-i440fx-2.5'>hvm</type> <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader> <nvram>/etc/libvirt/qemu/nvram/eab430d2-9405-a4fa-ab5d-d3111ffac370_VARS-pure-efi.fd</nvram> </os> <features> <acpi/> <apic/> <hyperv> <relaxed state='on'/> <vapic state='on'/> <spinlocks state='on' retries='8191'/> <vendor id='none'/> </hyperv> </features> <cpu mode='host-passthrough'> <topology sockets='1' cores='4' threads='1'/> </cpu> <clock offset='localtime'> <timer name='hypervclock' present='yes'/> <timer name='hpet' present='no'/> </clock> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/local/sbin/qemu</emulator> <disk type='file' device='disk'> <driver name='qemu' type='raw' cache='writeback'/> <source file='/mnt/user/domains/Windows 10 - Zeena/vdisk1.img'/> <backingStore/> <target dev='hdc' bus='virtio'/> <boot order='1'/> <alias name='virtio-disk2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> </disk> <disk type='file' device='cdrom'> <driver name='qemu' type='raw'/> <source file='/mnt/user/isos/Operating Systems/Windows10.iso'/> <backingStore/> <target dev='hda' bus='ide'/> <readonly/> <boot order='2'/> <alias name='ide0-0-0'/> <address type='drive' controller='0' bus='0' target='0' unit='0'/> </disk> <disk type='file' device='cdrom'> <driver name='qemu' type='raw'/> <source file='/mnt/user/isos/virtio-win-0.1.118-2.iso'/> <backingStore/> <target dev='hdb' bus='ide'/> <readonly/> <alias name='ide0-0-1'/> <address type='drive' controller='0' bus='0' target='0' unit='1'/> </disk> <controller type='usb' index='0' model='ich9-ehci1'> <alias name='usb'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/> </controller> <controller type='usb' index='0' model='ich9-uhci1'> <alias name='usb'/> <master startport='0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/> </controller> <controller type='usb' index='0' model='ich9-uhci2'> <alias name='usb'/> <master startport='2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/> </controller> <controller type='usb' index='0' model='ich9-uhci3'> <alias name='usb'/> <master startport='4'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/> </controller> <controller type='pci' index='0' model='pci-root'> <alias name='pci.0'/> </controller> <controller type='ide' index='0'> <alias name='ide'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <controller type='virtio-serial' index='0'> <alias name='virtio-serial0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </controller> <interface type='bridge'> <mac address='52:54:00:8e:42:48'/> <source bridge='br0'/> <target dev='vnet0'/> <model type='virtio'/> <alias name='net0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </interface> <serial type='pty'> <source path='/dev/pts/4'/> <target port='0'/> <alias name='serial0'/> </serial> <console type='pty' tty='/dev/pts/4'> <source path='/dev/pts/4'/> <target type='serial' port='0'/> <alias name='serial0'/> </console> <channel type='unix'> <source mode='bind' path='/var/lib/libvirt/qemu/channel/target/domain-Windows 10 - Zeena/org.qemu.guest_agent.0'/> <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/> <alias name='channel0'/> <address type='virtio-serial' controller='0' bus='0' port='1'/> </channel> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x06' slot='0x00' function='0x0'/> </source> <alias name='hostdev0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x06' slot='0x00' function='0x1'/> </source> <alias name='hostdev1'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='no'> <source> <vendor id='0x04d9'/> <product id='0x1503'/> <address bus='3' device='2'/> </source> <alias name='hostdev2'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='no'> <source> <vendor id='0x1bcf'/> <product id='0x0007'/> <address bus='3' device='3'/> </source> <alias name='hostdev3'/> </hostdev> <memballoon model='virtio'> <alias name='balloon0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/> </memballoon> </devices> </domain> I changed <cputune> <vcpupin vcpu='0' cpuset='10'/> <vcpupin vcpu='1' cpuset='11'/> <vcpupin vcpu='2' cpuset='12'/> <vcpupin vcpu='3' cpuset='13'/> <emulatorpin cpuset='24-27'/> </cputune> and <cpu mode='host-passthrough'> <topology sockets='1' cores='4' threads='1'/> </cpu> You can also "isolcpus=" the Cores. Try isolating these cores: isolcpus=10-13,24-27 Go to Main -> Click on "Flash" -> add "isolcpus=10-13,24-27" before "initrd=/bzroot". label unRAID OS menu default kernel /bzimage append isolcpus=10-13,24-27 initrd=/bzroot Doing this might decrease performance a little bit but will improve latency. The MSI fix should stay enabled.
September 20, 20169 yr Author <cputune> <vcpupin vcpu='0' cpuset='10'/> <vcpupin vcpu='1' cpuset='11'/> <vcpupin vcpu='2' cpuset='12'/> <vcpupin vcpu='3' cpuset='13'/> <emulatorpin cpuset='24-27'/> </cputune> and <cpu mode='host-passthrough'> <topology sockets='1' cores='4' threads='1'/> </cpu> You can also "isolcpus=" the Cores. Try isolating these cores: isolcpus=10-13,24-27 Go to Main -> Click on "Flash" -> add "isolcpus=10-13,24-27" before "initrd=/bzroot". label unRAID OS menu default kernel /bzimage append isolcpus=10-13,24-27 initrd=/bzroot Doing this might decrease performance a little bit but will improve latency. The MSI fix should stay enabled. Going just 4 physical cores still made my audio (play music) stutter. I haven't tried isolating cores yet as my machine is pre-clearing disks. Will try later, but not keen as want unRAID to be able to multi-task fully. I've done some testing and here are my results (Cores, HT Y/N, EmulatorPin Y/N, CPUMark, Passmark, Stutter - Y/N) - 4,Y,Y, 5282, 1716, Y - 4,N,Y,4091,1753,N - 4,Y,Y,5396,1729,Y - 6,N,Y,5821,1813,Y (not much) - 6,Y,N,7559,1785,Y (not much) - 6,Y,Y,7554,1746 Y (not much) The stuttering with 6 physical cores is bearable as it's so infrequent and I only hear it when I really focus in trying to hear it. I don't game, so the occasional stutter (if any) is fine. I'm going to use the 6 physical/12 logical core options for a bit longer to see if I experience more problems as I'm only testing for about 3 mins by playing the same track over and over. I'm chuffed with a CPUmark of 7.5k - my CPU average according to cpubenchmark is 17.96k so roughly for 6/14 cores I should be getting 7.7K so 7.5K for a VM seems ace to me. My old PC was rated at 6.4k and it had to do all my Plex, sabnzbd stuff as well - brilliant! I plan to run two VMs so hopefully both will get this amount when unRAID isn't busy. The 2nd VM will never get worked hard, so I might isolate the CPUs on the 1st as I doubt unRAID will need to access all 14 cores at the same time - 8 should be enough. Buying my licence now as I've finished the main tasks I wanted to do first! Remaining tasks: (i) passingthrough HD6450 in first PCIe slot. Tried quickly and didn't work so think I need to mess around with BIOS (ii) Find a way to run only Torrents behind VPN so don't mess up plex. DelugeVPN didn't work for me with VPN on
September 26, 20169 yr Author ok, it's got bad again today. Help please! It'll play fine (streaming Google Play Music) for a few mins, then it'll go all crackly and slow and unlistenable - not sure why. Video playback stutters as well - I imagine if I had any PC games they would lag badly as well. PC works fine otherwise, just audio and video go weird. Reboot VM works for a while, then it does it all again. I'm not sure what's changed - I can't reboot unRAID at the moment as I'm preclearing a disk (really wish there was a way to resume a preclear). I've done the MSI fix and the number in brackets under interrupt request in Device Manger is positive. Other than the audio stuttering, everything else is going well on day 13 of my first server. dzmm-diagnostics-20160926-1046.zip
September 26, 20169 yr Reading this thread with interest as I have an equally capable 2660V3 @2.6Ghz Xeon. In my xml I pinned cores 0,10 (hyperthreaded pair) for the emulator and isolcpus for 8 cores 3,4,5,6,13,14,15,16 (hyperthreaded pair). Now, I'm not sure this is optimum but I don't get any stutter and I'm passing through a Realtek1150 onboard audio and nvidia 980ti. I also disabled C6,C1E,speedstep but kept turbo boost enabled in the BIOS so all my cores run at a minum of 2.6Ghz with the option to boost to 3Ghz+. I only get lag,stutter if a second VM uses any of the same cores/threads as the primary VM. Not sure if any of the above will help in your case.
September 26, 20169 yr Try this config: <domain type='kvm' id='3'> <name>Windows 10 - Zeena</name> <uuid>eab430d2-9405-a4fa-ab5d-d3111ffac370</uuid> <metadata> <vmtemplate xmlns="unraid" name="Windows 10" icon="windows.png" os="windows10"/> </metadata> <memory unit='KiB'>8388608</memory> <currentMemory unit='KiB'>8388608</currentMemory> <memoryBacking> <nosharepages/> <locked/> </memoryBacking> <vcpu placement='static'>8</vcpu> <cputune> <vcpupin vcpu='0' cpuset='10'/> <vcpupin vcpu='1' cpuset='11'/> <vcpupin vcpu='2' cpuset='12'/> <vcpupin vcpu='3' cpuset='13'/> <emulatorpin cpuset='24-27'/> </cputune> <resource> <partition>/machine</partition> </resource> <os> <type arch='x86_64' machine='pc-i440fx-2.5'>hvm</type> <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader> <nvram>/etc/libvirt/qemu/nvram/eab430d2-9405-a4fa-ab5d-d3111ffac370_VARS-pure-efi.fd</nvram> </os> <features> <acpi/> <apic/> <hyperv> <relaxed state='on'/> <vapic state='on'/> <spinlocks state='on' retries='8191'/> <vendor id='none'/> </hyperv> </features> <cpu mode='host-passthrough'> <topology sockets='1' cores='4' threads='1'/> </cpu> <clock offset='localtime'> <timer name='hypervclock' present='yes'/> <timer name='hpet' present='no'/> </clock> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/local/sbin/qemu</emulator> <disk type='file' device='disk'> <driver name='qemu' type='raw' cache='writeback'/> <source file='/mnt/user/domains/Windows 10 - Zeena/vdisk1.img'/> <backingStore/> <target dev='hdc' bus='virtio'/> <boot order='1'/> <alias name='virtio-disk2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> </disk> <disk type='file' device='cdrom'> <driver name='qemu' type='raw'/> <source file='/mnt/user/isos/Operating Systems/Windows10.iso'/> <backingStore/> <target dev='hda' bus='ide'/> <readonly/> <boot order='2'/> <alias name='ide0-0-0'/> <address type='drive' controller='0' bus='0' target='0' unit='0'/> </disk> <disk type='file' device='cdrom'> <driver name='qemu' type='raw'/> <source file='/mnt/user/isos/virtio-win-0.1.118-2.iso'/> <backingStore/> <target dev='hdb' bus='ide'/> <readonly/> <alias name='ide0-0-1'/> <address type='drive' controller='0' bus='0' target='0' unit='1'/> </disk> <controller type='usb' index='0' model='ich9-ehci1'> <alias name='usb'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/> </controller> <controller type='usb' index='0' model='ich9-uhci1'> <alias name='usb'/> <master startport='0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/> </controller> <controller type='usb' index='0' model='ich9-uhci2'> <alias name='usb'/> <master startport='2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/> </controller> <controller type='usb' index='0' model='ich9-uhci3'> <alias name='usb'/> <master startport='4'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/> </controller> <controller type='pci' index='0' model='pci-root'> <alias name='pci.0'/> </controller> <controller type='ide' index='0'> <alias name='ide'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <controller type='virtio-serial' index='0'> <alias name='virtio-serial0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </controller> <interface type='bridge'> <mac address='52:54:00:8e:42:48'/> <source bridge='br0'/> <target dev='vnet0'/> <model type='virtio'/> <alias name='net0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </interface> <serial type='pty'> <source path='/dev/pts/4'/> <target port='0'/> <alias name='serial0'/> </serial> <console type='pty' tty='/dev/pts/4'> <source path='/dev/pts/4'/> <target type='serial' port='0'/> <alias name='serial0'/> </console> <channel type='unix'> <source mode='bind' path='/var/lib/libvirt/qemu/channel/target/domain-Windows 10 - Zeena/org.qemu.guest_agent.0'/> <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/> <alias name='channel0'/> <address type='virtio-serial' controller='0' bus='0' port='1'/> </channel> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x06' slot='0x00' function='0x0'/> </source> <alias name='hostdev0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x06' slot='0x00' function='0x1'/> </source> <alias name='hostdev1'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='no'> <source> <vendor id='0x04d9'/> <product id='0x1503'/> <address bus='3' device='2'/> </source> <alias name='hostdev2'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='no'> <source> <vendor id='0x1bcf'/> <product id='0x0007'/> <address bus='3' device='3'/> </source> <alias name='hostdev3'/> </hostdev> <memballoon model='virtio'> <alias name='balloon0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/> </memballoon> </devices> </domain> I changed <cputune> <vcpupin vcpu='0' cpuset='10'/> <vcpupin vcpu='1' cpuset='11'/> <vcpupin vcpu='2' cpuset='12'/> <vcpupin vcpu='3' cpuset='13'/> <emulatorpin cpuset='24-27'/> </cputune> and <cpu mode='host-passthrough'> <topology sockets='1' cores='4' threads='1'/> </cpu> You can also "isolcpus=" the Cores. Try isolating these cores: isolcpus=10-13,24-27 Go to Main -> Click on "Flash" -> add "isolcpus=10-13,24-27" before "initrd=/bzroot". label unRAID OS menu default kernel /bzimage append isolcpus=10-13,24-27 initrd=/bzroot Doing this might decrease performance a little bit but will improve latency. The MSI fix should stay enabled. @f3dora In your recommendation above, you suggest isolcpu 24-27 and emulator pin 24-27. It is my understanding that you use isolcpu parameter to prevent UNRAID host processes consuming cores that are assigned to a VM? Why then in your example you would isolate cores 24-27 for a VM but also pin those same cores for UNRAID to use?
September 26, 20169 yr Author Reading this thread with interest as I have an equally capable 2660V3 @2.6Ghz Xeon. In my xml I pinned cores 0,10 (hyperthreaded pair) for the emulator and isolcpus for 8 cores 3,4,5,6,13,14,15,16 (hyperthreaded pair). Now, I'm not sure this is optimum but I don't get any stutter and I'm passing through a Realtek1150 onboard audio and nvidia 980ti. I also disabled C6,C1E,speedstep but kept turbo boost enabled in the BIOS so all my cores run at a minum of 2.6Ghz with the option to boost to 3Ghz+. I only get lag,stutter if a second VM uses any of the same cores/threads as the primary VM. Not sure if any of the above will help in your case. I think I'm going to have to give in and isolate the CPUs. To be honest, I've come nowhere near maxing out the CPU so I should be able to afford this. I did a rough stress test last week with about 7 Plex streams going - it started struggling on the 7th, but I think the problem was my wi-fi network and not my server as it only hit 50% usage, as my server is on a wifi bridge and all my clients were wireless. That's more than enough! I think I'll try isolating 4 pairs rather than 6 so that I don't take many away, as all I'm really running on my VM to be honest is chrome now that I've got all my dockers setup. I tried all the bios settings last week e.g. disabling all c states, although I think speedstep might still be on - so I'll try that next time I can reboot. Thanks. I also had emulatorpin for cores 0,1 (although unraid keeps changing this recently to cpuset=0-1 from cpuset=0,1) - I think I'll try your way and go for a HT pair as that might help as well.
September 26, 20169 yr Author I also had emulatorpin for cores 0,1 (although unraid keeps changing this recently to cpuset=0-1 from cpuset=0,1) - I think I'll try your way and go for a HT pair as that might help as well. Changing emulatorpin to: <emulatorpin cpuset='0,14'/> seems to have done the trick - 45 mins in and no stutter on audio. Makes sense and I'm kind of kicking myself that I didn't realise 0,1 was a bit daft. I'll try isolating and double-checking bios settings next. Thanks mikeyosm Update: stuttering started again. Will try isolating once I can reboot.
September 26, 20169 yr @f3dora In your recommendation above, you suggest isolcpu 24-27 and emulator pin 24-27. It is my understanding that you use isolcpu parameter to prevent UNRAID host processes consuming cores that are assigned to a VM? Why then in your example you would isolate cores 24-27 for a VM but also pin those same cores for UNRAID to use? I think that the manually pinned emulator ignores the isolated CPUs, isolcpus just prevents the system from automatically selecting these cores. Sadly it is hard to find information about this so i might be wrong.
September 28, 20169 yr Author latest update - ran some tests with pinned cores: - 6 unpinned core pairs: CPUmark 9445, Passmark 2174 ( vastly improved by turning off C states and speedstep in the bios since previous tests) - 4 unpinned core pairs: CPUmark 6623, Passmark 2115 - 4 pinned core pairs: CPUmark 9831, Passmark 2047 Shows the impact of bios settings and the better performance of pinned cores Vs unpinned. I'm going to play some music now to see if the stuttering has gone with my new unpinned and pinned scenarios. Preference is for unpinned as stated before.
September 29, 20169 yr latest update - ran some tests with pinned cores: - 6 unpinned core pairs: CPUmark 9445, Passmark 2174 ( vastly improved by turning off C states and speedstep in the bios since previous tests) - 4 unpinned core pairs: CPUmark 6623, Passmark 2115 - 4 pinned core pairs: CPUmark 9831, Passmark 2047 Shows the impact of bios settings and the better performance of pinned cores Vs unpinned. I'm going to play some music now to see if the stuttering has gone with my new unpinned and pinned scenarios. Preference is for unpinned as stated before. 9831 cpumark is pretty good for a processor @ 2.0ghz. My 2660V3 runs at 2.60ghz and I only get 7,700 cpu mark with 4 pinned core pairs. C1 C6 and speedstep is disabled too. Can you show me your xml please?
September 29, 20169 yr Author 9831 cpumark is pretty good for a processor @ 2.0ghz. My 2660V3 runs at 2.60ghz and I only get 7,700 cpu mark with 4 pinned core pairs. C1 C6 and speedstep is disabled too. Can you show me your xml please? Here you go <domain type='kvm' id='1'> <name>Windows 10 - Nvidia</name> <uuid>072617e6-bd86-aa40-2274-cb6a2d0e2a2c</uuid> <metadata> <vmtemplate xmlns="unraid" name="Windows 10" icon="windows.png" os="windows10"/> </metadata> <memory unit='KiB'>8388608</memory> <currentMemory unit='KiB'>8388608</currentMemory> <memoryBacking> <nosharepages/> <locked/> </memoryBacking> <vcpu placement='static'>12</vcpu> <cputune> <vcpupin vcpu='0' cpuset='8'/> <vcpupin vcpu='1' cpuset='9'/> <vcpupin vcpu='2' cpuset='10'/> <vcpupin vcpu='3' cpuset='11'/> <vcpupin vcpu='4' cpuset='12'/> <vcpupin vcpu='5' cpuset='13'/> <vcpupin vcpu='6' cpuset='22'/> <vcpupin vcpu='7' cpuset='23'/> <vcpupin vcpu='8' cpuset='24'/> <vcpupin vcpu='9' cpuset='25'/> <vcpupin vcpu='10' cpuset='26'/> <vcpupin vcpu='11' cpuset='27'/> <emulatorpin cpuset='0,14'/> </cputune> <resource> <partition>/machine</partition> </resource> <os> <type arch='x86_64' machine='pc-i440fx-2.5'>hvm</type> <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader> <nvram>/etc/libvirt/qemu/nvram/072617e6-bd86-aa40-2274-cb6a2d0e2a2c_VARS-pure-efi.fd</nvram> </os> <features> <acpi/> <apic/> <hyperv> <relaxed state='on'/> <vapic state='on'/> <spinlocks state='on' retries='8191'/> <vendor id='none'/> </hyperv> </features> <cpu mode='host-passthrough'> <topology sockets='1' cores='6' threads='2'/> </cpu> <clock offset='localtime'> <timer name='hypervclock' present='yes'/> <timer name='hpet' present='no'/> </clock> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/local/sbin/qemu</emulator> <disk type='file' device='disk'> <driver name='qemu' type='raw' cache='writeback'/> <source file='/mnt/user/domains/Windows 10 - Nvidia/vdisk1.img'/> <backingStore/> <target dev='hdc' bus='virtio'/> <boot order='1'/> <alias name='virtio-disk2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> </disk> <disk type='file' device='cdrom'> <driver name='qemu' type='raw'/> <source file='/mnt/user/isos/Operating Systems/Windows10.iso'/> <backingStore/> <target dev='hda' bus='ide'/> <readonly/> <boot order='2'/> <alias name='ide0-0-0'/> <address type='drive' controller='0' bus='0' target='0' unit='0'/> </disk> <disk type='file' device='cdrom'> <driver name='qemu' type='raw'/> <source file='/mnt/user/isos/virtio-win-0.1.118-2.iso'/> <backingStore/> <target dev='hdb' bus='ide'/> <readonly/> <alias name='ide0-0-1'/> <address type='drive' controller='0' bus='0' target='0' unit='1'/> </disk> <controller type='usb' index='0' model='nec-xhci'> <alias name='usb'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/> </controller> <controller type='pci' index='0' model='pci-root'> <alias name='pci.0'/> </controller> <controller type='ide' index='0'> <alias name='ide'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <controller type='virtio-serial' index='0'> <alias name='virtio-serial0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </controller> <interface type='bridge'> <mac address='52:54:00:ce:97:84'/> <source bridge='br0'/> <target dev='vnet0'/> <model type='virtio'/> <alias name='net0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </interface> <serial type='pty'> <source path='/dev/pts/0'/> <target port='0'/> <alias name='serial0'/> </serial> <console type='pty' tty='/dev/pts/0'> <source path='/dev/pts/0'/> <target type='serial' port='0'/> <alias name='serial0'/> </console> <channel type='unix'> <source mode='bind' path='/var/lib/libvirt/qemu/channel/target/domain-Windows 10 - Nvidia/org.qemu.guest_agent.0'/> <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/> <alias name='channel0'/> <address type='virtio-serial' controller='0' bus='0' port='1'/> </channel> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x06' slot='0x00' function='0x0'/> </source> <alias name='hostdev0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x06' slot='0x00' function='0x1'/> </source> <alias name='hostdev1'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='no'> <source> <vendor id='0x045e'/> <product id='0x0745'/> <address bus='3' device='5'/> </source> <alias name='hostdev2'/> </hostdev> <memballoon model='virtio'> <alias name='balloon0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/> </memballoon> </devices> </domain>
September 29, 20169 yr 9831 cpumark is pretty good for a processor @ 2.0ghz. My 2660V3 runs at 2.60ghz and I only get 7,700 cpu mark with 4 pinned core pairs. C1 C6 and speedstep is disabled too. Can you show me your xml please? Here you go <domain type='kvm' id='1'> <name>Windows 10 - Nvidia</name> <uuid>072617e6-bd86-aa40-2274-cb6a2d0e2a2c</uuid> <metadata> <vmtemplate xmlns="unraid" name="Windows 10" icon="windows.png" os="windows10"/> </metadata> <memory unit='KiB'>8388608</memory> <currentMemory unit='KiB'>8388608</currentMemory> <memoryBacking> <nosharepages/> <locked/> </memoryBacking> <vcpu placement='static'>12</vcpu> <cputune> <vcpupin vcpu='0' cpuset='8'/> <vcpupin vcpu='1' cpuset='9'/> <vcpupin vcpu='2' cpuset='10'/> <vcpupin vcpu='3' cpuset='11'/> <vcpupin vcpu='4' cpuset='12'/> <vcpupin vcpu='5' cpuset='13'/> <vcpupin vcpu='6' cpuset='22'/> <vcpupin vcpu='7' cpuset='23'/> <vcpupin vcpu='8' cpuset='24'/> <vcpupin vcpu='9' cpuset='25'/> <vcpupin vcpu='10' cpuset='26'/> <vcpupin vcpu='11' cpuset='27'/> <emulatorpin cpuset='0,14'/> </cputune> <resource> <partition>/machine</partition> </resource> <os> <type arch='x86_64' machine='pc-i440fx-2.5'>hvm</type> <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader> <nvram>/etc/libvirt/qemu/nvram/072617e6-bd86-aa40-2274-cb6a2d0e2a2c_VARS-pure-efi.fd</nvram> </os> <features> <acpi/> <apic/> <hyperv> <relaxed state='on'/> <vapic state='on'/> <spinlocks state='on' retries='8191'/> <vendor id='none'/> </hyperv> </features> <cpu mode='host-passthrough'> <topology sockets='1' cores='6' threads='2'/> </cpu> <clock offset='localtime'> <timer name='hypervclock' present='yes'/> <timer name='hpet' present='no'/> </clock> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/local/sbin/qemu</emulator> <disk type='file' device='disk'> <driver name='qemu' type='raw' cache='writeback'/> <source file='/mnt/user/domains/Windows 10 - Nvidia/vdisk1.img'/> <backingStore/> <target dev='hdc' bus='virtio'/> <boot order='1'/> <alias name='virtio-disk2'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> </disk> <disk type='file' device='cdrom'> <driver name='qemu' type='raw'/> <source file='/mnt/user/isos/Operating Systems/Windows10.iso'/> <backingStore/> <target dev='hda' bus='ide'/> <readonly/> <boot order='2'/> <alias name='ide0-0-0'/> <address type='drive' controller='0' bus='0' target='0' unit='0'/> </disk> <disk type='file' device='cdrom'> <driver name='qemu' type='raw'/> <source file='/mnt/user/isos/virtio-win-0.1.118-2.iso'/> <backingStore/> <target dev='hdb' bus='ide'/> <readonly/> <alias name='ide0-0-1'/> <address type='drive' controller='0' bus='0' target='0' unit='1'/> </disk> <controller type='usb' index='0' model='nec-xhci'> <alias name='usb'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/> </controller> <controller type='pci' index='0' model='pci-root'> <alias name='pci.0'/> </controller> <controller type='ide' index='0'> <alias name='ide'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <controller type='virtio-serial' index='0'> <alias name='virtio-serial0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </controller> <interface type='bridge'> <mac address='52:54:00:ce:97:84'/> <source bridge='br0'/> <target dev='vnet0'/> <model type='virtio'/> <alias name='net0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </interface> <serial type='pty'> <source path='/dev/pts/0'/> <target port='0'/> <alias name='serial0'/> </serial> <console type='pty' tty='/dev/pts/0'> <source path='/dev/pts/0'/> <target type='serial' port='0'/> <alias name='serial0'/> </console> <channel type='unix'> <source mode='bind' path='/var/lib/libvirt/qemu/channel/target/domain-Windows 10 - Nvidia/org.qemu.guest_agent.0'/> <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/> <alias name='channel0'/> <address type='virtio-serial' controller='0' bus='0' port='1'/> </channel> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x06' slot='0x00' function='0x0'/> </source> <alias name='hostdev0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x06' slot='0x00' function='0x1'/> </source> <alias name='hostdev1'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/> </hostdev> <hostdev mode='subsystem' type='usb' managed='no'> <source> <vendor id='0x045e'/> <product id='0x0745'/> <address bus='3' device='5'/> </source> <alias name='hostdev2'/> </hostdev> <memballoon model='virtio'> <alias name='balloon0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/> </memballoon> </devices> </domain> are those hyperthread pairs correct? E.g. 8,22 - 9,23 etc? I got a cpumark of 10,500 with 12 cores.
September 29, 20169 yr Author yeah 14 physical cores 0-13, and HT 14-27. I'll have a look at my bios settings to see what else contributed to the 2k increase in passmark, but I disabled almost everything that mentioned throttling.
September 29, 20169 yr yeah 14 physical cores 0-13, and HT 14-27. I'll have a look at my bios settings to see what else contributed to the 2k increase in passmark, but I disabled almost everything that mentioned throttling. Have you enabled MSI interrupts? I had to do that for every single win10 vm that uses hdmi audio: http://lime-technology.com/wiki/index.php/UnRAID_Manual_6#Enable_MSI_for_Interrupts_to_Fix_HDMI_Audio_Support
September 29, 20169 yr Author yes I did. Audio working fine now so not sure what did the trick - messing with cores or bios changes
Archived
This topic is now archived and is closed to further replies.