Nooke

hi there, is it possible to use libvirt hooks inside unRaid? What I want to do is run some specific bash scripts right before the start of a VM. And running another script as soon as the VM is stopped. on the libvirt documentation about hooks for my use case the "/etc/libvirt/hooks/qemu" would be the right one. but this is already a customized php script from unRaid and if I replace it with a bash script for my needs I would break the gui VM start/stop ability as it seems. VFIO-Tools on github has the specific qemu hook part to maintain hooks on a per vm basis. https://github.com/PassthroughPOST/VFIO-Tools would appreciate any support because I need that to allocate on the fly hugepages right before the VM is started. I could do that by starting my allocation bash script inside /boot/config/go but that would only do one part of the job (pre vm boot, not post shutdown) and I can't use any array specific parts for evaluating memory usage (eg /etc/libvirt is not accessable before array startup). cheers

post your xml please do you have the fps drops as soon as you move your mouse? if so, go to your mouse tool and change the frequency to 125Hz and check if it's better. I had that issue when running without "hypervisor" cpu flag. so better provide some more information about your system (VM xml, system devices, drivers etc) cheers

pretty simple - I just changed the cpu topology. I used the following <cpu mode='host-passthrough' check='none'> <topology sockets='1' cores='6' threads='2'/> <cache mode='passthrough'/> and now I'm using this instead <cpu mode='host-passthrough' check='none'> <topology sockets='2' cores='3' threads='2'/> <cache mode='passthrough'/> that made my L3 cache benchmark skyrocket. and overall smoothness of the windows 10 vm is improved. kinda have the most fps ever in cs:go and world of warcraft (stable!)

I had some serious fps drops and stutter in win 10 (not only in gaming). felt sluggish since last win 10 update. anyways I kinda fixed it. L3 cache benchmarks looking fine now: L3 read 388GB/s L3 write 300GB/s L3 copy 367GB/s L3 latency 10.6ns (6core 12threads) that's more like the results I would have expected at the beginning. If anyone else has some issues regarding this - could share my findings.

I did - no difference.

Thanks for sharing but I don't have a core pairing issue here. I'm using cores only from 1 numa node (eg node1, cores 6-11,18-23). Numa Node 1 is connected to my GPU aswell as my NMVe SDD (see lstopo attached) So my problem here is that with cores from 1 node depending on core assignments in win10 I get totally screwed benchmarks for L3 Cache performance in AIDA64.

Hi, so I have some serious differences in L3 cache performance for my win10 vm depending on cores being used. there must be something fishy... My current kernel options: append processor.max_cstate=1 nvme_core.default_ps_max_latency_us=0 kvm_amd npt=1 nested=1 amd_iommu=on isolcpus=6-11,18-23 nohz_full=6-11,18-23 rcu_nocbs=6-11,18-23 pcie_acs_override=downstream,multifunction vfio_iommu_type1.allow_unsafe_interrupts=1 initrd=/bzroot Here my current xml for 4core 8thread. Only difference for 5c/10t and 6c/12t would be the core-count, emulatorpin win10vm.xml Using unraid 6.8.0-rc3 latest windows 10 1903 as I'm still having issues with my system, appreciate any support cheers Nooke

Have to mention, most ppl will saturate their WAN in downstream not in upstream. Actually you can't shape the downstream at all (except in your local environment). QoS only works E2E and normal Internet Links don't have any QoS for customers. So I don't see the real benefit in using this pfSense solution except you have issues with your upstream bandwidth getting used too much. cheers

I made some benchmarks aswell. Not much difference between 440fx and Q35. https://docs.google.com/spreadsheets/d/1hhP34z_fSDPy2Uu2umJ1xfq5Zd4_F5IRchqAkUyiXJw/edit?usp=sharing

@rix you have the wrong machine type. this PCIe speed fix is for Q35 as 440FX has no PCIe Ports. Switch to Q35

looking forward to it thanks mate!

I'm on i440FX and dunno if it's worth it to switch to Q35. I had serious issues before with Q35 and i440FX is working kinda good right now. Switching template to Q35 broke my system the last time and I had to start by zero. So would like to know if there is much of a difference before starting from scratch again Anyone could do some comparison with both machine types on RC4 and share? Specs in signature.

Can anyone share some testing or benchmark for i440FX vs Q35 with this new PCIe patch? Would love a comparison.

sure, https://forum.level1techs.com/t/increasing-vfio-vga-performance/133443/84 there you go

well after upgrading to 6.7-rc3 I am in the same boat as you guys. already had latency issues before but it was manageable. I tried to go with TSC instead of HPET/Hypervclock. Latency dropped by alot but whole Windows VM became sluggish/unresponsive. As of right now I can't even get back to my 6.6 VM cause with rc3 update my flashdisk got corrupted and old VM xml is lost. Regarding the PCIe speed fix you are talking about, it's the one from level1techs right? If so, that one is only useful for Q35 machine type. Actually I can't even manage to get my DDR4 Latency back to 80-90ns..always sitting at 130-150ns even so I'm only allocating memory on the numa node where my cpu cores are pinned to. In level1techs forum there was a guy with hell like low Latency Even with his XML not possible to reach those latency on fresh install...sad