IamSpartacus

Yea I tried the ACS patch which does separate it but I get a Code 10 device cannot start in Windows so no dice so far.

@Warrentheo How did you pass this USB card through to a VM? I just got it installed and it's not showing up as a USB controller in an IOMMU group. It's showing under USB devices: Bus 003 Device 002: ID 2109:2812 VIA Labs, Inc. VL812 Hub Bus 004 Device 002: ID 2109:0812 VIA Labs, Inc. VL812 Hub EDIT: Nvmd. I got it working by isolating the USB hub to it's own IOMMU group and then adding the device id to vfio-pc.id= in syslinux.

@bastl You didn't by any chance try (and have success) passthroughing through the Wireless NIC to a Windows VM did you?

I'm trying to passthrough a Wireless NIC to a Win 10 VM. I've tried stubbing the device which gets it to show up in the list of Other PCI Devices. That then appends the XML to like like below but while the device passes through, Windows can not start the device and I get an Code 10. <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x05' slot='0x00' function='0x0'/> </source> <alias name='hostdev3'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x09' function='0x0'/> </hostdev> Here is the IOMMU group. IOMMU group 13: [1022:43ba] 01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset USB 3.1 xHCI Controller (rev 02) [1022:43b6] 01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset SATA Controller (rev 02) [1022:43b1] 01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset PCIe Bridge (rev 02) [1022:43b4] 02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) [1022:43b4] 02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) [1022:43b4] 02:05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) [1022:43b4] 02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) [1022:43b4] 02:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02) [8086:1539] 04:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03) [8086:24fb] 05:00.0 Network controller: Intel Corporation Dual Band Wireless-AC 3168NGW [Stone Peak] (rev 10) [8086:1539] 06:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03) [1b73:1100] 07:00.0 USB controller: Fresco Logic FL1100 USB 3.0 Host Controller (rev 10)

Done. Thanks again.

Tested transcoding six 4K HDR10 50-80Mbps files down to 2-4Mbps streams all at once. Obviously not at all a real world test because I'll never be transcoding 4K at all (at least not on purpose) but was cool to see how well my 1080Ti handled it. Thanks again so much to the LSIO team. I owe you all a round. Donate link?

Alright I got myself all setup now. I really wanted to get my first GPU working for the VM that way anytime I boot my server I've got video output. So I passed the vbios ROM to the VM with the first GPU passed through, but that just gave me an error 43 still. Then I found a post about making sure the server was booting in legacy mode and not UEFI mode. BINGO! That did the trick. I now have my first slot GPU passed through to my VM, driver loads fine, and no flickering or video distortion like I was getting before. 😁

Ahh, I've been playing around with a test container for all this so each time I've been adding/removing paths that's why it's been needing to be run again. Makes sense now. I only do manual container updates so I can easily just run the script on demand anytime I update Plex.

What's the best way to go about getting this script to run automatically after every restart/update of the Plex container?

Ahhh sweet, that worked thanks. Any reason why during Mobile Syncs I'm still seeing very high CPU usage (testing with the same video I'm testing live transcoding with). I see the GPU is being used but still seeing a lot of CPU usage during the process as well. Lack of decode support? EDIT: Nvmd, found the decode patch script.

First off, thank you so much the LSIO team for this. You made this process so easy and I know full well how much time it took to get this working so well. I think I have this working and I see the (hw) next to my test transcode but watch nvidia-smi is showing nothing under processes (1st pic). It's definitely reading that there is one because when I stop the video is shows "No processes found" as you can see in the second pic.

Lol yup. I mean, I did forget to mention I do play some VR with the Occulus Rift and I was dabbling into mining a little bit though that didn't last long. But yes, I fully admit it's an overkill system. Hense why I'm trying to now make use of all those spare resources. If i can get one of the 1080Ti's working in Plex with the unlocked nvidia driver thus not limiting the transcoding streams to 2, I can start adding some h265 media to my library which should free up some space.

Nope. I don't even have a gaming monitor because in all honesty I don't game much and if I do it's older stuff (ie. Remastered SC1, SuperSmash Brothers Melee in Dolphin, etc.) so it's not graphic intense. The system I build was WAY overkill for my needs but I like to go overboard sometimes :D). But yea, my monitor is a Dell 38in Ultrawide (just 60Hz).

If that's the case (which I'd expect to be the case based on how are boards are pretty much the same) than I do have the correct cores pinned and isolated in Unraid for the VM.

I sure do, thanks :D. As for your question about the flickering, it happens just sitting at the desktop with nothing open on the taskbar. As for the cores, I really don't know. I'd have to make one card disappear to know which card is assigned to which core die. Would simply removing power (with the system off of course) remove the GPU from being detected?

I did pass through the audio part of the GPU but does this fix apply if I'm only outputting via DP? EDIT: Ok i applied that fix, unfortunately I can't test it till I get home from work. I'm RDP'd into the VM right now but that is worthless for these testing purposes.

The monitor is not turning off power wise but the screen flickers completely black. What MS_fix are you talking about?

Good point. I always did think Prime95 was unreleastic. @bastl Here's my new lstopo output (you'll notice one NVMe gone as it's passed through) to the VM. I'm not having great luck with passing through my 1080Ti's though. When I try to pass through the GPU in slot 1 I get Error Code 43. When I try to passthrough the GPU in slot 3, it works but the screen goes black a lot. Sometimes every few minutes, sometimes every few seconds. I'm using the latest Nvidia drivers.

I built a Windows 10 VM and configured my network settings. Then I changed the graphics card to one of my 1080Ti's for passthrough. The VM boots up but it loses the newtork config (went from static to DHCP). It's as if the whole network card is getting reset because the the name of the adapter goes from Ethernet Adapter 1 to Ethernet Adapter 2. This keeps happening every time I go back and forth between VNC and GPU passthrough. Any way to stop this from happening?

Temps weren't really my issue in testing at 3.8GHz. I was idling around 27C and loading around 58-60C (I use HWMonitor by CPUID). But I had to bump the vcore up quite a bit in order to be stable in Prime95 using all 16 cores. I didn't do a ton of testing because i got preoccupied with other things like having my first child (this was a few months ago) so I will revisit this once I get all my VM stuff setup and working as I want it to.

What are your temps like at 4GHz @1.275 and what stress are you doing while seeing those temps? From what I've seen, that is quite a great chip you've got there. That's a very low vcore to be able to hit 4GHz.

The NVMe's I got figured out just like you said, based on the UD plugin. As for the GPU's I can't take them out of their slots because it's all together in a loop so I'd have to pull my loop apart. I guess I'll have to do trial and error with those. Thanks for the time on the UMA mode. For this project I set my BIOS settings back to default to upgrade the BIOS to 2.30 and then the latest (I was on 2.00). Once I get all my VM pass through config worked out I'll start testing OC's again. Previously I was at 3.8Ghz with 1.24vcore which I'm fine with if that's the best my chip can do.

@bastl How does one determine which device is in witch PCIe port? I have two identical 1080Ti's. Also, how did you determine which NVMe controller to pass through? I like you show 2 NVMe controllers. Attached is the output I got from lstopo,

Thanks for the link, that looks like a solid option I will definitely consider. I'm wondering if @bastl can comment since he has the same board as me and is passing through hardware to both Linux and Windows VMs. Have you successfully passed through some/all USB controllers on the ASRock x399 Taichi board to VMs?

I would need one with a USB 3.0 & 3.1 type C header. This is my front panel. I guess this would work if I could find a PCIe card with dual USB 3.0 headers and at least external USB ports. http://www.lian-li.com/product/pw-inc1tr/