Hello all, 

 

I have spent hours and hours watching the great How-To videos and looking through the forums but having some troubles. I am passing through a 1080TI on the non primary PCIE 3.0 x8 port, Disk Pass though using byID,  and passing through a USB controller on the PCIE 2.0 x1 port. On the first boot up or a complete shutdown the GPU and USB performs flawlessly. If I restart then I lose the GPU and USB passthrough.   I have added the vfio details on the syslinux/flash. I confirmed the USB controller allows RESET. 

label unRAID OS
  menu default
  kernel /bzimage
  append pcie_acs_override=id:1b21:1184 vfio-pci.ids=1b21:2142,1106:3483,8086:15b8 vfio_iommu_type1.allow_unsafe_interrupts=1 initrd=/bzroot

 

Items I have tried. 

• HyperV enabled and disabled. 
• GPU Rom included in XML and not included. 
• Tried to create a shutdown and startup script to devcon remove/disable and enable the devices. I could not get this work in a stable fashion. Think maybe credential problem??
• Created Task scheduler to call devcon disable and enable scripts. I could not get this work in a stable fashion. Think maybe credential problem??
• pcie_acs_override enabled and disabled. Currently just overriding the bridge for the USB controller. 
• USB 2.0 and USB 3.0 qemu xhci
• vfio_iommu_type1.allow_unsafe_interrupts=0 and 1
• Completely reformated and reinstalled Unraid 6.5.2.
• Deleted the image, reformated the drive, and reinstalled Windows 10 on a fresh VM image ALOT!!!!!

 

I have watched videos and videos and tried many different methods found in posts. 

 

I have considered creating a bash script in my unraid home directory with a sleep command that will start the VM after the status is not started. I could just shutdown VM everytime instead of restart and the script would start it after a length of time but that is extreme and not what I am looking for. 

 

I hope someone tells me that I am missing something easy and this is not normal behavior because I am all out of ideas! 

 

Hardware:

ASROCK X299 Tachi

32 GB DDR4 GSkill

I7-7820x

Nvidia 1080ti FE (PCIE3)

Cheap Nvidia card for primary GPU (PCIE1)

VIA 3.0 USB controller (PCIE2)4

 

I have attached my VM XML, IOMMU groups, and diagnostics. You can see the reboot at May 21 13:45:32. 

 

I hope someone can help. 

Thanks. 

 

win10XML.txt

pcieOverrideByIDIOMMU.txt

tower-diagnostics-20180521-1347.zip

Edited May 21, 20188 yr by Chowdr5

Too add  more details. 

The VM will boot up but I need to use libvirt USB plug in and attach a different keyboard. 

I can log into windows and see the 1080ti and via USB controller in device manager. 

1080ti - Windows has stopped this device because it has reported problems. Code 43

USB controller. - Windows has stopped this device because it has reported problems. Code 43. A USB port reset request failed. 

 

Thanks

 

Quote

<hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x17' slot='0x00' function='0x0'/>
      </source>
      <rom file='/mnt/user/ISO/vbios.rom'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x17' slot='0x00' function='0x1'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x07' slot='0x00' function='0x0'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x09' function='0x0'/>
    </hostdev>

 

I have a GTX 1080Ti and managed to pass it through without any issues, I did not need the rom file.

Try deleting the lines highlighted in black and let KVM reassign them to see if that works for you.

Hey Oldslugger, 

I removed the highlighted lines and started the VM. It started up cleanly and the <address> tags were recreated. Restarted and unfortunatley the GPU and USB did not reset. Windows error still occured in control panel. 

 

My hardware should allow this to work so I must be missing something. Any other ideas?

 

My sequence for install. 

Create VM with unformated SSD. 

Complete windows install. 

Go to control panel, update drivers using virtio disk. 

Goto virtio disk and install guest-agent. 

Install Nvidia drivers. 

Update power settings, disk frag/optimization, and windows searching indexing. 

 

Then I restart the machine and lose GPU and USB. 

 

Help?

 

 

 

 

 

Hi all, 

 

Sorry to be a pain but looking for some help. I truly have done hours and hours of research and tried multiple options but GPU and USB still errors on restart. 

 

Shutdown and Start works great and I can make do. But I hate giving up!

 

Thanks

 

I don't suppose there is a way to delete the <address> tags for each restart via a script or anything is there?

  <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>

 

If I delete these tags each time it looks like it boots up healthy each time .

 

 

Any progress on this? What is adding that line back after the fact? I thought XMLs were readonly at time of execution. Or is the interface adding the line when you save changes to the XML automatically?

 

Unfortunately I did not successfully resolve the issue and it wasn’t from lack of trying. I followed every video and how to post but if I restart the Windows machine it will not reset the USB controller or the Nvidia 1080Ti GPU. If I fully shut it down and stray from Unraid UI it works. I confirmed the USB controller has reset configuration. I returned back to barebones but would gladly return back to using Unraid if it can be resolved. 

For anyone who comes back to this post. Unraid 6.6.6 resolved all of my issues with the same hardware. GPU and USB reset works flawlessly after a restart. Also could setup a second Win10 box or CentOS box with a 1060 successfully. 

 

For those who need it, I used a Inateck USB controller which worked for Windows and LInux passthrough. 

https://www.amazon.com/gp/product/B00FPIMICA/ref=oh_aui_search_asin_title?ie=UTF8&amp;psc=1

 

Hardware:

ASROCK X299 Tachi

32 GB DDR4 GSkill

I7-7820x

Nvidia 1080ti FE (PCIE1)

Nvidia 1060 6GB (PCIE5)

Inateck/VIA 3.0 USB controller (PCIE2)4