Jump to content
mattz

Win10 VM graphics pass-through broke after AMD BIOS update

112 posts in this topic Last Reply

Recommended Posts

10 hours ago, kilobit said:

Im wanting to completely upgrade my current setup for gpu passthrough and was wanting a ryzen 9 3900x  Can anyone tell me if there is any motherboard that works correctly with passthrough on this chip?

thanks

X370 Taichi + ryzen 3900x working fine for me. 

Share this post


Link to post
11 hours ago, boris said:

X370 Taichi + ryzen 3900x working fine for me. 

Thank you for responding,  Im curious what gpus are you passing through and whats type of ram do you have?  I guess there would be no real benefits from me to get a 470/570.

Share this post


Link to post
8 minutes ago, kilobit said:

Thank you for responding,  Im curious what gpus are you passing through and whats type of ram do you have?  I guess there would be no real benefits from me to get a 470/570.

I have a 1080 ti passed through and using trident z neo 3600 32gb as RAM.

Share this post


Link to post

I want to share that I had a Ryzen 2700x on an Asus x470-F initially and I did have to downgrade the board bios to 4207 from Dec 2018 to be able to pass-through.

 

Before changing the cpu  to a 3900x, I upgraded to the latest bios 5406 Nov 25, 2019 and I was able to passthrough while still using the 2700x. Meaning that bios fixed whatever problem was preventing pass-through. I immediately swapped the cpu for the 3900x and it also worked without issue.

 

I have 2 cards and I can pass both cards (at the same time) without problem.

Share this post


Link to post
On 12/26/2019 at 9:35 PM, kilobit said:

Im wanting to completely upgrade my current setup for gpu passthrough and was wanting a ryzen 9 3900x  Can anyone tell me if there is any motherboard that works correctly with passthrough on this chip?

thanks

My 3900x on ASUS Prime x470 Pro works with GPU passthrough just fine with Nvidia cards on the latest bios with 1.0.0.4b AGESA. 

 

I’m currently running 2 VMs simultaneously with passthrough on a GTX 1650 Super (top slot) and a GTX 950 (middle). I’m working on getting a third GT 710 working if I can resolve IOMMU grouping issues with the bottom PCIe slot going through the chipset. This seems to be on all AMD motherboards however with passthrough on the chipset.

 

Some AMD GPUs experience a reset bug where rebooting a VM puts them in an unusable state and the server must be rebooted to become usable again but Nvidia cards don’t seem to have this issue. In my case, my 570 card was working fine with a 1700x on the Asus x470 motherboard but when I upgraded the bios to support the 3900x, the 570 would no longer reset giving -127 errors, forcing me to switch to Nvidia.

Share this post


Link to post

Thanks for responding with the updates on the latest mobo BIOS tests, @klingon00, @boris, @juan11perez, @dodgypast, and others.  Sounds like the AGESA AMD BIOS version 1.0.0.4 Patch B (1004 B) is fixing this pass-through issues for folks across the board (pun intended) for x370 and x470 mobos!  So, after 9 months from this issue first popping up, AMD has solved it!  Better late than never...

 

Just a note: if you update to this latest BIOS from a working old BIOS your CPU pinnings and IOMMU groups will change, so you will have to update your UnRaid configurations.

Share this post


Link to post
Posted (edited)

With the latest bios for my board:

  • Asus strix x470-F
  • Bios: 5406 : Update AM4 combo PI 1.0.0.4 patch B
  • Gpu: Asus strix gpu gtx 1070
  • Processor: Ryzen 2700x
  • Unraid: 6.80

Gpu passthrough not working, No error message. just blank screen.

Log:

-cpu host,hv-time,hv-relaxed,hv-vapic,hv-spinlocks=0x1fff,hv-vendor-id=none \
-drive file=/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd,if=pflash,format=raw,unit=0,readonly=on \
-drive file=/etc/libvirt/qemu/nvram/fc0e2c3c-8ea7-754a-298e-9c6867155fc6_VARS-pure-efi.fd,if=pflash,format=raw,unit=1 \
-m 4096 \
-overcommit mem-lock=off \
-smp 4,sockets=1,cores=4,threads=1 \
-uuid fc0e2c3c-8ea7-754a-298e-9c6867155fc6 \
-display none \
-no-user-config \
-nodefaults \
-chardev socket,id=charmonitor,fd=33,server,nowait \
-mon chardev=charmonitor,id=monitor,mode=control \
-rtc base=localtime \
-no-hpet \
-no-shutdown \
-boot strict=on \
-device ich9-usb-ehci1,id=usb,bus=pci.0,addr=0x7.0x7 \
-device ich9-usb-uhci1,masterbus=usb.0,firstport=0,bus=pci.0,multifunction=on,addr=0x7 \
-device ich9-usb-uhci2,masterbus=usb.0,firstport=2,bus=pci.0,addr=0x7.0x1 \
-device ich9-usb-uhci3,masterbus=usb.0,firstport=4,bus=pci.0,addr=0x7.0x2 \
-device virtio-serial-pci,id=virtio-serial0,bus=pci.0,addr=0x3 \
-drive 'file=/mnt/user/domains/Windows 10 Graphics Design/vdisk1.img,format=raw,if=none,id=drive-virtio-disk2,cache=writeback' \
-device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x4,drive=drive-virtio-disk2,id=virtio-disk2,bootindex=1,write-cache=on \
-drive file=/mnt/user/isos/Windows.iso,format=raw,if=none,id=drive-ide0-0-0,readonly=on \
-device ide-cd,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0,bootindex=2 \
-drive file=/mnt/user/isos/virtio-win-0.1.160-1.iso,format=raw,if=none,id=drive-ide0-0-1,readonly=on \
-device ide-cd,bus=ide.0,unit=1,drive=drive-ide0-0-1,id=ide0-0-1 \
-netdev tap,fd=36,id=hostnet0,vhost=on,vhostfd=37 \
-device virtio-net-pci,netdev=hostnet0,id=net0,mac=52:54:00:35:ba:5b,bus=pci.0,addr=0x2 \
-chardev pty,id=charserial0 \
-device isa-serial,chardev=charserial0,id=serial0 \
-chardev socket,id=charchannel0,fd=38,server,nowait \
-device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=org.qemu.guest_agent.0 \
-device vfio-pci,host=0000:0a:00.0,id=hostdev0,bus=pci.0,multifunction=on,addr=0x5,romfile=/mnt/user/domains/vbios/Asus.GTX1070.8192.160531.rom \
-device vfio-pci,host=0000:0a:00.1,id=hostdev1,bus=pci.0,addr=0x5.0x1 \
-sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
-msg timestamp=on
2020-01-03 17:19:04.721+0000: Domain id=5 is tainted: high-privileges
2020-01-03 17:19:04.721+0000: Domain id=5 is tainted: host-cpu

New windows 10 vm.

Other info:

  • Never downgraded the bios, cause i didn't need gpu pasthrough at the time.

Thank you.

 

gpu-passthrough_unraid.PNG

gpu-passthrough_unraid_xml_view.PNG

Edited by mojotaker

Share this post


Link to post
42 minutes ago, mojotaker said:

With the latest bios for my board:

  • Asus strix x470-F
  • Bios: 5406 : Update AM4 combo PI 1.0.0.4 patch B
  • Gpu: Asus strix gpu gtx 1070
  • Processor: Ryzen 2700x
  • Unraid: 6.80

Gpu passthrough not working, No error message. just blank screen.

Log:


-cpu host,hv-time,hv-relaxed,hv-vapic,hv-spinlocks=0x1fff,hv-vendor-id=none \
-drive file=/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd,if=pflash,format=raw,unit=0,readonly=on \
-drive file=/etc/libvirt/qemu/nvram/fc0e2c3c-8ea7-754a-298e-9c6867155fc6_VARS-pure-efi.fd,if=pflash,format=raw,unit=1 \
-m 4096 \
-overcommit mem-lock=off \
-smp 4,sockets=1,cores=4,threads=1 \
-uuid fc0e2c3c-8ea7-754a-298e-9c6867155fc6 \
-display none \
-no-user-config \
-nodefaults \
-chardev socket,id=charmonitor,fd=33,server,nowait \
-mon chardev=charmonitor,id=monitor,mode=control \
-rtc base=localtime \
-no-hpet \
-no-shutdown \
-boot strict=on \
-device ich9-usb-ehci1,id=usb,bus=pci.0,addr=0x7.0x7 \
-device ich9-usb-uhci1,masterbus=usb.0,firstport=0,bus=pci.0,multifunction=on,addr=0x7 \
-device ich9-usb-uhci2,masterbus=usb.0,firstport=2,bus=pci.0,addr=0x7.0x1 \
-device ich9-usb-uhci3,masterbus=usb.0,firstport=4,bus=pci.0,addr=0x7.0x2 \
-device virtio-serial-pci,id=virtio-serial0,bus=pci.0,addr=0x3 \
-drive 'file=/mnt/user/domains/Windows 10 Graphics Design/vdisk1.img,format=raw,if=none,id=drive-virtio-disk2,cache=writeback' \
-device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x4,drive=drive-virtio-disk2,id=virtio-disk2,bootindex=1,write-cache=on \
-drive file=/mnt/user/isos/Windows.iso,format=raw,if=none,id=drive-ide0-0-0,readonly=on \
-device ide-cd,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0,bootindex=2 \
-drive file=/mnt/user/isos/virtio-win-0.1.160-1.iso,format=raw,if=none,id=drive-ide0-0-1,readonly=on \
-device ide-cd,bus=ide.0,unit=1,drive=drive-ide0-0-1,id=ide0-0-1 \
-netdev tap,fd=36,id=hostnet0,vhost=on,vhostfd=37 \
-device virtio-net-pci,netdev=hostnet0,id=net0,mac=52:54:00:35:ba:5b,bus=pci.0,addr=0x2 \
-chardev pty,id=charserial0 \
-device isa-serial,chardev=charserial0,id=serial0 \
-chardev socket,id=charchannel0,fd=38,server,nowait \
-device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=org.qemu.guest_agent.0 \
-device vfio-pci,host=0000:0a:00.0,id=hostdev0,bus=pci.0,multifunction=on,addr=0x5,romfile=/mnt/user/domains/vbios/Asus.GTX1070.8192.160531.rom \
-device vfio-pci,host=0000:0a:00.1,id=hostdev1,bus=pci.0,addr=0x5.0x1 \
-sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
-msg timestamp=on
2020-01-03 17:19:04.721+0000: Domain id=5 is tainted: high-privileges
2020-01-03 17:19:04.721+0000: Domain id=5 is tainted: host-cpu

New windows 10 vm.

Other info:

  • Never downgraded the bios, cause i didn't need gpu pasthrough at the time.

Thank you.

 

gpu-passthrough_unraid.PNG

gpu-passthrough_unraid_xml_view.PNG

Did you modify the GPU Bios with a HEX Editor?

Share this post


Link to post
30 minutes ago, boris said:

Did you modify the GPU Bios with a HEX Editor?

@mojotaker - Agree with @boris.  It sounds unrelated to the pass-through issues.  If this is the first time you are using the GPU for pass-through, you may need to double-check the Vbios is properly set up.  Use this as a reference: 

 

Share this post


Link to post
1 hour ago, boris said:

Did you modify the GPU Bios with a HEX Editor?

Hmm very weird, I responded to you, but i guess the post didnt got through.

 

Thank you all for your time.

 

Yes i did edit the bios with a hex editor. Lol thats the video i followed.

 

Im going to redo it again, and will post back.

 

Thanks again.

Share this post


Link to post

WOOOOOOOOOOOW!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

 

 

Thank you, thank you, thank you, thank you.

 

You were correct.

 

I redit the vbios modifications, and its working now.

 

Thank you again. 

 

4hrs wasted on that.

 

 

Share this post


Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.