mattz
-
Posts
81 -
Joined
-
Last visited
-
Days Won
1
Content Type
Profiles
Forums
Downloads
Store
Gallery
Bug Reports
Documentation
Landing
Posts posted by mattz
-
-
I wanted to mention, this issue has just recently been affecting me. I am on an MSI x470 Gaming M7 AC motherboard. The issue occurred when I switched from the 2700x CPU to the 3900x CPU (I wanted more cores!!). I swapped the CPUs and all the VFIO Bus:Device.Function numbers changed (that's probably expected). However, the `USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller` (IOMMU group 22 in the pic below) I had passed-through with the 2700x no longer works in pass-thru, even after adjusting for the vfio numbers. Using it now locks up the system no matter what combo of "Non-essential" components I tag with vfio and pass with it. @Skitals described this problem with all x570 boards... Looks like it's the same for x470 boards with a 3000 series CPU. Why the heck is this a problem in the 3000 series, BTW??
I am going down the path of passing through the other USB controllers, as stated above. Unfortunately, on this board one of the controllers is the front USB, which are not very accessible to me. The other contains 3 regular USB ports and 1 USB-C port on the back to use, but that is contained in a very large IOMMU group that includes things like the Ethernet controller (IOMMU group 17), so I have my doubts about isolating that back USB panel.
Will provide an update when I get this going... Worst case I buy a separate, PCI USB controller and go that route.
-
22 minutes ago, wbsmolen said:
then my "power state d3" failures aren't related to bios. I'm up to date there
@wbsmolen - I agree- I think it is unrelated to this particular BIOS issue. I found this post about an x570 earlier in this thread to confirm it's probably not this issue, but it also may be related to your problem... ? Good luck.
On 8/18/2019 at 7:52 PM, Leoyzen said:Yes, I'm using 3700x and MSI X570 ACE with AGESA 1.0.0.3AB BIOS( which is the newest, MSI did not update 1.0.0.3AB for my board），and passthrough GPU works fine for me (I dont have meet the situation which the thread describe. I'm using RTX2070 for a Win 10/Ubuntu and RX560 for Win10/Hackintosh).
I'm fighting with some other problems the Zen 2 platform have, such as :
1. when restarting or hibrating the vm, the vm enter pause state and cant be resume anymore, I must force stop the vm and start again to make it work
-
10 hours ago, wbsmolen said:
Was anyone hitting this bug with the x570 taichi board from asrock? I'm hitting similar symptoms. Before I start trial/error downgrading to various revisions, I'm hoping someone else knows which bios ver works
There were some x570's that had the issue... can't remember which ones.
However, you should be good with any BIOS after November 2019. Anything this version or later: AGESA AMD BIOS version 1.0.0.4 Patch B (1004 B) fixes
-
30 minutes ago, boris said:
Did you modify the GPU Bios with a HEX Editor?
@mojotaker - Agree with @boris. It sounds unrelated to the pass-through issues. If this is the first time you are using the GPU for pass-through, you may need to double-check the Vbios is properly set up. Use this as a reference:
-
1
-
-
11 hours ago, cgi2099 said:
@mattz @SpaceInvaderOne I can confirm the new bios (3004) for the Crosshair VII with the agesa 1.0.0.4B update is working with pass-through with a single GPU
Woo hoo! Glad it worked for you. I understand being hesitant to update the BIOS, but I think having an up-to-date BIOS, if not the latest, is super important. Cheers.
-
Thanks for responding with the updates on the latest mobo BIOS tests, @klingon00, @boris, @juan11perez, @dodgypast, and others. Sounds like the AGESA AMD BIOS version 1.0.0.4 Patch B (1004 B) is fixing this pass-through issues for folks across the board (pun intended) for x370 and x470 mobos! So, after 9 months from this issue first popping up, AMD has solved it! Better late than never...
Just a note: if you update to this latest BIOS from a working old BIOS your CPU pinnings and IOMMU groups will change, so you will have to update your UnRaid configurations.
-
On 12/22/2019 at 7:32 PM, cgi2099 said:
It is a no go on putting the GPU in a different slot
Wonder if I am just unlucky and this is my problem:
@cgi2099 - It sounds like this was the issue causing your errors. Downgrading your motherboard BIOS fixed it, there is a new patch from AMD that is having success so you can update your BIOS to this version: AGESA AMD BIOS version 1.0.0.4 Patch B (1004 B). It started rolling out in BIOSes after late November 2019.
-
Wanted to throw out there: I upgraded my BIOS to the latest 1.0.0.4 Patch B (version 7B77v1D for my mobo), my GPU pass through with the MSI x470 Gaming M7 AC and a Ryzen 2700x now works without a hitch! Of course, the CPU Pinning numbers did change in addition to some IOMMU groups. Edit - Did this after upgrade to Unraid 6.8.0.
If you have been listening to this thread, waiting to update your motherboard BIOS because of this issue, I think it's a safe time to try if your manufacturer has that latest version. per MSI for my motherboard it is - Update AMD ComboPI1.0.0.4 Patch B (SMU v46.54).
Cheers!
-
@JM2005- still a great time to buy. New stuff has released and other prices have dropped since your first post in July.
* CPU - AMD Ryzen 2700x is $160 on Amazon right now (https://www.amazon.com/dp/B07B428M7F), but the AMD Ryzen 3000 series has released and offers better per-core performance. Your old setup with a Xeon makes me think an AMD ThreadRipper would be more comparable, and I think the prices have been good with that, too. But that does add a premium price to the motherboard you choose to pair.
* RAM - super cheap right now, shoot for 32 GB. Are you looking for ECC? That will be more, of course, but there are some good high-performance DDR4 deals, I use https://slickdeals.net/.
* Motherboard - for the Ryzen, the x470 or newer x570 prices are looking good, you can find a lot of choices for MicroATX. If you can find a local Fry's or MicroPC, you can probabaly get a discount for a combo CPU+Mobo deal.
* NVME drives keep dropping and would be great for your cache/VM/Docker storage needs, again I use https://slickdeals.net/
-
On 11/21/2019 at 10:52 AM, whiskeykilo said:
[...] MSI B450 Gaming Pro Carbon AC and the GPU is an EVGA GTX 1060 SC Gaming. [...]
Notes for 7B85v1B:
- Update AMD ComboPI1.0.0.4 Patch B (SMU v46.54)
[...]I can now boot into my Windows 10 VM. Will report back with any further issues
From what I am seeing, the latest AGESA AMD BIOS version 1.0.0.4 Patch B is working for some folks with ASUS PRIME X470 PRO. Read it on AMD support page https://community.amd.com/thread/241650
And if @whiskeykilo gets it working on the MSI B450 Gaming Pro AC, there may be good evidence on other platforms, too. I will try upgrading my BIOS with this latest version, maybe over this long weekend and get back.
-
Late reply on this one, but I went with the super long Cat5e cable (for $17. Thank you, Amazon) for making the connection. Much easier, cheaper, and more reliable for 2 weeks of use.
-
On 10/20/2019 at 12:37 AM, johnnie.black said:
Unraid doesn't support Wi-Fi.
For the first time in 3 years of using Unraid I need to use wifi to connect my server to my router. I am relocating, staying in an AirBNB for 2 weeks and would need to run a 200ft cable across the house to make the connection. I bought a mobo with a wifi card a while back just in case I ran into this exact use case; however, I didn't know about the Unraid limitation.
@johnnie.black - Thank you for the heads-up on this. I was searching around, worried that my motherboard wireless just wasn't supported by Linux-- its an MSI X470 Gaming M7 AC. However, sounds like from this that Unraid has no drivers or capabilities to support a wireless card.
For morbid curiosity - if I did want to get dirty and install iwconfig, drivers, etc. to try to use bond0 with the wireless card... Would that even be an option? It would be less headache to just buy the 200ft ethernet cable and have it running down the stairs than to try that, I have a feeling.
Thank you!
-
Sounds like a pretty classic use case--and a good idea to have an off-site backup. I have been using Duplicati to do my backup to the cloud. You should be able to work it by hosting maybe an FTP server on both ends. It allows you to upload multiple chunks, do incremental backups, and encrypt so your buddy can't see your files.
I use the Community App for it:
-
Welcome! I do think Unraid is a great use case for you...
On 9/8/2019 at 11:55 AM, Bruce11 said:Any information/advice is greatly appreciated.
@Bruce11 - Best advice is from @primeval_god below: Knowing basic Linux commands like ls, cd, cp, rm is super helpful. Know how to SSH into the server. And learn to use Docker. The Unraid Web GUI interface can do 90% of it without a problem, but you will eventually run into the need to do 10% using the terminal. And eventually you will likely want to do more through the terminal.
On 9/11/2019 at 8:32 AM, primeval_god said:Do you have much linux experience and or are you expecting to do things the linux way? One sticking point for a lot of newcomers who have a lot of linux knowledge and experience is that unRAID is not just another linux distro (similar to how it is not RAID).
On 9/14/2019 at 9:17 AM, JustusAurelius said:I am planning to use a R7 2700 for my build. You mentioned that you are using one, would u give this a go? or are there big problems? I hope it will have enough power to host 2 gameserver with each about max. 4 player, also an small nextcloud, to test things and stuff and also at least one Windows VM for Workload.
@JustusAurelius - I have the AMD 2700x for my build, and I love it (you can read about my server on my blog). I think it pairs very well with Unraid. At this moment, though, you will get better bang for your buck with the newer 3000 line of processes. The 2700x gives you 8 cores (for 16 threads). For your use case, buy plenty of RAM, at least 32 GB, depending on the gameserver requirements.
I use all of the examples you have above, and you should be able to run them just fine. My server runs 24x7, and I connect to it from external all the time via a VPN I set up. Example breakdown:
* I use a Windows 10 VM on Unraid as my primary gaming machine, pass-through a Nvida 1070 graphics card. I dedicate 6 threads and 16 GB RAM here.
* Game servers can be hosted on Docker using the Unraid App, or each their own Linux VM. Dedicate maybe 2 threads and maybe 2-4 GB RAM each (depending).
* Nextcloud I have running in a Docker container and it takes up almost no CPU or RAM power.
* NAS file share is a breeze, but this is the bread-and-butter of Unraid
What do you think? Would love to hear how it goes!
-
20 hours ago, ZooMass said:
Just updated my Asus Prime B450-A to 7/29/2019 BIOS version 1607 which says it updates AGESA 1.0.0.3 AB. Just tried to pass through an GeForce 760 to a Windows 10 VM, but I still get the same D3 error.
15 hours ago, qwijibo said:Still not working on an Asus Prime board with a 3000 or a 2000 series chip.
Thank you , @ZooMass and @qwijibo for trying that latest AGESA. It's disheartening it didn't work. It sounds like, though, from the post below that it might ALSO require an updated Linux kernel. I believe Unraid is working on this for the next version, but I am not sure when that will be released.
14 hours ago, david279 said:Try this
@Leoyzen - When you upgraded the Linux Kernel for the fix, did you also have the latest AGESA BIOS for that x570? Quite a few people on this thread are battling with the issues.
-
Along with what @boris said above... It looks like this issue has been fixed! Got this message from AMD Tech Support:
QuoteResponse and Service Request History:
This is with reference to your issue with the AGESA update breaking VFIO IOMMU GPU passthrough.
This issue has been addressed with the updated AGESA A1003 ABB BIOS version. Please check for the availability of this BIOS on the motherboard manufacturers web site.
I have no clue when it is going to roll out, or even what the heck a A1003 ABB version is, but it should be coming down the pipe sometime!
Edit -
* looks like it's already available for you ASUS folks! https://rog.asus.com/forum/showthread.php?112403-Agesa-1-0-0-3-abb
* and you ASROCK folks - https://www.asrock.com/support/index.asp?cat=BIOS
* and Gigabyte - https://hardforum.com/threads/agesa-1-0-0-3-abb.1984916/
* where is MSI??
Anyone willing to give it a shot and report back??
-
On 7/27/2019 at 9:04 AM, AGoulimis said:
Not sure if I should post this here or in the Code 43 tutorial thread (moderator, this is for you 😉), but here goes:
I had the same issue on an ASUS Prime X470 Pro. Downgrading worked just fine, thank you for that.
However, I didn't notice that after rebooting and starting the VM, the drivers for the GPU got automatically loaded from WU (because the GPU ended up on a different hostdev slot, for some reason). This resulted in a beatiful Code 43. While trying to fix the issue, the VM (and Unraid) would freeze when rebooting after the patched driver install. Turns out it was just because I had three screens connected! Removing the two extra screens, DDU-ing and reapplying the patched drivers, rebooting the VM, shutting it down (again) and reconnecting the two screens did the trick.
Hope this is of use to someone else!
@AGoulimis, I am not familiar with this error and doubt it's specific to this pass-through issue; however, it may help someone! And 3 screens, nice! The one thing I can comment on - I do think it's reasonable to see the GPU on a different hostdev slot. Those BIOS updates changed the CPU pinning for me, so it could have impacts on how devices are assigned, especially as they pass-through to the VM.
-
On 8/4/2019 at 12:27 AM, Brucej32 said:
THANK YOU THANK YOU THANK YOU FOR THIS THREAD.
I'm about to convert my ryzen 7 1700, Asus strix x370-f build over to an unraid setup, and I have the option of running an asus strix 1070 (for a W10 passthrough) and a gt710 for unraid. Has anyone tried any other bios(es?) other than 4207 (i.e. 5009) for passthrough, and do they work?
@Brucej32 - You should be good with the x370 and Ryzen 1700 if you downgrade the BIOS like @xsinmyeyes said, but if you're considering investing in a new 3000 series AMD Ryzen CPU... You won't be able to do the pass-through yet...
On 8/10/2019 at 10:02 AM, boris said:Apparently a new AGESA update (AGESA 1.0.0.4ABB) fixes the passthrough problem. AMD does recommend this only for Ryzen 3000 Series. Could someone check if it will work with Ryzen 3000 Series?
This would be amazing, @boris! I am a bit skeptical for a few reasons... Mostly because I cannot find a changelog for this update- apparently the AGESA number system is really inconsistent(??). So, I have questions like: How long will it take to roll out to all motherboards? Will it cover all motherboards? etc. But it is hopeful.
If you get a chance to try it, would love to see if it allows pass-through to work!
-
On 7/22/2019 at 7:31 AM, qwijibo said:
Wow, @SpaceInvaderOne has such a big following... This error is coming out of the wood works when he posts.
If you read this SpaceIO, this thread documents a bunch of cases when it happens, too.
-
12 hours ago, Borbosch said:
Hi! After the downgrade my ROG STRIX B450-F GAMING works fine with the Bios 2008.
Now i ordered a 3900x and ask myself, if the processor will work with this bios-version. The changelog of the biso 2008 says: "Update AGESA 0070 for the upcoming processors and improve CPU compatibility".
Anyone tried a Ryzen 3xxx with a AGESA 0070 Bios?
9 hours ago, CptLoRes said:Also planing to upgrade to a X3900/3950. But until support has been confirmed I think it will be best to just wait.
I can also confirm that downgrading to BIOS 4207 (last bios released before the AGESA updates started) using the Afuefix64 method is working on the ROG STRIX X470-F GAMING motherboard.
I think both of you are spot-on here. Downgrading the mobo BIOS brings back pass-thru functionality, but I do think it will NOT WORK with the new Ryzen 3 line of processors...
Someone added a post to the AMD forum, and I added this thread as a comment on it: https://community.amd.com/message/2921732
-
2 hours ago, widdefmh said:
I also have the same issue "Stuck in D3".
Unraid stable 6.7.2
Asus ROG STRIX B350-F Gaming motherboard, bios version 5008 (upgraded just before installing unraid, maybe that was a bad thing).
Asus GTX 1060 6GB Dual OC
Ryzen 1700 cpu (first gen)
Also tried to put an ASUS GTX 750 TI in the computer as well, with the exact same problem.
(both gpus installed at the same time)
EDIT2: Also tried to downgrade to the BIOS before 5008 with EzFlash, and the downgrade worked for the bios before but not with earlier bioses. Same thing here with "Stuck in D3".
Upgraded to 5008 again.
@widdefmh If it's worth anything, I think you did the right thing by upgrading your mobo BIOS before you installed Unraid. It is unfortunate you ran into this issue. Sounds like you tried several things with no success--that's about right. I also tried 2 GPUs and was unsuccessful.
You can still downgrade to fix this: use the Asus downgrade utility Afuefix64 from overclock.net. No one has posted about the ROG STRIX B350, so I am not sure what BIOS you should use. Check for one back before March 2019 (check the change log and choose one before they introduced the Ryzen 3000 upgrade).
-
On 7/19/2019 at 7:49 PM, qwijibo said:
Any suggestions for x570 boards yet?
I just upgraded from a b350 due to a broken SATA port and still running a 2600 however I have lost the ability to passthrough any GPU to Win10.
Obviously I can't downgrade the bios. VFIO support looks poor at this stage.
@qwijibo Congrats on the new motherboard! The x570 are the latest and greatest, right?? I was wondering if this issue would extend to them, and it sounds like it does. You're right- because you cannot downgrade, you are kind of stuck. Stay tuned to this thread. If there is ever a fix for this with a software patch or anything, it will probably work for you too. And we'll post it here once we know.
My only suggestion at this point would be to return it for an x470 (which works on older BIOSes), but that is a drastic move. The x570 gives you the latest PCI 4.0 lane stuff, but besides that, all the hardware including the CPU will work on the x470, I believe, and for cheaper.
And @qwijibo- what Model an Make x570 board is it? And BIOS version. I would like to add it to the list.
-
6 minutes ago, boris said:
For people who have Asrock MOBO's: I booted straight into Windows 10, used AFUWIN Tool to downgrade BIOS
(https://ami.com/en/download-license-agreement/?DownloadFile=Aptio_V_AMI_Firmware_Update_Utility.zip) with the command:
AFUWINx64.exe X370TC5.10 /CAPSULE /B /P /N
Great tip! I'm going to add it to OP.
And nice setup- I have very similar stuff, just different brands. 😎
-
What's your use case?? It's a great time to be building a new rig- new CPUs coming out, RAM prices slashed, and NVME drives that are very low on the $$/GB.
You're looking for a core-heavy server-class rig, based on your old Xeon, right? I would recommend Threadripper because AMD is having a day right now:
* I'm a bit late, but the 2950x was $500 on Amazon Prime Day - https://www.tomshardware.com/news/amd-threadripper-2950x-prime-day-deal,39931.html. Still, I would look for that for all TR for all the cores.
* DDR4 RAM is so cheap right now- shoot for 64+ GB! You can pick up 16GB of mid-range DDR4 3000 stuff for under $70 (US) https://www.newegg.com/team-16gb-288-pin-ddr4-sdram/p/N82E16820331042. Make sure it's Quad channel for the TR.
* Think about going all solid state for your storage needs. NVME SSDs are running under $0.20 per GB; see some larger 2TB ones at $0.10 / GB (https://www.amazon.com/dp/B07TN1MNJ4/). That's still pretty expensive, but FUTURE PROOF! Maybe only do it for Cache and VM drives...
* Spinning platter HDDs are running less than $0.02 for the WD Reds (https://www.amazon.com/gp/product/B07D3MWMNZ) for your storage needs.
Maybe a good start?
Wonder if I am just unlucky and this is my problem: 
Win10 VM graphics pass-through broke after AMD BIOS update
in VM Engine (KVM)
Posted · Edited by mattz
added descriptions
@killeriq- I think I'm in the same boat now. I just upgraded my x470 board to the Ryzen 3900x from the 2700x (wanted the cores!). However, I am no longer able to pass through my motherboard's USB Controller 3.0 the same way I did with the 2700x. I now get the same error you had and the whole system will lock up, requiring a hard reboot:
kernel: vfio-pci 0000:0c:00.0: not ready 1023ms after FLR; waitingIt is something others are encountering--the only way to fix it is to avoid passing through that particular USB controller, and use other USB Controllers, if you can:
There is also a Kernel patch, it appears, that could fix it. So, I am not sure, does the latest Unraid BIOS fix it for you? It could be the kernel patch made it in...