[Solved] VFIO: UNABLE TO POWER ON DEVICE, STUCK IN D3

Hi Guys,

Tried to boot any of my 3 VMs I would get "VFIO: UNABLE TO POWER ON DEVICE, STUCK IN D3" in the VM log. Read on google that a bios update is the solution. Updated the bios and VMs 1 & 2 boot but I still get "unable to power on stuck in D3" error. So I'm close.

However, I just realised that when I boot my server the bios splash logo is appearing on monitor 2 which means my server is treating gpu i2 as the main gpu. Furthermore, the gpu pcie speeds are x8 x16 and x8. I think Unraid my have gpu 3 and not releasing it?

UPDATE: The BIOS update included the addition of APM Advanced Power Management. The primary GPU would not be picked up as primary GPU and would shut down after two minutes and give a 'could not power on, stuck in D3' error which led me to believe it could be the power saving feature powering down the primary GPU. So I made sure APM was set to disabled, but it didn't fix the problem. I was about to pull the GPU out and send it back under warranty, as a last hail Mary I set APM to enable. F*ck me, everything is working!?. WTF??? It doesn't make sense?. You'd think that setting APM to disable would leave the GPU on all the time by default?.

tower-diagnostics-20220619-2010.zip

Edited July 22, 20223 yr by PeteyBoPetey