I'm trying to get an Ubuntu VM running with 3 Tesla K80s. I'm running Unraid 6.7.0-RC7. I've passed through all 6 devices (each K80 appears as 2 devices), but after configuring everything inside of the VM nvidia-smi only displays 1 GPU. The strange thing is that lspci displays all 6. If I install the nvidia drivers into the Unraid host, nvidia-smi there displays all 6 as expected. 

 

Is there anything special that has to be done to pass these GPUs through to the guest VM? 

So I just noticed the following in my dmesg log:

 

[    9.283359] NVRM: This PCI I/O region assigned to your NVIDIA device is invalid:
               NVRM: BAR0 is 0M @ 0x0 (PCI:0000:07:00.0)
[    9.283360] NVRM: The system BIOS may have misconfigured your GPU.
[    9.283383] NVRM: This PCI I/O region assigned to your NVIDIA device is invalid:
               NVRM: BAR0 is 0M @ 0x0 (PCI:0000:08:00.0)
[    9.283384] NVRM: The system BIOS may have misconfigured your GPU.
[    9.283405] NVRM: This PCI I/O region assigned to your NVIDIA device is invalid:
               NVRM: BAR0 is 0M @ 0x0 (PCI:0000:09:00.0)
[    9.283406] NVRM: The system BIOS may have misconfigured your GPU.
[    9.283430] NVRM: This PCI I/O region assigned to your NVIDIA device is invalid:
               NVRM: BAR0 is 0M @ 0x0 (PCI:0000:0a:00.0)
[    9.283431] NVRM: The system BIOS may have misconfigured your GPU.
[    9.283452] NVRM: This PCI I/O region assigned to your NVIDIA device is invalid:
               NVRM: BAR0 is 0M @ 0x0 (PCI:0000:0b:00.0)
[    9.283453] NVRM: The system BIOS may have misconfigured your GPU.
[    9.283465] NVRM: The NVIDIA probe routine failed for 5 device(s).
 

Any ideas on how to remedy this?

For anyone looking for an answer, I switched from OVMF to SeaBIOS and it seems to work just fine. Not sure why OVMF didn't work though. Anyone want to take a stab at that?