Ethernet controller pass through issues on MS GEN8

[roy]

Hello, guys,

I'm trying to move freenas system to unriad on my MS GEN8, then I faced some problems that I can not solved.

short introduction for GEN8, E3 1265L VT-D/VT-X enable//4G+4G smart memory// two ports network controller based on intel 82571. 6.7.2 trail version of unraid.

Now,  I following this topics Passing ThroughNetwork Controllers to unRAID 6 Virtual Machines(https://forums.unraid.net/search/?q=network controller).

I'm sure that I understand and follow them 100%,  I wanna pass through two ports of 82571 in IOMMU group 1, shown in below list from System Devices. 

1. IOMMU group 0:[8086:0108] 00:00.0 Host bridge: Intel Corporation Xeon E3-1200 Processor Family DRAM Controller (rev 09)
2. IOMMU group 1:[8086:0101] 00:01.0 PCI bridge: Intel Corporation Xeon E3-1200/2nd Generation Core Processor Family PCI Express Root Port (rev 09)
3.                        [8086:105e] 07:00.0 Ethernet controller: Intel Corporation 82571EB/82571GB Gigabit Ethernet Controller D0/D1 (copper applications) (rev 06)
4.                        [8086:105e] 07:00.1 Ethernet controller: Intel Corporation 82571EB/82571GB Gigabit Ethernet Controller D0/D1 (copper applications) (rev 06)
5. IOMMU group 2:[8086:010d] 00:06.0 PCI bridge: Intel Corporation Xeon E3-1200/2nd Generation Core Processor Family PCI Express Root Port (rev 09)
6. IOMMU group 3:[8086:1c2d] 00:1a.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #2 (rev 05)
7. IOMMU group 4:[8086:1c10] 00:1c.0 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 1 (rev b5)
8. IOMMU group 5:[8086:1c18] 00:1c.4 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 5 (rev b5)
9. IOMMU group 6:[8086:1c1c] 00:1c.6 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 7 (rev b5)
10. IOMMU group 7:[8086:1c1e] 00:1c.7 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 8 (rev b5)
11. IOMMU group 8:[8086:1c26] 00:1d.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #1 (rev 05)
12. IOMMU group 9:[8086:244e] 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a5)
13. IOMMU group 10:[8086:1c54] 00:1f.0 ISA bridge: Intel Corporation C204 Chipset LPC Controller (rev 05)
14.                          [8086:1c02] 00:1f.2 SATA controller: Intel Corporation 6 Series/C200 Series Chipset Family 6 port Desktop SATA AHCI Controller (rev 05)
15. IOMMU group 11:[14e4:165f] 03:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe
16.                         [14e4:165f] 03:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe
17. IOMMU group 12:[1912:0014] 04:00.0 USB controller: Renesas Technology Corp. uPD720201 USB 3.0 Host Controller (rev 03)
18. IOMMU group 13:[103c:3306] 01:00.0 System peripheral: Hewlett-Packard Company Integrated Lights-Out Standard Slave Instrumentation & System Support (rev 05)
19. [102b:0533] 01:00.1 VGA compatible controller: Matrox Electronics Systems Ltd. MGA G200EH
20. [103c:3307] 01:00.2 System peripheral: Hewlett-Packard Company Integrated Lights-Out Standard Management Processor Support and Messaging (rev 05)
21. [103c:3300] 01:00.4 USB controller: Hewlett-Packard Company Integrated Lights-Out Standard Virtual USB Controller (rev 02)

 

After reboot, I trying to build one VM using these 2 ports,  if I used the default virtual port( br0), the VM worked, but if I add these 2 ports in system( from general interface or XML), then it crashed like below list:

Execution error

internal error: qemu unexpectedly closed the monitor: 2020-02-07T23:37:23.774435Z qemu-system-x86_64: -device vfio-pci,host=07:00.0,id=hostdev0,bus=pci.0,addr=0x9: vfio 0000:07:00.0: failed to setup container for group 1: failed to set iommu for container: Operation not permitted.

 

Also, I'm aware of that the IOMMU group 1 include another device, which may bring some problems, so i pass through it too. but it do not help.

 

Did you guys faced this ever? I have spent some days to solve it but all failed. Many thanks for your help, suggestions.

[roy]

It's done. since HP MS biso issues, we just follow below topic to replact one file in flash drive.