Jump to content

D874as

Members
  • Posts

    4
  • Joined

  • Last visited

Posts posted by D874as

  1. 44 minutes ago, 1812 said:

     

    This is their fix for the gen 8/9 servers: https://support.hpe.com/hpsc/doc/public/display?docId=emr_na-c04781229&sp4ts.oid=5249566

     

    Not sure how applicable it is for micro servers.

     

    Here is also a redhat white paper on it : https://access.redhat.com/sites/default/files/attachments/rmrr-wp1.pdf

     

    Additionally, here is a proxmox post (in German) about passthrough problems on a gen 8 microserver. https://forum.proxmox.com/threads/hp-proliant-microserver-gen8-raidcontroller-hp-p410-passthrough-probleme.30547/

     

    They also describe changing the boot to include "iommu=on" or "intel_iommu=on" but I have not tried those. (there are also other options intended for AMD processors which include "iommu=pt" and "iommu=1" .   

     

    I also remember reading somewhere that in some newer bios for newer servers that HP had an option (don't remember what it was called) that enables the exclusion of cards for passthrough (but this was in passing about 6 months ago)

     

    thanks @1812 seems like I need to compile my own kernel. Maybe it also works for a custom made unRaid kernel? First of all, I need to educate myself about kernel building xD

  2. 3 minutes ago, 1812 said:

     

     

    It put the bridge back in with the GPU...... fun.

     

    is there a different slot you can try? my guess is no since it's a micro server....

     

    to be clear, this is an HP issue, not unRaid issue. HP has been a pain about actually fixing this. And their "fix" is a workaround that is not a simple as "click this to make it work."

     yes I am using a Microserver ..

    how much of a workaround is that? I am still new to this topic, also doing some reading on IOMMU etc.

  3. After editing config file to:

     

    default menu.c32
    menu title Lime Technology, Inc.
    prompt 0
    timeout 50
    label unRAID OS
      menu default
      kernel /bzimage
    append pcie_acs_override=id:1002:6779,1002:aa98 vfio_iommu_type1.allow_unsafe_interrupts=1 initrd=/bzroot
    label unRAID OS GUI Mode
      kernel /bzimage
      append initrd=/bzroot,/bzroot-gui
    label unRAID OS Safe Mode (no plugins, no GUI)
      kernel /bzimage
      append initrd=/bzroot unraidsafemode
    label unRAID OS GUI Safe Mode (no plugins)
      kernel /bzimage
      append initrd=/bzroot,/bzroot-gui unraidsafemode
    label Memtest86+
      kernel /memtest

     

    I got following output:

     

    IOMMU group 0:	[8086:0158] 00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v2/Ivy Bridge DRAM Controller (rev 09)
    IOMMU group 1:	[8086:0151] 00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor PCI Express Root Port (rev 09)
    	[1002:6779] 07:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Caicos [Radeon HD 6450/7450/8450 / R5 230 OEM]
    	[1002:aa98] 07:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Caicos HDMI Audio [Radeon HD 6450 / 7450/8450/8490 OEM / R5 230/235/235X OEM]
    IOMMU group 2:	[8086:015d] 00:06.0 PCI bridge: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor PCI Express Root Port (rev 09)
    IOMMU group 3:	[8086:1c2d] 00:1a.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #2 (rev 05)
    IOMMU group 4:	[8086:1c10] 00:1c.0 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 1 (rev b5)
    IOMMU group 5:	[8086:1c18] 00:1c.4 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 5 (rev b5)
    IOMMU group 6:	[8086:1c1c] 00:1c.6 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 7 (rev b5)
    IOMMU group 7:	[8086:1c1e] 00:1c.7 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 8 (rev b5)
    IOMMU group 8:	[8086:1c26] 00:1d.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #1 (rev 05)
    IOMMU group 9:	[8086:244e] 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a5)
    IOMMU group 10:	[8086:1c54] 00:1f.0 ISA bridge: Intel Corporation C204 Chipset Family LPC Controller (rev 05)
    	[8086:1c02] 00:1f.2 SATA controller: Intel Corporation 6 Series/C200 Series Chipset Family 6 port Desktop SATA AHCI Controller (rev 05)
    IOMMU group 11:	[14e4:165f] 03:00.0 Ethernet controller: Broadcom Limited NetXtreme BCM5720 Gigabit Ethernet PCIe
    	[14e4:165f] 03:00.1 Ethernet controller: Broadcom Limited NetXtreme BCM5720 Gigabit Ethernet PCIe
    IOMMU group 12:	[1912:0014] 04:00.0 USB controller: Renesas Technology Corp. uPD720201 USB 3.0 Host Controller (rev 03)
    IOMMU group 13:	[103c:3306] 01:00.0 System peripheral: Hewlett-Packard Company Integrated Lights-Out Standard Slave Instrumentation & System Support (rev 05)
    	[102b:0533] 01:00.1 VGA compatible controller: Matrox Electronics Systems Ltd. MGA G200EH
    	[103c:3307] 01:00.2 System peripheral: Hewlett-Packard Company Integrated Lights-Out Standard Management Processor Support and Messaging (rev 05)
    	[103c:3300] 01:00.4 USB controller: Hewlett-Packard Company Integrated Lights-Out Standard Virtual USB Controller (rev 02)

    trying to create a vm with only the video passthrough didn't help.
    I Still get the same log:

     

    Feb 10 13:28:14 Server kernel: vfio-pci 0000:07:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=none
    Feb 10 13:28:14 Server kernel: br0: port 2(vnet0) entered blocking state
    Feb 10 13:28:14 Server kernel: br0: port 2(vnet0) entered disabled state
    Feb 10 13:28:14 Server kernel: device vnet0 entered promiscuous mode
    Feb 10 13:28:14 Server kernel: br0: port 2(vnet0) entered blocking state
    Feb 10 13:28:14 Server kernel: br0: port 2(vnet0) entered forwarding state
    Feb 10 13:28:14 Server kernel: pci 0000:07:00.1: Device is ineligible for IOMMU domain attach due to platform RMRR requirement. Contact your platform vendor.
    Feb 10 13:28:14 Server kernel: br0: port 2(vnet0) entered disabled state
    Feb 10 13:28:14 Server kernel: device vnet0 left promiscuous mode
    Feb 10 13:28:14 Server kernel: br0: port 2(vnet0) entered disabled state
    Feb 10 13:28:14 Server kernel: vfio-pci 0000:07:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=none
    Feb 10 13:29:13 Server kernel: usb 3-1: USB disconnect, device number 2
    Feb 10 13:29:13 Server acpid: input device has been disconnected, fd 4

     

  4. Hello,

     

    i am also trying to passthrough a HD 6450 from my Microserver gen8 running the latest stable unRaid version. Having the same problem.

     

    Here is my config:

    default menu.c32
    menu title Lime Technology, Inc.
    prompt 0
    timeout 50
    label unRAID OS
      menu default
      kernel /bzimage
    append pcie_acs_override=id:8086:0151,1002:6779,1002:aa98 vfio_iommu_type1.allow_unsafe_interrupts=1 initrd=/bzroot
    label unRAID OS GUI Mode
      kernel /bzimage
      append initrd=/bzroot,/bzroot-gui
    label unRAID OS Safe Mode (no plugins, no GUI)
      kernel /bzimage
      append initrd=/bzroot unraidsafemode
    label unRAID OS GUI Safe Mode (no plugins)
      kernel /bzimage
      append initrd=/bzroot,/bzroot-gui unraidsafemode
    label Memtest86+
      kernel /memtest


     

    IOMMU group 0:	[8086:0158] 00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v2/Ivy Bridge DRAM Controller (rev 09)
    IOMMU group 1:	[8086:0151] 00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor PCI Express Root Port (rev 09)
    IOMMU group 2:	[8086:015d] 00:06.0 PCI bridge: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor PCI Express Root Port (rev 09)
    IOMMU group 3:	[8086:1c2d] 00:1a.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #2 (rev 05)
    IOMMU group 4:	[8086:1c10] 00:1c.0 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 1 (rev b5)
    IOMMU group 5:	[8086:1c18] 00:1c.4 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 5 (rev b5)
    IOMMU group 6:	[8086:1c1c] 00:1c.6 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 7 (rev b5)
    IOMMU group 7:	[8086:1c1e] 00:1c.7 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 8 (rev b5)
    IOMMU group 8:	[8086:1c26] 00:1d.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #1 (rev 05)
    IOMMU group 9:	[8086:244e] 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a5)
    IOMMU group 10:	[8086:1c54] 00:1f.0 ISA bridge: Intel Corporation C204 Chipset Family LPC Controller (rev 05)
    [8086:1c02] 00:1f.2 SATA controller: Intel Corporation 6 Series/C200 Series Chipset Family 6 port Desktop SATA AHCI Controller (rev 05)
    IOMMU group 11:	[1002:6779] 07:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Caicos [Radeon HD 6450/7450/8450 / R5 230 OEM]
    [1002:aa98] 07:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Caicos HDMI Audio [Radeon HD 6450 / 7450/8450/8490 OEM / R5 230/235/235X OEM]
    IOMMU group 12:	[14e4:165f] 03:00.0 Ethernet controller: Broadcom Limited NetXtreme BCM5720 Gigabit Ethernet PCIe
    [14e4:165f] 03:00.1 Ethernet controller: Broadcom Limited NetXtreme BCM5720 Gigabit Ethernet PCIe
    IOMMU group 13:	[1912:0014] 04:00.0 USB controller: Renesas Technology Corp. uPD720201 USB 3.0 Host Controller (rev 03)
    IOMMU group 14:	[103c:3306] 01:00.0 System peripheral: Hewlett-Packard Company Integrated Lights-Out Standard Slave Instrumentation & System Support (rev 05)
    [102b:0533] 01:00.1 VGA compatible controller: Matrox Electronics Systems Ltd. MGA G200EH
    [103c:3307] 01:00.2 System peripheral: Hewlett-Packard Company Integrated Lights-Out Standard Management Processor Support and Messaging (rev 05)
    [103c:3300] 01:00.4 USB controller: Hewlett-Packard Company Integrated Lights-Out Standard Virtual USB Controller (rev 02)

    Here are the logs:

    Feb 10 10:53:14 Server kernel: vfio-pci 0000:07:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=none
    Feb 10 10:53:14 Server kernel: br0: port 2(vnet0) entered blocking state
    Feb 10 10:53:14 Server kernel: br0: port 2(vnet0) entered disabled state
    Feb 10 10:53:14 Server kernel: device vnet0 entered promiscuous mode
    Feb 10 10:53:14 Server kernel: br0: port 2(vnet0) entered blocking state
    Feb 10 10:53:14 Server kernel: br0: port 2(vnet0) entered forwarding state
    Feb 10 10:53:15 Server kernel: pci 0000:07:00.1: Device is ineligible for IOMMU domain attach due to platform RMRR requirement. Contact your platform vendor.
    Feb 10 10:53:15 Server kernel: br0: port 2(vnet0) entered disabled state
    Feb 10 10:53:15 Server kernel: device vnet0 left promiscuous mode
    Feb 10 10:53:15 Server kernel: br0: port 2(vnet0) entered disabled state
    Feb 10 10:53:15 Server kernel: vfio-pci 0000:07:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=none

     

×
×
  • Create New...