Jump to content

Passthrough RAID controller IT-Mode error

phoanglong

By phoanglong
in VM Engine (KVM)

Recommended Posts

phoanglong Noob

phoanglong

Posted
Posted

hi guys,

I'm trying to passthrough the LSI 9210-8i flashed IT-mode, I have followed these two threads but could not get my RAID controller to passthrough to my VM. Could someone please point me to the right direction, many thanks.

 

 

1. My system devices

IOMMU as following

Quote

IOMMU group 0
    [8086:0c08] 00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v3 Processor DRAM Controller (rev 06)
IOMMU group 1
    [8086:0c01] 00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor PCI Express x16 Controller (rev 06)
IOMMU group 2
    [8086:041a] 00:02.0 VGA compatible controller: Intel Corporation Xeon E3-1200 v3 Processor Integrated Graphics Controller (rev 06)
IOMMU group 3
    [8086:0c0c] 00:03.0 Audio device: Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor HD Audio Controller (rev 06)
IOMMU group 4
    [8086:8c31] 00:14.0 USB controller: Intel Corporation 8 Series/C220 Series Chipset Family USB xHCI (rev 05)
IOMMU group 5
    [8086:8c3a] 00:16.0 Communication controller: Intel Corporation 8 Series/C220 Series Chipset Family MEI Controller #1 (rev 04)
    [8086:8c3d] 00:16.3 Serial controller: Intel Corporation 8 Series/C220 Series Chipset Family KT Controller (rev 04)
IOMMU group 6
    [8086:153a] 00:19.0 Ethernet controller: Intel Corporation Ethernet Connection I217-LM (rev 05)
IOMMU group 7
    [8086:8c2d] 00:1a.0 USB controller: Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #2 (rev 05)
IOMMU group 8
    [8086:8c20] 00:1b.0 Audio device: Intel Corporation 8 Series/C220 Series Chipset High Definition Audio Controller (rev 05)
IOMMU group 9
    [8086:8c10] 00:1c.0 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #1 (rev d5)
IOMMU group 10
    [8086:8c16] 00:1c.3 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #4 (rev d5)
IOMMU group 11
    [8086:8c1a] 00:1c.5 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #6 (rev d5)
IOMMU group 12
    [8086:8c1c] 00:1c.6 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #7 (rev d5)
IOMMU group 13
    [8086:8c1e] 00:1c.7 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #8 (rev d5)
IOMMU group 14
    [8086:8c26] 00:1d.0 USB controller: Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #1 (rev 05)
IOMMU group 15
    [8086:8c56] 00:1f.0 ISA bridge: Intel Corporation C226 Series Chipset Family Server Advanced SKU LPC Controller (rev 05)
    [8086:8c02] 00:1f.2 SATA controller: Intel Corporation 8 Series/C220 Series Chipset Family 6-port SATA Controller 1 [AHCI mode] (rev 05)
    [8086:8c22] 00:1f.3 SMBus: Intel Corporation 8 Series/C220 Series Chipset Family SMBus Controller (rev 05)
    [8086:8c24] 00:1f.6 Signal processing controller: Intel Corporation 8 Series Chipset Family Thermal Management Controller (rev 05)
IOMMU group 16
    [1000:0072] 01:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)
IOMMU group 17
    [111d:8018] 02:00.0 PCI bridge: Integrated Device Technology, Inc. [IDT] PES12N3A PCI Express Switch (rev 04)
IOMMU group 18
    [111d:8018] 03:00.0 PCI bridge: Integrated Device Technology, Inc. [IDT] PES12N3A PCI Express Switch (rev 04)
IOMMU group 19
    [111d:8018] 03:01.0 PCI bridge: Integrated Device Technology, Inc. [IDT] PES12N3A PCI Express Switch (rev 04)
IOMMU group 20
    [8086:10a4] 04:00.0 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet Controller (rev 06)
    [8086:10a4] 04:00.1 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet Controller (rev 06)
IOMMU group 21
    [8086:10a4] 05:00.0 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet Controller (rev 06)
    [8086:10a4] 05:00.1 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet Controller (rev 06)
IOMMU group 22
    [8086:1533] 06:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection (rev 03)
IOMMU group 23
    [10e3:8113] 07:00.0 PCI bridge: Tundra Semiconductor Corp. Device 8113 (rev 01)
    [104c:8023] 08:03.0 FireWire (IEEE 1394): Texas Instruments TSB43AB22A IEEE-1394a-2000 Controller (PHY/Link) [iOHCI-Lynx]
IOMMU group 24
    [1912:0015] 09:00.0 USB controller: Renesas Technology Corp. uPD720202 USB 3.0 Host Controller (rev 02)
IOMMU group 25
    [1b21:0612] 0a:00.0 SATA controller: ASMedia Technology Inc. ASM1062 Serial ATA Controller (rev 01)

 

Trying to passthrough this:

Quote

IOMMU group 16
    [1000:0072] 01:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)

 

and I have included this in my VM's XML:

Quote

<hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
      </source>
</hostdev>

 

This is my dmesg | grep -e DMAR -e IOMMU output

Quote

root@LILOTOWER:~# dmesg | grep -e DMAR -e IOMMU
[    0.000000] Warning: PCIe ACS overrides enabled; This may allow non-IOMMU protected peer-to-peer DMA
[    0.000000] ACPI: DMAR 0x00000000D98B2440 0000B8 (v01 INTEL  BDW      00000001 INTL 00000001)
[    0.000000] DMAR: IOMMU enabled
[    0.017232] DMAR: Host address width 39
[    0.017314] DMAR: DRHD base: 0x000000fed90000 flags: 0x0
[    0.017398] DMAR: dmar0: reg_base_addr fed90000 ver 1:0 cap c0000020660462 ecap f0101a
[    0.017485] DMAR: DRHD base: 0x000000fed91000 flags: 0x1
[    0.017567] DMAR: dmar1: reg_base_addr fed91000 ver 1:0 cap d2008c20660462 ecap f010da
[    0.017650] DMAR: RMRR base: 0x000000d9eab000 end: 0x000000d9eb9fff
[    0.017731] DMAR: RMRR base: 0x000000dc000000 end: 0x000000de1fffff
[    0.017815] DMAR-IR: IOAPIC id 8 under DRHD base  0xfed91000 IOMMU 1
[    0.017896] DMAR-IR: HPET id 0 under DRHD base 0xfed91000
[    0.017975] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit.
[    0.018041] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting.
[    0.018421] DMAR-IR: Enabled IRQ remapping in xapic mode
[    7.140217] DMAR: No ATSR found
[    7.140547] DMAR: dmar0: Using Queued invalidation
[    7.140636] DMAR: dmar1: Using Queued invalidation
[    7.217791] DMAR: Software identity mapping for device 0000:00:00.0
[    7.217878] DMAR: Software identity mapping for device 0000:00:01.0
[    7.217962] DMAR: Software identity mapping for device 0000:00:02.0
[    7.218048] DMAR: Software identity mapping for device 0000:00:03.0
[    7.218130] DMAR: Software identity mapping for device 0000:00:14.0
[    7.218211] DMAR: Software identity mapping for device 0000:00:16.0
[    7.218297] DMAR: Software identity mapping for device 0000:00:16.3
[    7.218378] DMAR: Software identity mapping for device 0000:00:19.0
[    7.218460] DMAR: Software identity mapping for device 0000:00:1a.0
[    7.218542] DMAR: Software identity mapping for device 0000:00:1b.0
[    7.218623] DMAR: Software identity mapping for device 0000:00:1c.0
[    7.218704] DMAR: Software identity mapping for device 0000:00:1c.3
[    7.218786] DMAR: Software identity mapping for device 0000:00:1c.5
[    7.218867] DMAR: Software identity mapping for device 0000:00:1c.6
[    7.218948] DMAR: Software identity mapping for device 0000:00:1c.7
[    7.219030] DMAR: Software identity mapping for device 0000:00:1d.0
[    7.219112] DMAR: Software identity mapping for device 0000:00:1f.0
[    7.219193] DMAR: Software identity mapping for device 0000:00:1f.2
[    7.219279] DMAR: Software identity mapping for device 0000:00:1f.3
[    7.219361] DMAR: Software identity mapping for device 0000:00:1f.6
[    7.219446] DMAR: Software identity mapping for device 0000:01:00.0
[    7.219536] DMAR: Software identity mapping for device 0000:02:00.0
[    7.219626] DMAR: Software identity mapping for device 0000:03:00.0
[    7.219713] DMAR: Software identity mapping for device 0000:03:01.0
[    7.219798] DMAR: Software identity mapping for device 0000:04:00.0
[    7.219885] DMAR: Software identity mapping for device 0000:04:00.1
[    7.219969] DMAR: Software identity mapping for device 0000:05:00.0
[    7.220054] DMAR: Software identity mapping for device 0000:05:00.1
[    7.220139] DMAR: Software identity mapping for device 0000:06:00.0
[    7.220229] DMAR: Software identity mapping for device 0000:09:00.0
[    7.220322] DMAR: Software identity mapping for device 0000:0a:00.0
[    7.220408] DMAR: Setting RMRR:
[    7.220484] DMAR: Setting identity map for device 0000:00:02.0 [0xdc000000 - 0xde1fffff]
[    7.220727] DMAR: Setting identity map for device 0000:00:14.0 [0xd9eab000 - 0xd9eb9fff]
[    7.220818] DMAR: Setting identity map for device 0000:00:1a.0 [0xd9eab000 - 0xd9eb9fff]
[    7.220903] DMAR: Setting identity map for device 0000:00:1d.0 [0xd9eab000 - 0xd9eb9fff]
[    7.220988] DMAR: Prepare 0-16MiB unity mapping for LPC
[    7.221067] DMAR: Setting identity map for device 0000:00:1f.0 [0x0 - 0xffffff]
[    7.221266] DMAR: Intel(R) Virtualization Technology for Directed I/O
[    7.257459] AMD IOMMUv2 driver by Joerg Roedel <[email protected]>
[    7.257541] AMD IOMMUv2 functionality not available on this system
[    7.273046] DMAR: 32bit 0000:00:1a.0 uses non-identity mapping
[    7.273154] DMAR: Setting identity map for device 0000:00:1a.0 [0xd9eab000 - 0xd9eb9fff]
[    7.284321] DMAR: 32bit 0000:00:1d.0 uses non-identity mapping
[    7.284430] DMAR: Setting identity map for device 0000:00:1d.0 [0xd9eab000 - 0xd9eb9fff]
 

 

This is my current Syslinux Configuration

Quote

default /syslinux/menu.c32
menu title Lime Technology, Inc.
prompt 0
timeout 50
label unRAID OS
  menu default
  kernel /bzimage
  append intel_iommu=on iommu=pt vfio_iommu_type1.allow_unsafe_interrupts=1 pcie_acs_override=downstream vfio-pci.ids=1000:0072 initrd=/bzroot
label unRAID OS GUI Mode
  kernel /bzimage
  append pcie_acs_override=downstream initrd=/bzroot,/bzroot-gui
label unRAID OS Safe Mode (no plugins, no GUI)
  kernel /bzimage
  append pcie_acs_override=downstream initrd=/bzroot unraidsafemode
label unRAID OS GUI Safe Mode (no plugins)
  kernel /bzimage
  append pcie_acs_override=downstream initrd=/bzroot,/bzroot-gui unraidsafemode
label Memtest86+
  kernel /memtest
 

 

This is the error i got from running the VM (from logs)

 

Quote

DR0=0000000000000000 DR1=0000000000000000 DR2=0000000000000000 DR3=0000000000000000 
DR6=00000000ffff0ff0 DR7=0000000000000400
EFER=0000000000000000
FCW=037f FSW=0000 [ST=0] FTW=00 MXCSR=00001f80
FPR0=0000000000000000 0000 FPR1=0000000000000000 0000
FPR2=0000000000000000 0000 FPR3=0000000000000000 0000
FPR4=0000000000000000 0000 FPR5=0000000000000000 0000
FPR6=0000000000000000 0000 FPR7=0000000000000000 0000
XMM00=00000000000000000000000000000000 XMM01=00000000000000000000000000000000
XMM02=00000000000000000000000000000000 XMM03=00000000000000000000000000000000
XMM04=00000000000000000000000000000000 XMM05=00000000000000000000000000000000
XMM06=00000000000000000000000000000000 XMM07=00000000000000000000000000000000
CPU #3:
EAX=00000000 EBX=00000000 ECX=00000000 EDX=000306c3
ESI=00000000 EDI=00000000 EBP=00000000 ESP=00000000
EIP=0000fff0 EFL=00000002 [-------] CPL=0 II=0 A20=1 SMM=0 HLT=0
ES =0000 00000000 0000ffff 00009300
CS =f000 ffff0000 0000ffff 00009b00
SS =0000 00000000 0000ffff 00009300
DS =0000 00000000 0000ffff 00009300
FS =0000 00000000 0000ffff 00009300
GS =0000 00000000 0000ffff 00009300
LDT=0000 00000000 0000ffff 00008200
TR =0000 00000000 0000ffff 00008b00
GDT= 00000000 0000ffff
IDT= 00000000 0000ffff
CR0=60000010 CR2=00000000 CR3=00000000 CR4=00000000
DR0=0000000000000000 DR1=0000000000000000 DR2=0000000000000000 DR3=0000000000000000 
DR6=00000000ffff0ff0 DR7=0000000000000400
EFER=0000000000000000
FCW=037f FSW=0000 [ST=0] FTW=00 MXCSR=00001f80
FPR0=0000000000000000 0000 FPR1=0000000000000000 0000
FPR2=0000000000000000 0000 FPR3=0000000000000000 0000
FPR4=0000000000000000 0000 FPR5=0000000000000000 0000
FPR6=0000000000000000 0000 FPR7=0000000000000000 0000
XMM00=00000000000000000000000000000000 XMM01=00000000000000000000000000000000
XMM02=00000000000000000000000000000000 XMM03=00000000000000000000000000000000
XMM04=00000000000000000000000000000000 XMM05=00000000000000000000000000000000
XMM06=00000000000000000000000000000000 XMM07=00000000000000000000000000000000
2017-12-08 16:00:35.380+0000: shutting down, reason=crashed

 

I have been banging my head to wall for the last 24 hours desperately trying to find a way to make this work. Could someone please help..

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
Go to topic listing
×
×
  • Create New...