• [6.9.1] Not all PCIe device show at System Devices page


    Vr2Io
    • Closed Minor

    Below device [ 4x : xx . x ] missing in Devices page, so I can't passthrough the device by GUI. I have try several change in BIOS or Unraid setting still no change.

     

     

     

    image.png.e283e444105865fd22172bc4092d46ca.png

     

     

    40:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Root Complex
    40:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) I/O Memory Management Unit
    40:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    40:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
    40:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
    40:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    40:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    40:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    40:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    40:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
    40:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
    40:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
    41:00.0 Non-Volatile memory controller: Lite-On Technology Corporation Device 23f1 (rev 01)
    42:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
    43:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function
    43:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor
    43:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
    44:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function
    44:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)

     



    User Feedback

    Recommended Comments

    Could it be that only the devices connected to NUMA node 0 are being displayed?

    • Like 1
    Link to comment
    Share on other sites
    3 hours ago, John_M said:

    Could it be that only the devices connected to NUMA node 0 are being displayed?

    Yes, you make the problem clear.

     

    image.png.62a9a2c07d36b3774911af1c1cc1272d.png

    Link to comment
    Share on other sites

    @Vr2Io would you please give me the output from this command?

    ls -1 /sys/kernel/iommu_groups/*/devices/

    also these:

    lspci -s 40:00.0
    lcpci -ns 40:00.0

     

    Link to comment
    Share on other sites

    Based on the output of this:
      ls -1 /sys/kernel/iommu_groups/*/devices/
    the [4x:xx.x] devices you are looking for are not in any IOMMU groups, so they aren't eligible to be bound to vfio-pci or passed through to a VM. 

     

    I haven't seen devices like this that are completely outside of IOMMU groups. Open to suggestions here.

    • Thanks 1
    Link to comment
    Share on other sites
    Vr2Io

    Posted (edited)

    Thanks. But this X399 platform haven't problem in previous Unraid version, no hardware have change.

     

    A NVMe is one of [4x:xx.x] devices which have passthrough to VM as boot media in past.

     

    May be I will try some previous Unraid version then feedback and followup.

    Edited by Vr2Io
    Link to comment
    Share on other sites
    Vr2Io

    Posted (edited)

    I try different Unraid version, even new fresh install, but problem persist.

    So I try different BIOS setting again, finally setting IOMMU from default "AUTO" to "Enable" then problem solve.

     

    image.thumb.png.789e9c519ccf27497e607b7a168c171e.png

    Edited by Vr2Io
    Link to comment
    Share on other sites

    Oh I missed the notification on this one. I am very glad you were able to figure it out!

    Link to comment
    Share on other sites

    Thank you found out the symptom, I never think it is BIOS IOMMU setting cause NUMA 1 device out of any IOMMU group.

    Link to comment
    Share on other sites


    Join the conversation

    You can post now and register later. If you have an account, sign in now to post with your account.
    Note: Your post will require moderator approval before it will be visible.

    Guest
    Add a comment...

    ×   Pasted as rich text.   Restore formatting

      Only 75 emoji are allowed.

    ×   Your link has been automatically embedded.   Display as a link instead

    ×   Your previous content has been restored.   Clear editor

    ×   You cannot paste images directly. Upload or insert images from URL.


  • Status Definitions

     

    Open = Under consideration.

     

    Solved = The issue has been resolved.

     

    Solved version = The issue has been resolved in the indicated release version.

     

    Closed = Feedback or opinion better posted on our forum for discussion. Also for reports we cannot reproduce or need more information. In this case just add a comment and we will review it again.

     

    Retest = Please retest in latest release.


    Priority Definitions

     

    Minor = Something not working correctly.

     

    Urgent = Server crash, data loss, or other showstopper.

     

    Annoyance = Doesn't affect functionality but should be fixed.

     

    Other = Announcement or other non-issue.