Skip to content
View in the app

A better way to browse. Learn more.
Unraid

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.
Unraid Summer Sale in live: 20% off Starter and Unleashed + buy one, get one 50% off

Thunderbolt GPUs passthrough to VMs/Dockers eGPU

SmokeyColes
in VM Engine (KVM)

Featured Replies

Hi

A couple of years back I tried using a Nvidia GPU in a Legion and Razor GPU enclosure connected with a Thunderbolt 3 cable.

It was a complete nightmare to get working and often failed as it involved lots of reboots etc and sort of hoping it would recognise.

The idea was to pass through to dockers or VMs for hardware transcoding due to no PCIe slots free.

I spoke with the developers and pretty much I think they told me there's not much of a need to develop it in UNRAID as its not a common use case they would normally consider. Nor could they test as they didn't have the hardware.

I am wondering if there has been any success stories recently or progress made into eGPUs and VMs?

Especially as I see more and more motherboards with thunderbolt.

Thanks

Chris

  • Quote
    • Community Expert
    7 hours ago, SmokeyColes said:

    Hi

    A couple of years back I tried using a Nvidia GPU in a Legion and Razor GPU enclosure connected with a Thunderbolt 3 cable.

    It was a complete nightmare to get working and often failed as it involved lots of reboots etc and sort of hoping it would recognise.

    The idea was to pass through to dockers or VMs for hardware transcoding due to no PCIe slots free.

    I spoke with the developers and pretty much I think they told me there's not much of a need to develop it in UNRAID as its not a common use case they would normally consider. Nor could they test as they didn't have the hardware.

    I am wondering if there has been any success stories recently or progress made into eGPUs and VMs?

    Especially as I see more and more motherboards with thunderbolt.

    Thanks

    Chris

    Work has been done to improve in 7.2 so you may want to try to test again.

  • Quote
    • 4 months later...

    I have an Razer Core X V2 (x16 mechanically/electrically) on thunderbolt 4 with an NVIDIA A4000 (x16 mechanically/electrically). I cannot connect the eGPU to UNRAID. I however can connect the eGPU to UNRAID on a Echo Express SE IIIe with a (x8 mechanically/electrically -- cut the back end out to fit the x16 mechanically) connection. So, it seems to be something about Razer Core X V2?

    Installed Nvidia Driver for both cases: 590.48.01 standard, non-open source driver.

    Razer Core X V2:

    IOMMU group 0: [8086:46a8] 00:02.0 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 1: [8086:4601] 00:00.0 Host bridge: Intel Corporation Alder Lake-U15 Host and DRAM Controller (rev 04)

    IOMMU group 2: [8086:464d] 00:06.0 PCI bridge: Intel Corporation 12th Gen Core Processor PCI Express x4 Controller #0 (rev 04)

    IOMMU group 3: [8086:466e] 00:07.0 PCI bridge: Intel Corporation Alder Lake-P Thunderbolt 4 PCI Express Root Port #0 (rev 04)

    IOMMU group 4: [8086:462f] 00:07.2 PCI bridge: Intel Corporation Alder Lake-P Thunderbolt 4 PCI Express Root Port #2 (rev 04)

    IOMMU group 5: [8086:461e] 00:0d.0 USB controller: Intel Corporation Alder Lake-P Thunderbolt 4 USB Controller (rev 04)

    Bus 001 Device 001 Port 1-0 ID 1d6b:0002 Linux Foundation 2.0 root hub

    Bus 002 Device 001 Port 2-0 ID 1d6b:0003 Linux Foundation 3.0 root hub

    Bus 002 Device 002 Port 2-2 ID 174c:3074 ASMedia Technology Inc. ASM1074 SuperSpeed hub

    Bus 002 Device 004 Port 2-2.2 ID 174c:55aa ASMedia Technology Inc. ASM1051E SATA 6Gb/s bridge, ASM1053E SATA 6Gb/s bridge, ASM1153 SATA 3Gb/s bridge, ASM1153E SATA 6Gb/s bridge

    Bus 002 Device 005 Port 2-1 ID 8087:5787 Intel Corp. USB3 HUB

    [8086:463e] 00:0d.2 USB controller: Intel Corporation Alder Lake-P Thunderbolt 4 NHI #0 (rev 04)

    [8086:466d] 00:0d.3 USB controller: Intel Corporation Alder Lake-P Thunderbolt 4 NHI #1 (rev 04)

    IOMMU group 6: [8086:51ed] 00:14.0 USB controller: Intel Corporation Alder Lake PCH USB 3.2 xHCI Host Controller (rev 01)

    Bus 003 Device 001 Port 3-0 ID 1d6b:0002 Linux Foundation 2.0 root hub

    Bus 003 Device 003 Port 3-3 ID 05dc:c75c Lexar Media, Inc. JumpDrive V10

    Bus 003 Device 004 Port 3-4 ID 174c:2074 ASMedia Technology Inc. ASM1074 High-Speed hub

    Bus 003 Device 007 Port 3-4.3 ID 10c4:ea60 Silicon Labs CP210x UART Bridge

    Bus 003 Device 008 Port 3-4.4 ID 0bda:8771 Realtek Semiconductor Corp. Bluetooth Radio

    Bus 003 Device 009 Port 3-1 ID 1d5c:5801 Fresco Logic USB2.0 Hub

    Bus 003 Device 010 Port 3-1.1 ID 1532:125b Razer USA, Ltd DMC Device

    Bus 003 Device 011 Port 3-1.4 ID 1532:0f51 Razer USA, Ltd Razer Core X V2

    Bus 004 Device 001 Port 4-0 ID 1d6b:0003 Linux Foundation 3.0 root hub

    [8086:51ef] 00:14.2 RAM memory: Intel Corporation Alder Lake PCH Shared SRAM (rev 01)

    IOMMU group 7: [8086:51e8] 00:15.0 Serial bus controller: Intel Corporation Alder Lake PCH Serial IO I2C Controller #0 (rev 01)

    [8086:51e9] 00:15.1 Serial bus controller: Intel Corporation Alder Lake PCH Serial IO I2C Controller #1 (rev 01)

    IOMMU group 8: [8086:51e0] 00:16.0 Communication controller: Intel Corporation Alder Lake PCH HECI Controller (rev 01)

    IOMMU group 9: [8086:51d3] 00:17.0 SATA controller: Intel Corporation Alder Lake-P SATA AHCI Controller (rev 01)

    [0:0:0:0] disk ATA ST8000NM017B-2TJ SN04 /dev/sdc 8.00TB

    [1:0:0:0] disk ATA WDC WD40EFRX-68N 0A82 /dev/sdd 4.00TB

    IOMMU group 10: [8086:51b8] 00:1c.0 PCI bridge: Intel Corporation Device 51b8 (rev 01)

    IOMMU group 11: [8086:51bc] 00:1c.4 PCI bridge: Intel Corporation Alder Lake PCI Express x4 Root Port #5 (rev 01)

    IOMMU group 12: [8086:51be] 00:1c.6 PCI bridge: Intel Corporation Device 51be (rev 01)

    IOMMU group 13: [8086:51b0] 00:1d.0 PCI bridge: Intel Corporation Alder Lake PCI Express Root Port #9 (rev 01)

    IOMMU group 14: [8086:5182] 00:1f.0 ISA bridge: Intel Corporation Alder Lake PCH eSPI Controller (rev 01)

    [8086:51c8] 00:1f.3 Audio device: Intel Corporation Alder Lake PCH-P High Definition Audio Controller (rev 01)

    [8086:51a3] 00:1f.4 SMBus: Intel Corporation Alder Lake PCH-P SMBus Host Controller (rev 01)

    [8086:51a4] 00:1f.5 Serial bus controller: Intel Corporation Alder Lake-P PCH SPI Controller (rev 01)

    IOMMU group 15: [144d:a80a] 01:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller PM9A1/PM9A3/980PRO

    [N:0:6:1] disk Samsung SSD 980 PRO 2TB__1 /dev/nvme0n1 2.00TB

    IOMMU group 16: [8086:5786] 2c:00.0 PCI bridge: Intel Corporation JHL9480 Thunderbolt 5 80/120G Bridge [Barlow Ridge Hub 80G 2023] (rev 85)

    IOMMU group 17: [8086:5786] 2d:00.0 PCI bridge: Intel Corporation JHL9480 Thunderbolt 5 80/120G Bridge [Barlow Ridge Hub 80G 2023] (rev 85)

    IOMMU group 18: [8086:5786] 2d:01.0 PCI bridge: Intel Corporation JHL9480 Thunderbolt 5 80/120G Bridge [Barlow Ridge Hub 80G 2023] (rev 85)

    IOMMU group 19: [8086:5786] 2d:02.0 PCI bridge: Intel Corporation JHL9480 Thunderbolt 5 80/120G Bridge [Barlow Ridge Hub 80G 2023] (rev 85)

    IOMMU group 20: [8086:5786] 2d:03.0 PCI bridge: Intel Corporation JHL9480 Thunderbolt 5 80/120G Bridge [Barlow Ridge Hub 80G 2023] (rev 85)

    IOMMU group 21: [10de:24b0] 2e:00.0 VGA compatible controller: NVIDIA Corporation GA104GL [RTX A4000] (rev a1)

    [10de:228b] 2e:00.1 Audio device: NVIDIA Corporation GA104 High Definition Audio Controller (rev a1)

    IOMMU group 22: [144d:a80a] 56:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller PM9A1/PM9A3/980PRO

    [N:1:6:1] disk Samsung SSD 980 PRO 2TB__1 /dev/nvme1n1 2.00TB

    IOMMU group 23: [1d6a:04c0] 57:00.0 Ethernet controller: Aquantia Corp. AQtion AQC113 NBase-T/IEEE 802.3an Ethernet Controller [Antigua 10G] (rev 03)

    IOMMU group 24: [1d6a:04c0] 58:00.0 Ethernet controller: Aquantia Corp. AQtion AQC113 NBase-T/IEEE 802.3an Ethernet Controller [Antigua 10G] (rev 03)

    IOMMU group 25: [1b21:1164] 59:00.0 SATA controller: ASMedia Technology Inc. ASM1164 Serial ATA AHCI Controller (rev 02)

    [2:0:0:0] disk ATA Samsung SSD 870 2B6Q /dev/sde 2.00TB

    [3:0:0:0] disk ATA Samsung SSD 870 2B6Q /dev/sdf 2.00TB

    [4:0:0:0] disk ATA ST8000NM017B-2TJ SN04 /dev/sdg 8.00TB

    [5:0:0:0] disk ATA WDC WD40EFRX-68N 0A82 /dev/sdh 4.00TB

    IOMMU group 26: [8086:46a8] 00:02.1 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 27: [8086:46a8] 00:02.2 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 28: [8086:46a8] 00:02.3 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 29: [8086:46a8] 00:02.4 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 30: [8086:46a8] 00:02.5 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 31: [8086:46a8] 00:02.6 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 32: [8086:46a8] 00:02.7 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 33: [8086:5786] 02:00.0 PCI bridge: Intel Corporation JHL9480 Thunderbolt 5 80/120G Bridge [Barlow Ridge Hub 80G 2023] (rev 85)

    IOMMU group 34: [8086:5786] 03:00.0 PCI bridge: Intel Corporation JHL9480 Thunderbolt 5 80/120G Bridge [Barlow Ridge Hub 80G 2023] (rev 85)

    IOMMU group 35: [8086:5786] 03:01.0 PCI bridge: Intel Corporation JHL9480 Thunderbolt 5 80/120G Bridge [Barlow Ridge Hub 80G 2023] (rev 85)

    IOMMU group 36: [8086:5786] 03:02.0 PCI bridge: Intel Corporation JHL9480 Thunderbolt 5 80/120G Bridge [Barlow Ridge Hub 80G 2023] (rev 85)

    IOMMU group 37: [8086:5786] 03:03.0 PCI bridge: Intel Corporation JHL9480 Thunderbolt 5 80/120G Bridge [Barlow Ridge Hub 80G 2023] (rev 85)

    IOMMU group 38: [10de:24b0] 04:00.0 VGA compatible controller: NVIDIA Corporation GA104GL [RTX A4000] (rev a1)

    [10de:228b] 04:00.1 Audio device: NVIDIA Corporation GA104 High Definition Audio Controller (rev a1)

    ECHO Express SE IIIe:

    IOMMU group 0: [8086:46a8] 00:02.0 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 1: [8086:4601] 00:00.0 Host bridge: Intel Corporation Alder Lake-U15 Host and DRAM Controller (rev 04)

    IOMMU group 2: [8086:464d] 00:06.0 PCI bridge: Intel Corporation 12th Gen Core Processor PCI Express x4 Controller #0 (rev 04)

    IOMMU group 3: [8086:466e] 00:07.0 PCI bridge: Intel Corporation Alder Lake-P Thunderbolt 4 PCI Express Root Port #0 (rev 04)

    IOMMU group 4: [8086:462f] 00:07.2 PCI bridge: Intel Corporation Alder Lake-P Thunderbolt 4 PCI Express Root Port #2 (rev 04)

    IOMMU group 5: [8086:461e] 00:0d.0 USB controller: Intel Corporation Alder Lake-P Thunderbolt 4 USB Controller (rev 04)

    Bus 001 Device 001 Port 1-0 ID 1d6b:0002 Linux Foundation 2.0 root hub

    Bus 002 Device 001 Port 2-0 ID 1d6b:0003 Linux Foundation 3.0 root hub

    Bus 002 Device 002 Port 2-2 ID 174c:3074 ASMedia Technology Inc. ASM1074 SuperSpeed hub

    Bus 002 Device 003 Port 2-2.2 ID 174c:55aa ASMedia Technology Inc. ASM1051E SATA 6Gb/s bridge, ASM1053E SATA 6Gb/s bridge, ASM1153 SATA 3Gb/s bridge, ASM1153E SATA 6Gb/s bridge

    [8086:463e] 00:0d.2 USB controller: Intel Corporation Alder Lake-P Thunderbolt 4 NHI #0 (rev 04)

    [8086:466d] 00:0d.3 USB controller: Intel Corporation Alder Lake-P Thunderbolt 4 NHI #1 (rev 04)

    IOMMU group 6: [8086:51ed] 00:14.0 USB controller: Intel Corporation Alder Lake PCH USB 3.2 xHCI Host Controller (rev 01)

    Bus 003 Device 001 Port 3-0 ID 1d6b:0002 Linux Foundation 2.0 root hub

    Bus 003 Device 002 Port 3-3 ID 05dc:c75c Lexar Media, Inc. JumpDrive V10

    Bus 003 Device 003 Port 3-4 ID 174c:2074 ASMedia Technology Inc. ASM1074 High-Speed hub

    Bus 003 Device 004 Port 3-4.3 ID 10c4:ea60 Silicon Labs CP210x UART Bridge

    Bus 003 Device 005 Port 3-4.4 ID 0bda:8771 Realtek Semiconductor Corp. Bluetooth Radio

    Bus 004 Device 001 Port 4-0 ID 1d6b:0003 Linux Foundation 3.0 root hub

    [8086:51ef] 00:14.2 RAM memory: Intel Corporation Alder Lake PCH Shared SRAM (rev 01)

    IOMMU group 7: [8086:51e8] 00:15.0 Serial bus controller: Intel Corporation Alder Lake PCH Serial IO I2C Controller #0 (rev 01)

    [8086:51e9] 00:15.1 Serial bus controller: Intel Corporation Alder Lake PCH Serial IO I2C Controller #1 (rev 01)

    IOMMU group 8: [8086:51e0] 00:16.0 Communication controller: Intel Corporation Alder Lake PCH HECI Controller (rev 01)

    IOMMU group 9: [8086:51d3] 00:17.0 SATA controller: Intel Corporation Alder Lake-P SATA AHCI Controller (rev 01)

    [0:0:0:0] disk ATA ST8000NM017B-2TJ SN04 /dev/sdc 8.00TB

    [1:0:0:0] disk ATA WDC WD40EFRX-68N 0A82 /dev/sdd 4.00TB

    IOMMU group 10: [8086:51b8] 00:1c.0 PCI bridge: Intel Corporation Device 51b8 (rev 01)

    IOMMU group 11: [8086:51bc] 00:1c.4 PCI bridge: Intel Corporation Alder Lake PCI Express x4 Root Port #5 (rev 01)

    IOMMU group 12: [8086:51be] 00:1c.6 PCI bridge: Intel Corporation Device 51be (rev 01)

    IOMMU group 13: [8086:51b0] 00:1d.0 PCI bridge: Intel Corporation Alder Lake PCI Express Root Port #9 (rev 01)

    IOMMU group 14: [8086:5182] 00:1f.0 ISA bridge: Intel Corporation Alder Lake PCH eSPI Controller (rev 01)

    [8086:51c8] 00:1f.3 Audio device: Intel Corporation Alder Lake PCH-P High Definition Audio Controller (rev 01)

    [8086:51a3] 00:1f.4 SMBus: Intel Corporation Alder Lake PCH-P SMBus Host Controller (rev 01)

    [8086:51a4] 00:1f.5 Serial bus controller: Intel Corporation Alder Lake-P PCH SPI Controller (rev 01)

    IOMMU group 15: [144d:a80a] 01:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller PM9A1/PM9A3/980PRO

    [N:1:6:1] disk Samsung SSD 980 PRO 2TB__1 /dev/nvme1n1 2.00TB

    IOMMU group 16: [8086:15d3] 02:00.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016] (rev 02)

    IOMMU group 17: [8086:15d3] 03:01.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016] (rev 02)

    [10b5:8724] 04:00.0 PCI bridge: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA (rev ca)

    [10b5:8724] 05:00.0 PCI bridge: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA (rev ca)

    [10b5:8724] 05:01.0 PCI bridge: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA (rev ca)

    [10b5:8724] 05:08.0 PCI bridge: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA (rev ca)

    [10b5:8724] 05:09.0 PCI bridge: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA (rev ca)

    [10de:24b0] 06:00.0 VGA compatible controller: NVIDIA Corporation GA104GL [RTX A4000] (rev a1)

    [10de:228b] 06:00.1 Audio device: NVIDIA Corporation GA104 High Definition Audio Controller (rev a1)

    IOMMU group 18: [8086:15d3] 03:04.0 PCI bridge: Intel Corporation JHL6540 Thunderbolt 3 Bridge (C step) [Alpine Ridge 4C 2016] (rev 02)

    IOMMU group 19: [144d:a80a] 5b:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller PM9A1/PM9A3/980PRO

    [N:0:6:1] disk Samsung SSD 980 PRO 2TB__1 /dev/nvme0n1 2.00TB

    IOMMU group 20: [1d6a:04c0] 5c:00.0 Ethernet controller: Aquantia Corp. AQtion AQC113 NBase-T/IEEE 802.3an Ethernet Controller [Antigua 10G] (rev 03)

    IOMMU group 21: [1d6a:04c0] 5d:00.0 Ethernet controller: Aquantia Corp. AQtion AQC113 NBase-T/IEEE 802.3an Ethernet Controller [Antigua 10G] (rev 03)

    IOMMU group 22: [1b21:1164] 5e:00.0 SATA controller: ASMedia Technology Inc. ASM1164 Serial ATA AHCI Controller (rev 02)

    [2:0:0:0] disk ATA Samsung SSD 870 2B6Q /dev/sde 2.00TB

    [3:0:0:0] disk ATA Samsung SSD 870 2B6Q /dev/sdf 2.00TB

    [4:0:0:0] disk ATA ST8000NM017B-2TJ SN04 /dev/sdg 8.00TB

    [5:0:0:0] disk ATA WDC WD40EFRX-68N 0A82 /dev/sdh 4.00TB

    IOMMU group 23: [8086:46a8] 00:02.1 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 24: [8086:46a8] 00:02.2 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 25: [8086:46a8] 00:02.3 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 26: [8086:46a8] 00:02.4 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 27: [8086:46a8] 00:02.5 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 28: [8086:46a8] 00:02.6 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

    IOMMU group 29: [8086:46a8] 00:02.7 VGA compatible controller: Intel Corporation Alder Lake-UP3 GT2 [Iris Xe Graphics] (rev 0c)

  • Quote

    • Join the conversation

    You can post now and register later. If you have an account, sign in now to post with your account.
    Note: Your post will require moderator approval before it will be visible.

    Guest
    Reply to this topic...
    Go to topic listing

    Account

    Navigation

    Search

    Search

    Configure browser push notifications
    Chrome (Android)
    1. Tap the lock icon next to the address bar.
    2. Tap Permissions → Notifications.
    3. Adjust your preference.
    Chrome (Desktop)
    1. Click the padlock icon in the address bar.
    2. Select Site settings.
    3. Find Notifications and adjust your preference.