Jump to content

PCIe nvme adapter with pcie switch (support non-bifurcation motherboard)

SithRonin

Recommended Posts

MAM59 Community Regular

MAM59

Posted
Posted

Both of them should work, although, I would avoid the 2nd (4*NVMe) one because of a possible conflict with your hardware.

 

There are AMD Processors ("G"-Type) out on the market that occupy 4 lanes of the 1st (and usually the only) 16x slots for their internal GPU. Sadly they use the 2nd 4x block. So the slot will only have 4x0x4x4x. And some switches depend on consecutive lanes, so they only use the 1st 4x lanes of the slot and the remaining lanes are left alone. This can lead to significant speed reductions.

And you cannot know before, so this is a risk you take.

 

The 2*NVMe in the 4x Slot of the 1st card should work in any Motherboard.

  • Like 1
Link to comment
SithRonin Noob

SithRonin

Posted
  • Author
Posted

Thanks for the reply ! the hardware of my UNraid server is a HPE proliant dl360p gen8 (Intel Xeon). I saw a video from a guy who installed the IO Crest adapter (4x nvme) on the same server and it was working flawlessly. So I was wondering if I could encounter any problem with UNraid.

Link to comment
MAM59 Community Regular

MAM59

Posted
Posted

The "active" cards (containing a switch) should present several different devices to the BIOS which just hands them over to the OS.

 

With bifurbication support, this switching is done by the motherboard/bios itself, so no expensive switch on the card is needed.

Check your manual if your server supports bifurbication, if yes you can save a lot of money.

(A xeon server should be able to do this, I once had a 360 Gen 6 which already was capable of 8x8x or 4x4x4x4.)

 

Link to comment
Vinks99 Noob

Vinks99

Posted
Posted
On 4/20/2023 at 8:06 AM, SithRonin said:

hello,

 

I'm new with UNRAID (and linux) and I would like to know If I could use these kind of adpater to add some nvme drive 
→ https://a.co/d/geBwOPd

→ https://a.co/d/h37oStN

 

Yes, both of those PCIe NVMe adapters with PCIe switches should be compatible with UNRAID and should allow you to add NVMe drives to your server.
 

- The first adapter you linked (https://a.co/d/geBwOPd) is a PCIe 3.0 x16 adapter with a built-in PCIe switch that supports up to four M.2 NVMe drives. This adapter should work well with your HPE ProLiant DL360p Gen8 server, which supports PCIe 3.0. 

 

- The second adapter you linked (https://a.co/d/h37oStN) is a PCIe 3.0 x8 adapter with a built-in PCIe switch that also supports up to four M.2 NVMe drives. This adapter should also work with your server, but keep in mind that it will use up one of your PCIe x8 slots, leaving you with only one PCIe x8 slot and one PCIe x4 slot available for other expansion cards.

 

Both of these adapters should be plug-and-play with UNRAID and should show up in the Unassigned Devices section of the web UI once you have installed them in your server. From there, you can assign them to a storage pool or use them as cache drives. You may find more information here. 

Link to comment
MAM59 Community Regular

MAM59

Posted
Posted (edited)
6 minutes ago, SithRonin said:

unfortunately, it doesn't seems to work. I have 2 nvme ssd installed and only one shows up in unraid 

Maybe my AMD-G warning applies to you too?

Return the card and get the other one. If it only shows 1 disk too, try to use the slots 1,3&4 and avoid slot2.

 

Your Server should have 2 slots over a riser card. One 16x, one 8x. Try the other slot and pray.

Edited by MAM59
Link to comment
JorgeB Grand Master

JorgeB

Posted
Posted 
07:00.0 PCI bridge [0604]: ASMedia Technology Inc. Device [1b21:2812] (rev 01)
    Kernel driver in use: pcieport
08:00.0 PCI bridge [0604]: ASMedia Technology Inc. Device [1b21:2812] (rev 01)
    Kernel driver in use: pcieport
08:08.0 PCI bridge [0604]: ASMedia Technology Inc. Device [1b21:2812] (rev 01)
    Kernel driver in use: pcieport
0a:00.0 Non-Volatile memory controller [0108]: Silicon Motion, Inc. SM2263EN/SM2263XT SSD Controller [126f:2263] (rev 03)
    Subsystem: Silicon Motion, Inc. SM2263EN/SM2263XT SSD Controller [126f:2263]
    Kernel driver in use: nvme
    Kernel modules: nvme

 

PCIe bridge appears to be correctly detected, did you try swapping the NVMe devices to see if it's a specific slot or device that is working?

Link to comment
SithRonin Noob

SithRonin

Posted
  • Author
Posted
7 hours ago, JorgeB said: 
07:00.0 PCI bridge [0604]: ASMedia Technology Inc. Device [1b21:2812] (rev 01)
    Kernel driver in use: pcieport
08:00.0 PCI bridge [0604]: ASMedia Technology Inc. Device [1b21:2812] (rev 01)
    Kernel driver in use: pcieport
08:08.0 PCI bridge [0604]: ASMedia Technology Inc. Device [1b21:2812] (rev 01)
    Kernel driver in use: pcieport
0a:00.0 Non-Volatile memory controller [0108]: Silicon Motion, Inc. SM2263EN/SM2263XT SSD Controller [126f:2263] (rev 03)
    Subsystem: Silicon Motion, Inc. SM2263EN/SM2263XT SSD Controller [126f:2263]
    Kernel driver in use: nvme
    Kernel modules: nvme

 

PCIe bridge appears to be correctly detected, did you try swapping the NVMe devices to see if it's a specific slot or device that is working?

I installed 2 NVME ssd on the card and only 1 is available.  1 of these two drive is my cache drive so in theory the second ssd "should" appear as "unassigned"

Link to comment
caplam Contributor

caplam

Posted
Posted

bought  this one works flawlessly in HP Z620.

 

pros: works with 22110 ssd

         works in x16 x8 and x4 (not verified) slots

cons: small fan on the card a bit noisy.

  

IOMMU group 29:				[10b5:8748] 04:00.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 30:				[10b5:8748] 05:08.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 31:				[10b5:8748] 05:09.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 32:				[10b5:8748] 05:0a.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 33:				[10b5:8748] 05:0b.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 34:				[10b5:8748] 05:10.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 35:				[10b5:8748] 05:11.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 36:				[10b5:8748] 05:12.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 37:				[10b5:8748] 05:13.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 38:			 	[1c5c:2527] 06:00.0 Non-Volatile memory controller: SK hynix Device 2527
[N:0:1:1]    disk    HFS960GD0TEG-6410A__1                      /dev/nvme0n1   960GB
IOMMU group 39:			 	[1c5c:2527] 07:00.0 Non-Volatile memory controller: SK hynix Device 2527
[N:1:1:1]    disk    HFS960GD0TEG-6410A__1                      /dev/nvme1n1   960GB
IOMMU group 40:			 	[1c5c:2527] 08:00.0 Non-Volatile memory controller: SK hynix Device 2527
[N:2:1:1]    disk    HFS960GD0TEG-6410A__1                      /dev/nvme2n1   960GB
IOMMU group 41:			 	[1c5c:2527] 09:00.0 Non-Volatile memory controller: SK hynix Device 2527
[N:3:1:1]    disk    HFS960GD0TEG-6410A__1                      /dev/nvme3n1   960GB

 

 

Link to comment
SithRonin Noob

SithRonin

Posted
  • Author
Posted
24 minutes ago, caplam said:

bought  this one works flawlessly in HP Z620.

 

pros: works with 22110 ssd

         works in x16 x8 and x4 (not verified) slots

cons: small fan on the card a bit noisy.

  

IOMMU group 29:				[10b5:8748] 04:00.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 30:				[10b5:8748] 05:08.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 31:				[10b5:8748] 05:09.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 32:				[10b5:8748] 05:0a.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 33:				[10b5:8748] 05:0b.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 34:				[10b5:8748] 05:10.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 35:				[10b5:8748] 05:11.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 36:				[10b5:8748] 05:12.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 37:				[10b5:8748] 05:13.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca)
IOMMU group 38:			 	[1c5c:2527] 06:00.0 Non-Volatile memory controller: SK hynix Device 2527
[N:0:1:1]    disk    HFS960GD0TEG-6410A__1                      /dev/nvme0n1   960GB
IOMMU group 39:			 	[1c5c:2527] 07:00.0 Non-Volatile memory controller: SK hynix Device 2527
[N:1:1:1]    disk    HFS960GD0TEG-6410A__1                      /dev/nvme1n1   960GB
IOMMU group 40:			 	[1c5c:2527] 08:00.0 Non-Volatile memory controller: SK hynix Device 2527
[N:2:1:1]    disk    HFS960GD0TEG-6410A__1                      /dev/nvme2n1   960GB
IOMMU group 41:			 	[1c5c:2527] 09:00.0 Non-Volatile memory controller: SK hynix Device 2527
[N:3:1:1]    disk    HFS960GD0TEG-6410A__1                      /dev/nvme3n1   960GB

 

 

I saw this card in other forum but the reseller do not mention if you bifurcation enabled in the bios. In my case, that is my main problem because the bios in hpe proliant dl360p gen8 doesn't support pcie bifurcation. So i'm stuck with a over priced pcie riser card to add NVME ssd  :(

 

Link to comment
caplam Contributor

caplam

Posted
Posted (edited)
16 minutes ago, SithRonin said:

I saw this card in other forum but the reseller do not mention if you bifurcation enabled in the bios. In my case, that is my main problem because the bios in hpe proliant dl360p gen8 doesn't support pcie bifurcation. So i'm stuck with a over priced pcie riser card to add NVME ssd  :(

 

I can confirm you don't need bifurcation to use this card.

As mentionned in my post there is "PLX Technology, Inc. PEX 8748" which is a pci-e switch

 

ediit: to be clear my Z620 doesn't support bifurcation either

Edited by caplam
Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
Go to topic listing
×
×
  • Create New...