Jump to content
Guan

Multiple OS Build Advice

8 posts in this topic Last Reply

Recommended Posts

Hi All,

 

I am starting a new build to run multiple OS (namely two ubuntu and windows machine on my server). As I am trying to source from a server supplier for the hardware required (EXALIT), we came up with a few enquiries regarding it.

 

The hardware that we are going to run are:

CPU: 2 x Xeon Gold 5218

Motherboard: PCI-E lanes without PLX chip

RAM: 8 x 32GB DDR4-2933 ECC RDIMM 

Storage: 4 x 960GB Enterprise SATA SSD, 2.5”, 1DWPD endurance, 2M MTBF

GPU: 3 x RTX 2080Ti equivalent (Might be RTX 4000 as it is a single slot GPU)

USB PCI-E Cards: TBD (decided upon query answered)

GIGABIT LAN PCI-E Cards: TBD (decided upon query answered)

 

As we would like to run multiple OS at the same time, the queries are:

1) Can unRAID assign GPUs to each OS if they are running on a PLX chip?
2) Can unRAID assign a couple of USB ports for all the different OS from the same USB controller? (same question for LAN ports)
3) Can unRAID use the motherboard usb and gigabit LAN port whilst the other OS use the PCI-E usb and LAN ports?

 

Thank you for assisting me on the queries!

 

Cheers,

-Guan-
 

Share this post


Link to post

SSDs are not recommended in the parity array but can be used in the cache pool. At least one data disk is required in the array. 

Share this post


Link to post
8 hours ago, Guan said:

1) Can unRAID assign GPUs to each OS if they are running on a PLX chip?

I would need to test to verify, but I don't believe PLX prevents GPU assignment, though it may impact IOMMU groupings and the rules for those remain true.  You would need to boot up a server with all your PCI-e add-on cards installed to see the IOMMU groupings to determine what assignments are possible.

 

8 hours ago, Guan said:

2) Can unRAID assign a couple of USB ports for all the different OS from the same USB controller? (same question for LAN ports)

There is a specific USB add-on controller that you can purchase which is a single physical controller but has four discrete USB controllers built inside of it.  We use this controller and assign an individual port to each VM, using a USB hub to create multiple ports out of the one for each user.

 

You cannot assign individual USB ports themselves to VMs in Unraid yet.  This is something we have looked into in the past, but haven't prioritized for development just yet.

 

8 hours ago, Guan said:

3) Can unRAID use the motherboard usb and gigabit LAN port whilst the other OS use the PCI-E usb and LAN ports?

Yes, but while the benefits are obvious for using PCI-e USB controllers for VMs, using virtual NICs for VMs is far more efficient than trying to do NIC passthrough (though there are of course use-cases for wanting that).

Share this post


Link to post
14 hours ago, trurl said:

SSDs are not recommended in the parity array but can be used in the cache pool. At least one data disk is required in the array. 

Thanks Trurl, will look into getting data disks as storage devices. The usage of SSDs was to make it as the primary drive for OS booting and software launching. May I know if I could mount it outside of the array to do as such, rather than combining them into one array as a cache pool?

 

6 hours ago, jonp said:

I would need to test to verify, but I don't believe PLX prevents GPU assignment, though it may impact IOMMU groupings and the rules for those remain true.  You would need to boot up a server with all your PCI-e add-on cards installed to see the IOMMU groupings to determine what assignments are possible.

Thanks jonp for replying. I think I will tell the supplier to provide me with a motherboard and cpu combo that does not need a PLX chip for my usage as it poses a lot of unkowns to me.

 

6 hours ago, jonp said:

There is a specific USB add-on controller that you can purchase which is a single physical controller but has four discrete USB controllers built inside of it.  We use this controller and assign an individual port to each VM, using a USB hub to create multiple ports out of the one for each user.

May I know if this is the similar to the one you were mentioning? http://techsupportlb.com/product/pvu3-5o2u-usb3-0-7-ports-desktop-pci-express-card-with-vl800-vl812-usb-3-0-controller/

Do you have a link to the specific usb add-on controller that you mentioned? That would be help tremendously with my serach.

 

6 hours ago, jonp said:

Yes, but while the benefits are obvious for using PCI-e USB controllers for VMs, using virtual NICs for VMs is far more efficient than trying to do NIC passthrough (though there are of course use-cases for wanting that).

 Noted with the suggestion. Thanks a lot for helping!

Share this post


Link to post

May I know if there are any LAN cards with four different controllers like the USB cards that @jonp mentioned? It will be of great help! Thanks!

Share this post


Link to post
7 hours ago, Guan said:

May I know if there are any LAN cards with four different controllers like the USB cards that @jonp mentioned? It will be of great help! Thanks!

I use the Intel I350 ethernet controller.

IOMMU group 14:	[8086:1521] 07:00.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
IOMMU group 15:	[8086:1521] 07:00.1 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
IOMMU group 16:	[8086:1521] 07:00.2 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
IOMMU group 17:	[8086:1521] 07:00.3 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)

 

Share this post


Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.