Jump to content

m.2 slots for cache. will it work?


Recommended Posts

Posted

I am planning a system on a Ryzen 3700x processor with a Gigabyte X570 gaming X motherboard and 32gb ram.

 

The question is, can I use the 2 x m.2 slots for Samsung evo860 500gb m.2 ssd's for the cache?

 

Or should I play safe and use conventional SSD's on the sata ports.

 

The board only has 6 sata connectors and I would like to reserve them for the array.

 

Posted
2 hours ago, Jessie said:

can I use the 2 x m.2 slots for Samsung evo860 500gb m.2 ssd's for the cache?

Yes if the motherboard supports SATA devices on both m.2 slots, sometimes only NVMe devices are supported in one or more slots, check the manual.

Posted
2 hours ago, Jessie said:

The board only has 6 sata connectors and I would like to reserve them for the array.

Also note that usually using a SATA M.2 device disables a SATA port, again check manual.

Posted
On 5/28/2020 at 5:06 PM, johnnie.black said:

Yes if the motherboard supports SATA devices on both m.2 slots, sometimes only NVMe devices are supported in one or more slots, check the manual.

Thanks for that suggestion.

 

Just checked the manual again.  It will support m.2 sata and pci4 x4/x2.  There is no mention of disabled sata ports so I presume they are operating independently. 

 

I ordered the parts yesterday, so will find out the hard way if i'm wrong.

 

The other thing I am a little concerned about is hardware pass through to the graphics card.  This will be my first Ryzen 3 series build.

 

I have built other machines in Ryzen 2 platforms using X370 motherboards and passthrough would fail if bios supporting Ryzen 3 was loaded.

 

Otherwise they were very stable.

 

  • 2 weeks later...
Posted
On 5/28/2020 at 2:58 PM, Jessie said:

I am planning a system on a Ryzen 3700x processor with a Gigabyte X570 gaming X motherboard and 32gb ram.

 

The question is, can I use the 2 x m.2 slots for Samsung evo860 500gb m.2 ssd's for the cache?

 

Or should I play safe and use conventional SSD's on the sata ports.

 

The board only has 6 sata connectors and I would like to reserve them for the array.

 

To answer my own question. (and if anyone wants to know)  Yes, it worked very well.  With the exception of passing through the onboard sound controller.

I googled that issue and it appears that a future kernel update will rectify the problem.

Someone rebuilt a 6.8.1 kernel and fixed it, but I won't be going down that track.

 

The hardware was as mentioned above plus 2 x 4tb western digital reds for the array.

I chose Gigabyte for the motherboard because they reckon the chipset fans use high quality bearings.  Not keen on chipset fans but is compulsary on X570 chipsets.  I'm hoping the fan will outlast the motherboard.  I noticed that the fan spends a lot of time "off", however it is winter here and temps will go to 46 degrees in summer, so I expect it will be busier then.

 

I put it into an Antec P101 silent case because it has 8 conventional  HD bays plus 2 x 2.5"ssds bays. Enough room to fully expand the system.

Power supply is a coolermaster Masterwatt 650.

 

I have used coolermaster silencio 550 cases on other builds but that case is discontinued. I felt that the new series of coolermaster cases do not suit unraid. Not a lot of 3.5 slots, and they are spread randomly around the case. (Messy).  I'm also not a fan of mounting mechanical drives vertically as is required in the new coolermaster cases.

 

So the system as is, can handle 6 sata drives = 20tb of protected storage on the array using 4tb drives plus 2 x m.2 drives for the cache.

 

Graphics is a gigabyte gtx1650 passed through to the windows vm, with the addition of the bios file.

 

The motherboard has a feature in bios which optimises the IOMMU groups for VM working.

This meant it was not necessary to turn on ACS in unraid.

I pasted the IOMMU grouping below for before and after.

 

I passed the GPU and its sound adapter through via the normal method and passed most of the USB controllers minus the one with the unraid adapter using the VFIO-PCI Config plugin. This allowed hot plugging of all 4 usb jacks on front of case plus a couple on the back for windows.

 

It will initially act as a windows workstation with protected storage and nextcloud server/letsencrypt/collabora dockers running in the background.

It might end up running a pfsense vm and openvpn, either running from pfsense or maybe the docker for remote access.

Possibly a media server docker to stream home movies to tv devices.

 

To automate things a bit, I set bios to turn the machine on in the morning and the Dynamix S3 Sleep plugin to shut it down at night.

This will allow access to the cloud server during the day and save a bit of power overnight.

 

 

Gigabyte X570 Gaming X IOMMU groups

 

Standard (before)
PCI Devices and IOMMU Groups

IOMMU group 0:    [1022:1482] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
    [1022:1483] 00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge
    [1022:57ad] 01:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57ad
    [1022:57a3] 02:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a3
    [1022:57a4] 02:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
    [1022:57a4] 02:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
    [1022:57a4] 02:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
    [10ec:8168] 03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 16)
    [1022:1485] 04:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
    [1022:149c] 04:00.1 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
    [1022:149c] 04:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
    [1022:7901] 05:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
    [1022:7901] 06:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
IOMMU group 1:    [1022:1482] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
IOMMU group 2:    [1022:1482] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
    [1022:1483] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge
    [10de:1f82] 07:00.0 VGA compatible controller: NVIDIA Corporation TU117 [GeForce GTX 1650] (rev a1)
    [10de:10fa] 07:00.1 Audio device: NVIDIA Corporation Device 10fa (rev a1)
IOMMU group 3:    [1022:1482] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
IOMMU group 4:    [1022:1482] 00:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
IOMMU group 5:    [1022:1482] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
IOMMU group 6:    [1022:1484] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
IOMMU group 7:    [1022:1482] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
IOMMU group 8:    [1022:1484] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
IOMMU group 9:    [1022:1484] 00:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
IOMMU group 10:    [1022:1484] 00:08.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
IOMMU group 11:    [1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 61)
    [1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
IOMMU group 12:    [1022:1440] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 0
    [1022:1441] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 1
    [1022:1442] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 2
    [1022:1443] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 3
    [1022:1444] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 4
    [1022:1445] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 5
    [1022:1446] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 6
    [1022:1447] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 7
IOMMU group 13:    [1022:148a] 08:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
IOMMU group 14:    [1022:1485] 09:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
IOMMU group 15:    [1022:1486] 09:00.1 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP
IOMMU group 16:    [1022:149c] 09:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
IOMMU group 17:    [1022:1487] 09:00.4 Audio device: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller
IOMMU group 18:    [1022:7901] 0a:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
IOMMU group 19:    [1022:7901] 0b:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)


CPU Thread Pairings

Pair 1:    cpu 0 / cpu 8
Pair 2:    cpu 1 / cpu 9
Pair 3:    cpu 2 / cpu 10
Pair 4:    cpu 3 / cpu 11
Pair 5:    cpu 4 / cpu 12
Pair 6:    cpu 5 / cpu 13
Pair 7:    cpu 6 / cpu 14
Pair 8:    cpu 7 / cpu 15


USB Devices

Bus 001 Device 001:    ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 001 Device 002:    ID 2516:0051
Bus 002 Device 001:    ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 003 Device 001:    ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 003 Device 002:    ID 046d:c52b Logitech, Inc. Unifying Receiver
Bus 003 Device 003:    ID 048d:8297 Integrated Technology Express, Inc.
Bus 004 Device 001:    ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 005 Device 001:    ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 005 Device 002:    ID 0781:5571 SanDisk Corp. Cruzer Fit
Bus 005 Device 003:    ID 0557:7000 ATEN International Co., Ltd Hub
Bus 005 Device 004:    ID 0557:2213 ATEN International Co., Ltd CS682 2-Port USB 2.0 DVI KVM Switch
Bus 006 Device 001:    ID 1d6b:0003 Linux Foundation 3.0 root hub


SCSI Devices

[0:0:0:0]    disk    SanDisk' Cruzer Fit       1.00  /dev/sda   8.00GB
[5:0:0:0]    disk    ATA      Samsung SSD 860  3B6Q  /dev/sdb    500GB
[7:0:0:0]    disk    ATA      WDC WD40EFAX-68J 0A82  /dev/sdc   4.00TB
[11:0:0:0]    disk    ATA      WDC WD40EFAX-68J 0A82  /dev/sdd   4.00TB
[18:0:0:0]    disk    ATA      Samsung SSD 860  3B6Q  /dev/sde    500GB

 

 

ACS enabled on Motherboard (after)

 

PCI Devices and IOMMU Groups

IOMMU group 0:    [1022:1482] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
IOMMU group 1:    [1022:1483] 00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge
IOMMU group 2:    [1022:1482] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
IOMMU group 3:    [1022:1482] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
IOMMU group 4:    [1022:1483] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge
IOMMU group 5:    [1022:1482] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
IOMMU group 6:    [1022:1482] 00:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
IOMMU group 7:    [1022:1482] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
IOMMU group 8:    [1022:1484] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
IOMMU group 9:    [1022:1482] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
IOMMU group 10:    [1022:1484] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
IOMMU group 11:    [1022:1484] 00:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
IOMMU group 12:    [1022:1484] 00:08.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
IOMMU group 13:    [1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 61)
    [1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
IOMMU group 14:    [1022:1440] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 0
    [1022:1441] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 1
    [1022:1442] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 2
    [1022:1443] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 3
    [1022:1444] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 4
    [1022:1445] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 5
    [1022:1446] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 6
    [1022:1447] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 7
IOMMU group 15:    [1022:57ad] 01:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57ad
IOMMU group 16:    [1022:57a3] 02:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a3
IOMMU group 17:    [1022:57a4] 02:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
    [1022:1485] 04:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
    [1022:149c] 04:00.1 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
    [1022:149c] 04:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
IOMMU group 18:    [1022:57a4] 02:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
    [1022:7901] 05:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
IOMMU group 19:    [1022:57a4] 02:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
    [1022:7901] 06:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
IOMMU group 20:    [10ec:8168] 03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 16)
IOMMU group 21:    [10de:1f82] 07:00.0 VGA compatible controller: NVIDIA Corporation TU117 [GeForce GTX 1650] (rev a1)
    [10de:10fa] 07:00.1 Audio device: NVIDIA Corporation Device 10fa (rev a1)
IOMMU group 22:    [1022:148a] 08:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
IOMMU group 23:    [1022:1485] 09:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
IOMMU group 24:    [1022:1486] 09:00.1 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP
IOMMU group 25:    [1022:149c] 09:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
IOMMU group 26:    [1022:1487] 09:00.4 Audio device: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller
IOMMU group 27:    [1022:7901] 0a:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
IOMMU group 28:    [1022:7901] 0b:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)


CPU Thread Pairings

Pair 1:    cpu 0 / cpu 8
Pair 2:    cpu 1 / cpu 9
Pair 3:    cpu 2 / cpu 10
Pair 4:    cpu 3 / cpu 11
Pair 5:    cpu 4 / cpu 12
Pair 6:    cpu 5 / cpu 13
Pair 7:    cpu 6 / cpu 14
Pair 8:    cpu 7 / cpu 15


USB Devices

Bus 001 Device 001:    ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 001 Device 002:    ID 2516:0051
Bus 001 Device 003:    ID 046d:c52b Logitech, Inc. Unifying Receiver
Bus 002 Device 001:    ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 003 Device 001:    ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 003 Device 002:    ID 048d:8297 Integrated Technology Express, Inc.
Bus 004 Device 001:    ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 005 Device 001:    ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 005 Device 002:    ID 0781:5571 SanDisk Corp. Cruzer Fit
Bus 006 Device 001:    ID 1d6b:0003 Linux Foundation 3.0 root hub


SCSI Devices

[0:0:0:0]    disk    SanDisk' Cruzer Fit       1.00  /dev/sda   8.00GB
[5:0:0:0]    disk    ATA      Samsung SSD 860  3B6Q  /dev/sdb    500GB
[7:0:0:0]    disk    ATA      WDC WD40EFAX-68J 0A82  /dev/sdc   4.00TB
[11:0:0:0]    disk    ATA      WDC WD40EFAX-68J 0A82  /dev/sdd   4.00TB
[18:0:0:0]    disk    ATA      Samsung SSD 860  3B6Q  /dev/sde    500GB

 

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...