Anybody planning a Ryzen build?

[tr0910]

When they first hit,I was able to get complete servers with 128gb ECC dual 2670 CPU in an Intel 4u server case with dual 750 watt PSU for less than $500. Comes with IPMI and other server goodies. I now have 4.

 

via mobile

 

 

 

 

[TType85]

Got my Ryzen 1700 system up and running.  Threw a Unraid USB in to see how the IOMMU stuff lays out.  Not looking great.  Board is a Asus B350-Prime

 

Thread paring is a bit different than my dual E5-2665 v1

cpu 0 <===> cpu 16
cpu 1 <===> cpu 17
cpu 2 <===> cpu 18
cpu 3 <===> cpu 19
cpu 4 <===> cpu 20
cpu 5 <===> cpu 21
cpu 6 <===> cpu 22
cpu 7 <===> cpu 23
cpu 8 <===> cpu 24
cpu 9 <===> cpu 25
cpu 10 <===> cpu 26
cpu 11 <===> cpu 27
cpu 12 <===> cpu 28
cpu 13 <===> cpu 29
cpu 14 <===> cpu 30
cpu 15 <===> cpu 31

[chadjj]

TType85 can you elaborate on what you mean by layout is not looking great.

 

I have a PRIME x370-PRO motherboard, Ryzen 7 1700 on order and it would be interesting to see if their would be similar IOMMU groupings.  From my understanding there are 3 ways to passthrough hardware and blacklisting shouldn't be affected as you can isolate individual components.

 

I plan to upgrade my current unraid solution with a new Ryzen setup and passthrough a graphics card for gaming.  Do you expect that would be an issue?  I would also likely purchase a bluetooth adapter for a game controller and obviously passthrough keyboard/mouse.

[TType85]

1 minute ago, chadjj said:

TType85 can you elaborate on what you mean by layout is not looking great.

 

I have a PRIME x370-PRO motherboard, Ryzen 7 1700 on order and it would be interesting to see if their would be similar IOMMU groupings.  From my understanding there are 3 ways to passthrough hardware and blacklisting shouldn't be affected as you can isolate individual components.

 

I plan to upgrade my current unraid solution with a new Ryzen setup and passthrough a graphics card for gaming.  Do you expect that would be an issue?  I would also likely purchase a bluetooth adapter for a game controller and obviously passthrough keyboard/mouse.

I don't like seeing the PCI bridge and host bridge in the group. I don't know what will happen when they get passed through (what are they attached to). It probably can still be done but it will not be as easy as if it was right.  I would be interested to see how the x370's IOMMU grouping is.  Listening to some stuff by Wendel (Level1Techs) he said so far no ACS patch has worked on it yet.  The good news is ECC seems to work.

[chadjj]

1 minute ago, TType85 said:

I don't like seeing the PCI bridge and host bridge in the group. I don't know what will happen when they get passed through (what are they attached to). It probably can still be done but it will not be as easy as if it was right.  I would be interested to see how the x370's IOMMU grouping is.  Listening to some stuff by Wendel (Level1Techs) he said so far no ACS patch has worked on it yet.  The good news is ECC seems to work.

 

I watched the same video and I'm no Linux expert or unraid for that matter.  Can IOMMU groupings change from a BIOS updates or is this CPU bound with the new AMD architecture?  Would the worst case be that you can't passthrough a GPU?

[chadjj]

1 hour ago, chadjj said:

 

I watched the same video and I'm no Linux expert or unraid for that matter.  Can IOMMU groupings change from a BIOS updates or is this CPU bound with the new AMD architecture?  Would the worst case be that you can't passthrough a GPU?

 

Attached is the IRQ assignment so it looks like the PCIe x16_1 is on its own lane so I wonder if that is a direct correlation to the IOMMU group.  I hope so.

[urbanracer34]

Here's my part list for my new main server (CAD, not including drives)

 

PCPartPicker part list / Price breakdown by merchant

CPU: AMD RYZEN 7 1700 3.0GHz 8-Core Processor  ($427.05 @ shopRBC) 
Motherboard: ASRock X370 Taichi ATX AM4 Motherboard  ($326.73 @ NCIX) 
Memory: Crucial 8GB (1 x 8GB) DDR4-2133 Memory  ($74.99 @ PC Canada) 
Memory: Crucial 8GB (1 x 8GB) DDR4-2133 Memory  ($74.99 @ PC Canada) 
Case: Fractal Design Define R5 (White) ATX Mid Tower Case  ($146.98 @ NCIX) 
Power Supply: EVGA SuperNOVA G2 1000W 80+ Gold Certified Fully-Modular ATX Power Supply  ($209.97 @ DirectCanada) 
Total: $1260.71
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2017-03-05 23:14 EST-0500

 

It is replacing a mac mini mid 2010 with a spaghetti mess of wires and drives.

 

I am waiting to see what LimeTech finds out about Ryzen, before I spend the cash. 

[TType85]

53 minutes ago, urbanracer34 said:

Here's my part list for my new main server (CAD, not including drives)

 

PCPartPicker part list / Price breakdown by merchant

CPU: AMD RYZEN 7 1700 3.0GHz 8-Core Processor  ($427.05 @ shopRBC) 
Motherboard: ASRock X370 Taichi ATX AM4 Motherboard  ($326.73 @ NCIX) 
Memory: Crucial 8GB (1 x 8GB) DDR4-2133 Memory  ($74.99 @ PC Canada) 
Memory: Crucial 8GB (1 x 8GB) DDR4-2133 Memory  ($74.99 @ PC Canada) 
Case: Fractal Design Define R5 (White) ATX Mid Tower Case  ($146.98 @ NCIX) 
Power Supply: EVGA SuperNOVA G2 1000W 80+ Gold Certified Fully-Modular ATX Power Supply  ($209.97 @ DirectCanada) 
Total: $1260.71
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2017-03-05 23:14 EST-0500

 

It is replacing a mac mini mid 2010 with a spaghetti mess of wires and drives.

 

I am waiting to see what LimeTech finds out about Ryzen, before I spend the cash. 

You are going to need some sort of GPU, there is no built in GPU on the Ryzen 7 chips. If you are just using it for a server, any cheap card will do.

[urbanracer34]

15 hours ago, TType85 said:

You are going to need some sort of GPU, there is no built in GPU on the Ryzen 7 chips. If you are just using it for a server, any cheap card will do.

Guess I'll have to add a cheap one. Thanks for the help. 

[atxalex]

@TType85 Any issues with S3 sleep and WOL in unraid on the Ryzen 1700 build? 

[garycase]

On ‎2‎/‎24‎/‎2017 at 3:24 AM, lionceau said:

The latest news on ECC support is that Ryzen will not officially support it

Very disappointing.   The 1800X with a TDP under 100w and a PassMark of 15494 is a VERY enticing processor ... might even get this old Intel dog to think about a new trick !!       But not without ECC support.

 

[garycase]

On ‎3‎/‎2‎/‎2017 at 0:02 PM, solrsa said:

Lisa Su (AMD CEO) just confirmed that Ryzen supports ECC memory

 

Wow!  Clearly I didn't read far enough in this thread.    This is excellent news.

 

 

 

[garycase]

On ‎2‎/‎23‎/‎2017 at 5:43 PM, johnnie.black said:

I intend to buy one (for desktop or unRAID) as soon as I can afford it.

 

Such a wimpy, artificial constraint

[hblockx]

So i also have my ryzenbuild working now. I really would like to passthrough my added USB-PCI-Card but as before mentioned the immou-groups are unlucky for that. Are there really any ways to get this done anyways? ( [1106:3483] 09:00.0 USB controller: VIA Technologies, Inc. VL805 USB 3.0 Host Controller (rev 01))

 

Besides that: Ryzen + Unraid is working amazing (and it is going to be better the time unraid updates its kernel )

 

IOMMU group 0
	[1022:1452] 00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
IOMMU group 1
	[1022:1453] 00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1453
IOMMU group 2
	[1022:1452] 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
IOMMU group 3
	[1022:1452] 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
IOMMU group 4
	[1022:1453] 00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1453
IOMMU group 5
	[1022:1453] 00:03.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1453
IOMMU group 6
	[1022:1452] 00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
IOMMU group 7
	[1022:1452] 00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
IOMMU group 8
	[1022:1454] 00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1454
IOMMU group 9
	[1022:1452] 00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
IOMMU group 10
	[1022:1454] 00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1454
IOMMU group 11
	[1022:790b] 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
	[1022:790e] 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
IOMMU group 12
	[1022:1460] 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1460
	[1022:1461] 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1461
	[1022:1462] 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1462
	[1022:1463] 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1463
	[1022:1464] 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1464
	[1022:1465] 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1465
	[1022:1466] 00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1466
	[1022:1467] 00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1467
IOMMU group 13
	[1022:43b9] 03:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43b9 (rev 02)
	[1022:43b5] 03:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] Device 43b5 (rev 02)
	[1022:43b0] 03:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b0 (rev 02)
	[1022:43b4] 04:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
	[1022:43b4] 04:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
	[1022:43b4] 04:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
	[1022:43b4] 04:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
	[1022:43b4] 04:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
	[1022:43b4] 04:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
	[1b21:1343] 05:00.0 USB controller: ASMedia Technology Inc. Device 1343
	[8086:1539] 06:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
	[1969:e0b1] 07:00.0 Ethernet controller: Qualcomm Atheros Device e0b1 (rev 10)
	[1106:3483] 09:00.0 USB controller: VIA Technologies, Inc. VL805 USB 3.0 Host Controller (rev 01)
IOMMU group 14
	[10de:17c8] 0b:00.0 VGA compatible controller: NVIDIA Corporation GM200 [GeForce GTX 980 Ti] (rev a1)
	[10de:0fb0] 0b:00.1 Audio device: NVIDIA Corporation GM200 High Definition Audio (rev a1)
IOMMU group 15
	[10de:1c82] 0c:00.0 VGA compatible controller: NVIDIA Corporation GP107 [GeForce GTX 1050 Ti] (rev a1)
	[10de:0fb9] 0c:00.1 Audio device: NVIDIA Corporation Device 0fb9 (rev a1)
IOMMU group 16
	[1022:145a] 11:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
	[1022:1456] 11:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Device 1456
	[1022:145c] 11:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Device 145c
IOMMU group 17
	[1022:1455] 12:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
	[1022:7901] 12:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
	[1022:1457] 12:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Device 1457

[HellDiverUK]

I was going to go for Ryzen and had pre-ordered and all.  But, motherboard availability is terrible in the UK, so in the end up I cancelled the pre-order.  

 

But, all that said I might consider one in the future if I decide to replace my unRAID box.

[meep]

Anyone know if the future holds the possibility of multi-cpu setups with ryzen. There's scant information in the Google machine.

 

I've been really reallyhappy with my AMD FX8320 8 core CPU which has been powering my server for the past 3 years. The only thing I'd like would be more cores and more memory to allow more VMs. I've been thinking about migrating to one of those cheap(ish) dual Xeon builds but have hesitated for a while

 

If dual Ryzen is on the horizon enabling a system with 12 or 16 cores, 128GB Memory, 6 or more expansion slots and unRAID compatibility, that would keep me happy. Guess I'm waiting to se how it pans out and what MBs become available.

 

 

 

[planetwilson]

I am in the same boat, Ryzen or a Xeon E5 build? The Xeon's just don't clock as high in general but wondering if I should be too worried. I am not a massive gamer so as long as they boost up to say 3GHz then together with my GTX 950 I think it would be one for moderate gaming. Then I could still have 12 or 14 cores for VMs...those X99 mobs are a bit pricey as well. The Ryzen equivalents look cheaper.

[Pauven]

11 minutes ago, meep said:

Anyone know if the future holds the possibility of multi-cpu setups with ryzen. There's scant information in the Google machine.

 

Ryzen on socket AM4 will be single CPU only. There's just no support for multi-cpu communications with AM4. 

 

Ryzen is the desktop version of the Zen architecture. Naples is the server version of Zen, and is coming out in Q2 (so in the next 4 months). Naples will have up to 32 cores/64 threads on a single CPU. The socket for Naples will be much more capable than AM4, and will support multi-cpu of at least 2 CPU's, and possibly 4. So in theory you could get up to 128 cores/256 threads in a single 4-socket server. Nice, eh? 

 

Another benefit of Naples is that you can run more memory and more channels. Whereas Ryzen is limited to Dual Channel,  4 DIMMs and 64GB, a 16 core Naples doubles that to Quad Channel, 8 DIMMs and 128GB. The 32 core Naples doubles it again to Octo-Channel, 16 DIMMs and 256GB!   Going to 2-CPUs also has a doubling effect, for example 2 x 32 core Naples would max out at 16-Channel, 32 DIMMs and half a terabyte of memory. The Zen architecture plugs together and multiplies benefits like Legos, brilliant! 

 

Of course, ECC is a given.

 

On the other hand, expect processor speeds to be lower than Ryzen. How else do you fit 32 cores into 140w.

 

All sounds nice, but how does this affect you? Immediately, not at all. First deliveries of Naples will be in vendor supplied severs (Dell, etc.), and standalone motherboards and CPU's will probably be at least a quarter behind. 

 

But eventually (perhaps fall /winter 2017), you should be able to get your hands on a server or workstation class motherboard, with a 16 core Naples CPU, and have exactly what you're seeking. 

 

Also, a single-CPU 16-core chip setup will be MUCH cheaper than a dual 8-core setup. MULTI-CPU motherboards are expensive. But still, Naples won't be cheap by any means. Cheaper than a new Intel server, yes, but not cheaper than the used Intel servers you can pick up on ebay. AMD is going for the high end server market, and that doesn't align with your budget. 

 

Lastly, I'm hoping AMD mimics Intel's Broadwell-E lineup, and offer versions of 12 or 16 core Naples CPU's as Ryzen Extreme for the desktop. Would require a different socket than AM4, and possibly different than Naples to prevent cross-shopping. Just like Intel's extreme edition processors, expect these to cost north of $1000, if they ever come to market, and not before 2018.

 

-Paul

 

[Pauven]

1 hour ago, meep said:

I've been really reallyhappy with my AMD FX8320 8 core CPU which has been powering my server for the past 3 years. The only thing I'd like would be more cores and more memory to allow more VMs. I've been thinking about migrating to one of those cheap(ish) dual Xeon builds but have hesitated for a while

 

The FX CPU's are semi-8-core processors that often perform like 4-cores. Ryzen are true 8-core processors that often perform like 16-cores. Plus each core is better. It's a massive upgrade. Only problem is you're currently capped at 64GB with Ryzen. 

 

-Paul 

[Pauven]

After writing my post above, I went to read my daily news and was surprised to find this gem. 

 

http://techreport.com/news/31549/amd-naples-platform-prepares-to-take-zen-into-the-datacenter

 

Only read the first paragraph, but so far lines up well with what I wrote. I recommend reading it for a lot better detail. Plus pictures. 

 

Perfect timing. 

 

-Paul 

[-Daedalus]

Great article there Pauven.

 

TL;DR - Dual socket Naples is 2x faster than 2x2699v4s, apples to apples. 2.5x if Naples is let run at full tilt.

[Pauven]

If anyone is wondering about pricing, that Intel E5-2699v4  lists for nearly $5k. And it just got trounced by AMD's new beast. These will be expensive... 

 

As they said in the video: "Unleash the Beast"  

 

-Paul 

[chadjj]

2 hours ago, meep said:

Anyone know if the future holds the possibility of multi-cpu setups with ryzen. There's scant information in the Google machine.

 

I've been really reallyhappy with my AMD FX8320 8 core CPU which has been powering my server for the past 3 years. The only thing I'd like would be more cores and more memory to allow more VMs. I've been thinking about migrating to one of those cheap(ish) dual Xeon builds but have hesitated for a while

 

If dual Ryzen is on the horizon enabling a system with 12 or 16 cores, 128GB Memory, 6 or more expansion slots and unRAID compatibility, that would keep me happy. Guess I'm waiting to se how it pans out and what MBs become available.

 

 

 

 

From what I have read multi CPU's will not come from the Ryzen family but Naples.  See link below.

64 Cores / 128 Threads dual socket, Octa-channel RAM with up to 171 GB / s

 

https://translate.googleusercontent.com/translate_c?depth=2&nv=1&rurl=translate.google.com&sl=de&sp=nmt4&tl=en&u=https://www.computerbase.de/2017-03/amd-naples-cpu-benchmarks/&usg=ALkJrhg2eYTsMK9H0YgzD8JkMXKDG0mJMw

Edited March 7, 2017 by chadjj

[billington.mark]

Some interesting info here regarding Virtualisation on Ryzen: https://www.redhat.com/archives/vfio-users/2017-March/msg00005.html

 

Seems some patches will be introduced to get things working nicely in the future.

Worth mentioning that any patches applied will need to wait for LimeTech to implement in updates. whether that updates the the Kernel, libvirt or QEMU... 

 

Edited March 7, 2017 by billington.mark
words

[meep]

1 hour ago, Pauven said:

After writing my post above, I went to read my daily news and was surprised to find this gem. 

 

http://techreport.com/news/31549/amd-naples-platform-prepares-to-take-zen-into-the-datacenter

 

Only read the first paragraph, but so far lines up well with what I wrote. I recommend reading it for a lot better detail. Plus pictures. 

 

Perfect timing. 

 

-Paul 

 

Thanks for all of this. End of year / early 2018 would likely be my upgrade timeline in any case so I'm happy to wait to see how all this pans out.