Anyone use Asrock Rack X399D8A-2T?


JohnyClassic

Recommended Posts

Hey, just wondering if anyone has experience running Unraid on the the AsRock Rack X399D8A-2T motherboard for Threadripper seen here: https://www.asrockrack.com/general/productdetail.asp?Model=X399D8A-2T#Specifications

 

Found a couple of threads by people considering running it but not sure if anyone has actually used it. I'm especially curious if the on board  Intel X550-AT2 10gb nic will work? 

 

Thanks! 

Link to comment
  • 5 months later...

Been running it for a few months now and love it, it's been super stable (disabled C states and set power supply idle control to typical in BIOS). Both Intel NIC's work out the box and register as 10Gb and the IOMMU groupings are nice as well. Details of my system are in my signature.

 

I am on the latest 6.9.0Beta25 using a recompiled Kernel to add Nvidia Drivers from @ich777 's nice docker tool - Here

 

For BIOS and BMC:

BMC Version - 1.30.00 - Download

BIOS Version - L1.37 (BETA BIOS I requested from Support) - Download

 

For the BETA BIOS, it's been rock solid. The difference with this one is not only (current release bios doesn't even have bifurcation) does it allow you to set bifurcation, but it does so on a per PCIe slot basis. BETA BIOS prior had PCIe slots setup in groups. So if you wanted to set one slot to x4x4x4x4, then you got two slots as x4x4x4x4, I didn't like that. I am posting it in my onedrive for you since I find it a requirement.

 

 

image.thumb.png.a417913b86a1ce18a3eb911a56501295.png

image.thumb.png.cc5ae9b2d3421325c615cf6e3a475d2b.png

image.thumb.png.e11bc6d343cb60dc5a8cb195607655c0.png

image.thumb.png.2a24b323737d074d9aec34c66a1367b1.png

 

 

Edited by cybrnook
  • Like 2
  • Thanks 1
Link to comment
23 minutes ago, RockDawg said:

Thanks so much for the detailed response!  Especially including the links to BMC and BIOS.  What model of SuperMicro RAM is that you're using.  I'd be curious to compare it's price to what Asrock lists on their QVL list.

They are discontinued now, but I got 8 x sticks of this in there: https://store.supermicro.com/16gb-ddr4-2400-mem-dr416l-hv01-eu24.html

 

MANUFACTURER Hynix

MEMORY CAPACITY 16 GB

MEMORY TECHNOLOGY DDR4

MEMORY SPEED 2400 MHz

VOLTAGE 1.2 V

ECCVLP ECC UDIMM

RANK 2 rank

CAS LATENCY CL17

MANUFACTURER PART NUMBER HMA82GU8AFR8N-UH

WARRANTY 5 year warranty

 

(here is the current equivelant: https://store.supermicro.com/memory/ddr4/16gb-ddr4-mem-dr416l-cv02-eu26.html)

 

 

Also, if you need a TR for cheap, let me know. I jumped on the 2950X deal, so want to sell off my 1920X for about $220 shipped. (I'm in SE Michigan, seemingly right above you)

Edited by cybrnook
Link to comment
13 minutes ago, RockDawg said:

This is now a sore spot for me. I screwed around and missed the Newegg Deal! I finally sat down to place my order yesterday and, of course, out of stock! Now they're $929. I am so ticked off at myself for waiting. Not sure what I'll do now. 

 

Good info anyhow. Thanks for reporting! 

I think you should pickup the 1920X I have 🙂 . There is nothing wrong with it, as I have been running my unraid system with it for about 6 months now. You lose 4 cores and you don't get PBO, but confirmed working on what I am running at least.

Edited by cybrnook
Link to comment
  • 1 month later...
19 minutes ago, RockDawg said:

I researched this very recently as I just built a system with this board.  From what I read Tcdie is the actual CPU temp. Tctl is the CPU temp with a 27C offset.  In IPMI it will show the CPU temp reading the same as Tctl.

ok so i should set it to the Tdie for correctly showing the cpu temp.  nice thx :)

Link to comment

Does the motherboard model and info for this board appear for you guys?  Mine just says " ASRockRack Version - s/n:".  I swear it used to show the model but I am on my 3rd board (no fault of Asrock) so maybe it was one or both of the others that showed and this one isn;t reading.  Wondering if the beta BIOS broke that or if maybe there's an issue with my board.

Link to comment
  • 6 months later...
On 9/6/2020 at 8:54 AM, cybrnook said:

Been running it for a few months now and love it, it's been super stable (disabled C states and set power supply idle control to typical in BIOS). Both Intel NIC's work out the box and register as 10Gb and the IOMMU groupings are nice as well. Details of my system are in my signature.

 

I am on the latest 6.9.0Beta25 using a recompiled Kernel to add Nvidia Drivers from @ich777 's nice docker tool - Here

 

For BIOS and BMC:

BMC Version - 1.30.00 - Download

BIOS Version - L1.37 (BETA BIOS I requested from Support) - Download

 

For the BETA BIOS, it's been rock solid. The difference with this one is not only (current release bios doesn't even have bifurcation) does it allow you to set bifurcation, but it does so on a per PCIe slot basis. BETA BIOS prior had PCIe slots setup in groups. So if you wanted to set one slot to x4x4x4x4, then you got two slots as x4x4x4x4, I didn't like that. I am posting it in my onedrive for you since I find it a requirement.

 

 

image.thumb.png.a417913b86a1ce18a3eb911a56501295.png

image.thumb.png.cc5ae9b2d3421325c615cf6e3a475d2b.png

image.thumb.png.e11bc6d343cb60dc5a8cb195607655c0.png

image.thumb.png.2a24b323737d074d9aec34c66a1367b1.png

 

 

Hey, Cybrnook. I finally got around to buying the X399D8A-2T. But for some reason I can't get my existing unraid usb to boot and get an IP assigned. When go to the ip address I get the IPMI login screen but I can't get to the unraid main screen. A fresh unraid install boots just fine, it gets an IP and I can navigate to the unraid page. Did you have that problem with yours?

Link to comment
Posted (edited)
On 5/30/2021 at 3:42 AM, JohnyClassic said:

Hey, Cybrnook. I finally got around to buying the X399D8A-2T. But for some reason I can't get my existing unraid usb to boot and get an IP assigned. When go to the ip address I get the IPMI login screen but I can't get to the unraid main screen. A fresh unraid install boots just fine, it gets an IP and I can navigate to the unraid page. Did you have that problem with yours?

There are a few things you may need to consider (nothing really specific to the board itself, but overall). Not sure what your current USB drive is, but you would want to make sure it's formatted for UEFI boot vs Legacy boot (that also means renaming the -EFI file to EFI on the unraid USB). Then in the BIOS of the board, you will need to make sure your boot options are setup correctly. My server is in the middle of it's monthly parity check, so I am not going to reboot it now, but if you want, I can send you a screenshot of my boot options the next time I reboot so you can see what I am using. High level I disabled all boot options for things I didn't need, like PCIe boot, booting from network etc.

 

Now that I think about it, the AsRock rack boards come with a lot of virtual devices enabled in the BMC, you will have to disable that for your USB drive to be listed as a bootable device. If you don't, then the boot options menu in the bios are just flooded with virtual devices.

 

image.thumb.png.72eaeb8ff8b78b10649ba55ef3a2e89a.png

 

Disable in General:

image.png.bf1e78eb6790d55c361843dd0711b2e4.png

 

Set all devices to 0 in VMedia Instance:

image.png.e2783b07a2f6f86564201f3079bf287d.png

 

 

EDIT: Also, you said 

Quote

When go to the ip address I get the IPMI login screen but I can't get to the unraid main screen.

 

Make sure that you are NOT using the same IP for BMC as you are for your UnRaid server, they need to be different IP's. On top of that, the board has a dedicated NIC for BMC, I assume that's what you have plugged in. You will need to use one of (or both) of the 10Gb nic's for your UnRaid server. So that means you will need to make sure the MAC address and NIC device are set accordingly in your existing unraid install, since that's likely setup for your old system. An easy way to get around that is to rename your existing network.cfg file and replace it with a stock one from the vanilla unraid install media and then boot. Once it's up and running with DHCP, you can log in and reconfigure your network.

Edited by cybrnook
Link to comment
  • 5 weeks later...
5 hours ago, ryanhaver said:

Thank you @cybrnook!

 

AsRock Support just provided me with L1.32 which they state has support for bifurcation.

 

I've asked them for clarification on the differences between BIOS versions L1.32 and L1.37.

 

Bifurcation was supported in BIOSes already prior to 1.37. What 1.37 gave me, and is what I asked for, is PER SLOT bifurcation options. Prior to 1.37 bifurcation worked in groupings.

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.