U.C.D applicant T-Bone, and his four servers.


Recommended Posts

Been a YUGE fan of unraid for quite some time. Figured I should get involved, and well.. I've got a current issue with one of my servers and needed to kill some time 😅
I am a sysadmin, my handle is T-Bone. 

 

Codename: Tank https://prnt.sc/H2Pw3yfb_psX

Theme: Solarized Dark

Unraid ... 5...8? or so? 
CPU: 4x Xeon E7-8880v2 @ 2.5ghz/3.1 turbo 15c/30t 37.5MB cache (60c/120t)( 
Motherboard: Supermicro X10QBi 
RAM: 384GB of DDR3 ECC 1600MT's (running 1333mhz) 
Case: Supermicro 4U - CSE-848XA-R3240B 
Drive Cage(s): 24bay hotswap 
Power Supply: 4x1460W platinum (Using two) 
Expansion Card(s): LSI SAS2008 (9211-8i)
Cables: SFF8087 
Fans: Like... 10? Will count one day. 

Parity Drive: Where were going, we don't need those. 
Data Drives: 15 drives 4Seagate, 11 Toshiba*More info below* 
Cache Drive: Samsung 970 Evo 500gb nvme 
Total Drive Capacity: 100TB 

Drives, I started with Toshiba x300's and loved their performance. They were also one of the cheapest per gb when I started. Moved to seagate. https://prnt.sc/Fj2_SnxJcl1h

 

Primary Use: NAS/Media streaming/Domain Controller 
Likes: Overpowered. Overbuilt. Overkill 
Dislikes: Its a commercial grade server, that requires commercial grade hearing protection 
Add Ons Used: Unassigned Devices, Nerdpack/tools, CA Auto update, All the dynamix plugins, Custom Tab, IPMI Support, Enhanced Log Viewer, File Activity, CA Unlimited Width, GPU Statistics, MyServers, Nvidia Driver, NVTOP, Rclone, Theme Engine, Tips and Tweaks, Unbalance, UserScripts 
Future Plans: A good dusting.  

Boot (peak): 1200w
Idle (avg): ???w(array off) 450w(array on)
Active (avg): 650-700w
Light use (avg): 500-550w

 

 

Codename: PhatMicro https://prnt.sc/Tp5qmuyTu3CJ

Theme: Custom Green/Black /w logos

Unraid ... 6? Ish 
CPU: 4x Xeon E7-4890v2@ 2.8ghz/3.4 turbo 15c/30t 37.5MB cache (60c/120t)( 
Motherboard: Supermicro X10QBi 
RAM: 768GB of DDR3 ECC 1600MT's (running 1333mhz) 
Case: Supermicro 4U - CSE-848XA-R3240B 
Drive Cage(s): 24bay hotswap 
Power Supply: 4x1460W platinum (Using two) 
Expansion Card(s): 2xLSI SAS3008 (9401-8i I think..)
Cables: SFF8643 I think... 
Fans: Like... 10? Will count one day. 

Parity Drive: Where were going, we don't need those. 
Data Drives: 14 drives All Seagate*More info below* 
Cache Drive: 2x Samsung 980 Pro 1TB nvme 
Total Drive Capacity: 172TB 

All seagate drives. Started with IronWolf, moving to Exos. https://prnt.sc/GXLbjaMmRu3D

 

Primary Use: NAS/Media streaming/Domain Controller/PON Controller/Remote Support/Small Business 
Likes: Overpowered. Overbuilt. Overkill 
Dislikes: Its a commercial grade server, that requires commercial grade hearing protection 
Add Ons Used: Unassigned Devices, Nerdpack/tools, CA Auto update, All the dynamix plugins, Custom Tab, IPMI Support, Enhanced Log Viewer, File Activity, CA Unlimited Width, GPU Statistics, MyServers, Nvidia Driver, NVTOP, Rclone, Theme Engine, Tips and Tweaks, Unbalance, UserScripts 
Future Plans: A good dusting.  

Boot (peak): 1200w
Idle (avg): ???w(array off) 600w(array on)
Active (avg): 750w
Light use (avg): 575-600w

 

Codename: Loki https://prnt.sc/dV4u6vIFO8nE (ignore the 100% log.. hah)

Theme: NordDark

Unraid ... 5...8? or so? 
CPU: 2x Xeon E5-2670v1 @ 2.6ghz/3.3 turbo 8c/16t 20MB cache (16c/32t)( 
Motherboard: ASRock EP2C602-4L/D16 
RAM: 64GB of DDR3 ECC 1600MT's (running 1600mhz) 
Case: Rosewill 4U - RSV-L4000U 
Drive Cage(s): 4bay hotswap 
Power Supply: Evga Suprnova g3? 1000w 
Expansion Card(s): LSI SAS2008 (9211-8i)
Cables: SFF8087 
Fans: 2x120mm intake 2x92mm cpu, 2x80mm rear 

Parity Drive: Where were going, we don't need those. 
Data Drives: 13 array, 14drives*More info below* 
Cache Drive: 1xSamsung 960 Evo 250Gb nvme, 1xSamsung 970 Evo 250gb nvme 
Total Drive Capacity: 6.7TB 

Drives are hoge poge. All good and working, but small and useless. Leftovers. All brands, even a raid0 in the array (the one with the * for temperature) https://prnt.sc/X28JfKWuKJvG

 

Primary Use: Testing platform, VPN, Backup 
Likes: Diy. Homebrew. Custom built 
Dislikes: His name is Loki and he causes he grief. 
Add Ons Used: Unassigned Devices, Nerdpack/tools, CA Auto update, All the dynamix plugins, Custom Tab, IPMI Support, Enhanced Log Viewer, File Activity, CA Unlimited Width, GPU Statistics, MyServers, Nvidia Driver, NVTOP, Rclone, Theme Engine, Tips and Tweaks, Unbalance, UserScripts 
Future Plans: A gpu? Larger and or working cache drives? Real drives? 😅 

Boot (peak): 600w
Idle (avg): ???w(array off) 250w(array on)
Active (avg): 250w
Light use (avg): 175w maybe

 

Codename: BKuhl https://prnt.sc/m8SfpjmZ2Em8

Theme: Custom (old windows inspired)

Unraid ... 6.4 maybe? 
CPU: Xeon E5-2680v3 @ 2.5ghz/3.3 turbo 12c/24t 30MB cache)( 
Motherboard: Dell 0K240Y 
RAM: 64GB of DDR4 ECC 2666MT's (running 2133mhz) 
Case: Dell Precision 5820 
Drive Cage(s): 6x Internal 
Power Supply: 425w Gold rated, I think 
Expansion Card(s): None, using onboard
Cables: N/a 
Fans: 3x120mm and 1x92mm cpu I think 

Parity Drive: Where were going, we don't need those. 
Data Drives: 4 drives All Seagate*More info below* 
Cache Drive: SanDisk SD8SB8U 512gb ssd(sata) 
Total Drive Capacity: 36TB 

All seagate drives. 2x10tb IronWolfs, 1x16TB Exos, 1x 3TB Skyhawk 

https://prnt.sc/MA8eC7Ovf-f7

 

Primary Use: NAS/Media streaming/NVR Controller/Home Automation 
Likes: Prebuilt(sorta) 
Dislikes: Not really upgradeable 
Add Ons Used: Unassigned Devices, Nerdpack/tools, CA Auto update, All the dynamix plugins, Custom Tab, IPMI Support, Enhanced Log Viewer, File Activity, CA Unlimited Width, GPU Statistics, MyServers, Nvidia Driver, NVTOP, Rclone, Theme Engine, Tips and Tweaks, Unbalance, UserScripts 
Future Plans: Rehouse it in a 3 or 4u? 

Boot (peak): 250?
Idle (avg): ???w(array off) 150w?(array on)
Active (avg): 200w?
Light use (avg): 100-150w?

 

Tank, PhatMicro, and Loki are all physically located in my home. Tank and Loki are mine. PhatMicro is my buddys server / our company server. BKuhl is located a few miles across town, at a third friends house. 

 

Network Related

Ubiquity stuff
Edge Router 4
Edge Router 4

Edge Switch es24lite

Edge Router 3 lite
ERX-10

Edge Switch 24 non lite
a few unify cams

Unify wifi mesh ap's

 

Not my area of expertise (yet), so im winging this section. We've got two racks, a lot of switches, IPSEC site to site vpn, 3g, 4g, 5g, PON, wireguard vpn, and GRE tunnels.

 

Theres also a synology ds18something plus. And a dell r270 something server, old lab stuff. 

Raspberry pi2 model b+ 4gb, Raspberry pi4 Model b+ 8gb, several laptops, and more.

 

Incoming is a 1gb split 5 ways (5ips) via a /28

Across town is a /25 and a /24. Can achieve 1gbps throughput even on vpn) to all sites. 

And some 3g/4g/5g and PON stuff on /22

10gbe between Tank and PhatMicro via /30

 

Its also my job to cable manage all the things... and well... It always starts out good, but then we always change something. Please, complain below 🤣

 

My talents include hardware, building, customizing, and administering. Some scripting, and more. Phat's are primarily networking, and trying to beat me at my own game :) Together we are a force to be reckoned with. We have a business together, and now live together, and have future plans of solar and battery backup for the server room. We are both tri-lingual when it comes to OS's, but primarily Windows for gaming.

 

I've got fair to strong linux skills, and phat is learning that most networking stuff, is linux, so hes catching up fast. Were currently testing a bad to the bone switch as seen on the small rack, which houses two xeons, some memory, and has the ability to run VM's. Some juniper stuff we've been testing. And more. Future plans of 10gbe from ISP. They offer 2.5gb and its not that much more money, waiting on a response about 10gbe. But 10gbe would be ideal seeing we've already got gear, and it doesnt support 2.5gb (sorta...)

 

Tank, and Loki are located on the short rack. Phatmicro and networking gear on larger rack. And a hidden dell r270 or something. Also a hardware kvm. 

 

The room has more blinking lights then my k70mk2 corsair. 🤓😂

 

Note: Wattages are estimated, sorta. We've got IPMI which gives us some information, and we just recently got two of these emporia kits that allows us a lot more granular information. https://www.emporiaenergy.com/how-the-vue-energy-monitor-works

 

Note2: Folks may wonder how the two main servers have so much ram. Google x10qbi from supermicro. We've got 8x daughter boards for memory each with 12 slots. The servers can theoretically hold like 6TB of ram. 

 

Note3: My phone has an outshell that makes night pictures suck. Sorry. 

 

Note4: We don't use parity anymore. Sizes are too large, and take too long. Even in raid0 and 1 for parity drives (Dont do this.. bad idea lol)

Our current solution is a business dropbox account and utilizing encryption. 

 

b96d062b-6eb0-43a7-9640-70e691cd34fc.thumb.jpg.994c5d695295e068657a08e69f328cf7.jpg

9dc3450d-b440-42c4-aac4-bbf380858d7c.thumb.jpg.0dea2d0f199e6c5046acc048a2e77faf.jpg

3fa6126c-0a16-4e52-9600-35ec6fbf255c.thumb.jpg.c3d2f710c15778b5cdda2ab7b69bcf2f.jpg

ex4600.thumb.png.627e9c68136f83e7f2eb2ddf7463ed2f.png

20230312_053900.thumb.jpg.cb60279baa3cf69c67cea706b2c2cc8f.jpg

20230312_053919.thumb.jpg.420c12430c92f37557f96c9757aed0f2.jpg

 

Edited by tbonedude420
added Note4, typos, pics
  • Like 1
Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.