My Out Of Control Build

[jwolfe]

I've had an unraid build for a few years and it's grown quite a lot.  It started out small with left over hardware but has grown out of control.  I'm at 98 TB usable now and running out of space pretty quickly. Here's my current specs:

OS Current: 6.8.2
CPU: Intel i5-3470
Motherboard: Gigabyte GA-Z77MX-D3H
RAM: 32GB G.SKILL Ares Series 32GB (4 x 8GB) DDR3 1333
Case: Antec Twelve Hundred V3 Black Steel
Cage: Cooler Master 4-in-3 Device Module Cage
Power Supply: CORSAIR HX Series HX750 750W
NIC: Intel EXPI9301CTBLK

 

Drive Controllers: 2x SUPERMICRO AOC-SASLP-MV8 PCI-Ex4
Cables: 4x 3ware CBL-SFF8087OCF-10M

 

Drive Controller: LSI Logic SAS9200-8E 8PORT (To DAS)
DAS: Lenovo 70F10000UX THINKSERVER SA120

 

Cache:

3x Samsung SSD 850 EVO 1TB

 

Drives:

12x WD Red 3TB NAS
7x WD Red 6TB NAS
6x Seagate 4TB Desktop Drives
2x WD Gold 4TB Enterprise

 

USB for Unraid:
Cruzer 8 GB

 

Unassigned Drives:
1x Intel® SSD DC S3700 400GB (passthrough / QVM)
1x 2TB WD My Passport

I have too many random drives, but looking to consolidate the drives into bigger drives.  I'm already looking to get larger drives to replace one drive that is going bad in the array.

 

I use the unassigned 2TB WD USB drive to sync my most critical items to.  It's sort of my bug out drive if anything happens.  I've got pretty much my whole array sync'ed to the cloud as a backup.

 

 

 

Edited June 12, 2020 by jwolfe
Add pictures

[gtroyp]

Two questions: what is the cage/drive stack next to the case? Edit. Figured this out

 

 

Second, what plug-in is providing all the data at the bottom of that dashboard?

 

Edited June 19, 2020 by gtroyp
Solved first question

[cbr600ds2]

1 hour ago, gtroyp said:

Two questions: what is the cage/drive stack next to the case? Second, what plug-in is providing all the data at the bottom of that dashboard?

 

yeah I want to know what the bottom plug in screen is as well.  

 

looks good man.   

[HK-Steve]

Nice setup, Congrats.

CPU temp is high at 73'c, what cooler do you have?

 

You also should replace the SUPERMICRO AOC-SASLP-MV8 PCI-Ex4, LSI are more reliable for UnRaid.

[hernandito]

On 6/17/2020 at 6:11 PM, gtroyp said:

 

Second, what plug-in is providing all the data at the bottom of that dashboard?

 

Its not a plugin but a series of Dockers... Grafana... It has a bit of a learning curve... This should start you up:

 

 

 

 

 

 

[CS01-HS]

Can you post your grafana drive spin-up section so I can steal it?

[jwolfe]

On 7/12/2020 at 10:48 AM, CS01-HS said:

Can you post your grafana drive spin-up section so I can steal it?

Sure. Here are the two scripts I use to take drive temp and also to see if the disk is spun up.

 

You're going to need curl for this to work.  This is for drive temp. Replace DBURL with your influx IP address.  And replace DISK_ARRAY and DESCRIPTION with your drives.

#!/usr/bin/bash

DBURL=http://192.168.X.X:8086
DBNAME=telegraf
DEVICE="UNRAID"
CURDATE=`date +%s`

# Todo: Need to parse /var/local/emhttp/disks.ini in the future
DISK_ARRAY=( sdl sdj sdz sdy sdu sdx sdv sdw sdt sdad sdaa sdab sdac sdag sds sdae sdc sdg sdk sdf sdaf sdn sde sdm sdh sdi sdd sdp sdq sdr )
DESCRIPTION=( Parity1 Parity2 Disk1 Disk2 Disk3 Disk4 Disk5 Disk6 Disk7 Disk8 Disk9 Disk10 Disk11 Disk12 Disk13 Disk14 Disk15 Disk16 Disk17 Disk18 Disk19 Disk20 Disk21 Disk22 Disk23 Disk24 Disk25 Cache1 Cache2 Cache3 )

# Added -n standby to the check so smartctl is not spinning up my drives
#
i=0
for DISK in "${DISK_ARRAY[@]}"
do
smartctl -n standby -A /dev/$DISK | grep "Temperature_Cel" | awk '{print $10}' | while read TEMP
do
        echo ${DISK} : ${TEMP}
        curl -is -XPOST "$DBURL/write?db=$DBNAME" --data-binary "DiskTempStats,DEVICE=${DEVICE},DISK=${DESCRIPTION[$i]} Temperature=${TEMP} ${CURDATE}000000000" >/dev/null 2>&1
done
((i++))
done

 

This is for drive spinup:

#!/usr/bin/bash

DBURL=http://192.168.X.XX:8086
DBNAME=telegraf
DEVICE="UNRAID"
CURDATE=`date +%s`

# Todo: Need to parse /var/local/emhttp/disks.ini
DISK_ARRAY=( sdl sdj sdz sdy sdu sdx sdv sdw sdt sdad sdaa sdab sdac sdag sds sdae sdc sdg sdk sdf sdaf sdn sde sdm sdh sdi sdd sdp sdq sdr )
DESCRIPTION=( Parity1 Parity2 Disk1 Disk2 Disk3 Disk4 Disk5 Disk6 Disk7 Disk8 Disk9 Disk10 Disk11 Disk12 Disk13 Disk14 Disk15 Disk16 Disk17 Disk18 Disk19 Disk20 Disk21 Disk22 Disk23 Disk24 Disk25 Cache1 Cache2 Cache3 )

i=0
for DISK in "${DISK_ARRAY[@]}"
do
hdparm -C /dev/$DISK | grep 'state' | awk '{print $4}' | while read STATUS
do
        echo ${DISK} : ${STATUS} : ${DESCRIPTION[$i]}
        if [ ${STATUS} = "standby" ]
        then
                curl -is -XPOST "$DBURL/write?db=$DBNAME" --data-binary "diskStatus,DEVICE=${DEVICE},DISK=${DESCRIPTION[$i]} Active=0 ${CURDATE}000000000" >/dev/null 2>&1
        else
                curl -is -XPOST "$DBURL/write?db=$DBNAME" --data-binary "diskStatus,DEVICE=${DEVICE},DISK=${DESCRIPTION[$i]} Active=1 ${CURDATE}000000000" >/dev/null 2>&1
        fi
done
((i++))
done

 

[CS01-HS]

42 minutes ago, jwolfe said:

Sure. Here are the two scripts I use to take drive temp and also to see if the disk is spun up.

Thanks, I meant the Grafana pane settings, maybe a screenshot of the query and customizations if you don't mind?

 

I'm collecting the relevant data with the HDDTemp docker and have everything displaying properly except for spin-up which I couldn't figure out.