Jump to content
Shinta0Saint

SSD Array for unraid?

21 posts in this topic Last Reply

Recommended Posts

I have a couple used ssd’s, out of curiosity, can I build an array with parity with it?, don’t have an unraid system built yet, still learning as much as I could about it, don’t need any mass storage, just fast access to files. What are the pros and cons aside from the cost (obviously). Do mechanical drives last longer with parity? Or ssd are still superior in this case?

 

 

Sent from my iPhone using Tapatalk

Share this post


Link to post

Samsung announced this week mass production of consumer level 4TB SSDs.  Whilst the prices aren't known yet (to me at least), it got me thinking again about a supported version of unRaid running on SSDs.

 

I'd quite happily shift over to something running quieter, faster, smaller and more efficient at some point.

 

Does anybody know the latest on Lime Tech officially supporting/recommending SSDs in the array?  Or does the TRIM rule it out completely?

Share this post


Link to post
24 minutes ago, Cessquill said:

Or does the TRIM rule it out completely?

 

Some TRIM performs like zeroing - so a RAID machine can recompute the parity as if the data was zeroed (which means all disks needs to be online or the original contents needs to be read before TRIM is sent).

 

But the parity drive can never make use of TRIM, since it doesn't have a file system with unused portions to TRIM. This means that a RAID should be designed in a way where TRIM isn't needed for it to work well.

 

So the way to use SSD in a RAID is to have overprovisioning. Either enterprise disks that is delivered with a significantly large, hidden, amount of overprovisioning. Or high-end customer drives that can be configured so parts of the user space of the drive is reserved for overprovisioning.

 

But note that large HDD (especially helium-filled models) are quite efficient when used for a home media server, since you can often manage with a single disk spinning. So best is a tiered solution where data files and audio is stored on SSD and movies and TV-series are stored on big HDD. This is what I am currently doing. So mirrored SSD for often used data. Mirrored 2.5" HDD for next tier of data. And then multi-disk RAID with dual-parity for bulk storage. And backup to drives that are allowed to spin down between each backup run, with new data "rolling" over multiple drives so backup drives doesn't need to spin up every night.

Share this post


Link to post

They've landed now.  In stock (note it's NZ price) as per links below.  The 8TB might be out of my price range though.

 

https://www.pbtech.co.nz/product/HDDSAM60400/Samsung-860-QVO-MZ-76Q4T0BW-4TB--Samsung-V-NAND-SA

https://www.pbtech.co.nz/product/HDDITX45108002/Intel-P4510-Series-8TB-25-PCI-E-NVMe-SSD-3200MBs-r

 

Without reading up on it (so could be wrong), the below statement in 6.7.0 release almost sounds like it would work for a filesystem across multiple ssd's?

 

Added the '--allow-discards' option to LUKS open.  This should only have any effect when using encrypted Cache device/pool with SSD devices.  It allows a file system to notice if underlying device supports TRIM and if so, passes TRIM commands down.

 

?

Share this post


Link to post
5 hours ago, Marshalleq said:

the below statement in 6.7.0 release almost sounds like it would work for a filesystem across multiple ssd's?

Yes, for the cache pool, and trim always worked for the cache pool, it doesn't for array devices.

Share this post


Link to post
Posted (edited)

Not trivial at all when you can't guarantee how the SSDs behave when a "trim" command is sent to them. Taking the disk offline, trimming it, and putting it back online can Frak up your Parity protection.

Edited by BRiT

Share this post


Link to post
26 minutes ago, fluisterben said:

Does seem somewhat trivial to also support it for array devices. Just take the disk offline, trim it, put it back online.

Keep in mind that parity is calculated and maintained for every bit, not just the bits actively used by files. If you change bits in an "unused" area with the drive offline, that parity address will be wrong when you put the drive back in.

Share this post


Link to post
3 hours ago, jonathanm said:

Keep in mind that parity is calculated and maintained for every bit, not just the bits actively used by files. If you change bits in an "unused" area with the drive offline, that parity address will be wrong when you put the drive back in.

http://xfs.org/index.php/FITRIM/discard

Share this post


Link to post

Yup, and all that has to be supported by the unRAID md block driver as specified by the requirements on the link you posted. So it's not trivial as you think.

 

Requirements

  1. The block device underneath the filesystem must support the FITRIM operation.

Share this post


Link to post
On 7/13/2019 at 8:46 PM, BRiT said:

Yup, and all that has to be supported by the unRAID md block driver as specified by the requirements on the link you posted. So it's not trivial as you think.

 

Requirements

  1. The block device underneath the filesystem must support the FITRIM operation.

"All that" ? Looks to me like a little config editing and you're done. Seriously, it's 2019 and Unraid does not support TRIM in its array? This should at the very least be mentioned before trying to sell it.

Share this post


Link to post
1 hour ago, fluisterben said:

"All that" ? Looks to me like a little config editing and you're done. Seriously, it's 2019 and Unraid does not support TRIM in its array? This should at the very least be mentioned before trying to sell it.

Ignorant keyboard warrior. 🙄

Share this post


Link to post
15 minutes ago, testdasi said:

Ignorant keyboard warrior. 🙄

You need to grow up and stop yelling like a toddler. And mind your own business.

http://xfs.org/index.php/FITRIM/discard > "The kernel must include TRIM support and XFS must include FITRIM support (this has been true for Linux since v2.6.38, Jan 18 2011)"

Edited by fluisterben

Share this post


Link to post
18 minutes ago, fluisterben said:

You need to grow up and stop yelling like a toddler. And mind your own business.

http://xfs.org/index.php/FITRIM/discard > "The kernel must include TRIM support and XFS must include FITRIM support (this has been true for Linux since v2.6.38, Jan 18 2011)"

You need to stuff your ignorance back up your backside. This aint Trump's states.

 

It has nothing to do with the config. The issue is how that would interact of parity calculation and there have already been reports of a certain SSD causing parity error when in the array - and that is without trim complicating the matter.

 

And for a double dose of stuffing ignorance back up your backside, I already raised a feature request to enable trim in the array before your throwing tantrum. So I am minding my business.

 

Share this post


Link to post
2 hours ago, fluisterben said:

"All that" ? Looks to me like a little config editing and you're done. Seriously, it's 2019 and Unraid does not support TRIM in its array? This should at the very least be mentioned before trying to sell it.

So do it yourself then.

Share this post


Link to post
"All that" ? Looks to me like a little config editing and you're done. Seriously, it's 2019 and Unraid does not support TRIM in its array? This should at the very least be mentioned before trying to sell it.
Tom answered this question in the Q&A only certain SSDs are possible to use. And it's all dependent upon what they return for a sector contents after either a trim or background garbage collection. Since not all SSDs handle this the way that any RAID system needs it to then you just cant say you support SSDs. The ones which handle it correctly though will operate no problems.

If they dont handle it correctly then on any RAID system you will wind up corrupting the parity system

Sent from my NSA monitored device

Share this post


Link to post
On 9/9/2019 at 9:47 AM, Squid said:

Tom answered this question in the Q&A only certain SSDs are possible to use.

Now you've got me curious on which ones might work... but I can't find the thread. If you could post a link, search terms, or point me to where this topic is, that would be great. Thanks!

Share this post


Link to post

Unraid website, the 14th birthday blog post

Sent from my NSA monitored device

Share this post


Link to post
1 minute ago, Squid said:

Unraid website, the 14th birthday blog post
 

Thanks....on it! 

Share this post


Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.