nerbonne Posted March 15, 2019 Share Posted March 15, 2019 I'm hoping to get some advice on what to change. The overall throughput for my array is slow (about 430 MB/s max). I know that it not unRaid, I'm not implying that at all. This speed issue was manageable until I added a second parity drive, now when the cache drive writes back to the array, the array becomes so slow it's virtually unuseable. About my setup: Desktop PC with a 7th gen i7 CPU. 20 Drives in the array, ranging from 1TB to 4TB, two are parity and one 480 Gb SSD for cache, so 17 data drives. The cache drive, one of the two parity drives, and two data drives are inside the tower connected via Sata. I have two Mediasonic 8 bay enclosures, both are connected via eSata to seperate eSata cards. The cards support port multiplying. I'm guessing the eSata port multiplier cards are the main culprit, but how do I prove this. Additionally, what is a normal overall array speed. 430 MB/s is what the entire array does during a parity rebuild, which means at the beginning when the 1 TB drives are still rebuilding, the per drive speed is around 20 MB/s. Right now, the cache drive is writing back to the array, and it's only writing at about 22 MB/s. This is with all apps disabled except plex, to keep the other I/O down. Quote Link to comment
JorgeB Posted March 15, 2019 Share Posted March 15, 2019 7 hours ago, nerbonne said: Additionally, what is a normal overall array speed. 430 MB/s is what the entire array does during a parity rebuild With no bottlenecks you just multiply the maximum speed of the slowest disk by the number to disks, I have some server doing about 5GB/s. 7 hours ago, nerbonne said: I have two Mediasonic 8 bay enclosures, both are connected via eSata to seperate eSata cards. The cards support port multiplying. These won't be good for performance (and reliability), but might not be the only reason for this: 7 hours ago, nerbonne said: now when the cache drive writes back to the array, the array becomes so slow it's virtually unuseable. There could be other things going on, like CPU, etc. Quote Link to comment
Taddeusz Posted March 15, 2019 Share Posted March 15, 2019 I would guess the problem with throughput is SATA bus contention. If you have both those cases filled with drives that is conservatively as much as 2400MB/s (150MB/s * 16) trying to be pushed through two 600MB/s SATA connections. That's not even taking into account the overhead of the two port multipliers in the cases switching between drives. I don't know what kind of latency SATA port multipliers confer when switching? I have 9 drives hooked to two LSI 9211-8i cards. During parity checks or rebuilds I get a total throughput of about 1.3GB/s. Quote Link to comment
Taddeusz Posted March 15, 2019 Share Posted March 15, 2019 The problem could also be a bus bottleneck. How many PCIe lanes are those eSATA cards? Quote Link to comment
nerbonne Posted April 15, 2019 Author Share Posted April 15, 2019 Hi all, thanks for the responses. Not sure how many PCIe lanes the eSATA cards have, but I'm to the point where I want to get a rack mount chassis, just not sure where to start. Maybe you guys have some suggestions? I'm shooting for a 24 bay system but I'll settle for 20 bays, 3.5 inch. All my current drives are 4tb or smaller, but I'd like the backplane to support larger drives, 10tb seem to be the most cost effective right now. The part I'm struggling with is trying to find the right backplane and raid controller. Seems like no matter how much I google this, I just keep coming up with really old info, and most backplanes being sold on ebay don't specify what size drive they support, so I'm guessing it's only 2tb? Quote Link to comment
nerbonne Posted April 15, 2019 Author Share Posted April 15, 2019 So I'm looking at the supermicro 846 case, can i go with a SAS2 backplane or do i need a SAS3 backplane? I've been all over supermicro's site and they don't come out and say what size drive they support. Pretty sure the regular SAS backplane is limited to 2tb right? Quote Link to comment
JorgeB Posted April 15, 2019 Share Posted April 15, 2019 SAS2 is fine, it supports all current and foreseeable future sizes, Supermicro backplanes wit SAS1 expanders are limited to 2TB. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.