Hi All,

 

I've searched google / forums and not found any direct solution to this issue, but apologies if it's been covered and I didn't find it!

 

I'm having an issue where mounting an NVMe disk in UD acheives a write speed of 1GBps, saturating a 10Gbe network. I'm really happy with this.

 

If I mount that disk as a pool, I'm getting around half at 500MBps write speed.

 

I've checked things like Direct IO are enabled, but can't find a solution.

 

Can anyone shed any light on this?

 

My ultimate aim is to have 5 x 2TB NVMe as a RAID5 (or RAID-Z1) so I have a little more redundancy. 

 

Thanks!

I should add that I deal with lots of big files, so a 500MBps difference is quite a bit deal for me. Thanks

Try using an exclusive share (or disk share).

and supply diagnostics, maybe your nvme drive or your controller is the bottleneck?

 

Thanks JorgeB, using a disk share gave the full performance as expected.

 

Exclusive share is a better idea. Be sure you don't attempt to work with disk shares and user shares at the same time.

Hi, 

 

Thanks for your input, and to clarify,

 

I can't combine using the Raid-Z1 pool as a stand alone share AND as the Cache Drive for my Array unless I'm prepared to accept 500MBps transfer speeds.

 

Exclusive Shares don't work with my Raid-Z1 pool because it spans over multiple NVMe disks?

 

I can only use the Raid-Z1 pool at (what I'd call) realistic speeds if it's a Disk Share.

 

I can't get around this by using a different Cache Drive for the array because I can't copy between Disk Shares and User Shares. --- OR will this work because the disk share is writing to a cache disk and not the array? I assume that would work if mover has completed the move to the arrray, but if it hasn't, there is still a potential for data loss?

 

Am I missing something here?

 

Thanks

Edited December 23, 20232 yr by andypdmg

28 minutes ago, andypdmg said:

Exclusive Shares don't work with my Raid-Z1 pool because it spans over multiple NVMe disks?

Not quite sure I understand.    You can always use a pool (whatever type and number of drives) as an Exclusive Share as long as all files for the share are on the pool.

Hi,

Really strange, it would only allow an Exclusive Share if there was only a single disk in the pool, now it's just working for the raid pool. I don't understand why as I haven't changed anything (I think!).

 

Exclusive share only requires that the data for that share exists only in a single pool, note that just having the top level folder in the array or another pool will prevent that.