June 14, 20242 yr Hello, I have 15x SSD 870 evo plugged to an HBA 9500 16i card. I have configured a zfs pool in RAIDz1 with only 1 vdev. I get via SMB 500mo/s with a 10gbe link. I also have a synology with 8x HDD RAID5 + NVMe caching, with the same client i get 1,2go/s.... I try to create a ZFS pool with 4x NVMe in raid0 and i get 600mo/s..... What am i missing please ? Edited June 14, 20242 yr by RaptorBeaver
June 14, 20242 yr Community Expert Solution Try accessing the pool using a disk share, or enable exclusive shares.
June 14, 20242 yr Author Thank you so much for your quick reply After enabling exclusive shares I get almost 1GO/s on the NVMe pool and on the SSD pool. Better but i do not saturate my 10gbe link... Edited June 14, 20242 yr by RaptorBeaver
June 15, 20242 yr Community Expert 1GB/s is almost line speed for 10GbE and a pretty good result, you can try Jumbo Frames if supported by all the network hardware, it could give a few more MB/s.
June 15, 20242 yr Author Thanks JorgeB, i tried some dd commands, i get 9GB/s reading and 5GB/s writing so i guess the pool is working well i need to tune my smb. Still waiting for my 25GB NIC that's why i try to push more speed, because basically you're write with 10gbe it's useless to have this kind of pool. I try to understand how exclusive shares and disk shares works, the documentation is very small regardins that, do you have some readings about it ? Just to understand what changed ? Thanks for your help
June 15, 20242 yr Community Expert 1 hour ago, RaptorBeaver said: I try to understand how exclusive shares and disk shares works The only thing you probably need to know is that both of these by-pass the Fuse layer that Unraid uses to provide a unified view of a share across multiple drives thus removing the overhead of going through this extra layer. This is know to give better performance.
June 15, 20242 yr Author I don't understand... while i'm trying to move files from one ZFS pool (nvme raid0 x4) to other pool (ssd raidz1 x15) netdata tell me that my max speed is 2GB/s... In this case it's not about the network and not about SMB... Seems very slow regarding the setup of both pool....
June 15, 20242 yr Community Expert In my experience this is usually a CPU limitation, typical real world copy speeds from fast devices/pools are around 1.5GB/s to 2.5GB/s, and what affects this range the most, is the CPU single thread performance.
June 15, 20242 yr Author My CPU is a AMD EPYC 7402... Because if i can only get this kind of speed it will be more effective in terms of cost to send ssd back and get somme mechanical HDD... With 15x mechanical HDD the speed will be basically the same....
June 15, 20242 yr Author When I try to copy files between those 2 pools with unraid CLI i get 400MB/s with rsync and 650MB/s with pv... Definetely don't understand. Driving me crazy
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.