RaptorBeaver Posted June 14 Share Posted June 14 (edited) Hello, I have 15x SSD 870 evo plugged to an HBA 9500 16i card. I have configured a zfs pool in RAIDz1 with only 1 vdev. I get via SMB 500mo/s with a 10gbe link. I also have a synology with 8x HDD RAID5 + NVMe caching, with the same client i get 1,2go/s.... I try to create a ZFS pool with 4x NVMe in raid0 and i get 600mo/s..... What am i missing please ? Edited June 14 by RaptorBeaver Quote Link to comment
Solution JorgeB Posted June 14 Solution Share Posted June 14 Try accessing the pool using a disk share, or enable exclusive shares. Quote Link to comment
RaptorBeaver Posted June 14 Author Share Posted June 14 (edited) Thank you so much for your quick reply After enabling exclusive shares I get almost 1GO/s on the NVMe pool and on the SSD pool. Better but i do not saturate my 10gbe link... Edited June 14 by RaptorBeaver Quote Link to comment
JorgeB Posted June 15 Share Posted June 15 1GB/s is almost line speed for 10GbE and a pretty good result, you can try Jumbo Frames if supported by all the network hardware, it could give a few more MB/s. Quote Link to comment
RaptorBeaver Posted June 15 Author Share Posted June 15 Thanks JorgeB, i tried some dd commands, i get 9GB/s reading and 5GB/s writing so i guess the pool is working well i need to tune my smb. Still waiting for my 25GB NIC that's why i try to push more speed, because basically you're write with 10gbe it's useless to have this kind of pool. I try to understand how exclusive shares and disk shares works, the documentation is very small regardins that, do you have some readings about it ? Just to understand what changed ? Thanks for your help Quote Link to comment
itimpi Posted June 15 Share Posted June 15 1 hour ago, RaptorBeaver said: I try to understand how exclusive shares and disk shares works The only thing you probably need to know is that both of these by-pass the Fuse layer that Unraid uses to provide a unified view of a share across multiple drives thus removing the overhead of going through this extra layer. This is know to give better performance. Quote Link to comment
RaptorBeaver Posted June 15 Author Share Posted June 15 I don't understand... while i'm trying to move files from one ZFS pool (nvme raid0 x4) to other pool (ssd raidz1 x15) netdata tell me that my max speed is 2GB/s... In this case it's not about the network and not about SMB... Seems very slow regarding the setup of both pool.... Quote Link to comment
JorgeB Posted June 15 Share Posted June 15 In my experience this is usually a CPU limitation, typical real world copy speeds from fast devices/pools are around 1.5GB/s to 2.5GB/s, and what affects this range the most, is the CPU single thread performance. Quote Link to comment
RaptorBeaver Posted June 15 Author Share Posted June 15 My CPU is a AMD EPYC 7402... Because if i can only get this kind of speed it will be more effective in terms of cost to send ssd back and get somme mechanical HDD... With 15x mechanical HDD the speed will be basically the same.... Quote Link to comment
RaptorBeaver Posted June 15 Author Share Posted June 15 When I try to copy files between those 2 pools with unraid CLI i get 400MB/s with rsync and 650MB/s with pv... Definetely don't understand. Driving me crazy Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.