hecky Posted March 7, 2023 Share Posted March 7, 2023 Hi there, i am setting up a new server - it my unraid-1st-time I am comming from an True-Nas 4-Disk-ZFS1-pool. At the moment i am disapointet and try to find the weak link and trying different comibations of parity/FS-setups comparing ingoing and outgoing transfer-speeds. Setup: Supermicro X10SLH-F 32gig of ram HP 10gb SFP+ single link direct connection. Same card on the truenas-server. writing speed starts ~220mb/sec an shortly decreases to ~70mb/sec thanks in regard Quote Link to comment
JorgeB Posted March 7, 2023 Share Posted March 7, 2023 See turbo write, but array read/write speed cannot be faster than single disk speed, you can use pools for more speed. Quote Link to comment
Arbadacarba Posted March 8, 2023 Share Posted March 8, 2023 Take a look at my results from my setup... I'm told they are about what to expect: I'm just trying to decide on some changes to mine but I'm generally pretty happy with the speeds I'm getting Quote Link to comment
hecky Posted March 11, 2023 Author Share Posted March 11, 2023 (edited) Things i tried. Setting the MTU 1500>9000. Enabled turbo write. Using the internal 1GBE-BaseT instead of the 10GBE-SFP+ interface. Using other motherboard (supermicro > asus) CPU(Xeon > i5-5820k) - allways ~16gig RAM. Using other connections to disks - 1: SATA-ports on motherboard | 2: LSI-Raid SAS/SATA raid-controller (IT-mode)) Using windows-file-explorer (SMB: network routing client1>switch>router>switch>router>client2) using krusader (SMB: direct connection between 2 nas-servers). When writing to the unraid-server its allways dropping from "max thruput" (Network or Disk) to ~70MB/s (picture from 1GBE-connection attached). Nothing is changing the drop to 70 MB/sec, when using parity Edited March 11, 2023 by hecky Quote Link to comment
JorgeB Posted March 11, 2023 Share Posted March 11, 2023 That looks like you are limited to gigabit speeds, check NIC link speed or run a single stream iperf test in both directions. Quote Link to comment
hecky Posted March 11, 2023 Author Share Posted March 11, 2023 The picture i think u refer to was between 2 clients with 1GBe Using iperf3 ovia direct connection (2x2 SFT+ via fibre and LAGG/LACP) shows the following: Seems fine to me. When writing from Unraid to ZFS1-Raid i get a constant ~255 MB/sec. Writing the other way it starts with ~500 and decreasing constantly to 70 an fluctuating curve. At the end after moving ~70gigs it middles at arround 134MB/sec. Quote Link to comment
JorgeB Posted March 12, 2023 Share Posted March 12, 2023 Please post diags grabbed during a transfer. Quote Link to comment
apandey Posted March 20, 2023 Share Posted March 20, 2023 JorgeB was asking for diagnostics (look under tools tab, then attach the generated zip). After transfer, before a reboot Quote Link to comment
hecky Posted March 20, 2023 Author Share Posted March 20, 2023 (edited) unraid-diagnostics-20230320-1333.zip Edited March 20, 2023 by hecky Quote Link to comment
JorgeB Posted March 20, 2023 Share Posted March 20, 2023 There's no disk activity when the diags were saved but turbo write is disabled. On 3/7/2023 at 6:37 PM, JorgeB said: See turbo write, Quote Link to comment
hecky Posted March 20, 2023 Author Share Posted March 20, 2023 Enabebling TurboWrite an setting MTU to 9000 results in max. of ~320mb/sek. But its alternating drasticly - down to ~93mb/sek. The attachted file was created during a file-transfer. Or should I download it after the transfer finished? unraid-diagnostics-20230320-1540.zip Quote Link to comment
JorgeB Posted March 20, 2023 Share Posted March 20, 2023 According to the diags disk1 is writing at 265MB/s, so not a disk problem. Quote Link to comment
hecky Posted March 20, 2023 Author Share Posted March 20, 2023 (edited) Does the log-file-creator care when i am creating log? I am shure that i created the logs when the transfer-rate was dropping to ~120-130 mb/sec. Changed an i7 6-core > E5 10-core and RAM from 32 > 48. Still not ideal Does it make a difference when using different bondig-modes for my transfer-problem? At the moment I am using "Mode 4 (802.3ad)" (Unraid) and "Link Aggregation (LACP)" with the Truenas-Server. Edited March 20, 2023 by hecky Quote Link to comment
JorgeB Posted March 20, 2023 Share Posted March 20, 2023 If the disks are faster than the data is being received it will writes in bursts, at max speed, enable read/writes speed on main page, top right and see the actual write speed of the disks, if they are writing in bursts data is not arriving fast enough. Quote Link to comment
hecky Posted March 21, 2023 Author Share Posted March 21, 2023 In my opinion it has to be something with the disks. Using the onboard nic and an windows pc conectet via a switch and smb-share it also drops from constant 100mb to ~70mb. Sry to bother u JorgeB but sadly i am not able to find icon u marked Is this an aditional plugin u use? Quote Link to comment
hecky Posted March 21, 2023 Author Share Posted March 21, 2023 Switched to single port (instead of bonding) and got these results (pic attached) In Krusader and on the dashboard-page its alternating between 90 .. 400 mb/sek - also und the unraid-dashboard-tab. On the main-tab its relativly constant. Quote Link to comment
JorgeB Posted March 21, 2023 Share Posted March 21, 2023 As you see the disks are writing at a good speed, and if they write in bursts it means they are waiting for the data. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.