Skip to content
View in the app

A better way to browse. Learn more.

Unraid

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.

Help understanding how Unraid writes files and improving network performance when moving data

Featured Replies

New user to Unraid with LOTS of data to move from my workstation to an Unraid server soon. I'm almost done reconfiguring them so both server and workstation are connected via 10Gb network. My understanding is that when I copy a directory with lots of content over SMB to the Unraid server using robocopy or even just Windows Explorer, that process is going to move files sequentially. On the receiving end, Unraid will write those files sequentially as it receives them to the appropriate drive as determined by the high-water setting. Unlike a RAID 5 array that would split the incoming stream out among drives, Unraid will only ever write this incoming stream of content to one drive at a time, thus making the drive write speed, not my NIC speed the bottleneck, correct?

 

If I run parallel copy processes on my workstation moving broken up different portions of my data to the Unraid server at the same time, would Unraid potentially handle each incoming stream of content independently in a way that would allow writing to multiple disks simultaneously rather than one at a time and thus allowing me to take better advantage of my 10Gb connection?

Edited by poshmick907ak

Solved by trurl

  • Community Expert
26 minutes ago, poshmick907ak said:

Unraid will only ever write this incoming stream of content to one drive at a time, thus making the drive write speed, not my NIC speed the bottleneck, correct?

If you write to the array, and if you have parity, actually slower than single drive.

https://docs.unraid.net/unraid-os/manual/storage-management/#array-write-modes

 

You can have multidisk btrfs or zfs pools outside the parity array and those would be faster than single drive speed. Files from pools can be moved to the parity array automatically during scheduled idle time.

  • Community Expert
  • Solution
32 minutes ago, poshmick907ak said:

independently in a way that would allow writing to multiple disks simultaneously

If writing to an array with parity, they can't be independent even if the destination is different disks, because parity is realtime and has to be updated for each.

  • Author

Thanks @trurl, that confirms my assumption. Looks like I'm stuck at the slower transfer rate for the time being unless I reconfigure the structure of my array (not really wanting to do right now). I'll just have to be patient then :)

  • Community Expert

You could remove parity and rebuild it after you are finished with initial data load.

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

Account

Navigation

Search

Search

Configure browser push notifications

Chrome (Android)
  1. Tap the lock icon next to the address bar.
  2. Tap Permissions → Notifications.
  3. Adjust your preference.
Chrome (Desktop)
  1. Click the padlock icon in the address bar.
  2. Select Site settings.
  3. Find Notifications and adjust your preference.