Skip to content
View in the app

A better way to browse. Learn more.

Unraid

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.

(SOLVED) Cache: Performance and max filesize

Featured Replies

A few weeks ago I upgraded my PC and the unraid-Server with 10G network interfaces.

Until then, I had only configured one SSD as a cache disk. This cache disk had the file system "xfs" and was of course the bottleneck to exhaust the 10G performance.

So I installed an identical, second SSD and configured it as a cache pool (btrfs, raid0).
Strangely, this had no effect on the write performance over the 10G interface. I get max ~ 300 MB/s when transferring a large file to a share (with cache = prefer). Is there anything else I'm missing here? Diagnostics data is attached.

 

During the test with dd:
 

sync; dd if=/dev/zero of=/mnt/cache/testfile.img bs=5G count=1; sync

I realized, that the max. filesize for the cache is 2G. Is that correct? I used to write larger files to the unraid-NAS, so how will the cache behave?

nas.fritz.box-diagnostics-20201012-1601.zip

  • Community Expert
4 minutes ago, Toskache said:

I get max ~ 300 MB/s when transferring a large file

Have you done an iperf test? See what you get for a single stream.

  • Author
11 minutes ago, JorgeB said:

Have you done an iperf test? See what you get for a single stream.

The iperf-performance seems to bee ok:

 

toskache@10GPC ~ % iperf3 -c 192.168.2.4
Connecting to host 192.168.2.4, port 5201
[  5] local 192.168.2.199 port 50204 connected to 192.168.2.4 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  1.15 GBytes  9.90 Gbits/sec
[  5]   1.00-2.00   sec  1.15 GBytes  9.89 Gbits/sec
[  5]   2.00-3.00   sec  1.15 GBytes  9.89 Gbits/sec
[  5]   3.00-4.00   sec  1.15 GBytes  9.89 Gbits/sec
[  5]   4.00-5.00   sec  1.15 GBytes  9.89 Gbits/sec
[  5]   5.00-6.00   sec  1.15 GBytes  9.89 Gbits/sec
[  5]   6.00-7.00   sec  1.15 GBytes  9.89 Gbits/sec
[  5]   7.00-8.00   sec  1.15 GBytes  9.89 Gbits/sec
[  5]   8.00-9.00   sec  1.15 GBytes  9.90 Gbits/sec
[  5]   9.00-10.00  sec  1.15 GBytes  9.89 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.00  sec  11.5 GBytes  9.89 Gbits/sec                  sender
[  5]   0.00-10.00  sec  11.5 GBytes  9.89 Gbits/sec                  receiver

iperf Done.

 

Edited by Toskache

  • Community Expert
19 minutes ago, Toskache said:

I realized, that the max. filesize for the cache is 2G. Is that correct?

No, what made you think that limit applied?   The limit is going to be imposed by available space on the cache.

  • Community Expert

Iperf looks good, enable disk shares and transfer directly to cache (\\tower\cache), see if that makes any difference.

  • Author
21 minutes ago, JorgeB said:

Iperf looks good, enable disk shares and transfer directly to cache (\\tower\cache), see if that makes any difference.

Ok, I'll test that out tonight!

  • Author
26 minutes ago, itimpi said:

No, what made you think that limit applied?   The limit is going to be imposed by available space on the cache.

Ok, it was probably a mistake of mine. I was just surprised that files> 2G were never generated during the performance tests with "dd".

  • Author

Sorry for the late response.

@JorgeB I performed a retest with iperf:

unraid as iperf3-Server:

toskache@Hacky ~ % iperf3 -c 192.168.2.4
Connecting to host 192.168.2.4, port 5201
[  5] local 192.168.2.26 port 53229 connected to 192.168.2.4 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   519 MBytes  4.35 Gbits/sec
[  5]   1.00-2.00   sec   504 MBytes  4.22 Gbits/sec
[  5]   2.00-3.00   sec   491 MBytes  4.12 Gbits/sec
[  5]   3.00-4.00   sec   498 MBytes  4.17 Gbits/sec
[  5]   4.00-5.00   sec   499 MBytes  4.18 Gbits/sec
[  5]   5.00-6.00   sec   437 MBytes  3.66 Gbits/sec
[  5]   6.00-7.00   sec   384 MBytes  3.22 Gbits/sec
[  5]   7.00-8.00   sec   424 MBytes  3.56 Gbits/sec
[  5]   8.00-9.00   sec   472 MBytes  3.96 Gbits/sec
[  5]   9.00-10.00  sec   501 MBytes  4.20 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.00  sec  4.62 GBytes  3.97 Gbits/sec                  sender
[  5]   0.00-10.00  sec  4.62 GBytes  3.97 Gbits/sec                  receiver

iperf Done.

unraid as iperf3 client:

toskache@Hacky ~ % iperf3 -s
-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------
Accepted connection from 192.168.2.4, port 45284
[  5] local 192.168.2.26 port 5201 connected to 192.168.2.4 port 45286
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  1.02 GBytes  8.73 Gbits/sec
[  5]   1.00-2.00   sec  1.04 GBytes  8.92 Gbits/sec
[  5]   2.00-3.00   sec  1.04 GBytes  8.91 Gbits/sec
[  5]   3.00-4.00   sec  1.04 GBytes  8.95 Gbits/sec
[  5]   4.00-5.00   sec  1.04 GBytes  8.97 Gbits/sec
[  5]   5.00-6.00   sec  1.05 GBytes  8.98 Gbits/sec
[  5]   6.00-7.00   sec  1.04 GBytes  8.94 Gbits/sec
[  5]   7.00-8.00   sec  1.04 GBytes  8.92 Gbits/sec
[  5]   8.00-9.00   sec  1.04 GBytes  8.94 Gbits/sec
[  5]   9.00-10.00  sec  1.04 GBytes  8.93 Gbits/sec
[  5]  10.00-10.01  sec  6.23 MBytes  9.08 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.01  sec  10.4 GBytes  8.92 Gbits/sec                  receiver

 

So there is a very asymmetric performance.

At the same time you can see in the unraid dashboard that there are drops on the recipient side:

image.png.c91693a8aed583dc5ccd880de06e84d9.png

I tried allready different cables an switch-ports. Both interfaces (unraid and PC) are working with an MTU of 1500.

Unraid is on version 6.9.0-beta30.

I don't know where the drops came from. 😞

 

I also enabled disk-shares and tested the cache-pool directly:

5GB-File:

image.png.b09097d7ffa25de0fa06ad989beb88d4.png

 

That seems to be the perfomance of a single SATA-SSD even though the cache-pool is set to raid0:

image.png.744993f7182d7e713cf56d04f140da6a.png

 

At least the reading speed should be much higher, right?

 

And: Thank you for your support!

 

 

 

 

  • Community Expert
19 hours ago, Toskache said:

Both interfaces (unraid and PC) are working with an MTU of 1500.

10GbE usually is faster with MTU=9000

  • Author
2 hours ago, JorgeB said:

10GbE usually is faster with MTU=9000

That is crystal clear, but my Router (Fritz!Box 6591 Cable) doesn‘t support jumbo frames MTU 1518 is the maximum.


But the MTU-Size is not the reason for the drops!?

  • Community Expert
43 minutes ago, Toskache said:

But the MTU-Size is not the reason for the drops!?

Shouldn't be.

On 10/12/2020 at 4:08 PM, Toskache said:

During the test with dd:
 


sync; dd if=/dev/zero of=/mnt/cache/testfile.img bs=5G count=1; sync

I realized, that the max. filesize for the cache is 2G. Is that correct?

Never seen anyone go for a block size of 5G before, that’s literally orders of magnitude larger than commonly seen...

 

How about a reasonable block size and increased count to match instead?

  • Author
1 hour ago, gubbgnutten said:

Never seen anyone go for a block size of 5G before, that’s literally orders of magnitude larger than commonly seen...

You are completely right! I Testet with various combinations of bs and count. The last one I copied in the thread realy not reasonable.

With

dd if=/dev/zero of=/mnt/cache/testfile.img bs=32K count=32000; sync

I get 490 MB/s which is the ca. 90% of the double-performance of one single SATA-SSD. So the cache performance seems to be fine. For more performance i have to go with M.2/NVMe.

 

The only problem now are the dropped RX packets. With 6.9.0-beta25 i did not see any droped rx-packets. I posted it in the beta-thread.

  • Toskache changed the title to (SOLVED) Cache: Performance and max filesize

Archived

This topic is now archived and is closed to further replies.

Account

Navigation

Search

Search

Configure browser push notifications

Chrome (Android)
  1. Tap the lock icon next to the address bar.
  2. Tap Permissions → Notifications.
  3. Adjust your preference.
Chrome (Desktop)
  1. Click the padlock icon in the address bar.
  2. Select Site settings.
  3. Find Notifications and adjust your preference.