slow bandwidth between win10vm and unraid array

[CrossFireS]

I'm having issue of really slow transfer speed between win10vm with dedicate nvme passthrough and unraid array
 

tested with iperf and i got around 5Mb/s from vm to array. but got normal speed from other laptop.

internet connection aren't affected, only when trying to move file from win10vm to the array is really slow.

Tried
update unraid from 6.8.2 to 6.8.3
update virtio to latest version.

anyone could point out to where i should look into?

[Vr2Io]

Pls enable Windows firewall ICMP ( default is disable ) and provide the ping response time for ref.

 

Below is a test on a low-end ATOM J1900 system which host Win10 VM, ping result always less then 1ms, file transfer also reach 1Gbps. But Iperf result show 300Mbps only. ( All test direction was Unraid to VM )

 

64 bytes from 192.168.9.19: icmp_seq=234 ttl=128 time=0.706 ms
64 bytes from 192.168.9.19: icmp_seq=235 ttl=128 time=0.723 ms
64 bytes from 192.168.9.19: icmp_seq=236 ttl=128 time=0.652 ms
64 bytes from 192.168.9.19: icmp_seq=237 ttl=128 time=0.685 ms
64 bytes from 192.168.9.19: icmp_seq=238 ttl=128 time=0.970 ms
64 bytes from 192.168.9.19: icmp_seq=239 ttl=128 time=0.903 ms
64 bytes from 192.168.9.19: icmp_seq=240 ttl=128 time=0.791 ms
64 bytes from 192.168.9.19: icmp_seq=241 ttl=128 time=0.635 ms
64 bytes from 192.168.9.19: icmp_seq=242 ttl=128 time=0.804 ms
64 bytes from 192.168.9.19: icmp_seq=243 ttl=128 time=0.575 ms
64 bytes from 192.168.9.19: icmp_seq=244 ttl=128 time=0.585 ms

 

 

Quote

[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  41.2 MBytes   345 Mbits/sec    0    254 KBytes       
[  5]   1.00-2.00   sec  36.2 MBytes   303 Mbits/sec    0    382 KBytes       
[  5]   2.00-3.00   sec  41.2 MBytes   345 Mbits/sec    0    342 KBytes       
[  5]   3.00-4.00   sec  44.8 MBytes   376 Mbits/sec    0    319 KBytes       
[  5]   4.00-5.00   sec  38.6 MBytes   324 Mbits/sec    0    314 KBytes       
[  5]   5.00-6.00   sec  44.8 MBytes   376 Mbits/sec    1    311 KBytes       
[  5]   6.00-7.00   sec  43.6 MBytes   366 Mbits/sec    0    282 KBytes       
[  5]   7.00-8.00   sec  39.9 MBytes   335 Mbits/sec    1    282 KBytes       
[  5]   8.00-9.00   sec  39.9 MBytes   335 Mbits/sec    1    342 KBytes       
[  5]   9.00-10.00  sec  42.3 MBytes   355 Mbits/sec    0    322 KBytes 

 

Edited February 17, 2021 by Vr2Io

[CrossFireS]

here are result from the ping

64 bytes from 192.200.12.8: icmp_seq=56 ttl=128 time=0.191 ms
64 bytes from 192.200.12.8: icmp_seq=57 ttl=128 time=0.204 ms
64 bytes from 192.200.12.8: icmp_seq=58 ttl=128 time=0.153 ms
64 bytes from 192.200.12.8: icmp_seq=59 ttl=128 time=0.287 ms
64 bytes from 192.200.12.8: icmp_seq=60 ttl=128 time=0.172 ms
64 bytes from 192.200.12.8: icmp_seq=61 ttl=128 time=0.138 ms
^C
--- 192.200.12.8 ping statistics ---
61 packets transmitted, 61 received, 0% packet loss, time 61423ms
rtt min/avg/max/mdev = 0.118/0.189/0.310/0.039 ms

Files transfer speed never go above 700KB/s which in line with around 5Mb/s from iperf

Edited February 17, 2021 by CrossFireS

[theruck]

i suspect your home network switch or cabling/wifi and more suspect/guess it is a router from your ISP

[CrossFireS]

4 minutes ago, theruck said:

i suspect your home network switch or cabling/wifi and more suspect/guess it is a router from your ISP

this is vm on same machine as array.

what funny is that my laptop connected via wifi can have 4xx mbps to the array and vm.
 

[Vr2Io]

Strange

[CrossFireS]

2 hours ago, Vr2Io said:

Strange

trying again and now from unraid to VM is fine now but otherway around still same speed

[Vr2Io]

Have similar result if test on low-end system.

 

 

But in a high-end system, both direction will be 10Gbps.

 

 

What CPU are you using ?? ( all test was Unraid to self VM )

Edited February 17, 2021 by Vr2Io

[CrossFireS]

updated unraid to 6.9.0 rc2 and now i got 1-300 Mb/s from vm to unraid.

top 2 are tested from unraid to self VM and bottom one is other way around

My system is 3950x + 64GB ram
 

[Vr2Io]

Pls also ref. below post, try virtio or virtio-net in VM setting

I notice your test have high value Retr (retry count) and 3950x was NUMA type CPU, you may need pin CPU core, so Unraid and VM within same node.

 

Edited February 17, 2021 by Vr2Io

[CrossFireS]

13 hours ago, Vr2Io said:

Pls also ref. below post, try virtio or virtio-net in VM setting

I notice your test have high value Retr (retry count) and 3950x was NUMA type CPU, you may need pin CPU core, so Unraid and VM within same node.

Tried reduce RSS to 2 and didnt change anything.

is it related to my vm running as i440fx-5.1 ? i never used q35 before, would it make any different?

what made me curious is that it used to work perfectly fine for more than a year and suddenly this, i think i saw someone mentioned similar issue before and create similar new VM don't have same issue. this made me think that it's windows related issue but can't figure out where should i look into.

for the high retry count, i think it's related to windows firewall or something, iperf3 from unraid having issue testing to windows vm. other way around it's perfectly fine and testing from laptop to both vm and unraid also perfectly fine

Tested changing back to virtio and it's worsen to around 1Mb/s
 

Edited February 18, 2021 by CrossFireS

[CrossFireS]

tried pin only 4 cores to VM and still same issues.