Ariloum

I got single cpu system, there is only 1 numa node

I found that if I turn off virtualization support on Windows VM then Ubuntu22 VM getting to work fine in parallel, while Debian12 is still stucked. Idk what to think, is it a kind of Unraid bugs? If so should I report it somehow else than here?

Same stucking happens with Ubuntu 22.04 LTS. Meanwhile Ubuntu 24 works fine, but it has too high python version - 3.12 - I need 3.10 for some project that runs in docker. Why did I have to bruteforce linux distros with the Unraid? I though that VM is basic function that must work out of the box.

Here is both VM's xml configurations attached debian.txt windows.txt

Hello fellow unraiders, looks like I need some help discovering one strange behave. I got 2 VM's installed: 1. Windows 10, runs at 12 cores, 16Gb memory. 2. Debian 12.6, runs at 4 cores, 4Gb memory. Both installed on fast cache SSD, both has selected it's own logical CPU cores. If started alone they both runs smooth and fast. But If I got Windows VM running, starting Debian takes almost endless amounts of time (15-20+ mins) and everything goes very slow with it, I'm getting error messages in console while it loading about locking cpu by timeout and so on. If I turn down Windows VM then Debian start working normally, but if I launch Windows VM after that - Debian goes laggy again - if I start some application like Firefox Debian start using 2-4 of it's cores at 100% and it takes a few minutes to launch it. I have another Debian12 in docker and it runs fine in parallel (I got it turned off while encountering this issue). What could be source of this? I though I could run VM's normally even on same cores..

Yeah I can confirm taht two mellanox cards gives 9+ gbps singlethreaded with iperf...

Today I got my Mellanox ConnectX-3 Pro MCX312b-X adapters (detects as MT27520 in the unraid's lspci), looks like it's drivers works better than Intel X520 ones - reaching ~5gbps singlethread with the iperf3 tests and ~9.5gbps multithreaded. Going to try swapping my pc's Intel x520 to Mellanox, maybe it will reach 9.5gbps singlethreaded like that? Thanks for the help, guys.

actually I have 2xRJ45 transceivers and used them a few days on small speeds in 2 different cases 1. 2.5gbit ethernet was plugged into 10gbit rj45 sfp switch 2. x520 to sfp switch I've had no any issues but I didn't tried to test it on heavy load for long time.

Actually I heard that for the Intel x520 and many other sfp adapters Windows is most capricious system. Usually all these adapters is working good on *nix systems. But for now most capricious system leadership, in my eyes, is overtaking by unraid. I've ordered some cheap Mellanox adapter. Guess I'm going to bruteforce these hardware adapters until the unraid finally deigns to work. If it won't run within 3 adapters I'm going to switch to Debian with SnapRAID (same parity disks system).

That is curious that smb network copying speed to unraid win10 VM is reaching that 500Mb/sec (one thread of iperf3):

definitely that is only your exp and related to overheating of RJ45 transceivers, I have a data-center friend who is using tons of these Intel X520 in many cases (mostly on server-racks), but these cards just works everywhere (except unraid) and well supported even by Synology.

Well, looks like these cards has many revisions too, like Intel? How do I know which revisions are supported by unraid? For example: Mellanox Oracle MHQH29B-XSR ConnectX-2 There is lots of them: Mellanox CX-3 EN PRO 10/20 Gb MCX312B-XCCT Mellanox CX-4 Lx 10/20Gb 25/50 Gb Eth MCX4121A-ACAT Mellanox ConnectX-3 VPI MCX354A-FCBT Mellanox ConnectX-3 Pro VPI MCX354A-FCCT Mellanox ConnectX-3 Pro EN MCX314A-BCCT Mellanox CX-4 Lx 10/20/40/50Gb Gb Eth MCX4131A-GCAT Mellanox CX-4 EN 10/20/40/50Gb 56Gb Eth MCX413A-GCAT / MCX413A-BCAT Mellanox ConnectX-4 VPI MCX455A-ECAT

I'm curious what 10gbit adapters are you using with unraid and what transceivers? Looks like I have close to zero chances to get full drivers support for my net adapters from the unraid team thus I will have to replace my hardware. I know Intel got like 3 or more revisions of their X520 adapters - 82599, 82599es, 82599eb, and probably unraid doesn't supports some of them.

Is there any way to find the bottleneck? I'm not a developer thus my possibilities of analyzing is very limited.

If so then why did I have 2-3 times lower copying speed if my single iperf thread speed shows ~4gbit? 4gbit is something like 500 Mb/s but I'm getting 170 Mb/s. For me it seems that unraid has some serious network issues. Did it also has single-threaded packets queue?

Hmm, interesting, I tried to run iperf3 -P 10 and it shows 9gbit sum speed. That means it is working somehow. But how to reach good files copying speed? I have one nvme Samsung 990 pro ssd with NTFS filesystem in the unassigned devices which I shared to test copy speed, also I have some btrfs cache drives over some shares like isos folder. Copying files to ntfs drive speed is like ~150 megabytes/second, copying files to cached share is ~175 megabytes/second. Why it is that slow?

I did some investigations, here is update: 1. I reinstalled win10 again on the unraid server machine and my network hits easy 10gbe with direct smb files copying. But.. iperf3 still shows half speed, so I ended up with bug-reporting this case at https://github.com/esnet/iperf/issues/1718 2. I've tested that log autherror idea with the Chrome addons and have unraud webui page running 24/7 in the Chrome incognito window (no addons) - it has no any auth errors in the log for last ~40 hours. So it must be something related to the addons functionality... I have ~23 addons in my Chrome, but all them works well with many of web UI's I run locally (4-5 java, a few REST api's with different types of auth and frameworks, stability UI's like stable diffusion/forge/swarm etc., some handwritten media server with auth and so on). I didn't see cascades of connections on my webUI's logs with these addons like unraid webUI has with it's nginx... and the main problem is still unresolved - unraid declines to work at 10gbe speed with that Intel X520-DA2 network adapter and barely hits 2gbps... I purchased this network adapter because of many other forums confirmations/recommendations on it, like these - that is very sad I can't get it working with unraid: and here:

That "unauthenticated" error comes from the webUI page of the unraid itself, if we have to do guesswork ourselves with tricking that error handling that mostly means poorly error-handled code server-side or poorly written client-side or both (I have a few years of exp on enterprise java backend development). About ipv6 I got it turned off for ages... Other solutions from that link doesn't looks good - why would I increase nginx limits to endless - it's not secure if some1 gonna try to bruteforce passwords I will not see it... And switching browser to Firefox - what kind of solution is this? Laughtable ? I agreed there could be some browser bugs, but they (Google in case of Chrome) fixing it pretty fast - imagine having bugs with only unraid UI and blaming browser... The only thing comes to my mind that could cause issues for some kind of webUI's is browser's addon's, I will try to investigate if this error still happens on incognito Chrome page. I have upgraded that unraid thingy from Ryzen 5 5600G and looks like 7900x works overall well except that network speed issue. And it's not only fileserver, I have many usages of it with DB's/VMs/neural stuff and heavy tasks... I got 7950x too on my main PC and these both is nice cpu's (except the fact it can handle only 2 of 4 memory sticks on full speed otherwise speed is halfed). Tbh that 7900x is not too new - it has been released 8 months ago. Also there is many AMD cpu's for servers like threadripper and epyc. check the cpu benchmark top list, did you see Intel here? https://www.cpubenchmark.net/high_end_cpus.html I personally do not like Intel since they still got too fat nm tech for their cpu's and thus got too high TDP (too hot), so more noise for fans - I'm not a fan of their fanbase for long time). And, at the moment, I don't like their efficiency cores which is not covering many software cases (same like these new Mac m2-m3 arm cpu's with "e-cores" not covering many audio DAW's plugins processing - that is including Apple's one Logic Pro - looks like it's hard to sync hardware and software layers even for Apple..). I still prefer flat, stable, cold and clear systems/cores which just works for everything. Thanks for trying to help. Most likely this network speed problem leads to the drivers, need some other hand here please - the one who knows how to tweak the drivers.

Yeah that "authlimit" is kinda annoying error if you want to just read the logs. I got my pc on 24/7 and Chrome browser has 1 open page with unraid UI. I also tried to google about that problem before and I have seen the link you attached. Here I seen a post of admin ljm42 and he said significant part "If an open page becomes unauthenticated" - at this point I started to count this error as unRAID bug and stopped discovering it, my thought was that unraid webUI must not lose auth that easy (why did it happens btw? token expiration timer too small or ...? I have all my Chrome cache turned off so it should not try to load any cache/history attached to that page). Also that error is not filling my memory much and I got that network speed bug after fresh reboot of unraid server so I think that network speed issue has some other roots.

Could someone exp please take a look at my diagnostics files, I purchased these 10gbit network adapters because was specially googled and everyone were saying nic (Intel X520) is working good and fully supporting by unraid. tower-diagnostics-20240615-1949.zip

is there any manual for the unraid network driver change? I tried to google but didn't found anything usable (some peeps offering to compile custom kernels).

It's already working on that hardware with 10gbit - if I unplug unraid and boot windows from internal m2 ssd files copy speed will be 10gbit as on the screen above. It doesn't works if I run unraid on that hardware.

That screen I made during testing win2win files copy

yep it's RouterOS - at first I tried direct connection with LAN adapters between Windows <-> Windows w/o switch and it worked with copying files at 10gbps, then I added that switch and it was working fine too. I changed flow control to auto and restarted switch - still same image on the unraid side: root@Tower:~# ethtool eth0 Settings for eth0: Supported ports: [ FIBRE ] Supported link modes: 10000baseT/Full Supported pause frame use: Symmetric Supports auto-negotiation: No Supported FEC modes: Not reported Advertised link modes: 10000baseT/Full Advertised pause frame use: Symmetric Advertised auto-negotiation: No Advertised FEC modes: Not reported Speed: 10000Mb/s Duplex: Full Auto-negotiation: off Port: FIBRE PHYAD: 0 Transceiver: internal Supports Wake-on: d Wake-on: d Current message level: 0x00000007 (7) drv probe link Link detected: yes