Robot

Mmm... interesting indeed!! I do have an M1 Mac Mini running Big Sur. I'll have to try it out when the issue happens again regularly. It's so random that sometimes it'll happen just half the times. As soon as the issue seems persistent copying some files over, I'll try this.

Hi @jonp! Thanks for replying! I see, and I understand. But yes, as you say, in the end I'm getting pretty good performance, at least on Mac. I hope to also equip my Windows machine with 10Gbe at some point, I hope the overhead loss is as low as with the Mac! But as you said too, I was expecting to push it even harder Yeah... although it's not worth the compromises to be honest This has happened when copying over laaaarge files, I'm speaking >20GB at least. And I'd swear it happened after having copied several files. I noticed this for the first time when I was doing my first "speed tests" in the 10Gbe connection. I selected a random 50GB video export and copied it over. I deleted it using Krusader and copied again. And again. Some times to different folders and/or shares. Just to check speed. In between copies I might do something else. I don't know how to exactly reproduce it. I'm copying a 51GB file right now just to test, and speeds are all over the place. They jump between 300 and 900MB/s constantly. I did the copy again, although through terminal so I could precisely time it: File is 51GB according to <du -h>, but macos reports 54,88GB. --> It took 1 minute 58 seconds, which is around 450MB/s depending on what size you choose as correct. I've encountered this issue some times, can't really tell what scenarios exactly, except for one: If I run a backup in Carbon Copy Cloner from my main disc to a specific folder in my UNRAID server, it takes several hours. Instead, if doing it to an external NVME plugged in via Tunderbolt, it takes around 2 minutes. I know 10Gbe maxes out at like 1/3 the speed of the external NVME, but even 2 minutes *10 would be just 20 minutes, not 3-5 hours I abandoned the idea of backup up to my UNRAID and I'm doing everything to this external NVME. There are more examples... but I can't be precise. The other day I was copying over some files from my server, such as backups made by CA Restore/Backup (usb, vms, appdata), and it was doing the transfer at 5-10MB/s for some reason. I tried copying some of those files now manually, but it hits 150MB/s and then just finishes. Well that would be awesome!! Is it a new feature coming in next release?? 😮 Thank you!

Thank you, Spencer!

Hello again, After looking into this a bit more, I found out several things: SHFS Overhead When working with shares, UNRAID seems to add to SMB transfers an SHFS Overhead (or something like that, didn't quite understand what it is). I'm not sure what this overhead is used for, but makes a performance hit. Apparently, how bad this hit is, depends on the system itself. In my case, iperf3 shows a connection of 9.41Gbps, which should translate to over 1.1GB/s, but instead I get around 890 - 920MB/s on average. It's not super bad, but could be better. I guess I can thank my performance impact is around just 15-20%. IMPORTANT NOTE: This only affects writing to UNRAID shares. Reading from them does max out the connection. (As long as the disks allow for it). Writing directly to Cache Disks Following up with the SHFS Overhead, it turns out that you can indeed get 100% network performance, as long as you accept a lot of compromises. This is achieved by enabling showing all disks shares, and then mounting your Cache Drives. When transferring files to my cache files, I do indeed get over 1.1GB/s transfer speeds, both writing and reading. Just to clarify, I did NOT accept those compromises. I just enabled the cache share to test out performance. Weird halt times at the end of copying files With all these tests, I realized that when copying large files (several GB video files) to my UNRAID Server, once the copy gets to the end, it halts for around 10-20s. Then finishes. I was copying a 65GB file to my server, and it took around 1min 12sec to get to the end of the progress bar, than it halted there for 20s, then finished. Not sure why this happens, but it's consistent. Haven't tried through Windows, I don't have a Windows PC with 10Gbe connection, not yet at least. Terribly slow transfers of certain files/folders When copying certain files over the 10Gbe connection, transfer speeds are terribly slow. For instance, transferring an appdata backup in a .tar file, goes at around 5 - 10MB/s. I guess I'll just have to live with all these, for now at least. I wonder if all these issues are caused by the SHFS Overhead.

Hi! Thanks for the response! I was getting excited reading the post, but then I realized that it doesn't really apply to my case, sadly. I'm already getting the speeds the OP of that threads finally manages to get (a little better, actually). I ran an iperf3 yesterday, and I got 8.31Gbps, which honestly seemed a little off compared to what you see on the forums. All my shares are set to public, since only I have access to my network. BUT, I decided to try out a private share with a user, and running an iperf3 today got me 9.41Gbps... I restarted my Mac and connected again just as a guest, and I'm still getting 9.41Gbps, not sure what happened yesterday. That being said, tough, transfer speeds are still the same. Around 900+ MB/s. Again, it is not bad, but I expect at least 1.1GB/s from a 9.41Gbps connection. If anything has any idea what is going on, I would appreciate! (Can't really try out from a Windows machine as of now)

Hi! I work with 4K video (extensive editing and a lot of exports), and I've always wanted to switch to 10Gbe. I finally did it! Yay!! I purchased: - ASUS XG-C100C (For the unRAID server) - Netgear XS508M-100EUS (as a Switch) - My working machine is a Mac Mini M1 (which has 10Gbe built in). (Planning on getting a Mac Studio at some point). Now, my speeds aren't BAD, but I was expecting more. Any ideas what might be going on here? While copying a single 50GB video export, I'm getting speeds around 900MB/s. See image here. It is saying 8,1Gbps, which should be 1012MB/s, but Mac OS reports between 880 and 920MB/s. Also checks out while timing the transfer. When running a Blackmagic Speedtest, I'm getting numbers around 800MB/s Write and 1000MB/s read. See here. Considering 1Gbe is pretty efficient and I was getting regularly ~115MB/s (920Mbps), which is just a 8% loss, I was expecting a maximum of 10% less speed, that is 9Gbps, just a little over 1.1GB/s. IMPORTANT: This is NOT a disk limitation. My cache disk is a Corsair MP400 4TB drive, which gives speeds over 3GB/s both write and read. Thank you!!

Hi! I did a Clear Disk + Post-read verification of two 2TB drives. I was using the old plugin, and for some reason after the zeroing (success apparently), both drives failed and then disappeared from the system. I had to reboot in order for them to show up again. I don't know what happened, but since finding out about this new version due to "issues" in the old plugin, I assume it was something like that. Now, I'm assuming my disks are zeroed, so I'm running a "Verify Disk" on them. Is that the same as the "post read verification"? Thanks!

No one? Keeps happening from time to time for no apparent reason.

I ran dmesg and the last three lines are as follows: CIFS: VFS: Autodisabling the use of server inode numbers on \\192.168.1.114\Share CIFS: VFS: The server doesn't seem to support them properly or the files might be on different servers (DFS) CIFS: VFS: Hardlinks will not be recognized on this mount. Consider mounting with the "noserverino" option to silence this message. All red, denoting ERROR level I assume. I hope it helps diagnosing the problem

Hi! I have a VM with one UNRAID Share mounted to it. The VM is just running scripts in the background using crontab. I mounted the share with fstab, as follows: //ServerIP/Share_name /media/Folder_I_Created cifs guest,uid=1000,iocharset=utf8 0 0 (Server has fixed IP) I sometimes connect to my VM via VNC and see the scripts stopped doing their tasks. Upon inspection, I always find that the share is unaccessible. Navigating to it through terminal gives no results, as if it wasn't mounted. Opening my home folder via de UI and clicking on the share icon (it still shows) gives an error (not accessible). There's the "Eject" button, but it does nothing. Using "sudo mount -a" in terminal does nothing, I usually have to manually restart the VM in order to get it mounted again. Any ideas of what might be happening? I recently switched to a new UNRAID server, I configured this VM exactly as my old one in my old server, where I never had this issue. Thank you!!

Nice, thanks! Nah it's OK, this server is new. I'm still using the old one since I need it 24/7 for work. Once everything is set up, I'll move data across. Thank you both!

I see. I'll have to dig into both those options do decide whether or not it's worth for me. Now, in case I want to go XFS, what should I do? Stop array, go into the cache settings, and just set it to XFS? And then install the TRIM plugin, of course. Thank you.

Hi all! I have doubts with the filesystem for my pools. I'm going to have three pools, as follows: - 1x NVME 4TB for data cache - 1x NVME 1TB for Dockers and VMs - 1x SSD 2TB for various stuff VM related I created the pools and the system automatically gave them the btrfs filesystem. Afterwards though, I see you can change it to XFS. I understand btrfs is the only option when RAID0/1, but what about one single drive caches? + I've read people recommending btrfs, because it needs no TRIM. + I've read others recommending XFS, since it's more robust apparently and you can TRIM with a plugin anyways. Any thoughts? Thank you!

Perfect, everything's solved. Thanks!

Thank you both! Something else that just came to mind: I guess I should set the shares to not use the cache pool until all data is copied over, right? Thank you! Interesting. I thought the speed would be around 150 - 200MB/s, which would be like 50% faster (assuming 175MB/s vs 115MB/s). This would've meant 20h instead of 40+, and since I need the server for work stuff... Such a shame. I will then do it over Ethernet.