Eksitus

I'm so glad I reached out for help on the forum because my current suspect was a faulty pendrive / Unraid system file corruption or even a faulty motherboard. However, it would all make sense, as the first time I built the system, it came with 2 boxes of 2 sticks of 16GB RAM, where each box had one stick not passing the Memtest. The servers were running with the working half as expected. After going through warranty, sticks that came from RMA passed Memtest, so I thought they are good to go, but turns out they might suffer from exactly the same issue, making only one stick from the box usable (which I assume ended up in server A) and the other one from the bundle currently wreaks havoc in server B. Lesson learned not to take Memtest for granted. Jonathan, your expertise in solving this issue was immensely valuable. Thank you for the lesson!

Hello! I am fairly experienced using Unraid, but this is by far the strangest issue I've encountered. I am dealing with a system that introduces corruption when dealing with larger files, even locally, both on array and cache. The system passed full MemTest with no issues (both at 3600 and 3200 MHz). I have 2 servers with the same motherboard / CPU / RAM combo. The systems were working well for a couple of months. Eventually, they started raising a lot of BTRFS corruption errors. I thought this was a result of using RAM XMP profile (I know, bad idea for a server, but I had no issues using XMP on any other server). I defaulted to RAM timings within spec (3200 MHz). When the BTRFS errors did not stop, I scrapped BTRFS altogether and reformatted them to XFS. On one server (A), this resolved any issues. On XFS, it runs two VMs with GPU passthrough and advanced USBIP setup for over a month now, with not a single error logged. Windows VMs are in perfect health, with no crashes or problematic system events. Also, the sha test described below results in correct sha (on server A), so I'd say this server is hopefully cleansed from any corruption issues. However, the other server (B), even running XFS cannot hold it together. When working with larger files (starting at around 1GB), it corrupts them on move / rsync / cp attempts. Even running sha256sum on the same file in a row can yield different result. Copying working VM images from another server to this one (A -> B) not only is not possible, because the image copied with rsync -avz does not arrive intact (sha does not match) but also after some time, not only Windows tools are not able to recover the state of the system, but it also crashes more every time it's run. I was able to detect the system on server B had the wrong sha for bzfirmware. As far as I know, this should be detected at boot, no idea why the system booted normally and did not even raise any log errors. This issue possibly goes back to before the update, as an old flash backup of this server has analogous corruption. Copying fresh bzfirmware to the pendrive did not resolve the issue. All bz* files have correct sha now. Also sometimes when using SMB the server throws Kernel issues, once lead to a complete crash. Showcase of the main problem: `Any other system` root@arch /h/e/builds# dd if=/dev/zero of=8gb_zeros.img bs=1M count=8192 8192+0 records in 8192+0 records out 8589934592 bytes (8.6 GB, 8.0 GiB) copied, 3.63427 s, 2.4 GB/s root@arch /h/e/builds# sha256sum 8gb_zeros.img ebfb4ef19ae410f190327b5ebd312711263bc7579970e87d9c1e2d84e06b3c25 8gb_zeros.img `Malfunctioning System (here, array but same issue is on cache)` root@LOG-B:/mnt/user/BACKUP_NEW# dd if=/dev/zero of=8gb_zeros.img bs=1M count=8192 8192+0 records in 8192+0 records out 8589934592 bytes (8.6 GB, 8.0 GiB) copied, 48.1192 s, 179 MB/s root@LOG-B:/mnt/user/BACKUP_NEW# cp 8gb_zeros.img cp8gb_zeros.img root@LOG-B:/mnt/user/BACKUP_NEW# sha256sum 8gb_zeros.img cp8gb_zeros.img 8gb_zeros.img cp8gb_zeros.img 8gb_zeros.img cp8gb_zeros.img 54bece301a2162431b067cd4360c803c53cecd7e63802f1bd302c2a80b3bc19d 8gb_zeros.img 54bece301a2162431b067cd4360c803c53cecd7e63802f1bd302c2a80b3bc19d cp8gb_zeros.img 3b4c8723c218d93bff840c79dfb3a089bf7c6b2a7592e9d77f49d86f6908730d 8gb_zeros.img b775253dc3222607e940a73333a270c4c4ef57b8d8c459d0fd349e40488c12b6 cp8gb_zeros.img 3b4c8723c218d93bff840c79dfb3a089bf7c6b2a7592e9d77f49d86f6908730d 8gb_zeros.img 8bab52d97e6e28f87b585469611e20624157a4ccea88b5d4e5fc534c209cef91 cp8gb_zeros.img `After reboot` root@LOG-B:/mnt/user/BACKUP_NEW# sha256sum 8gb_zeros.img cp8gb_zeros.img 8gb_zeros.img cp8gb_zeros.img 8gb_zeros.img cp8gb_zeros.img ebfb4ef19ae410f190327b5ebd312711263bc7579970e87d9c1e2d84e06b3c25 8gb_zeros.img <----- Correct SHA e4c55c999f5560bf706d8303c1464464327c7b186be8ba91c39df792d0fb5a00 cp8gb_zeros.img dfd0b073462375fa96bde6ec6b4faab121c9c1e232c1fca7bfd4965e27b05e5c 8gb_zeros.img <----- Gets corrupted ? 4cd75493b0dc36a262f8289ce658ef5c4d2508ddf8a66fe5edf4c85d56f5ef39 cp8gb_zeros.img ebfb4ef19ae410f190327b5ebd312711263bc7579970e87d9c1e2d84e06b3c25 8gb_zeros.img <----- Correct SHA again ? 4cd75493b0dc36a262f8289ce658ef5c4d2508ddf8a66fe5edf4c85d56f5ef39 cp8gb_zeros.img `For smaller file` root@LOG-B:/mnt/user/BACKUP_NEW# sha256sum 1gb_zeros.img 1gb_zeros.img 1gb_zeros.img 1gb_zeros.img 1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img root@LOG-B:/mnt/user/BACKUP_NEW# cp 1gb_zeros.img cp1gb_zeros.img root@LOG-B:/mnt/user/BACKUP_NEW# sha256sum 1gb_zeros.img cp1gb_zeros.img 1gb_zeros.img cp1gb_zeros.img 1gb_zeros.img cp1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 cp1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img e7b2f8cc13543b56922a628630683babb3726f0f0b6b4f9b5a36be451ada27a0 cp1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img e7b2f8cc13543b56922a628630683babb3726f0f0b6b4f9b5a36be451ada27a0 cp1gb_zeros.img root@LOG-B:/mnt/user/BACKUP_NEW# sha256sum 1gb_zeros.img cp1gb_zeros.img 1gb_zeros.img cp1gb_zeros.img 1gb_zeros.img cp1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img e7b2f8cc13543b56922a628630683babb3726f0f0b6b4f9b5a36be451ada27a0 cp1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img e7b2f8cc13543b56922a628630683babb3726f0f0b6b4f9b5a36be451ada27a0 cp1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img e7b2f8cc13543b56922a628630683babb3726f0f0b6b4f9b5a36be451ada27a0 cp1gb_zeros.img Given this behavior, I'm no longer sure whether the server A had any corruption issues in the first place, or was it a result of moving corrupted flies from server B during backups / VM migrations. I still have some ideas on how to troubleshoot it, but I'm afraid soon I'll run out of ideas, and the stress levels from dealing with this issue will be too high. I attach diagnostics for the perfectly working server (A) and the corruption-infested one (B). Their configuration is very similar, B has 3 extra HDD drives and A has one different GPU. I attach a current Syslog. I also have a Syslog since January, would it be safe to post it here publicly, or could it have any private information? I'd appreciate any help or hints in diagnosing the issue. log-b-diagnostics-20230814-2028.zip log-b-syslog-20230814-1827.zip log-a-diagnostics-20230814-2008.zip

update: changing <gic version='2'/> to <gic version='3'/> allows to have more than 8 threads

I doubt it was running through virsh at all, as far as I'm aware just using qemu, running the command from the post does not list it using "virsh list" and vm kills itself after closing the console. However, after a lot of trial and error, I managed to create a very rough XML template, that suprisingly works! (still, I did not even test VNC) At least now it's possible it use the VM headless as a normal unraid VM. I hope someone can upgrade it and post the result, I expect there is huge room for improvement and it'd be nice to learn from more professional version. Make sure to update any file locations & UUID accordingly if you want to use it. <?xml version='1.0' encoding='UTF-8'?> <domain type='qemu'> <name>deb_aarch64</name> <uuid>UUID</uuid> <memory unit='KiB'>1048576</memory> <currentMemory unit='KiB'>1048576</currentMemory> <vcpu placement='static'>2</vcpu> <os> <type arch='aarch64' machine='virt-6.2'>hvm</type> <kernel>/mnt/user/isos/arm/vmlinuz-4.9.0-19-arm64</kernel> <initrd>/mnt/user/isos/arm/initrd.img-4.9.0-19-arm64</initrd> <cmdline>root=/dev/vda2</cmdline> <boot dev='hd'/> </os> <features> <gic version='2'/> </features> <cpu mode='custom' match='exact' check='none'> <model fallback='forbid'>cortex-a72</model> <topology sockets='1' dies='1' cores='2' threads='1'/> </cpu> <clock offset='utc'/> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>destroy</on_crash> <devices> <emulator>/usr/bin/qemu-system-aarch64</emulator> <disk type='file' device='disk'> <driver name='qemu' type='qcow2'/> <source file='/mnt/user/isos/arm/hda.qcow2'/> <backingStore/> <target dev='vda' bus='virtio'/> <address type='pci' domain='0x0000' bus='0x03' slot='0x00' function='0x0'/> </disk> <controller type='pci' index='0' model='pcie-root'/> <controller type='pci' index='1' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='1' port='0x8'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0' multifunction='on'/> </controller> <controller type='pci' index='2' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='2' port='0x9'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <controller type='pci' index='3' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='3' port='0xa'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> </controller> <controller type='pci' index='4' model='pcie-to-pci-bridge'> <model name='pcie-pci-bridge'/> <address type='pci' domain='0x0000' bus='0x02' slot='0x00' function='0x0'/> </controller> <interface type='bridge'> <mac address='52:54:00:95:98:31'/> <source bridge='br0'/> <model type='virtio-net'/> <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/> </interface> <audio id='1' type='none'/> </devices> </domain>

https://translatedcode.wordpress.com/2017/07/24/installing-debian-on-qemus-64-bit-arm-virt-board/ I followed this tutorial and was able to get aarch64 VM running pretty well. (I needed second linux to extract files from disk image since unraid does not have the required tool) Issues: - Not sure how to best convert the quemu arguments to xml file for libvirt - I only need to access VM via command line, so I did not even try to get VNC to work Otherwise the VM runs pretty stable and so far faster than I expected, I did not run along any issue during the installation but it took couple hours for the system to install. Good luck to anyone who wants to try!

Image of the same issue from the internet: So there is some UAC issue with RDP connection where if I connect via RDP to non-admin user I cannot raise the elevation above the credentials I use for RDP. At least I think that's what raises this issue.

I completely agree with going with RDP if it hadn't been for an edge case when user without administrative privileges needs elevation. RDP just does not allow to do anything in this case without physical access to keyboard.

Did anyone manage to successfully convert OVMF VM image to SeaBios? I'm talking about a solution with preserving the previous OS (Windows 10), without clean installation. I tried to convert the drive from GPT to MBR, but it resulted in "Booting from Hard Disk ..." or when I hard-copied the C drive from OVMF image to SeaBios image I managed to boot into windows recovery but diskpart shows no disks. For curious people: I want to convert them because OVMF VNC does not support high resolution when running in parallel to GPU passthrough (at least I couldn't get it to work no matter what I tried) and SeaBios has no such issues. I have 6 VMs that I want to convert, and a clean installation is not an option because they were used for some time already, and it would take ages to go back to this stage. I'd appreciate any clues that might help!

From my experience with this plugin, even if you don't use it for USB/IP it can act as an extension of unassigned devices (UD) plugin where you can hotplug (attach/detach) USB devices on running VMs, yet UD has limitation where it cannot handle devices with the same name. However, this plugin distinguishes the devices by their bus/id allocation and can hotplug them even when they share the same name or manufacturer info. If I'm mistaken I hope someone can correct me since I don't have an Unraid machine nearby to back up my claims, but I'm fairly confident it will solve your problem at least when it comes to hotplugging the devices (attaching them to VM after it started).

I'm asking about the scenario where USB stick or other high bandwidth devices are plugged in and exported/bound elsewhere in the local network and then attached to unraid/VMs using USB/IP protocol.

Did anyone test the speed/throughput that is achievable with devices such as USB sticks / drives? So far I can't get it to run with decent speeds (I got 500KBps at best for average and problematic delay at the beginning of the transfer). I'm using Unraid and a laptop under gigabit switch in local network. Is it a problem in my config or is this performance to be expected from this protocol?

Hello! I'm thinking about implementing a server for 6 VM stations in my company, with an option to expand it by 1-2 stations down the line. However, every VM needs to have a separate USB controller since when last time I implemented a server with 3 VMs with one controller it turned out to be very problematic long term. Does there exist a (reasonably priced) Unraid compatible server motherboard that can support min. of 6 but preferably 8 GPUs (one per VM) and still leave an option to somehow assign a separate USB controller to each VM? What PCIe card/combination would allow for expanding the number of controllers or would resolve the problem in another way, and would take as few PCIe slots as possible? Maybe there exists a server solution you know of (EU based) that custom builds servers fitting these requirements? I'd be thankful for any solutions or leads to follow in my research!

All utility of such VM aside (yes, there is basically none), I thought it would be an interesting challenge to try and run deck's SteamOS since the real deal will be unobtainable for quite some time. I found a link to the recovery tool with an img file( Steam deck recovery image ), yet I had no luck booting from img and converting it to iso, qcow2, and vmdk for vmware workstation gave similar results. My best attempt resulted in infinite "Booting from Hard Disk..." using SeaBIOS, but it might have just been restricted by my limited KVM experience. So my question to the more KVM advanced friends, do you think it's possible to somehow sideload it into unraid? Did steam use some protection against such attempts or is it just completely incompatible? Let me know what do you think!

Speaking about security... every device connected via ethernet cable has assigned a PUBLIC IP!!! for some unknown reason! Good thing I found about it quickly and took measures not to expose my unraid shares to global internet! I'm aware and don't even have a need to do that since I get every software license I need using my .edu email I mean so far it's really great (what a waste would it be not to use it for unraid...) And for some reason when I asked them about using internet router... """ Q: Hi, There is the information that "Personal routers are not allowed in residence halls" but I think I've read somewhere that they were permitted as long as their wifi was turned off. Would it be possible to use the router with all the wireless functionality turned off (I have router that has this option) like a "smart" internet switch? Or is it something that is not permitted from now on? """ A: Unfortunately, personal routers are not allowed in residence halls in any capacity. If you have any further questions, feel free to reply. """ Which makes completely no sense since how am I going to protect my devices against access from public without the router in between?! Should I manually block every port possible? I'd like to ask somebody in charge for the reasoning behind this I can either ask support that knows how to solve only basic problems or make a risk writing more emails just to get an answer "sorry, we can help you" and risk being tracked as potential risk to their network (that I think couldn't be more dangerous than giving everyone open public ip and risking having their files stolen or computers broken into...). I'd just like to set uo my router, open one and only port for wireguard and make windows and linux vms to connect to via rdp on android tablet (lightweight, great battery) when I'm outside the dorm which I find to be way more secure than the forced public ip I have assigned to my server now. Unless I miss some details or lack knowledge in which case please correct me... Maybe it can be done without router with pfsense to treat the server as the router? (but I don't know much about it yet, just heard this name in similar discussions) Anyway, thanks for your responses so far! Please let me know what do you think about this public IP situation, is it as crazy as I think or do I overreact?

Hi! I'm currently living in an university dorm with great (almost gigabit) wired internet connection. However they have it configured so that only one device is allowed to connect to internet per single connection (at least that is my hypothesis). I tried splitting this connection with network switch to my laptop and unRAID server and only one was connected to the internet at once. The biggest problem is the usage of virtual machines, because they can't access the internet (probably because they ask for separate IP). So without the internet I can't even access them via RDP/parsec and the lack of internet makes them kind of useless. Do you know what can I do in this situation? Or what information / logs do I need to give to you to be able to receive help? Do you think buying internet router would resolve this issue? (And what are your recommendations for budget-friendly one because I can't find my brand of choice - Fritz! after moving to US)

Thanks a lot! I'll try to educate myself more about private subnets and sequencial static IP and see what I can achieve with it. Actually you're right about this educational challange, I've only recently started building my advanced networking knowledge, so this project seems like a perfect fit to throw myself in at the deep end.

Hi, SHORT VERSION: Raspberry Pi SSH into Unraid, no router possible. I have a UPS that has no way of telling Unraid to cleanly shutdown. Therefore, I used its signaling LED voltage to determine the state of running on battery via GPIO and now I'd like the raspberry pi to communicate it to Unraid. Unfortunately I can't do it via router, since it won't be powered on during power loss, so I thought it could be possible to SSH into unraid via second NIC (eth1) and send the command to shutdown on the raspberry pi. Is there an option to achieve this goal (maybe not exactly the way I described)? Does it require auto MDI-X cable or maybe linux VM and networking shenanigans? I'm looking for the least expensive and obtrusive way possible but I'll be glad to learn from every possible solution. In case it's nearly impossible I will simply run the wiring from the PC power button to RPI's GPIO but it'd like to avoid it. Thanks in advance!

That's great to hear! Sorry for taking your time, just wanted to make sure I've done it the right way.

Hi, I only recently started learning about Linux's permission and user system, and combining it with Unraid and docker it's not my level yet, so I'm looking forward to your help. I have a Plex docker with mapped /mnt/user/plex_data/DATA/symlink_A that leads to /mnt/user/A. From what I've read in order for this to work I need to give the plex access to this "A" share so it can read its contents. How I go about finding how is the plex user colled (or its user-id?) and how to give it (preferably only read) access to the data? So far I managed to find a work-around and map host path: /mnt/user/A as a container path: /A and it works as intended, so is it viable as a good long-term option or just a silly temporary solution? With the above-mentioned possibility, it is not actually necessary for me to create this topic, but I think it may help someone with a similar problem in the future, and it gives the opportunity to learn something about the permissions system in Unraid 😄

After two weeks of trying I cannot establish a connection to my LAN network. After following SpaceInvader's OpenVPN and these https://forums.unraid.net/topic/84226-wireguard-quickstart/ tutorials - in OpenVPN I'm not able to connect to the server and in the WireGuard I'm not able to establish a handshake with the device outside LAN. I believe there is no way I still configure something wrong after so many attempts and with different combinations. Digging deeper and limiting my network setup to the bare minimum (only fiber cable router with a direct connection to my server) still no progress. Now I suspect the router may be at fault because in the "User log" I found the entry: 2020-02-23 00:36:16 [Error][Alarm-Log] AlarmID:303500,AlarmLevel:Error,DoS attack. Type: smurf. Source IP address: 192.168.18.4. Destination IP address: 203.119..... Source MAC address: 2c-3a..... (OpenVPN / WIreguard IP?) Unfortunately, this router comes from my internet provider and I can't substitute it with my Fritz! router. Below you can find the screenshot with every piece of information I think is useful, if not tell me what is needed. Note: The DMZ function and port mapping (alongside UPnP) are configured on screenshots mainly for demonstrational purposes, mostly I tried setting everything up without them. Tomorrow I will add screenshots from OpenVPN config. Hope you can give me some hints, thanks in advance.

Thanks a lot, your respond clarifies everything

Yet, you had the opportunity to test it with unraid with GPU passthrough? If yes, have you found any major problems?

Hi, I'm facing the decision of a purchase of particular hardware and I want to know what do you think about it. I'm talking about threadripper 2970WX and motherboard Gigabyte X399 Aorus Pro. Are there perhaps any users running this motherboard or any known problems with this manufacturer / series / model that I should be aware of or by your knowledge it should work just fine? Thanks in advance

The only thing that was preventing me is my lack of experience using Unraid. Hearing that particularly Nvidia cards require dumping vbios I thought that putting RX in 1. slot will resolve the problem, additionally there is the good practice of putting the best GPU in the first slot when it goes to building normal PCs that apparently in the server field gives more problems that benefits (given that there are even any benefits). Thank you for setting me on the right track. Now I'm going to put RX in 3. slot and fill remaining slots wih GT 710. Just one additional question, do you recommend dumbing vbios of all the cards or just the primary GPU?

Hi, I will try to keep it short and simple not to waste your time I'm using Unraid primarly to create VMs for 4 users. Hardware: CPU: Threadripper 1950X (4.0 GHz) 16 cores MOBO: MSI X399 SLI PLUS RAM: 32GB DDR4 GPU: Radeon RX 580 4GB GT 710 * 3 The question is about GPU passthrough, is it possible to run VMs using following configuration? 1. PCIe x16 RX 580 2. PCIe x8 GT710 3. PCIe x16 GT710 4. PCIe x8 GT710 From what I can find there is no option to choose primary GPU i my bios What works like a charm: - only RX 580 in 3. slot (btw before displaying TianoCore logo I can see screen with glitched, primarly pink graphic and a lot of artifacts, after everything is correct) - only GT 710 in 1. and 3. slot (VM only on GPU in 3. slot) So on paper all GPU are compatible. What does not work: - RX 580 in 1. slot (black screen) I know that nvidia GPU in 1. slot or as single GPU require dumping vbios, but how does it work with AMD GPU as primary GPU (1. slot)? The point is not to waste 1. GPU slot for Unraid GPU and if possible avoid dumping vbios of nvidia card. Do you see the possibility of passing through GPU in all 4 slots, if yes what GPU setup do you recommend? Have anyone tried setting up AMD GPU as primary GPU? Thanks in advance.