Eksitus

I'm so glad I reached out for help on the forum because my current suspect was a faulty pendrive / Unraid system file corruption or even a faulty motherboard. However, it would all make sense, as the first time I built the system, it came with 2 boxes of 2 sticks of 16GB RAM, where each box had one stick not passing the Memtest. The servers were running with the working half as expected. After going through warranty, sticks that came from RMA passed Memtest, so I thought they are good to go, but turns out they might suffer from exactly the same issue, making only one stick from the box usable (which I assume ended up in server A) and the other one from the bundle currently wreaks havoc in server B. Lesson learned not to take Memtest for granted. Jonathan, your expertise in solving this issue was immensely valuable. Thank you for the lesson!

Hello! I am fairly experienced using Unraid, but this is by far the strangest issue I've encountered. I am dealing with a system that introduces corruption when dealing with larger files, even locally, both on array and cache. The system passed full MemTest with no issues (both at 3600 and 3200 MHz). I have 2 servers with the same motherboard / CPU / RAM combo. The systems were working well for a couple of months. Eventually, they started raising a lot of BTRFS corruption errors. I thought this was a result of using RAM XMP profile (I know, bad idea for a server, but I had no issues using XMP on any other server). I defaulted to RAM timings within spec (3200 MHz). When the BTRFS errors did not stop, I scrapped BTRFS altogether and reformatted them to XFS. On one server (A), this resolved any issues. On XFS, it runs two VMs with GPU passthrough and advanced USBIP setup for over a month now, with not a single error logged. Windows VMs are in perfect health, with no crashes or problematic system events. Also, the sha test described below results in correct sha (on server A), so I'd say this server is hopefully cleansed from any corruption issues. However, the other server (B), even running XFS cannot hold it together. When working with larger files (starting at around 1GB), it corrupts them on move / rsync / cp attempts. Even running sha256sum on the same file in a row can yield different result. Copying working VM images from another server to this one (A -> B) not only is not possible, because the image copied with rsync -avz does not arrive intact (sha does not match) but also after some time, not only Windows tools are not able to recover the state of the system, but it also crashes more every time it's run. I was able to detect the system on server B had the wrong sha for bzfirmware. As far as I know, this should be detected at boot, no idea why the system booted normally and did not even raise any log errors. This issue possibly goes back to before the update, as an old flash backup of this server has analogous corruption. Copying fresh bzfirmware to the pendrive did not resolve the issue. All bz* files have correct sha now. Also sometimes when using SMB the server throws Kernel issues, once lead to a complete crash. Showcase of the main problem: `Any other system` root@arch /h/e/builds# dd if=/dev/zero of=8gb_zeros.img bs=1M count=8192 8192+0 records in 8192+0 records out 8589934592 bytes (8.6 GB, 8.0 GiB) copied, 3.63427 s, 2.4 GB/s root@arch /h/e/builds# sha256sum 8gb_zeros.img ebfb4ef19ae410f190327b5ebd312711263bc7579970e87d9c1e2d84e06b3c25 8gb_zeros.img `Malfunctioning System (here, array but same issue is on cache)` root@LOG-B:/mnt/user/BACKUP_NEW# dd if=/dev/zero of=8gb_zeros.img bs=1M count=8192 8192+0 records in 8192+0 records out 8589934592 bytes (8.6 GB, 8.0 GiB) copied, 48.1192 s, 179 MB/s root@LOG-B:/mnt/user/BACKUP_NEW# cp 8gb_zeros.img cp8gb_zeros.img root@LOG-B:/mnt/user/BACKUP_NEW# sha256sum 8gb_zeros.img cp8gb_zeros.img 8gb_zeros.img cp8gb_zeros.img 8gb_zeros.img cp8gb_zeros.img 54bece301a2162431b067cd4360c803c53cecd7e63802f1bd302c2a80b3bc19d 8gb_zeros.img 54bece301a2162431b067cd4360c803c53cecd7e63802f1bd302c2a80b3bc19d cp8gb_zeros.img 3b4c8723c218d93bff840c79dfb3a089bf7c6b2a7592e9d77f49d86f6908730d 8gb_zeros.img b775253dc3222607e940a73333a270c4c4ef57b8d8c459d0fd349e40488c12b6 cp8gb_zeros.img 3b4c8723c218d93bff840c79dfb3a089bf7c6b2a7592e9d77f49d86f6908730d 8gb_zeros.img 8bab52d97e6e28f87b585469611e20624157a4ccea88b5d4e5fc534c209cef91 cp8gb_zeros.img `After reboot` root@LOG-B:/mnt/user/BACKUP_NEW# sha256sum 8gb_zeros.img cp8gb_zeros.img 8gb_zeros.img cp8gb_zeros.img 8gb_zeros.img cp8gb_zeros.img ebfb4ef19ae410f190327b5ebd312711263bc7579970e87d9c1e2d84e06b3c25 8gb_zeros.img <----- Correct SHA e4c55c999f5560bf706d8303c1464464327c7b186be8ba91c39df792d0fb5a00 cp8gb_zeros.img dfd0b073462375fa96bde6ec6b4faab121c9c1e232c1fca7bfd4965e27b05e5c 8gb_zeros.img <----- Gets corrupted ? 4cd75493b0dc36a262f8289ce658ef5c4d2508ddf8a66fe5edf4c85d56f5ef39 cp8gb_zeros.img ebfb4ef19ae410f190327b5ebd312711263bc7579970e87d9c1e2d84e06b3c25 8gb_zeros.img <----- Correct SHA again ? 4cd75493b0dc36a262f8289ce658ef5c4d2508ddf8a66fe5edf4c85d56f5ef39 cp8gb_zeros.img `For smaller file` root@LOG-B:/mnt/user/BACKUP_NEW# sha256sum 1gb_zeros.img 1gb_zeros.img 1gb_zeros.img 1gb_zeros.img 1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img root@LOG-B:/mnt/user/BACKUP_NEW# cp 1gb_zeros.img cp1gb_zeros.img root@LOG-B:/mnt/user/BACKUP_NEW# sha256sum 1gb_zeros.img cp1gb_zeros.img 1gb_zeros.img cp1gb_zeros.img 1gb_zeros.img cp1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 cp1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img e7b2f8cc13543b56922a628630683babb3726f0f0b6b4f9b5a36be451ada27a0 cp1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img e7b2f8cc13543b56922a628630683babb3726f0f0b6b4f9b5a36be451ada27a0 cp1gb_zeros.img root@LOG-B:/mnt/user/BACKUP_NEW# sha256sum 1gb_zeros.img cp1gb_zeros.img 1gb_zeros.img cp1gb_zeros.img 1gb_zeros.img cp1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img e7b2f8cc13543b56922a628630683babb3726f0f0b6b4f9b5a36be451ada27a0 cp1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img e7b2f8cc13543b56922a628630683babb3726f0f0b6b4f9b5a36be451ada27a0 cp1gb_zeros.img 49bc20df15e412a64472421e13fe86ff1c5165e18b2afccf160d4dc19fe68a14 1gb_zeros.img e7b2f8cc13543b56922a628630683babb3726f0f0b6b4f9b5a36be451ada27a0 cp1gb_zeros.img Given this behavior, I'm no longer sure whether the server A had any corruption issues in the first place, or was it a result of moving corrupted flies from server B during backups / VM migrations. I still have some ideas on how to troubleshoot it, but I'm afraid soon I'll run out of ideas, and the stress levels from dealing with this issue will be too high. I attach diagnostics for the perfectly working server (A) and the corruption-infested one (B). Their configuration is very similar, B has 3 extra HDD drives and A has one different GPU. I attach a current Syslog. I also have a Syslog since January, would it be safe to post it here publicly, or could it have any private information? I'd appreciate any help or hints in diagnosing the issue. log-b-diagnostics-20230814-2028.zip log-b-syslog-20230814-1827.zip log-a-diagnostics-20230814-2008.zip

update: changing <gic version='2'/> to <gic version='3'/> allows to have more than 8 threads

I doubt it was running through virsh at all, as far as I'm aware just using qemu, running the command from the post does not list it using "virsh list" and vm kills itself after closing the console. However, after a lot of trial and error, I managed to create a very rough XML template, that suprisingly works! (still, I did not even test VNC) At least now it's possible it use the VM headless as a normal unraid VM. I hope someone can upgrade it and post the result, I expect there is huge room for improvement and it'd be nice to learn from more professional version. Make sure to update any file locations & UUID accordingly if you want to use it. <?xml version='1.0' encoding='UTF-8'?> <domain type='qemu'> <name>deb_aarch64</name> <uuid>UUID</uuid> <memory unit='KiB'>1048576</memory> <currentMemory unit='KiB'>1048576</currentMemory> <vcpu placement='static'>2</vcpu> <os> <type arch='aarch64' machine='virt-6.2'>hvm</type> <kernel>/mnt/user/isos/arm/vmlinuz-4.9.0-19-arm64</kernel> <initrd>/mnt/user/isos/arm/initrd.img-4.9.0-19-arm64</initrd> <cmdline>root=/dev/vda2</cmdline> <boot dev='hd'/> </os> <features> <gic version='2'/> </features> <cpu mode='custom' match='exact' check='none'> <model fallback='forbid'>cortex-a72</model> <topology sockets='1' dies='1' cores='2' threads='1'/> </cpu> <clock offset='utc'/> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>destroy</on_crash> <devices> <emulator>/usr/bin/qemu-system-aarch64</emulator> <disk type='file' device='disk'> <driver name='qemu' type='qcow2'/> <source file='/mnt/user/isos/arm/hda.qcow2'/> <backingStore/> <target dev='vda' bus='virtio'/> <address type='pci' domain='0x0000' bus='0x03' slot='0x00' function='0x0'/> </disk> <controller type='pci' index='0' model='pcie-root'/> <controller type='pci' index='1' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='1' port='0x8'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0' multifunction='on'/> </controller> <controller type='pci' index='2' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='2' port='0x9'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <controller type='pci' index='3' model='pcie-root-port'> <model name='pcie-root-port'/> <target chassis='3' port='0xa'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> </controller> <controller type='pci' index='4' model='pcie-to-pci-bridge'> <model name='pcie-pci-bridge'/> <address type='pci' domain='0x0000' bus='0x02' slot='0x00' function='0x0'/> </controller> <interface type='bridge'> <mac address='52:54:00:95:98:31'/> <source bridge='br0'/> <model type='virtio-net'/> <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/> </interface> <audio id='1' type='none'/> </devices> </domain>

https://translatedcode.wordpress.com/2017/07/24/installing-debian-on-qemus-64-bit-arm-virt-board/ I followed this tutorial and was able to get aarch64 VM running pretty well. (I needed second linux to extract files from disk image since unraid does not have the required tool) Issues: - Not sure how to best convert the quemu arguments to xml file for libvirt - I only need to access VM via command line, so I did not even try to get VNC to work Otherwise the VM runs pretty stable and so far faster than I expected, I did not run along any issue during the installation but it took couple hours for the system to install. Good luck to anyone who wants to try!

Image of the same issue from the internet: So there is some UAC issue with RDP connection where if I connect via RDP to non-admin user I cannot raise the elevation above the credentials I use for RDP. At least I think that's what raises this issue.

I completely agree with going with RDP if it hadn't been for an edge case when user without administrative privileges needs elevation. RDP just does not allow to do anything in this case without physical access to keyboard.

Did anyone manage to successfully convert OVMF VM image to SeaBios? I'm talking about a solution with preserving the previous OS (Windows 10), without clean installation. I tried to convert the drive from GPT to MBR, but it resulted in "Booting from Hard Disk ..." or when I hard-copied the C drive from OVMF image to SeaBios image I managed to boot into windows recovery but diskpart shows no disks. For curious people: I want to convert them because OVMF VNC does not support high resolution when running in parallel to GPU passthrough (at least I couldn't get it to work no matter what I tried) and SeaBios has no such issues. I have 6 VMs that I want to convert, and a clean installation is not an option because they were used for some time already, and it would take ages to go back to this stage. I'd appreciate any clues that might help!

From my experience with this plugin, even if you don't use it for USB/IP it can act as an extension of unassigned devices (UD) plugin where you can hotplug (attach/detach) USB devices on running VMs, yet UD has limitation where it cannot handle devices with the same name. However, this plugin distinguishes the devices by their bus/id allocation and can hotplug them even when they share the same name or manufacturer info. If I'm mistaken I hope someone can correct me since I don't have an Unraid machine nearby to back up my claims, but I'm fairly confident it will solve your problem at least when it comes to hotplugging the devices (attaching them to VM after it started).

I'm asking about the scenario where USB stick or other high bandwidth devices are plugged in and exported/bound elsewhere in the local network and then attached to unraid/VMs using USB/IP protocol.

Did anyone test the speed/throughput that is achievable with devices such as USB sticks / drives? So far I can't get it to run with decent speeds (I got 500KBps at best for average and problematic delay at the beginning of the transfer). I'm using Unraid and a laptop under gigabit switch in local network. Is it a problem in my config or is this performance to be expected from this protocol?

Hello! I'm thinking about implementing a server for 6 VM stations in my company, with an option to expand it by 1-2 stations down the line. However, every VM needs to have a separate USB controller since when last time I implemented a server with 3 VMs with one controller it turned out to be very problematic long term. Does there exist a (reasonably priced) Unraid compatible server motherboard that can support min. of 6 but preferably 8 GPUs (one per VM) and still leave an option to somehow assign a separate USB controller to each VM? What PCIe card/combination would allow for expanding the number of controllers or would resolve the problem in another way, and would take as few PCIe slots as possible? Maybe there exists a server solution you know of (EU based) that custom builds servers fitting these requirements? I'd be thankful for any solutions or leads to follow in my research!

All utility of such VM aside (yes, there is basically none), I thought it would be an interesting challenge to try and run deck's SteamOS since the real deal will be unobtainable for quite some time. I found a link to the recovery tool with an img file( Steam deck recovery image ), yet I had no luck booting from img and converting it to iso, qcow2, and vmdk for vmware workstation gave similar results. My best attempt resulted in infinite "Booting from Hard Disk..." using SeaBIOS, but it might have just been restricted by my limited KVM experience. So my question to the more KVM advanced friends, do you think it's possible to somehow sideload it into unraid? Did steam use some protection against such attempts or is it just completely incompatible? Let me know what do you think!

Speaking about security... every device connected via ethernet cable has assigned a PUBLIC IP!!! for some unknown reason! Good thing I found about it quickly and took measures not to expose my unraid shares to global internet! I'm aware and don't even have a need to do that since I get every software license I need using my .edu email I mean so far it's really great (what a waste would it be not to use it for unraid...) And for some reason when I asked them about using internet router... """ Q: Hi, There is the information that "Personal routers are not allowed in residence halls" but I think I've read somewhere that they were permitted as long as their wifi was turned off. Would it be possible to use the router with all the wireless functionality turned off (I have router that has this option) like a "smart" internet switch? Or is it something that is not permitted from now on? """ A: Unfortunately, personal routers are not allowed in residence halls in any capacity. If you have any further questions, feel free to reply. """ Which makes completely no sense since how am I going to protect my devices against access from public without the router in between?! Should I manually block every port possible? I'd like to ask somebody in charge for the reasoning behind this I can either ask support that knows how to solve only basic problems or make a risk writing more emails just to get an answer "sorry, we can help you" and risk being tracked as potential risk to their network (that I think couldn't be more dangerous than giving everyone open public ip and risking having their files stolen or computers broken into...). I'd just like to set uo my router, open one and only port for wireguard and make windows and linux vms to connect to via rdp on android tablet (lightweight, great battery) when I'm outside the dorm which I find to be way more secure than the forced public ip I have assigned to my server now. Unless I miss some details or lack knowledge in which case please correct me... Maybe it can be done without router with pfsense to treat the server as the router? (but I don't know much about it yet, just heard this name in similar discussions) Anyway, thanks for your responses so far! Please let me know what do you think about this public IP situation, is it as crazy as I think or do I overreact?

Hi! I'm currently living in an university dorm with great (almost gigabit) wired internet connection. However they have it configured so that only one device is allowed to connect to internet per single connection (at least that is my hypothesis). I tried splitting this connection with network switch to my laptop and unRAID server and only one was connected to the internet at once. The biggest problem is the usage of virtual machines, because they can't access the internet (probably because they ask for separate IP). So without the internet I can't even access them via RDP/parsec and the lack of internet makes them kind of useless. Do you know what can I do in this situation? Or what information / logs do I need to give to you to be able to receive help? Do you think buying internet router would resolve this issue? (And what are your recommendations for budget-friendly one because I can't find my brand of choice - Fritz! after moving to US)