war4peace

Thank you, it took this much time for my issue to resurface, and it turns out it was not the lsof thing all along. Or... maybe it also was, but in combination with other things. I found this topic referring exactly to my problem, but of course it sat unanswered. Sigh...

Apologies for the necro... have you ever figured out what is causing this? My server started doing this as well. It starts about 11 days after a reboot. While this was happening, I managed to turn off the docker service as well as the sole VM I had (Home Assistant), but the "lsof" command spam continued. The server never crashes, but becomes sluggish, uses a lot of power (CPU almost maxed out) and continues like that indefinitely. HDD usage is also almost maxed out. Rebooting the server fixes it... until it starts happening again. Currently using Unraid 7.0.0.

I think I know what has been causing this, but I am not 100% sure. Back when I added those HDDs, I used Unbalanced plugin several times to consolidate data, and I think there were some errors when gathering data from other HDDs to the ZFS ones, which resulted in unbalanced not deleting the source properly, which, in turn, left many files and folders „duplicated” across HDDs. Naturally, in the share itself, those appear only once, but when deleting them, they „pop back in” once more, since only one of the „mirrored” files was deleted. I'll now have to figure out a way to find all duplicates across disks, rather than shares, and delete the ones outside Disk3 and Disk6. Once that's done, I'll update here.

It's happening using Krusader as well, which is docker local to Unraid. I managed to narrow it down to file deletions only, which means it's not necessarily a "file move" issue, it's a "file deletion" issue. I wasn't expecting anything to be logged because there are no errors. The file move process finishes as expected, basically the file system, for lack of better wording, "lies" to the copy/move/delete solution (whichever that is) that the file deletion was successful, where, in fact, it was not. This is actually the weird part of it. The files are both larger (up to 4 GB) and smaller (as small as several MB), and the issue does not consistently favor any size range. But I will try mc locally, check whether the issue persists there as well.

Done. Diagnostics attached, generated right after the first occurrence of failed file deletions during a move, after system reboot. tower-diagnostics-20241227-1926.zip

That wasn't the cause. I just moved 29 files from one directory, and 21 remained untouched, despite the expectation they would have been deleted.

Tautulli docker. LE: I stopped it, I am not using it much anyway. I believe it might be spamming the log because it tries to read changes to FS, and I am currently in the process of moving 300+ GB from my main PC to the server. But now it's off.

I have two HDDs formatted as ZFS in my array. Reason: to take advantage of file compression, because I have a large collection of files which do benefit from 1.25:1 to 1.3:1 compression. There is one share using those two disks only, on which this collection of data resides While cleaning up this large collection of files and folders, I move a lot of things around from the server to my main PC, clean them up (extract files from archives, rename directories and so on), via a 10g LAN connection. Nothing new, I have done that before successfully. The share works, everything is fine, except for one annoying issue. More often than not, moving files does NOT delete the original files from the share. For example, I have a folder with, say, 50 files. I access it remotely, via Total Commander, I select them, press F6 to move them all to my PC. Once the process ends, the source still contains, say, 41 files. I select them, try to delete them, 26 files remain. Repeat, now there's 12 files left. Maybe a final pass will sometimes get rid of them all, sometimes there's still a couple files remaining. The destination folder contains all moved files, but the source does not empty. Rarely, it does, but that's more of an exception than a rule. Troubleshooting: I checked whether this behavior can be replicated for other disks (XFS, btrfs😞 it cannot. This is specific to ZFS only. I have bought more RAM, thinking maybe the ARC cache was too small. I am now up from 32 GB to 128 GB RAM, and an ARC cache of 64 GB RAM. Issue persists. I tried using other file managers: TeraCopy (issue persists), Krusader docker on Unraid (issue persists, even when moving files using two steps: copy, then delete) Interestingly, I tried a couple small batches of file moving using Unraid's Terminal, and the issue did not appear there, but it might have been a fluke. This issue has always occurred, since day 1 of using ZFS. This is particularly annoying, because everything else works perfectly, and I have started to second-guess any file operation I perform on ZFS drives: "Are the files truly gone? Do I have duplicates? Have I moved all archives to my main PC?" Diagnostics are attached. Thank you! tower-diagnostics-20241226-2051.zip

Hello, I apologize in advance if I missed something obvious. I just installed my first game server for Unraid (V Rising). Installation went smoothly, checking the container log shows nothing out of the ordinary. Yet I am unable to connect to the game locally (via LAN), getting „No response from remote host” in the game client. Both client and server are on the same subnet, with no firewalling issues between them. I checked for port conflict, ports 9876-9877 are good, no conflicting ports. And I am not sure how to troubleshoot any further. Some pointers would be greatly appreciated! EDIT: I managed to connect after I unchecked „LAN Server” checkmark in the client. Which is strange, because the server and the client are on the same LAN. Oh well... at least it works.

Any chance for a response to my October 2023 post, above?

I don't think this topic is monitored.

Hello, I would very much appreciate if you could help a newbie around queue processing for Avidemux. I have it installed on my Unraid, in a docker, and I have quite a few videos (camera surveillance footage) which I need to cut parts and save them separately for a montage. Just family stuff, with family members coming and going when they visit us. I want to go through a few hundred of those footage files, execute the cut for each and add to queue processing. I am able to add a cut to a job, now Avidemux is asking me for a job name and output file. After filling that form, I assume the job is added to some list somewhere. Opening the docker container's command line from Unraid, I managed to find "/usr/bin/avidemux3_jobs_qt5", when running, the docker application shows an "Avidemux jobs" window and the CLI shows the following output: /usr/bin # ./avidemux3_jobs_qt5 Directory /root/.avidemux6/ exists.Good. Using /root/.avidemux6/ as base directory for prefs, jobs, etc. ************************* Avidemux Jobs v2.8.1 ************************* http://www.avidemux.org Code : Mean, JSC, Gruntster GFX : Nestor Di , [email protected] Design : Jakub Misak FreeBSD : Anish Mistry, [email protected] Audio : Mihail Zenkov MacOsX : Kuisathaverat Win32 : Gruntster Compiler: GCC Alpine Clang 13.0.1 Build Target: Linux (x86-64) [jobInit] 21:14:57-696 Initializing database (/root/.avidemux6/jobs.sql) [ADM_jobCheckVersion] 21:14:57-697 Db version 3, our version 3 [ADM_jobCheckVersion] 21:14:57-697 Same version, continuing.. [jobInit] 21:14:57-697 Successfully connected to jobs database.. QStandardPaths: runtime directory '/tmp/run/user/app' is not owned by UID 0, but a directory permissions 0700 owned by UID 99 GID 100 [loadTranslator] 21:14:57-708 Using system language [loadTranslator] 21:14:57-708 Initializing language en_US [loadTranslator] 21:14:57-708 Translation folder is </usr/share/avidemux6/qt5/i18n/> [loadTranslation] 21:14:57-708 [Locale] Loading language file /usr/share/avidemux6/qt5/i18n/qtbase_en_US [loadTranslation] 21:14:57-708 FAILED [loadTranslation] 21:14:57-708 [Locale] Loading language file /usr/share/avidemux6/qt5/i18n/avidemux_en_US [loadTranslation] 21:14:57-708 succeeded [loadTranslator] 21:14:57-708 Updating translations... [loadTranslator] 21:14:57-708 [Locale] Test: &Edit -> &Edit [createBindAndAccept] 21:14:57-741 Binding on 127.0.0.1:0 [createBindAndAccept] 21:14:57-741 Socket bound to port 45445 [jobWindow] 21:14:57-741 Socket bound to 45445 [refreshList] 21:14:57-741 Found 0 jobs The job list window is empty, though. ...And this is where I am not sure how to continue any more. Any help would be greatly appreciated! Thank you!

I had more luck on Facebook. Thanks.

Hello everyone, I have started planning for a large upgrade to my existing Unraid server. Current specs: Unraid Pro on X570 motherboard, Ryzen 2400g, 2x nVME SSDs in RAID0 as fast cache, 2x SATA SSDs in RAID1, cache for VMs and docker, and a hodge-podge of various sized HDDs (6x pieces) ranging from 4 TB to 18 TB. One parity drive. Add-ons: 10g NIC and a LSI HBA which supports 8x HDDs. All in a tower case. Starting with my budget: up to €5000, but could go maybe 10% more if there's a good reason for it. Reason to upgrade: I am currently rebuilding my whole network, putting everything in a tall 19" rack, and current server's hardware specs don't allow for much expansion. Drive setup will certainly expand as time goes by, I only want to buy 18+ TB drives to maximize data density. Longer term goal is to have at least 1 PB of space within the next 3 years. Therefore, I want to have a good server infrastructure (mobo, CPU(s), RAM, HBA cards) in place before I start expanding space. I saw quite a few options for EPYC CPUs on Ebay, and I plan to buy from there. After looking long and hard at various options, I admit I'm a bit lost (too many things to choose from, I'm afraid), therefore I'd much appreciate some piece of advice. Starting with the HBA card(s?): I saw this as a good option, but open to others if they are better: LSI SAS 9300-16I 12GB/S HBA BUS ADAPTER CARD IT Mode 4*SFF-8643 SATA Cable Motherboard/CPU/RAM combo: Now, this is where it becomes complicated. I need 10g LAN for sure, but before that, I need to figure out which of these two options is preferrable: Single-CPU or dual-CPU. I'd rather splurge on a future-proof build, rather than beat myself up two years from now for not going the right route, so here are two options: 1. Single-CPU board: Supermicro MBD-H12SSL-CT-O Socket SP3/ Single AMD EPYC 7002/ DDR4/ ATX Server MB. 2. Dual-CPU board: Supermicro H12DSi-NT6 CPUs: EPYC 7742 (for single-CPU board) or EPYC 7642 (for Dual-CPU board) RAM: since I don't need enormous RAM speed for VMs or other things I plan to do (ZFS comes to mind), 2133 MHz DDR4 ECC would suffice. Quantity over speed is what I am looking for. Example: Samsung 64GB (1x64GB) DDR4 Registered ECC PC4-19200 2400Mhz (16x for dual-CPU, 8x for single-CPU). Now, the big question is: would there be a net advantage of dual-CPU versus single-CPU? I'd like to know your opinions on this. Moving on: For fastcache (temporary files), I'd still use 2x nVME drives, but I am not sure RAID0 would bring any advantage, might want to go for RAID1 as well. 2x2TB drives is my goal. As for docker cache pool, SATA SSDs should suffice. One more thing I am considering, since there will be plenty PCI Express lanes available, is to buy a PCI-E card which holds 4x nVME drives later on and use those for VMs exclusively. Case: this is where I am truly lost. Having everything in one case is more compact, but... not sure if it's a good idea. I saw this case (IPC 4F28 MINING-RACK) which is not expensive, and holds a ton of HDDs, but would it fit the whole build? if not, I am looking for a combo (one dedicated drive case and one system case, both rackable), open to suggestions because I frankly have nothing in mind in that case. Add-ons: I have a pair of watercooled (from factory) GTX 1080 Ti GPUs which I plan to put in the build, for real-time transcoding of my surveillance cameras streams (6x 4K + 2x 1440p), as well as Tdarr whenever applicable. I will repurpose the existing 10g NIC, so that'll not be used any more. Power delivery and UPS: I have a brand new Cyberpower OLS2000ERT2U which can, if needed, be beefed up with a BPSE72V45ART2U battery pack. However, I am not sure whether I'll need server-grade PSUs or not. Advice is greatly appreciated! Cooling and noise: My current plan is to watercool both CPU(s) and GPUs using a MoRa 420 with dual-pump, and for all other hardware (HDDs and whatnot), I already own several Noctua Industrial 3000 RPM fans (120mm). Noise is of no importance, everything sits in my garage in a technical area, nobody leaves there except the odd spider which makes its way in. I am pretty sure they will not complain. Well... it's quite the topic, now that I am looking back at it. Hopefully there's enough information for some informed advice from the experts here. Thank you all in advance for your replies, looking forward to read some awesome responses!

"Internationalization" - I assume it's voluntary work, by whoever feels the urge?