war4peace

Thank you, it took this much time for my issue to resurface, and it turns out it was not the lsof thing all along. Or... maybe it also was, but in combination with other things. I found this topic referring exactly to my problem, but of course it sat unanswered. Sigh...

Apologies for the necro... have you ever figured out what is causing this? My server started doing this as well. It starts about 11 days after a reboot. While this was happening, I managed to turn off the docker service as well as the sole VM I had (Home Assistant), but the "lsof" command spam continued. The server never crashes, but becomes sluggish, uses a lot of power (CPU almost maxed out) and continues like that indefinitely. HDD usage is also almost maxed out. Rebooting the server fixes it... until it starts happening again. Currently using Unraid 7.0.0.

I think I know what has been causing this, but I am not 100% sure. Back when I added those HDDs, I used Unbalanced plugin several times to consolidate data, and I think there were some errors when gathering data from other HDDs to the ZFS ones, which resulted in unbalanced not deleting the source properly, which, in turn, left many files and folders „duplicated” across HDDs. Naturally, in the share itself, those appear only once, but when deleting them, they „pop back in” once more, since only one of the „mirrored” files was deleted. I'll now have to figure out a way to find all duplicates across disks, rather than shares, and delete the ones outside Disk3 and Disk6. Once that's done, I'll update here.

It's happening using Krusader as well, which is docker local to Unraid. I managed to narrow it down to file deletions only, which means it's not necessarily a "file move" issue, it's a "file deletion" issue. I wasn't expecting anything to be logged because there are no errors. The file move process finishes as expected, basically the file system, for lack of better wording, "lies" to the copy/move/delete solution (whichever that is) that the file deletion was successful, where, in fact, it was not. This is actually the weird part of it. The files are both larger (up to 4 GB) and smaller (as small as several MB), and the issue does not consistently favor any size range. But I will try mc locally, check whether the issue persists there as well.

Done. Diagnostics attached, generated right after the first occurrence of failed file deletions during a move, after system reboot. tower-diagnostics-20241227-1926.zip

That wasn't the cause. I just moved 29 files from one directory, and 21 remained untouched, despite the expectation they would have been deleted.

Tautulli docker. LE: I stopped it, I am not using it much anyway. I believe it might be spamming the log because it tries to read changes to FS, and I am currently in the process of moving 300+ GB from my main PC to the server. But now it's off.

I have two HDDs formatted as ZFS in my array. Reason: to take advantage of file compression, because I have a large collection of files which do benefit from 1.25:1 to 1.3:1 compression. There is one share using those two disks only, on which this collection of data resides While cleaning up this large collection of files and folders, I move a lot of things around from the server to my main PC, clean them up (extract files from archives, rename directories and so on), via a 10g LAN connection. Nothing new, I have done that before successfully. The share works, everything is fine, except for one annoying issue. More often than not, moving files does NOT delete the original files from the share. For example, I have a folder with, say, 50 files. I access it remotely, via Total Commander, I select them, press F6 to move them all to my PC. Once the process ends, the source still contains, say, 41 files. I select them, try to delete them, 26 files remain. Repeat, now there's 12 files left. Maybe a final pass will sometimes get rid of them all, sometimes there's still a couple files remaining. The destination folder contains all moved files, but the source does not empty. Rarely, it does, but that's more of an exception than a rule. Troubleshooting: I checked whether this behavior can be replicated for other disks (XFS, btrfs😞 it cannot. This is specific to ZFS only. I have bought more RAM, thinking maybe the ARC cache was too small. I am now up from 32 GB to 128 GB RAM, and an ARC cache of 64 GB RAM. Issue persists. I tried using other file managers: TeraCopy (issue persists), Krusader docker on Unraid (issue persists, even when moving files using two steps: copy, then delete) Interestingly, I tried a couple small batches of file moving using Unraid's Terminal, and the issue did not appear there, but it might have been a fluke. This issue has always occurred, since day 1 of using ZFS. This is particularly annoying, because everything else works perfectly, and I have started to second-guess any file operation I perform on ZFS drives: "Are the files truly gone? Do I have duplicates? Have I moved all archives to my main PC?" Diagnostics are attached. Thank you! tower-diagnostics-20241226-2051.zip

Hello, I apologize in advance if I missed something obvious. I just installed my first game server for Unraid (V Rising). Installation went smoothly, checking the container log shows nothing out of the ordinary. Yet I am unable to connect to the game locally (via LAN), getting „No response from remote host” in the game client. Both client and server are on the same subnet, with no firewalling issues between them. I checked for port conflict, ports 9876-9877 are good, no conflicting ports. And I am not sure how to troubleshoot any further. Some pointers would be greatly appreciated! EDIT: I managed to connect after I unchecked „LAN Server” checkmark in the client. Which is strange, because the server and the client are on the same LAN. Oh well... at least it works.

Any chance for a response to my October 2023 post, above?

I don't think this topic is monitored.

Hello, I would very much appreciate if you could help a newbie around queue processing for Avidemux. I have it installed on my Unraid, in a docker, and I have quite a few videos (camera surveillance footage) which I need to cut parts and save them separately for a montage. Just family stuff, with family members coming and going when they visit us. I want to go through a few hundred of those footage files, execute the cut for each and add to queue processing. I am able to add a cut to a job, now Avidemux is asking me for a job name and output file. After filling that form, I assume the job is added to some list somewhere. Opening the docker container's command line from Unraid, I managed to find "/usr/bin/avidemux3_jobs_qt5", when running, the docker application shows an "Avidemux jobs" window and the CLI shows the following output: /usr/bin # ./avidemux3_jobs_qt5 Directory /root/.avidemux6/ exists.Good. Using /root/.avidemux6/ as base directory for prefs, jobs, etc. ************************* Avidemux Jobs v2.8.1 ************************* http://www.avidemux.org Code : Mean, JSC, Gruntster GFX : Nestor Di , [email protected] Design : Jakub Misak FreeBSD : Anish Mistry, [email protected] Audio : Mihail Zenkov MacOsX : Kuisathaverat Win32 : Gruntster Compiler: GCC Alpine Clang 13.0.1 Build Target: Linux (x86-64) [jobInit] 21:14:57-696 Initializing database (/root/.avidemux6/jobs.sql) [ADM_jobCheckVersion] 21:14:57-697 Db version 3, our version 3 [ADM_jobCheckVersion] 21:14:57-697 Same version, continuing.. [jobInit] 21:14:57-697 Successfully connected to jobs database.. QStandardPaths: runtime directory '/tmp/run/user/app' is not owned by UID 0, but a directory permissions 0700 owned by UID 99 GID 100 [loadTranslator] 21:14:57-708 Using system language [loadTranslator] 21:14:57-708 Initializing language en_US [loadTranslator] 21:14:57-708 Translation folder is </usr/share/avidemux6/qt5/i18n/> [loadTranslation] 21:14:57-708 [Locale] Loading language file /usr/share/avidemux6/qt5/i18n/qtbase_en_US [loadTranslation] 21:14:57-708 FAILED [loadTranslation] 21:14:57-708 [Locale] Loading language file /usr/share/avidemux6/qt5/i18n/avidemux_en_US [loadTranslation] 21:14:57-708 succeeded [loadTranslator] 21:14:57-708 Updating translations... [loadTranslator] 21:14:57-708 [Locale] Test: &Edit -> &Edit [createBindAndAccept] 21:14:57-741 Binding on 127.0.0.1:0 [createBindAndAccept] 21:14:57-741 Socket bound to port 45445 [jobWindow] 21:14:57-741 Socket bound to 45445 [refreshList] 21:14:57-741 Found 0 jobs The job list window is empty, though. ...And this is where I am not sure how to continue any more. Any help would be greatly appreciated! Thank you!

I had more luck on Facebook. Thanks.

Hello everyone, I have started planning for a large upgrade to my existing Unraid server. Current specs: Unraid Pro on X570 motherboard, Ryzen 2400g, 2x nVME SSDs in RAID0 as fast cache, 2x SATA SSDs in RAID1, cache for VMs and docker, and a hodge-podge of various sized HDDs (6x pieces) ranging from 4 TB to 18 TB. One parity drive. Add-ons: 10g NIC and a LSI HBA which supports 8x HDDs. All in a tower case. Starting with my budget: up to €5000, but could go maybe 10% more if there's a good reason for it. Reason to upgrade: I am currently rebuilding my whole network, putting everything in a tall 19" rack, and current server's hardware specs don't allow for much expansion. Drive setup will certainly expand as time goes by, I only want to buy 18+ TB drives to maximize data density. Longer term goal is to have at least 1 PB of space within the next 3 years. Therefore, I want to have a good server infrastructure (mobo, CPU(s), RAM, HBA cards) in place before I start expanding space. I saw quite a few options for EPYC CPUs on Ebay, and I plan to buy from there. After looking long and hard at various options, I admit I'm a bit lost (too many things to choose from, I'm afraid), therefore I'd much appreciate some piece of advice. Starting with the HBA card(s?): I saw this as a good option, but open to others if they are better: LSI SAS 9300-16I 12GB/S HBA BUS ADAPTER CARD IT Mode 4*SFF-8643 SATA Cable Motherboard/CPU/RAM combo: Now, this is where it becomes complicated. I need 10g LAN for sure, but before that, I need to figure out which of these two options is preferrable: Single-CPU or dual-CPU. I'd rather splurge on a future-proof build, rather than beat myself up two years from now for not going the right route, so here are two options: 1. Single-CPU board: Supermicro MBD-H12SSL-CT-O Socket SP3/ Single AMD EPYC 7002/ DDR4/ ATX Server MB. 2. Dual-CPU board: Supermicro H12DSi-NT6 CPUs: EPYC 7742 (for single-CPU board) or EPYC 7642 (for Dual-CPU board) RAM: since I don't need enormous RAM speed for VMs or other things I plan to do (ZFS comes to mind), 2133 MHz DDR4 ECC would suffice. Quantity over speed is what I am looking for. Example: Samsung 64GB (1x64GB) DDR4 Registered ECC PC4-19200 2400Mhz (16x for dual-CPU, 8x for single-CPU). Now, the big question is: would there be a net advantage of dual-CPU versus single-CPU? I'd like to know your opinions on this. Moving on: For fastcache (temporary files), I'd still use 2x nVME drives, but I am not sure RAID0 would bring any advantage, might want to go for RAID1 as well. 2x2TB drives is my goal. As for docker cache pool, SATA SSDs should suffice. One more thing I am considering, since there will be plenty PCI Express lanes available, is to buy a PCI-E card which holds 4x nVME drives later on and use those for VMs exclusively. Case: this is where I am truly lost. Having everything in one case is more compact, but... not sure if it's a good idea. I saw this case (IPC 4F28 MINING-RACK) which is not expensive, and holds a ton of HDDs, but would it fit the whole build? if not, I am looking for a combo (one dedicated drive case and one system case, both rackable), open to suggestions because I frankly have nothing in mind in that case. Add-ons: I have a pair of watercooled (from factory) GTX 1080 Ti GPUs which I plan to put in the build, for real-time transcoding of my surveillance cameras streams (6x 4K + 2x 1440p), as well as Tdarr whenever applicable. I will repurpose the existing 10g NIC, so that'll not be used any more. Power delivery and UPS: I have a brand new Cyberpower OLS2000ERT2U which can, if needed, be beefed up with a BPSE72V45ART2U battery pack. However, I am not sure whether I'll need server-grade PSUs or not. Advice is greatly appreciated! Cooling and noise: My current plan is to watercool both CPU(s) and GPUs using a MoRa 420 with dual-pump, and for all other hardware (HDDs and whatnot), I already own several Noctua Industrial 3000 RPM fans (120mm). Noise is of no importance, everything sits in my garage in a technical area, nobody leaves there except the odd spider which makes its way in. I am pretty sure they will not complain. Well... it's quite the topic, now that I am looking back at it. Hopefully there's enough information for some informed advice from the experts here. Thank you all in advance for your replies, looking forward to read some awesome responses!

"Internationalization" - I assume it's voluntary work, by whoever feels the urge?

Hello, After reading through most of this topic, I wasn't able to find a way to add/install one of the utilities which would generate an image from a STL file. Now, before I come across as a needy person, I have done my research and attempted to self-service my issue, but alas, I am not that smart. One command line tool is this: https://github.com/unlimitedbacon/stl-thumb And the other is this: https://github.com/aslze/minirender Any would suit my needs. The reason to ask is, I have a large collection of STL files which I would like to generate thumbnail images for. I can create scripts which use the command line tools, but I haven't found a way to compile and use them under Unraid. I also should mention I do have a way to generate thumbnails using a script and a different tool from my remote Windows machine, but that means I need to read each STL over wireless and generate a thumbnail. Some of those files are BIG (up to 1 GB each) and it takes an enormous amount of time. Generating images locally would be preferrable. So... if it's not that big of a hassle, could you please add any of those tools to NerdTools? Thank you in advance!

I am trying to use the script to zero out Disck #6 from my array. Followed all instructions, emptied the drive using Unbalance, drive is now empty. I created a folder called 'clear-me', exactly as specified. Running the script yields the following: root@Tower:/boot/config/cleardrive# sh clear_array_drive *** Clear an unRAID array data drive *** v1.4 Checked 6 drives, did not find an empty drive ready and marked for clearing! To use this script, the drive must be completely empty first, no files or folders left on it. Then a single folder should be created on it with the name 'clear-me', exactly 8 characters, 7 lowercase and 1 hyphen. This script is only for clearing unRAID data drives, in preparation for removing them from the array. It does not add a Preclear signature. Could it be the way I created the folder? I used this command from Terminal: cd /mnt/disk6/ mkdir clear-me The disk is empty and freshly formatted, with just that folder on it. root@Tower:/boot/config/cleardrive# du /mnt/disk6 0 /mnt/disk6/clear-me 16 /mnt/disk6 Any idea why the script dislikes the disk/folder?

Anyone who could point me to the right direction?

Hello everyone, This issue puzzles me, and I can't figure out why it's happening. A few days ago, I installed a 10g network card in my Unraid server. The card was detected and used with no problem, but some (not all!) docker apps stopped working for some reason, with no obvious message as to why. Some examples: Shinobi Pro: Worked flawlessly for a year or so, no errors, after changing the network card, all monitors were shown as "not started". I exported all monitor settings, installed another Shinobi Pro docker from another repo, reimported the monitors and they worked fine. Grafana-Unraid-Stack: worked flawlessly before I changed network card, now it crashes when starting, all dashboards show no data, docker log below: * Starting Grafana Server ...fail! [info] All done [error] influxdb crashed! [info] loki PID: 60 [info] Skip hddtemp due to USE_HDDTEMP set to no [error] telegraf crashed! [info] promtail PID: 75 [error] grafana crashed! Reinstalling the container didn't change anything. Many other docker apps work perfectly after network card addition. The previous NIC (motherboard integrated) is disabled. Any idea what might have caused these docker apps to misbehave, and how to fix GUS issue? Thank you!

Thank you! I plan on getting the same motherboard, but the AMD EPYC 7402P, the SuperMicro CSE-836BE1C-R1K03B case, and I was unsure about RAM

Could you please tell me which memory have you chosen for this server?

Makes sense. I had been incorrectly assuming /home has a flash drive counterpart. I'll move the files to another location then. Problem solved Thank you!

Hello community, I have Unraid 6.9, working great with absolutely no issue... except for one. Every time the machine restarts or shuts down, all the data from /home (under root) disappears completely. I have created a couple scripts with the User Scripts plugin, they use a bash script called "discord-notify" and ffmpeg static build which are both saved in /home folder. A few weeks ago I shut down the server to physically move it from one location to another. Upon boot, everything from the /home folder was gone. Vanished without a trace. I didn't think much of it, redownloaded the ffmpeg static build and recreated the script, all was good, until two days ago, when there was a power outage. The UPS held for a while, and Unraid was configured to gracefully shut down if the UPS battery was under 20%. Unraid shut down just as expected, all was good, however when I started it back, all files from /home were gone again. Is this expected behavior? Should I place those files somewhere else? And why would the files from /home not stay there across reboots/shutdowns?