Kees Fluitman

Hey. I used to have it set to move only files older than 60 days. but my cache kept filling. Now i've set it to 15 days and ran the Mover. But nothing is moving... The logs just show .list files of files? The cachepool is btrfs. Lots of files are definitely old enough to move: -rw-rw-rw- 1 nobody users 7045601667 Feb 25 23:01 I noticed i was yet again using the deprecated version....lets see if it moves files now. Working now.

It seems I failed to debug properly myself. A classic mistake I was hoping I could avoid. The log shows the error and Ive fixed all the automatic Starting of my Backup Server. I recently changed the Network Card and OS of my backup server. And Wake-on wasnt set to g for this interface. And also the IP changed of course. So double trouble and me being an idiot. Im sure it will work now.

Hey Guys Cron jobs arent working for me in the container. I tried debugging, but couldnt find anything proper in the logs. Anyone that uses a different way to backup to an external server? I do it manually now, but i want to automate it. The Backup PC turns on in the night, and I want to trigger the backup at that time too since it is quite an extensive copy. The only thing I can think of is writing my own script that uses rsync to copy, but it was so nice that LuckyBackup does that for me. (Although it does have to recopy all the Appdata copies that I have new each day, it's technically still copying chunks of data every data instead of refreshing only what has changed.)

thnx. ye i also realised. i put back in some older RAM i still had, extending the new mem. Then I took m out and it was all good again.

Did it three times. It was stable last 12 hours now. Ill keep an eye on the logs and otherwise try again. seems radarr causes the issue. ``` Sep 8 12:33:10 server kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 0, rd 0, flush 0, corrupt 1622, gen 0 Sep 8 12:33:10 server kernel: BTRFS warning (device loop2): csum failed root 918 ino 25066 off 1228800 csum 0x2d6b047d expected csum 0xa321433a mirror 1 Sep 8 12:33:10 server kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 0, rd 0, flush 0, corrupt 1623, gen 0 Sep 8 12:33:10 server kernel: BTRFS warning (device loop2): csum failed root 918 ino 25066 off 1228800 csum 0x2d6b047d expected csum 0xa321433a mirror 1 Sep 8 12:33:10 server kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 0, rd 0, flush 0, corrupt 1624, gen 0 Sep 8 12:33:10 server kernel: BTRFS warning (device loop2): csum failed root 918 ino 25066 off 1228800 csum 0x2d6b047d expected csum 0xa321433a mirror 1 Sep 8 12:33:10 server kernel: BTRFS error (device loop2): bdev /dev/loop2 errs: wr 0, rd 0, flush 0, corrupt 1625, gen 0 Sep 8 12:33:10 server kernel: BTRFS warning (device loop2): csum failed root 918 ino 25066 off 1228800 csum 0x2d6b047d expected csum 0xa321433a mirror 1 ```

i did that. Converted to raid1. It was shrinked to 1TB, yet i couldnt replace a drive. I believe some partition was still single. Now that I've completely finished replacing and everything. I had to delete my docker.img, but im still getting some kernel panics. I also noticed this btrfs_error.txt

Thanks. I forgot that. Now the macvlan is gone (got docker macvlan on). Dont remember whether i should create one myself, or why that is? I use it for Adguard Home for instance. But i believe it should also allow connections between VMs and containers.

Ive got the same issue. Should i create my own topic? Ive added a 10G NIC. Recognized as eth1. I only want to use that one, the other one as eth0 is not connected. Ive got no bonding, no bridging and static IP on eth1. But then I have no resolving. Only when I set DNS servers for eth0, will it resolve stuff. Ive got DNS static now, but all IPs automatic for diagnostic purposes. As of now I get errors but it works: ˋˋˋ eth0 does not have a valid IP address, but eth1 does. For the best experience, you should go to Network Settings and adjust the settings (Interface Rules) so that eth0 is your primary NIC ˋˋˋ I want eth1 to be my primary. Disabling my mainboard NIC in BIOS didnt help.

Replacing a drive didnt work. Says a drive is missing. Maybe somehow it still has data spread. Or sth is still single (mbr?) So im moving all files to array first.

ah funny i couldnt find that. assumed the greyed out meant i couldnt convert. But it's under the balance tab. Thanks. Ill remove a drive afterwards and install the 2TB drive. Hope that will work in raid1 and will recognize the full 2TB after both 2TB are in.

ye. added it now.

Oke. Here you are. I also read and found some stuff: ``` btrfs device remove /dev/sdX1 /mnt/cache ``` https://docs.unraid.net/unraid-os/manual/storage-management/#switching-the-pool-to-multi-device-mode Which could help me remove 1 drive from the pool. then connect one of the newer 2TB, then create a new multi-device pool from the 2TB, and then remove the other 1TB. edit. sorry forgot to add it. server-diagnostics-20240905-1643.zip

the only thing i can think of, is this: ``` diskFsProfile="single" ``` but i cant change that manually. It's greyed out. So i'd assume that needs to be multi-device mode, and probably means i'd have to move all files back to array. and then delete the cache pool and recreate it. server-diagnostics-20240905-1630.zip

server-diagnostics-20240905-1630.zip

Yes i did that now. Ill send the diagnostics any moment now. What I'd actually like to do, is replace the two 1TB ssds with 2 TB ssds. Ive got them ready. But I dont want to start replacing them one after another, if there is no redundancy.

sorry no. I found it. Yes was enabled. Disabled it now. Can i stop the diagnostics tool? I couldnt find it's process in htop. Im gonna force shutdown.

i will. But somehow the diagnostics is running sed -i on all types of files and taking forever. Some random media folder i have it is running that...

Hey, I had to replace my mainboard of my unraid server. The new motherboard had 2 less sata ports available, so untill I got my sata controller, I had 1 less sata drive of my sata cache pool (2x 1TB in mirror) and my Parity drive was missing. Today I installed my sata controller, connected all drives appropriately (mechanical drives on sata controller) and restarted. Now I added the sata drive back to the pool, yet now, the 2 1TB drives are seen as a 2TB cachepool. But I want them as a 1TB cachepool with redundancy. I can't find any information, and thought this would go automatically. Connecting to my server via Winscp, I still see only 1 sata drive in /mnt/ So: ``` /dev/sdc1 1.9T 371G 1.5T 20% /mnt/satacache ``` Files are not secured I believe. Ill let the parity sync run for the next 13 hours and then come back to you. But this caught my attention.

Even after docker image deletion. It still gets kernel panic every 10 hours or so. Back to the drawing board I guess....I guess it's possible to do a clean install, save xml files of used apps and all docker compose files and use existing databases? Ill first check the syslogs and then shut down some containers one by one to see if that helps. I noticed 2 more things: 1. Since network settings were deleted and somehow the Create Flash Drive programm overwritten my backuped one. It was set to bonding and bridging, so a macvlan and bridge were both active. Which can cause instability. I reset it and changed back to my old settings (although my router refused to accept the old static ip i had set). 2. Plugins and NERD packages were not properly installed anymore (since they had been deleted and not recovered properly from flash backup), i reinstalled all of them. Let's see if that solves it. Was probably the network settings. Ive had that before. Has been on for more than 15 hours now.

So as a conclusion. I've skipped 2 hdds that only had bulk stuff that wasnt so important. But most importantly, it never got to my cache pools or nextcloud and pictures shares, fortunately... So it took me a couple of days, but got evrthg back in order. Just letting the parity check do it's fixing now. Only issue. is im getting kernel panics after a couple of hours. So ill let the parity check run without docker, and if that works, afterwards recreate the diocker image.

I am using UFS Explorer atm. Scan on 10TB drive takes about 13h. But it did indeed find the data in exactly the right dir structure and filenames. Ill check out your programm too. Another 2 Drives to go!

Ye i did not start the array cause i didnt want to have any reads corrupt my data. i did now, and yes, it did go through my 3 disks first, cutting them back from 15TB to around 2-3TB. The cache pool seems mostly oke, but it could be that some stuff is missing there too. Im gonna set up a windows to go usb now with some heavier gear to see if i can recover any data with it's filenames and folder structure.

Thanks for the headsup. I basically instantly tried to use my backup usb, which failed because the usb creation tool is bugged. So only after my confusion and thinking I should attempt sth else, did i read up and saw that the boot device was bugged. But i'd already tried booting in ubuntu and see what was still on the drives. Seemingly not finding part of the files...but i guess i was wrong then, and if i start the array, everything will be fine? So /mnt does not entail any disks once /* has started running? since nthing is mounted anymore?

Bei mir hat es config und EFI nicht rein kopiert. manuell hat das denn schon geklappt. Bei einem Recovery würde es sich auch lohnen array start und VM start aus zu schalten. Damit man das manuell machen kann.

hey. ye i saw that. its so hard sometimes to guess what's missing or if i got everything since data is on all disks. And Im using the undelete_xfs now with options such to ignore matroska files or files bigger than 2G, to only really get relevant data. But then it just doesn't find anything. So Im thinking i might just bite the bullet here now and go startup that array again. Only thing im wondering is, should I get one ssd full of the data before i restart the array? Or better to start it, and then get the data back on there? How does unraid handle missing files? or two ssds in the cache pool with different sets of data?