comfox

Thanks...I took a read through the post. Seems amazing, though looks a bit too complicated for me to setup and maintain. I don't know where to start.

Thanks for the info...will this type of backup cover me in this type of scenario where I had corruption? Would I just rebuild the pool from scratch and then put the snapshot back on to the new pool?

Consider this topic closed. Here is a rundown for anyone that stumbles across this in the future. NOTE: btrfs is still in its infancy and corruption can occur. Recovery tools are not easy to work with and don't do a very good job recovering. Use btrfs at your own risk and backup anything of value daily, if not hourly. For some reason on the weekend my Cache Pool (btrfs) decided to head to the crapper. I do not know why it did, there were no unexpected shutdowns and I didn't really look hard in to the why. I just assume that I am a heavy user and corruptions happened. On this cache drive was all my appdata for 7 dockers as well as the .img vHDD for my Windows 10 VM. I did have the CA Backup / Restore Appdata Plugin but for some reason it wasn't working correctly so my data was not being backed up. When I got home I tried to boot up my VM, which had crashed and it wasn't working. The VM was hanging and then it would lock up the unRAID box. After posting my log file it was apparent that my cache pool btrfs had become corrupt. I followed @johnnie.black advice and started running some of the commands from him post Of course the easy method didn't work so I ended up running the btrfs restore command to copy as much data off the drives as I could. I got most of it back, however my .img vHDD was corrupt and wouldn't mount. Since I had most of the image (205GB out of 215GB) I started to investigate a way to get in to the image and manually extract the data from within it. In my searching I came across an application called DM Disk Editor (www.dmde.com) which claimed to be able to open up raw image files and recover the contents. I used the free version first and validated that it could indeed recover some of the data. I then bought the full version and proceeded to recover as much of the data from the vHDD as I could. I recovered probably 90% of what I needed and it was a relatively easy process, though quite time consuming. I have now put a new cache drive in to unRAID, changed the file system to xfs and started restoring all the services, apps and VM's. I have copied all the recovered appdata over to my docker shares and restored the dockers through the docker tab. I am now starting the process of reinstalling Windows and reloading my VM with the recovered data. This has taken way to long to recover my life and I will be looking at better and easier backup solutions going forward. Hope this helps someone in the future.

Nevermind, I figured it out by reading your edit. I changed the slots from 3 to 1 and then the dropdown came back.

Thanks for the response. I don't see another place to click. I am changing from 2 drives to 1 so I only have one drive to click on.

I thought I should be able to change the file system by stopping the array and clicking on the drive and then change the file system through the drop down, however there is no drop down present on the drive screen. Am I doing something wrong?

Since I had this crazy failure with btrfs I would like to change my drives to be xfs. How do I go about changing the file system to xfs from btrfs?

So there is a switch in the btrfs restore command to isolate restoring only to a particular "regex". Would anyone know how to construct a regular expression for VM_HDD_Lib so that I could isolate the restores to only my image folder?

I am currently copying the img from the one server to a usb to see if the files I need from the VM are recoverable from it. I also setup another unRAID server and attached the second mirror and that server is currently working through the recovery command. unRAID still would not mount it sadly but the recovery is running, albeit with more errors than the other drive.

When I try to use the command mount -o recovery,ro /dev/sdc1 /x I get the error segmentation fault

OK, so the restore has froze at the 210GB mark of the .img restore for my VM...not sure what I should try to do now. tower-diagnostics-20170515-1552.zip

Thanks, I wasn't aware of that...I didn't realize it would mirror the corruption. I don't do unclean shutdowns ever so, if I get this fixed I will replace the cables and see if that helps longer term This pool was created when I built the system. I bought the key for this system on 12/15/2015 so that is when I would have most likely built this pool. I used 6.x for the pool, would have been the most current 6.x version available at the time, maybe you can check your release history to see which version was available then. I then upgraded through each new version that was released. The other catastrophic failures have been other file loss situations. The first was a loss of 3TB (2/21/15) of data from a drive becoming unrecognized by unRAID and the next was again a drive becoming unmountable (1/4/2017). So the restore is still going...it it currently on my Windows VM file which is a big file, it keeps updating the screen with "offset is XXXXX" where is XXXXX is an ever expanding number so I hope it is still recovering it. This is the main file I need, everything else can be lost but without this vm file I am screwed.

OK, I am rerunning the restore using -i right now to ignore errors and it has moved past the last point. Will see how far this one gets. This really burns my goat that I have mirroring on and I still have to resort to a manual recovery. What is the point of having a cache pool mirror if is doesn't recover in a situation like this?

So I have run the command btrfs restore -v /dev/sdX1 /mnt/disk2/restore and it restored a lot of items but not the items that I really needed. Can I have this command "skip" certain folders and restores others?

Thank you both, I will do what @johnnie.black has linked once my parity check completes.

Thanks Squid for the advice. I am having problems running the tools though as I am getting errors saying no valid btrfs found. I will play around with it some more. I went with btrfs because I do have a cache pool. I have two drives mirrored to prevent this type of issue from happening. Would both my drives be pooched?

So after some playing around I managed figure out that the lock up only happens when trying to mount the array. I can be in Safe Mode GUI all day long but once I click on Mount the whole GUI freezes and never recovers

Hi All, I was away for the weekend and came home to a locked up GUI, VM and Dockers. I was able to putty in so I did and then initiated a reboot. This went well for about 30 seconds and then everything locked up, including the putty session. I hard rebooted and was able to putty back in and get a syslog, there are errors in it but I don't know what they mean. I can't get the GUI to load either. I have rebooted in safemode but still get errors and still can't get the GUI to load. Any help? I have attached the only syslog I could grab. syslog.txt

OK, that command has seemed to have fixed it. Now to take a look in lost+found to see what files have been destroyed.

So turns out that the xfs_repair wasn't hung, just taking a long time. I am now on Phase 7. A few issues have been found. Hopefully once completely the drive will mount.

I was having an issue where my shares weren't working so I rebooted and once the server came up I got an error that Disk1 was Unmountable. I followed the instructions at https://lime-technology.com/wiki/index.php/Check_Disk_Filesystems and did the check disk and no errors came up. I then did a xfs_repair -v /dev/md1 but that command seems to have hung on Phase 2 as there is no progress in my terminal window. What should I do next? Attached is my diagnostic. tower-diagnostics-20170104-1932.zip

What is the webgui field for under Advanced Options?

OK thanks, I will try there. You should give pinning a go. I found it makes a world of difference in keeping my system stable, snappy and happy!

I have an odd issue with CPU pinning with this docker. I am using the following flags --memory=8GB --cpuset-cpus=3,7 but whenever I play a video and check the CPU usage on the Dashboard tab I only see CPU utilization for CPU 7. CPU 3 always remains at sub 5% Any thoughts? I have tried with the flags in the Repository: section and the Extra Parameters:and there is no difference. CPU 7 is pegged at 100% and CPU 3 is sub 5%

I found the root cause to this issue. My cache drive was running out of space so the VM was being automatically paused by KVM. For anyone that comes across this thread in the future, please check your cache drive for free space.