stah0121

Nginx proxy manager with SSL termination is setup for outside plex access and that's about it. I don't have any fancy automation copying/moving files or anything like that. In the past I've setup nextcloud and a few other things (also setup w/nginx proxy) but those dockers are disabled and were not updated as part of the sequence of steps in my post. I've even wondered if this was some kind of malware related incident? but that doesn't make any sense because the two folders that got wiped out were completely useless in terms of stealing my info or taking advantage of my systems. Maybe it was some record label malware that wants me to go buy physical music disks or something haha

Yes ... I've been using plex for probably close to 10yrs on a variety of different systems. I've been using the plex docker on unraid for at least 5-6yrs. This is also the reason why this is so concerning.

I'm considering trying to reproduce this on my backup box now that my primary is restored but I'd really like to avoid the headache. At the very least has anyone else experienced anything like this?

.. because I only did a few very minor things and they weren't even remotely related to the removal of files. I was able to confirm from my plex music history the files existed prior to those exact events described in my post. Right now my gut tells me it was the plex docker update because it was the only thing in that sequence who even cares about the 2 directories that were wiped out. A separate folder on the same share but there was no data loss in or around that destination. The 'backup1' share is the only one I use for anything and it was the movies and music directories that were wiped out. I know I have some appdata/cache files that aren't setup in the best of ways but this is the first time I've ever seen any data loss like this ... and for the basic stuff I was doing? It has me a bit more motivated to find out why this happened.

Does anyone have any ideas here? I realize this is a tough problem to root cause but it's also pretty serious because I had about 20TB deleted unexpectedly just because of a docker update.

Hi All, I am running unraid 6.12.4 and while I was in the middle of updating a few plugins and docker containers I noticed that roughly ~25% of my data got deleted somehow and it's rather concerning! (I have a recent backup but I don't like surprises like this) I have 1 share I use for data storage and 2 of the bigger directories are empty but all others seem to be fine. /mnt/user/backup1/movies /mnt/user/backup1/music I've attached the diagnostic zip file and the logs from my plex instance. I don't have any automation setup to manage those files and I write code & use linux for a living so I know for sure I didn't enter any careless CLI commands ... but with that said I fully realize I may have caused this in some other way haha. Exact sequence of events: 1hr 10min prior to the writing of this post I can see that music was streamed from plex so I'm assuming the files existed at the time Around that same time I logged on to start doing some update related activities. First I downloaded the Appdata backup plugin (expecting to upgrade to unraid 6.12.8 eventually but I never did) and triggered a manual backup Next I went to the plugins page and updated the following plugins: Unassigned devices, Nerdtools, Fix common problems, Tips and tweaks (in that order) Then I went to the docker page and started an update to the latest plex server and since the release notes said this update makes some DB changes and it takes a while I did not check on it until after I noticed the files were missing. At this point I updated the following dockers (in this order): homepage, mariaDB, nextcloud, redis After that I opened up the unraid release notes for 6.12.8 and when I went back to unraid I noticed my data usage percentage dropped from ~59% to 32%. All of my drives are showing healthy and like I said my software configuration doesn't have any automation to speak of and in general is very vanilla. I rebooted the unraid box to see if the problem would go away somehow but there was no change. Any help is appreciated. Thanks fatcat-diagnostics-20240220-1804.zip Plex Media Server Logs_2024-02-20_18-09-28.zip

Has anyone else tried this install process? I haven't seen anything about an official mediacms docker compatible with the community apps and it seems like people are having some difficulty deploying this on unraid.

This snippet from that post threw me off... "You can only remove devices from redundant pools (raid1, raid5/6, raid10, etc)" Which is why I tried to convert the pool to Single mode but I didn't think Single mode was redundant but I figured removing 1 drive from that configuration might work.

Wow I'm dumb haha ... yep that did it. I appreciate your patience. For anyone just tuning in here are the steps I followed to remove 1 of 2 cache SSDs from the pool. #1) btrfs balance start -f -mconvert=single /mnt/cache #2) stop and start the array #3) after 2min pause run (btrfs filesystem show /mnt/cache) to ensure the "missing devices" message is not displayed #4) stop the array #5) unassign the drive you want to remove (or all of them to reset cache config) #6) check the box that will allow the array to start with missing devices #7) start the array #7.1) if you removed all devices, stop the array, re-assign the devices you still want to use in the cache pool and start the array Feel free to correct me if I'm off base on the steps -- I personally did 1 final stop of the array and set the number of cache drive slots back to 1, but I don't think that is an overly critical step here. Thanks again for your help

I don't have any VMs or docker containers configured .. and prior to my last reboot set all my shares to "NO" for the cache setting. So my understanding is nothing should be pointing to either cache drive. However when I stop the array, and remove one or both of the cache drives from the Cache Devices list ... it displays a "missing" label and throws an unraid error saying that "Cache 2 in error state (disk missing) No device identification" When either of the cache SSDs are unassigned the button to Start the array is gray and not able to be clicked. Attached is another collection of diag data. fatcat-diagnostics-2.zip

root@Fatcat:~# btrfs filesystem show /mnt/cache Label: none uuid: e923abd6-c954-48cd-b2f4-9710cc30eedf Total devices 1 FS bytes used 22.00GiB devid 1 size 223.57GiB used 24.03GiB path /dev/sdc1 It looks like it cleaned up the missing device ... should I make another attempt at removing the drive from the pool? If so, can you clarify which steps I should use? In one of the posts there was mention of wiping the drive, and also btrfs remove device command was mentioned .. just want to make sure I am doing the right steps in the right order ... I didn't realize the array needed to be stopped and started after a balance operation. Apologies if that is supposed to be obvious.

Not exactly sure which files you're after, so here is the entire zip folder. fatcat-diagnostics-20200701-0812.zip

Hey everyone, I have a cache pool of 2 devices but I would like to revert this back to 1 device. What happened was I plugged in the drive, and added it to the cache pool before I realized the implications of the SSD's not being the same size (240GB vs. 2TB) -- so I've been following the below guides trying to remove the 2TB drive without any success and I was hoping to get some help here. https://forums.unraid.net/topic/51133-remove-a-drive-from-a-cache-pool/ https://forums.unraid.net/topic/46802-faq-for-unraid-v6/?tab=comments#comment-480418 Important note: This is my backup unraid box I'm trying to setup and I'm prepared to lose the data on here if I need to, but I would like to avoid having to re-transfer the ~12TB of data I have backed up on here because it takes several days. (i.e. matter of convenience) After a fresh reboot with both SSDs successfully in the cache pool, I am seeing this for the "btrfs filesystem show" output -- The device I'd like to remove is /dev/sdb and is not listed there but is showing green on the web page. root@Fatcat:~# btrfs filesystem show /mnt/cache/ Label: none uuid: e923abd6-c954-48cd-b2f4-9710cc30eedf Total devices 2 FS bytes used 21.00GiB devid 1 size 223.57GiB used 44.06GiB path /dev/sdc1 *** Some devices missing Performing the steps in the 1st link (../topic/51133-*) I do not see any errors when I run the "blkdiscard" command .. and yes I made sure I wasn't missing a digit or anything when running my commands. At some point I realized that I wasn't able to remove a cache pool disk when the default mode is raid1, so I tried to do a balance operation and convert it to single mode ... when I attempt this via webpage it seems to work fine and does not display any errors ... when I attempted this via console command it error'd out and said there was not a sufficient amount of disk space. To me this explains why I have never been able to see anything other than "No balance found on '/mnt/cache'" on the webpage or the console, because I believe the 240GB SSD is too small for whatever operation is being attempted. Here is the "btrfs filesystem df" output, please let me know if any additional information is required PS: If I can't figure this out, can I use the "New Config" tool -- preserve my assignments -- and then start fresh? .. and basically just take the hit of wasting several days re-transferring my data. btrfs filesystem df: Data, single: total=42.00GiB, used=21.00GiB System, DUP: total=32.00MiB, used=16.00KiB Metadata, RAID1: total=1.00GiB, used=176.00KiB Metadata, single: total=1.00GiB, used=0.00B GlobalReserve, single: total=16.00MiB, used=0.00B Thanks in advance any and all assistance

1. Storage will be its primary function, but I would like it to be powerful enough to handle some light weight docker instances. The mobo listed above has 10 SATA connections and the chassis has 8 drive bays, so it is budget friendly to not have to buy an extra controller. 2. Not sure about windows 10 VM, but yeah I figure I will probably want to upgrade to 16GB of RAM at some point -- but there will be a lot of available DIMM slots on that mobo if I'm only using up 2 of them right away.

Hello everyone, this is my first post and I am just getting familiar with unRaid and its community so go easy on me haha. I also want to say I'm really impressed by the unRaid software and how active/capable/polite the community seems to be. I've been doing DIY builds for home media, some (failed) business startup attempts and storing or backing up data for myself/others for around 6-7yrs. My hope for this post is that a handful of people can find something interesting/useful here, and that I can get some fresh perspective on what I've been thinking about and planning. My current setup consists of 3 desktop builds each containing an adaptec 6805e RAID controller... Win10, 2x 8TB HDD under RAID 0, GPU, Plex server, torrents, VirtualBox. Ubuntu, 8x 4TB HDD under RAID 10, Nginx as proxy server, CIFS share Ubuntu, 8x 2TB HDD under RAID 10, CIFS share The Win10 box is where most things are done via SplashTop remote login (great tool, switched to this because LogMeIn cost got ridiculous), and then I use the other two boxes to backup stuff from the Win10 box or other device. This has turned out to be a really messy setup that requires a lot of intervention and I think it's time to not only upgrade but reorganize. Recently my consumed storage space totaled ~16TB which is basically max capacity and has spilled over into external drives, so I've been researching what sort of options I have for upgrade. If my past years using consumer grade parts/software has taught me anything, its that you should expect a LOT of failure. I have replaced tons of drives, lost data mid-transfer because corruption, spent a lot of money for parts that struggle to achieve high performance and most of all have had to try a lot of different software. Some of this was me learning the basics, but I think most people agree that they want a setup with "great value" -- to me meaning they want 'adequate performance', 'high reliability' and to not be broke afterwards. Yes, these are subjective based on user needs but the goals are usually pretty similar. When you start looking at parts, if you go for the easiest stuff to find, or websites that will do the build for you but allow you to customize (think ibuypower) it is pretty easy to spend $2,000+ for consumer grade and $10,000+ for enterprise builds with just a few clicks. I found it surprisingly difficult to put together an enterprise grade build for less than $3,000-$4,000 that would accommodate this amount of storage and leave a little room for expansion. Lots of info online can be overwhelming because I'm not someone who closely follows which model of which part is the hottest and its price changes, but I think a helpful place to start is by thinking about which of these two things you need to prioritize ... storage, or compute power. For me personally, I need storage more than I need compute power, but my current system has been struggling with 4K transcoding via Plex and I would like to take that into consideration as well down the road. The following parts list is a storage focused build I am looking at doing. Storage Chassis - Supermicro CSE-825TQ-563LPB 2U ($389.99) Motherboard - Supermicro MBD-X10SRL-F ($258.99) Xeon E5-1620 v4 @ 3.5GHz 4core hyperthreaded ECC-capable ($306.99) Supermicro CPU Heatsink ($35.05) Kingston ValueRAM 4GB DDR4 2400 ECC Reg DIMM 288-pin ($60.73) Storage Array - Seagate Exos 12TB HDD ($391.99) I spent a lot of time reading about different types of RAM, what storage enclosures are available, visiting cpubenchmark.net looking up PassMark scores, talking with other people, visiting the recommended (unRaid) builds wiki page etc. and came to realize that the extra money & leg work is worth it when it comes to the satisfaction you feel knowing your system works well and can be trusted. If I did my homework correctly, the parts list above should get you a really basic enterprise grade storage solution for around $1500 depending on how much RAM and HDDs you buy. I am planning to spend around $2400 Below are some questions I was hoping to get feedback on, but feel free to comment on anything I've touched on in hopes that someone will find it useful. Did I forget anything? haha -- in other words, will this list of parts put together a functioning unit? (regardless of rack mount, ssd cache, or other accessories) In regards to old equipment, does anyone have any advice on re-selling / recycling / reusing components? (I have lots of mid-low end sata/x86 stuff, some unused network switches, etc) Just to clarify terminology ... IOMMU is implemented into Intel chips specifically and called "VT-d" correct? Does anyone have any thoughts on how to handle data backups in terms of "should I have more copies on cheaper gear?" or "should I have fewer copies on more expensive gear?" I'm pretty sure unRaid will work in that build, but are there any gotchas I should be aware of, or tweaks available in unRaid that would help me optimize things? Does anyone have any additional advice for people considering doing a new build either for the first time, or as someone wondering what the best upgrade path should be? Sorry for a long post, like I said I'm hoping in the end this will bring a lot of helpful information into one place.