chi_town60608 Posted August 17, 2019 Share Posted August 17, 2019 I added a hard drive to my system and when I finished getting it installed, all of my dockers were missing. So I installed them using CA -> Previously installed. I use Deluge VPN, Radarr, open VPN, Plex, and SabNZBD. Deluge wouldn't start at all. The rest of them will start, but they're all at the initial set up. Plex had nothing in it. I had to go in and create a Movies library and then point it to the Movies download folder. open VPN webGUI will open, but I can't remember my Username, PW. None of the data was deleted; there's still 20 TB of data on the disks. The apps just aren't set up to see it anymore. All of that is to say I've never had this issue. I could always delete the docker image, reinstall it, and all issues were resolved. This time when I did that, the problem persisted. I tried to install via 'Add container' and then user templates, but had the same issue. I believe these settings are saved on the flash drive and can find where they are, but I don't know how to proceed from there. So....anyone have a suggestion? I wasn't sure what was needed to help troubleshoot, so i didn't include anything, but I don't mind gathering any data that is needed. Thanks! Quote Link to comment
trurl Posted August 17, 2019 Share Posted August 17, 2019 Your docker templates are stored on the flash drive, so that is the likely problem. Go to Tools - Diagnostics and attach the complete diagnostics zip file to your next post. Quote Link to comment
JonathanM Posted August 17, 2019 Share Posted August 17, 2019 Also, what was your intent with pairing up a 1TB SSD with a 120GB SSD in the cache pool? If you haven't manually adjusted things, that will end up with 120GB of useable space, basically ignoring the capacity of the 1TB, and a free space display in the GUI that is seriously wrong. Quote Link to comment
Squid Posted August 17, 2019 Share Posted August 17, 2019 1 hour ago, jonathanm said: Also, what was your intent with pairing up a 1TB SSD with a 120GB SSD in the cache pool? If you haven't manually adjusted things, that will end up with 120GB of useable space, basically ignoring the capacity of the 1TB, and a free space display in the GUI that is seriously wrong. And the probable cause of the OP's issue, as a template issue wouldn't affect anything already installed. Quote Link to comment
trurl Posted August 17, 2019 Share Posted August 17, 2019 18 minutes ago, Squid said: And the probable cause of the OP's issue, as a template issue wouldn't affect anything already installed. Diagnostics would tell. If they really did fill up their (unexpectedly) small cache then they probably have other things about their configuration that need fixing too. Quote Link to comment
chi_town60608 Posted August 17, 2019 Author Share Posted August 17, 2019 7 hours ago, jonathanm said: Also, what was your intent with pairing up a 1TB SSD with a 120GB SSD in the cache pool? If you haven't manually adjusted things, that will end up with 120GB of useable space, basically ignoring the capacity of the 1TB, and a free space display in the GUI that is seriously wrong. I had a 120GB SSD, but wanted to enlarge my cache, so I added the 1TB. tower-diagnostics-20190817-2011.zip Quote Link to comment
itimpi Posted August 17, 2019 Share Posted August 17, 2019 3 minutes ago, chi_town60608 said: I had a 120GB SSD, but wanted to enlarge my cache, so I added the 1TB. tower-diagnostics-20190817-2011.zip 129.7 kB · 0 downloads The problem is that by default the cache is set up as BTRFS RAID1 which means that all data is stored on more than one drive. As a result with two drives of different sizes the available space is limited to that of the smallest drive. If you want the space to be added together (with no redundancy) then you can manually convert the cache to operate like that. Quote Link to comment
chi_town60608 Posted August 17, 2019 Author Share Posted August 17, 2019 (edited) 40 minutes ago, itimpi said: The problem is that by default the cache is set up as BTRFS RAID1 which means that all data is stored on more than one drive. As a result with two drives of different sizes the available space is limited to that of the smallest drive. If you want the space to be added together (with no redundancy) then you can manually convert the cache to operate like that. I don't really care if the 120GB is included. If that causes an issue, I can just remove it. But I also don't really have a use for it, so if there is a way of getting them both to work, that would be fine too. I'm all ears. And thanks for the info. Edited August 17, 2019 by chi_town60608 Quote Link to comment
trurl Posted August 17, 2019 Share Posted August 17, 2019 Your docker image is 100G, way more than it should be and that would consume most of the 120G you have for cache. Why did you make docker image so large? I always recommend 20G, and if you fill that much up you have something misconfigured. Docker image should grow very little, and 20G should be more than enough. Your docker image is corrupt. Possibly you have been filling it, I don't know. You will have to delete and recreate it. Some of it is on the array anyway so recreating it is the easiest way to fix that. Only give it 20G. Personally, I would just get rid of the 120G cache and free that port up for future use. It isn't really a significant amount compared to the 1TB. If you really did want to add them together raid0 would be the way to do that: https://forums.unraid.net/topic/46802-faq-for-unraid-v6/#comment-480421 Your syslog is filling with these: Aug 17 13:28:59 Tower kernel: usb 1-2: USB disconnect, device number 55 Aug 17 13:29:00 Tower kernel: usb 1-2: new low-speed USB device number 56 using xhci_hcd Aug 17 13:29:00 Tower kernel: input: PixArt HP USB Optical Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-2/1-2:1.0/0003:0461:4E66.0597/input/input1434 Aug 17 13:29:00 Tower kernel: hid-generic 0003:0461:4E66.0597: input,hidraw0: USB HID v1.11 Mouse [PixArt HP USB Optical Mouse] on usb-0000:00:14.0-2/input0 Aug 17 13:30:00 Tower kernel: usb 1-2: USB disconnect, device number 56 Aug 17 13:30:02 Tower kernel: usb 1-2: new low-speed USB device number 57 using xhci_hcd Aug 17 13:30:02 Tower kernel: input: PixArt HP USB Optical Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-2/1-2:1.0/0003:0461:4E66.0598/input/input1435 Aug 17 13:30:02 Tower kernel: hid-generic 0003:0461:4E66.0598: input,hidraw0: USB HID v1.11 Mouse [PixArt HP USB Optical Mouse] on usb-0000:00:14.0-2/input0 Aug 17 13:31:02 Tower kernel: usb 1-2: USB disconnect, device number 57 Aug 17 13:31:04 Tower kernel: usb 1-2: new low-speed USB device number 58 using xhci_hcd Aug 17 13:31:04 Tower kernel: input: PixArt HP USB Optical Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-2/1-2:1.0/0003:0461:4E66.0599/input/input1436 Aug 17 13:31:04 Tower kernel: hid-generic 0003:0461:4E66.0599: input,hidraw0: USB HID v1.11 Mouse [PixArt HP USB Optical Mouse] on usb-0000:00:14.0-2/input0 Aug 17 13:32:04 Tower kernel: usb 1-2: USB disconnect, device number 58 Not sure what that is about but it doesn't seem like a good thing. Quote Link to comment
chi_town60608 Posted August 17, 2019 Author Share Posted August 17, 2019 (edited) 7 minutes ago, trurl said: Your docker image is 100G, way more than it should be and that would consume most of the 120G you have for cache. Why did you make docker image so large? I always recommend 20G, and if you fill that much up you have something misconfigured. Docker image should grow very little, and 20G should be more than enough. Your docker image is corrupt. Possibly you have been filling it, I don't know. You will have to delete and recreate it. Some of it is on the array anyway so recreating it is the easiest way to fix that. Only give it 20G. Personally, I would just get rid of the 120G cache and free that port up for future use. It isn't really a significant amount compared to the 1TB. If you really did want to add them together raid0 would be the way to do that: https://forums.unraid.net/topic/46802-faq-for-unraid-v6/#comment-480421 Your syslog is filling with these: Aug 17 13:28:59 Tower kernel: usb 1-2: USB disconnect, device number 55 Aug 17 13:29:00 Tower kernel: usb 1-2: new low-speed USB device number 56 using xhci_hcd Aug 17 13:29:00 Tower kernel: input: PixArt HP USB Optical Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-2/1-2:1.0/0003:0461:4E66.0597/input/input1434 Aug 17 13:29:00 Tower kernel: hid-generic 0003:0461:4E66.0597: input,hidraw0: USB HID v1.11 Mouse [PixArt HP USB Optical Mouse] on usb-0000:00:14.0-2/input0 Aug 17 13:30:00 Tower kernel: usb 1-2: USB disconnect, device number 56 Aug 17 13:30:02 Tower kernel: usb 1-2: new low-speed USB device number 57 using xhci_hcd Aug 17 13:30:02 Tower kernel: input: PixArt HP USB Optical Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-2/1-2:1.0/0003:0461:4E66.0598/input/input1435 Aug 17 13:30:02 Tower kernel: hid-generic 0003:0461:4E66.0598: input,hidraw0: USB HID v1.11 Mouse [PixArt HP USB Optical Mouse] on usb-0000:00:14.0-2/input0 Aug 17 13:31:02 Tower kernel: usb 1-2: USB disconnect, device number 57 Aug 17 13:31:04 Tower kernel: usb 1-2: new low-speed USB device number 58 using xhci_hcd Aug 17 13:31:04 Tower kernel: input: PixArt HP USB Optical Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-2/1-2:1.0/0003:0461:4E66.0599/input/input1436 Aug 17 13:31:04 Tower kernel: hid-generic 0003:0461:4E66.0599: input,hidraw0: USB HID v1.11 Mouse [PixArt HP USB Optical Mouse] on usb-0000:00:14.0-2/input0 Aug 17 13:32:04 Tower kernel: usb 1-2: USB disconnect, device number 58 Not sure what that is about but it doesn't seem like a good thing. Those appear to be the keyboard and mouse I have attached to the tower. They get used on average once every 3 months or so. I'll disconnect them until I actually need to use them. I was having issues with my docker image hitting 20GB, so I increased it. I read until my eyes were bleeding on what could be wrong as I hate asking for help, but since I increased it, I haven't had the issue. I agree, though, there are probably multiple settings that aren't correct. I'm hoping someone will throw me a bone and get this stuff all sorted out. Lastly, I'll remove the 120GB drive. Doesn't seem worth the trouble of getting it added correctly. Edited August 17, 2019 by chi_town60608 Quote Link to comment
chi_town60608 Posted August 18, 2019 Author Share Posted August 18, 2019 I guess i should ask; is there a 'proper' way to take a cache disk out of the array? Quote Link to comment
trurl Posted August 18, 2019 Share Posted August 18, 2019 32 minutes ago, chi_town60608 said: I guess i should ask; is there a 'proper' way to take a cache disk out of the array? The FAQ has a whole section on managing the cache pool. That is where I got that other link I posted. https://forums.unraid.net/topic/46802-faq-for-unraid-v6/page/2/?tab=comments#comment-554741 Quote Link to comment
chi_town60608 Posted August 19, 2019 Author Share Posted August 19, 2019 Does anyone have any suggestions as to how I get all of my docker settings back? Quote Link to comment
trurl Posted August 19, 2019 Share Posted August 19, 2019 9 hours ago, chi_town60608 said: Does anyone have any suggestions as to how I get all of my docker settings back? As mentioned early in the thread, your docker templates are on flash, so unless there is something wrong with flash or they got deleted somehow (user error?) the settings of each of your dockers should still be there. But it doesn't matter unless you have already fixed the other things talked about in this thread. Have you? Quote Link to comment
JonathanM Posted August 19, 2019 Share Posted August 19, 2019 I suspect the docker settings aren't actually the OP's issue. It sounds to me like the appdata got lost / corrupted in the handling of the 1TB/120GB SSD cache pool. Quote Link to comment
trurl Posted August 19, 2019 Share Posted August 19, 2019 I think we are going to have to break this down into smaller specific steps to make any progress. If you have made any changes at all since the diagnostic you posted earlier, post a new diagnostic. If you have not made any changes, let us know that as well. Quote Link to comment
chi_town60608 Posted August 21, 2019 Author Share Posted August 21, 2019 (edited) Here are the newest diagnostics. I deleted the docker image and created a new one using 20GB. I installed all of my templates using 'Add container' -> 'User templates'. I removed the 120GB cache drive. tower-diagnostics-20190821-2009.zip Edited August 21, 2019 by chi_town60608 Correct file. Quote Link to comment
JonathanM Posted August 21, 2019 Share Posted August 21, 2019 24 minutes ago, chi_town60608 said: I removed the 120GB cache drive. Are all your appdata folders on the new cache drive? Quote Link to comment
chi_town60608 Posted August 21, 2019 Author Share Posted August 21, 2019 2 hours ago, jonathanm said: Are all your appdata folders on the new cache drive? I have the 'Use cache disk" option for appdata set to 'Prefer'. Not sure if that helps answer your question. Quote Link to comment
JonathanM Posted August 21, 2019 Share Posted August 21, 2019 17 minutes ago, chi_town60608 said: I have the 'Use cache disk" option for appdata set to 'Prefer'. Not sure if that helps answer your question. Doesn't answer what we need to know. My suspicion is that you ran out of space on your 120GB cache pool, and the file system was corrupted. Without a backup of your appdata folder from before this mess started, I suspect you will have to set everything up again from scratch. As you said, your data on the array is fine, but the containers lost their settings when the cache pool got corrupted. When you added the templates back, that simply installs the containers with all the fields filled in the way they were, but has nothing to do with the appdata contents, which means they all act like brand new installs. As to whether or not the original appdata contents are able to be recovered, that depends on exactly what happened behind the scenes when you were adding and removing drives to the cache pool. Absent an actual backup of the appdata like you would have with the CA Backup / Restore Appdata plugin, I doubt there is any way to get back to where you were without rebuilding things like you alluded to in the first post. The only thing I can think to do would be to attempt a data recovery on the original 120GB cache drive using BTRFS restore or similar. @johnnie.black may have a better idea about the situation. Quote Link to comment
chi_town60608 Posted August 21, 2019 Author Share Posted August 21, 2019 22 minutes ago, jonathanm said: Doesn't answer what we need to know. How would I go about getting the information to answer what you need to know? 23 minutes ago, jonathanm said: Absent an actual backup of the appdata like you would have with the CA Backup / Restore Appdata plugin, I doubt there is any way to get back to where you were without rebuilding things like you alluded to in the first post. I did make a backup of my flash drive at a point after I had everything set up. Would I be able to get the settings from that backup? Quote Link to comment
JonathanM Posted August 21, 2019 Share Posted August 21, 2019 On 8/17/2019 at 2:28 AM, chi_town60608 said: I added a hard drive to my system and when I finished getting it installed, all of my dockers were missing. Start here. Which hard drive did you add? Quote Link to comment
chi_town60608 Posted August 21, 2019 Author Share Posted August 21, 2019 (edited) WDC_WD100EMAZ-00WJTA0_JEKU*** - 10 TB (sdf) Disk 3 Edited August 21, 2019 by chi_town60608 Quote Link to comment
trurl Posted August 22, 2019 Share Posted August 22, 2019 Your latest diagnostics show appdata all on cache. Whether that is all new appdata I don't know. Your latest diagnostics also show part of system share on disk2, instead of all on cache where it belongs. From the terminal, what do you get with this? ls -lah /mnt/disk2/system Quote Link to comment
chi_town60608 Posted August 22, 2019 Author Share Posted August 22, 2019 drwxrwxrwx 3 nobody users 29 Aug 13 09:13 ./ drwxrwxrwx 7 nobody users 106 Aug 21 19:45 ../ drwxrwxrwx 2 nobody users 33 Aug 13 09:13 libvirt/ Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.