bgeorge104: redo cache drive


Recommended Posts

Finally got round to updating to V6.8.0 Way easier & painless than last time I upgraded. Somebody said my docker image may be corrupt. I tried to use the backup plugin to backup following spaceinvaders video. Only when I run it nothing gets backed up. I want to format my cache drive & start again. Mover doesn't work, says disabled. I copied the data from the "root cache" it contains all my dockers to a folder on my array. I've also taken screen shots of the setting for each of the dockers so I can type them in again manually if the worst happens. If I format the cache drive I'm betting it won't be as easy as copying to docker folders back to their original locations? I've tried to create a log file, but it hasn't stopped, file size is getting bigger, it's over 8mb, I must've done something wrong.

 

Thanks in Advance

 

Bernard

Link to comment
6 minutes ago, bgeorge104 said:

Finally got round to updating to V6.8.0 Way easier & painless than last time I upgraded. Somebody said my docker image may be corrupt. I tried to use the backup plugin to backup following spaceinvaders video. Only when I run it nothing gets backed up. I want to format my cache drive & start again. Mover doesn't work, says disabled. I copied the data from the "root cache" it contains all my dockers to a folder on my array. I've also taken screen shots of the setting for each of the dockers so I can type them in again manually if the worst happens. If I format the cache drive I'm betting it won't be as easy as copying to docker folders back to their original locations? I've tried to create a log file, but it hasn't stopped, file size is getting bigger, it's over 8mb, I must've done something wrong.

Sounds like your problems go deeper than just this plugin.

 

Go to Tools - Diagnostics and attach the complete diagnostics zip file to your NEXT post.

 

I may split your post and any responses into its own thread.

 

***EDIT***

 

In fact I see you already have a thread from a few months ago and it is likely your problems have just continued from there since it doesn't look like they were resolved. Maybe I will split these back into that thread.

Link to comment

tower-diagnostics-20191223-2211.zip

7 minutes ago, bgeorge104 said:

Finally got round to updating to V6.8.0 Way easier & painless than last time I upgraded. Somebody said my docker image may be corrupt. I tried to use the backup plugin to backup following spaceinvaders video. Only when I run it nothing gets backed up. I want to format my cache drive & start again. Mover doesn't work, says disabled. I copied the data from the "root cache" it contains all my dockers to a folder on my array. I've also taken screen shots of the setting for each of the dockers so I can type them in again manually if the worst happens. If I format the cache drive I'm betting it won't be as easy as copying to docker folders back to their original locations? I've tried to create a log file, but it hasn't stopped, file size is getting bigger, it's over 8mb, I must've done something wrong.

 

Thanks in Advance

 

Bernard

 

Link to comment

You have an unusual configuration with your dockers. Your default appdata is in a user share named "docker". Is this really where each of your dockers have their appdata? I haven't looked at the video, but likely it is telling you how to backup your appdata when it is in the standard location.

 

In any case, I don't see any point in continuing this here in this appdata backup plugin thread. I have split it into a new thread.

 

And for reference in case there is anything still relevant there, here is his older thread:

 

https://forums.unraid.net/topic/84474-cache-drive-full

 

Link to comment
7 minutes ago, trurl said:

I guess you might as well wait for mover to finish, then you will have to reboot to get your logspace back.

 

Then some new diagnostics.

 

If I understand correctly, your ultimate aim is to transfer everything from cache to the array so you can reformat cache. Is that correct?

Yes, although I'm pretty sure there's nothing in the cache drive other than my docker data. 

Link to comment
9 minutes ago, trurl said:

I guess you might as well wait for mover to finish, then you will have to reboot to get your logspace back.

 

Then some new diagnostics.

 

If I understand correctly, your ultimate aim is to transfer everything from cache to the array so you can reformat cache. Is that correct?

That's the longest time I've seen mover running before I upgraded to latest os.

 

Only browser I've open chrome with 28 tabs open, bit of a tab freak. I'm typing on my win10 vm, which is scanning my media libraries at the moment.

Link to comment
8 minutes ago, bgeorge104 said:

Yes, although I'm pretty sure there's nothing in the cache drive other than my docker data. 

Isn't that what you want to save on the array? And as I already said:

22 minutes ago, trurl said:

mover is moving the (probably thousands of) files in your plex appdata

Looking again at the log though, I see the plex appdata is actually in a share named "appdata" though that is not what you have specified as your default in Docker Settings. So your appdata share actually shows up anonymized in your diagnostics, but I found it. And it is cache-prefer.

 

So, mover is moving your appdata TO your cache, which is confirmed by the syslog:

 

Dec 23 22:11:52 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1/episodes/6.xml
Dec 23 22:11:52 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1/episodes/9/thumbs/c76cfb3b4c21721dc21a5b2d1e13a870b851ddd3
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1/episodes/9.xml
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1/episodes/8/thumbs/fd57f374fc82a56da4affb2c9144e9267b944350
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1/episodes/8.xml
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1/posters/506f4f9b18540c7912196913f9a25e9a33b8111b
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1/posters/67d8355751029c1e168f961daaaa0c240538e7dd
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1/posters/0b046443ea61e2f392c4dd31cb18ea0a5cce2965
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1/posters/c81a97803d4dfdaed1d8b1cd0982208ebe31712f
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1/posters/c7fa4abb36c5467e7df46010d0c42c55f852a47f
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1/posters/d1a25616ddf139d096e6c0f89fa67dfb76c24a59
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1/posters/41f79aa29d88444407d4af51aed2065cefef2bcf
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1/posters/ae3197b1397a4226acd56da55bae85d4f084f653
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1/posters/3d2dffbdf41158160a6cf5acc668a96c746053ce
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/1.xml
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/3/episodes/11/thumbs/33ea9bd5c35cb2a5fd3c300d6c0227329c4ac685
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/3/episodes/11.xml
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/3/episodes/10/thumbs/780660eb9bb7a9027e237e20422698f60d655ee4
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/3/episodes/10.xml
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/3/episodes/13/thumbs/a6660eaab685c54c7dbc2d5bda1ed834587cdf60
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/3/episodes/13.xml
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/3/episodes/12/thumbs/353a24cd2109de05f35485291130fdf465c3c7d8
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/3/episodes/12.xml
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/3/episodes/15/thumbs/dbc4cda8a4223119ffc1bb5a9085cc99bcc7cd2f
Dec 23 22:11:53 Tower move: move: file /mnt/disk18/appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/TV Shows/0/efc1e4886ecfe600ca415d47a7aa5dce0e0b7d0.bundle/Contents/com.plexapp.agents.thetvdb/seasons/3/episodes/15.xml
De

 

Link to comment
2 minutes ago, trurl said:

Why do you want to reformat cache anyway? What is the ultimate problem you are trying to solve?

I use to use a vm to download torrent files, but the vm would lose it's connection to the server, meaning files were no longer being seeded. Id create another vm, torrents would download & mover would move them from the cache drive to the array, all was working till one day mover stopped working & just filled up. I then started using deluge vpn, worked ok, but i had to use krusader to manually move files from cache drive to array. I don't mind using deluge vpn but I'd like mover to do its stuff automatically. If I've to format the cache drive & start again so be it.

 

Thanks

 

Bernrad

Link to comment

Not clear what specifically you had wrong with your configuration, but many people don't have these problems. Perhaps if we could see how you had things setup and what was happening at the time we could have figured things out.

 

Also not clear how formatting cache is going to solve anything. As long as cache is not corrupt things can be moved, copied, or deleted from it. We can rework your user shares and docker setup then work through setting up individual dockers.

 

You've been on the forum for several years. Do you have a pretty good understanding of how to setup user shares and dockers yourself, or were you just relying on others to tell you what to do?

Link to comment
10 minutes ago, trurl said:

Not clear what specifically you had wrong with your configuration, but many people don't have these problems. Perhaps if we could see how you had things setup and what was happening at the time we could have figured things out.

 

Also not clear how formatting cache is going to solve anything. As long as cache is not corrupt things can be moved, copied, or deleted from it. We can rework your user shares and docker setup then work through setting up individual dockers.

 

You've been on the forum for several years. Do you have a pretty good understanding of how to setup user shares and dockers yourself, or were you just relying on others to tell you what to do?

I thought I knew how to setup up shares in unraid, could never figure out how to make them read only for all but me. Dockers completely alien to me, I relied on watching videos from space invader, not the easiest to follow because of the colours used. 

Mover finished. Have posted log files. I'd love to get things sorted.

tower-syslog-20191224-1323.zip

Link to comment

I would say that your main problem is you have a very large number of disks in the parity array, and these are almost completely full. Personally if I were going to have an array with that many disks, I would be running dual parity.

 

You also have way more user shares than seems necessary. That large number of user shares, combined with your nonstandard way of using them for you docker configuration, makes it more trouble to try to make sense of them though, especially since the share names are anonymized in the diagnostics. Just looking at a few of those, it doesn't seem like you have bothered to set one of the most important settings for the shares, Minimum Free. And since your disks are so full it is likely that you will try to overfill your disks because there is no Minimum for your user shares. Have you ever had any errors due to lack of space?

 

I don't want to look at all those SMART reports and that isn't your purpose for this thread anyway, but I still want to know. Are any of your disks giving SMART warnings on the Dashboard?

 

What is your plans for increasing capacity?

 

I know you are really just trying to get your dockers working again. but your whole server setup is teetering on the edge at this point and those things need to be taken care of before trying to get your dockers setup correctly and working again.

 

Do you have any VMs?

 

Link to comment
1 hour ago, trurl said:

I would say that your main problem is you have a very large number of disks in the parity array, and these are almost completely full. Personally if I were going to have an array with that many disks, I would be running dual parity.

 

You also have way more user shares than seems necessary. That large number of user shares, combined with your nonstandard way of using them for you docker configuration, makes it more trouble to try to make sense of them though, especially since the share names are anonymized in the diagnostics. Just looking at a few of those, it doesn't seem like you have bothered to set one of the most important settings for the shares, Minimum Free. And since your disks are so full it is likely that you will try to overfill your disks because there is no Minimum for your user shares. Have you ever had any errors due to lack of space?

 

I don't want to look at all those SMART reports and that isn't your purpose for this thread anyway, but I still want to know. Are any of your disks giving SMART warnings on the Dashboard?

 

What is your plans for increasing capacity?

 

I know you are really just trying to get your dockers working again. but your whole server setup is teetering on the edge at this point and those things need to be taken care of before trying to get your dockers setup correctly and working again.

 

Do you have any VMs?

 

I have one vm, running plex. I do have plans to add another parity drive in the future, as well as swapping out some of the smaller drives. No Smart errors.

Edited by bgeorge104
Link to comment
17 hours ago, trurl said:

Why run plex in a VM? There are several plex dockers and they work well.

I found plex dockers to be not always accessible from outside my network. I've tried binhex plex & plex mediaserver, this is the one I've had most success with. If you know of better ones please let me know.

Link to comment
4 hours ago, bgeorge104 said:

I found plex dockers to be not always accessible from outside my network. I've tried binhex plex & plex mediaserver, this is the one I've had most success with. If you know of better ones please let me know.

I'm currently running linuxserver.io plex and my sister halfway across the country can access my plex just fine. That said, I know there are plenty of people using those others without that problem so I can only guess it is something wrong with your setup.

Link to comment
On 12/26/2019 at 9:30 PM, trurl said:

I'm currently running linuxserver.io plex and my sister halfway across the country can access my plex just fine. That said, I know there are plenty of people using those others without that problem so I can only guess it is something wrong with your setup.

Managed to get plex docker working & accessable outside home network. Also got air videohd working. tried adding another path & now its broken, can't access it all! That's the sort of thing that frustrates me about dockers. Even after removing the paths its still broken!

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.