The Transplant Posted February 27 Share Posted February 27 (edited) I just added a new cache drive (1TB). My plan is to remove the second drive (240GB) and then replace it with another 1TB drive and then mirror it. I added the new cache and have pointed all shares at it as needed. I have read dozens of posts about doing this but everyone seems to be slightly different - either on an older version of Unraid or not quite my configuration. As a result I will post my details and hope I can get specific information on how to do this in my case as I don't want to be rebuilding my box. I have stopped dockers and VMs and run the mover - twice. It completed. However I am still seeing a bunch of data on the old cache drive. Domains on the old cache has a folder for an old VM and nothing in it. System contains libvirt.img and docker.img. Presumably these need to be moved to the new cache but can't figure out how to do that. The appdata folder on the old cache contains a lot of old stuff This is my docker list now I see a few dockers that have references to the old cache. Is it as simple as stopping these, updating the location, and copying the folder from cache_specific to cache? And when I look at other docker folders in the old cache that have been updated recently I see files being written to as I look at them So clearly not everything has been moved. All of this leaves me with a distinct lack of confidence on how to pull this drive right now. So hoping to get some pointers. Diagnostics attached. Thanks. odin-diagnostics-20240227-1707.zip Edited February 27 by The Transplant Saved too soon Quote Link to comment
JorgeB Posted February 28 Share Posted February 28 14 hours ago, The Transplant said: I have stopped dockers and VMs and run the mover - twice. It completed. However I am still seeing a bunch of data on the old cache drive. Enable mover logging, run the mover, post the diagnostics. Quote Link to comment
The Transplant Posted February 28 Author Share Posted February 28 37 minutes ago, JorgeB said: Enable mover logging, run the mover, post the diagnostics. Thanks for responding. I have looked at the logs - all they seem to show is a lot of this. cache_specific is the drive that I am trying to empty. Is there something else in the logs I should be looking for or does this help diagnose? Thanks. Feb 28 08:25:20 Odin move: move_object: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/audio-output-none-panel.svg File exists Feb 28 08:25:20 Odin move: file: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/btsync-gui-disconnected.svg Feb 28 08:25:20 Odin move: move_object: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/btsync-gui-disconnected.svg File exists Feb 28 08:25:20 Odin move: file: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/audio-recorder-on.svg Feb 28 08:25:20 Odin move: move_object: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/audio-recorder-on.svg File exists Feb 28 08:25:20 Odin move: file: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/btsync-gui-paused.svg Feb 28 08:25:20 Odin move: move_object: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/btsync-gui-paused.svg File exists Feb 28 08:25:20 Odin move: file: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/audio-recorder-paused.svg Feb 28 08:25:20 Odin move: move_object: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/audio-recorder-paused.svg File exists Feb 28 08:25:20 Odin move: file: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/clementine-85-playing.svg Feb 28 08:25:20 Odin move: move_object: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/clementine-85-playing.svg File exists Feb 28 08:25:20 Odin move: file: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/audio-recorder.svg Feb 28 08:25:20 Odin move: move_object: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/audio-recorder.svg File exists Feb 28 08:25:20 Odin move: file: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/changes-allow.svg Feb 28 08:25:20 Odin move: move_object: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/changes-allow.svg File exists Feb 28 08:25:20 Odin move: file: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/audio-volume-high-panel.svg Feb 28 08:25:20 Odin move: move_object: /mnt/cache_specific/appdata/binhex-krusader/home/.icons/BLACK-Ice-Numix-FLAT/24/status/audio-volume-high-panel.svg File exists Quote Link to comment
JorgeB Posted February 28 Share Posted February 28 Logs show the files already exist, mover won't move duplicate files, you will need to delete one of the copies, usually the older one. Quote Link to comment
The Transplant Posted February 28 Author Share Posted February 28 3 hours ago, JorgeB said: Logs show the files already exist, mover won't move duplicate files, you will need to delete one of the copies, usually the older one. That makes sense. So how do I compare these files? Using Krusader I see the folders on cache_specific. But where is the file on the array that I should be comparing this too? I see disk1-5. One of them has an appdata folder. It contains virtually nothing and the others don't. So where am I supposed to compare against? Thanks. Quote Link to comment
JorgeB Posted February 28 Share Posted February 28 You can compare /mnt/user0 vs /mnt/cache_specific, look at the files date, newer one is usually the one you want, usually. Quote Link to comment
trurl Posted February 28 Share Posted February 28 appdata shareUseCache="yes" # Share exists on cache, disk1, cache_specific This shows the disks/pools appdata is on. It also says that you have appdata set to move files to the array. You really want this as Mover action:Array->Cache. Probably the reason it hasn't moved all of them to the array is because nothing can move open files. You will have to disable Docker in Settings before you can move these. Instead of Krusader, I recommend Dynamix File Manager, which you already have installed. Quote Link to comment
The Transplant Posted February 28 Author Share Posted February 28 27 minutes ago, trurl said: appdata shareUseCache="yes" # Share exists on cache, disk1, cache_specific This shows the disks/pools appdata is on. It also says that you have appdata set to move files to the array. You really want this as Mover action:Array->Cache. Probably the reason it hasn't moved all of them to the array is because nothing can move open files. You will have to disable Docker in Settings before you can move these. Instead of Krusader, I recommend Dynamix File Manager, which you already have installed. ok, fixed the mover action on appdata. I did shutdown vms and dockers when running mover before. But with this new setting change should I try shutting them down again and running Mover or am I still going to have an issue of file versions? Thanks. Quote Link to comment
trurl Posted February 28 Share Posted February 28 Since Mover won't move between pools, and appdata is on disk1 and also on 2 separate pools, you need to decide where you want it to be, set that as Primary, then probably simpler to finish the job yourself instead of relying on Mover. 2 hours ago, trurl said: I recommend Dynamix File Manager, which you already have installed. Quote Link to comment
The Transplant Posted February 28 Author Share Posted February 28 3 hours ago, trurl said: Since Mover won't move between pools, and appdata is on disk1 and also on 2 separate pools, you need to decide where you want it to be, set that as Primary, then probably simpler to finish the job yourself instead of relying on Mover. I would love to follow this advice - if I felt confident enough that I wouldn't hose the server in doing this. As an example I see a Radarr folder in both old and new cache. Different files and folders. And date/time stamps indicating that they are both being updated now. What do I do here? Im getting close to deleting all of the dockers at this point as it appears you need to have a very strong understanding of what is going on here in order to fix this. But willing to hang in to see if this can be done without me having to reconfigure everything. Thanks. new cache: old cache: Quote Link to comment
trurl Posted February 29 Share Posted February 29 You'd have to take a closer look in MediaCover to see if there were duplicates there, but otherwise there are no duplicates shown. You just need to get them all together on the pool you intend to use for appdata. Quote Link to comment
The Transplant Posted March 2 Author Share Posted March 2 On 2/28/2024 at 10:12 PM, trurl said: You'd have to take a closer look in MediaCover to see if there were duplicates there, but otherwise there are no duplicates shown. You just need to get them all together on the pool you intend to use for appdata. Well I held my nose and went for it. My concern was that some dockers were clearly writing to the old cache even after updating all settings. In some cases this was because their config had hard coded references to the cache location. In others it seems that when it has an option of old a new cache at the same time it continues writing to the old cache for existing files and new cache for newly created files? Anyway I was able to move them all successfully. Now on to adding a mirror for the cache so I don't find myself in this situation again. One more question. When a docker has a hard coded reference to the cache drive, for example: /mnt/cache/appdata/openvpn-client. Wouldn't it make sense to change this to; /mnt/user/appdata/openvpn-client and then it would go wherever the cache is located? Thanks. Quote Link to comment
itimpi Posted March 2 Share Posted March 2 3 minutes ago, The Transplant said: When a docker has a hard coded reference to the cache drive, for example: /mnt/cache/appdata/openvpn-client. Wouldn't it make sense to change this to; /mnt/user/appdata/openvpn-client and then it would go wherever the cache is located? Ideally the user should never set up hard coded references in the first place, particularily with the 6.12.x releases and the Introduction of Exclusive shares which have the same performance characteristics as these hard coded references. Unraid silently changing anything is highly undesirable because the user may have deliberately set things up a particular way and does not want it over-ridden. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.