Moving Appdata

[Fogey]

I just upgraded my server with a new CPU and MB. The MB has lots of M2NVMW ports, so I decided to set up a new pool with 2 NVME's and use it to store my Appdata - as Spaceinvader suggests. Currently the Appdata is stored on an old SSD pool.

 

On the Shares page, I pointed the Appdata at the new pool and thought that Unraid would transfer the files across. That didn't happen, and I'm now getting warnings to manually move the Appdata to the new pool.

 

I see that Unraid has put some Appdata files on the new pool, but it has also left a lot of data on the old pool. For example, I have Bibhex- Radarr on the old pool as well as the new pool.

 

My question is :

 

do I merge the old pool and new pool data onto the new pool, or

 

do I overwrite the new pool by copying the old data to it.

 

If I have to merge, each appdata folder has several subfolders, so do I have to go through and merge at a subfolder level?

 

Any advice would be helpful

Fogey

[itimpi]

Did you follow the steps outlined here in the online documentation?

 

You are likely to get better informed feedback if you attach your system’s diagnostics zip file to your next post in this thread. It is always a good idea when asking questions to supply your diagnostics so we can see details of your system, how you have things configured, and the current syslog.

[Fogey]

No, I was watching a Spcaeinvader video so followed him - I didn't red the online docs.

 

Sorry about the diagnostics - I didn't know.  I've attached them - should they be zipped or something?

 

Fogey

 

 

domain.cfg flash.cfg cache_nvme.cfg board.cfg pool_ssd.cfg docker.cfg smb-extra.conf editor.cfg super.dat ident.cfg share.cfg network.cfg go.txt disk.cfg listen.txt nvme.c0a9-313931374531464444323534-435431303030503153534438-00000001-2023-12-01 cache_nvme (nvme2).txt ST8000DM004-2U9188_ZR14G6T4-2023-12-01 disk2 (sdd).txt MKNSSDPE500GB-D8_MK20022110060AAED-2023-12-01 cache_nvme2 (nvme1).txt eui.e8238fa6bf530001001b448b4e4b99eb-2023-12-01 board (nvme0).txt WD_BLACK_SN770_500GB_22365K800761-2023-12-01 board (nvme0).txt ST8000DM004-2U9188_ZR12SAKC-2023-12-01 disk4 (sdf).txt CT1000BX500SSD1_2151E5F422E4-2023-12-01 pool_ssd (sdh).txt ST1000LM035-1RK172_ZDED7078-2023-12-01 disk7 (sdc).txt nvme.126f-4d4b323030323231313030363041414544-4d4b4e535344504535303047422d4438-00000001-2023-12-01 cache_nvme2 (nvme1).txt Samsung_PSSD_T7_S5TMNJ0RA00133R-0-0-2023-12-01 (sda).txt ST4000DM004-2CV104_ZFN34WRL-2023-12-01 disk6 (sde).txt ST8000DM004-2CX188_ZR10TN7P-2023-12-01 disk1 (sdg).txt ST12000VN0008-2YS101_ZRT09FTB-2023-12-01 parity (sdk).txt WDC_WD80EFBX-68AZZN0_VRGVY9BK-2023-12-01 disk5 (sdj).txt USB_SanDisk_3.2Gen1_01019b3d8a17996ae36a67d58ec259a2dce4d070f7a5fb51fee06e6a0875de26764d0000000000000000000020aefef4ff01570083558107a7aa9cb8-0-0-2023-12-01 flash (sdb).txt CT1000P1SSD8_1917E1FDD254-2023-12-01 cache_nvme (nvme2).txt WDC_WD40EFRX-68N32N0_WD-WCC7K2RX0DJ6-2023-12-01 disk3 (sdi).txt unraid-6.12.8.txt Windows 10.xml Ubuntu.xml cmdline.txt btrfs-usage.txt drm.txt unraid-api.txt plugins.txt motherboard.txt iommu_groups.txt ntp.txt ethtool.txt folders.txt sshd.txt lsmod.txt lsscsi.txt thirdparty_packages.txt loads.txt testparm.txt memory.txt lspci.txt zfs-info.txt meminfo.txt lsusb.txt urls.txt top.txt ps.txt servers.conf.txt vars.txt lscpu.txt lsof.txt df.txt ifconfig.txt dhcplog.txt docker.txt wg-quick.txt syslog-previous.txt syslog.txt appdata.cfg z---------s.cfg domains.cfg b-----s.cfg isos.cfg T----------------------------------Y.cfg system.cfg W---------k.cfg d--a.cfg shareDisks.txt P----s.cfg D-------s.cfg N-------d.cfg i----------s.cfg T--p.cfg

[trurl]

35 minutes ago, Fogey said:

should they be zipped

Diagnostics is a zip file. Your computer must have automatically unzipped it for you. Nobody is going to download those separate attachments. Please try again.

[Fogey]

You are correct - the MBP unzips the file. I've re-zipped it - attached

wd-diagnostics-20240323-1344.zip

[trurl]

Probably simpler to use Dynamix File Manager and take care of it yourself. Nothing can move or delete open files so you will have to Disable Docker in Settings to work with appdata.

 

If I understand what you did, probably everything on the new pool is new so there shouldn't be any duplicates.

[Fogey]

So just to be certain what you are saying, at present, I have an Appdata docker fie (e.g. Radarr) in the old Cache with a few “subfiles” . I also have the same Appdata docker file (Radarr) on the new Cache with a few more “subfiles”.

 

Your suggestion is to simply move those old cache subfiles into the new docker file on the new Cache. Does this mean that I just copy the “subfiles” into the Appdata docker on they new Cache, or do I need to merge the two “subfiles”together in the new cache.?

 

[trurl]

If you just move appdata from one pool to the other, it will merge them. If there are duplicates, it will ask if you want to replace. I don't expect duplicates though assuming all your containers only reference /mnt/user/appdata instead of /mnt/cache/appdata, for example.

[Fogey]

Thanks for the input - I did as you said and it worked fine. Still one final, very small, question - how can I delete the now empty Appdata folder on the old ssd cache that I moved everything from onto the new cache?  FiX Common Problems is telling me they are still there, so it's giving a constant warning. I tried Dynamix File Manager but it wouldt delete it.

[trurl]

45 minutes ago, Fogey said:

I tried Dynamix File Manager but it wouldt delete it.

I don't know why that wouldn't work, must be some attempt to keep users from easily doing the wrong thing. I notice it won't let you create a folder at the top level of pool or array disk either, since that would create a user share and it's better to do that explicitly from the User Shares page.

 

I guess you will have to go to the command line for that.

[trurl]

I didn't push the Delete button to see what would happen, but it looks like if you just browse to the top level of a pool it will let you select any folder and the Delete button is enabled.

 

How did you try to do it?

[Fogey]

Did what you tried and pushed the Delete button - it makes no difference as the folder is still there.

 

[trurl]

It doesn't give you any feedback like,are you sure you want to do this, or why you can't do this?

[trurl]

1 hour ago, Fogey said:

FiX Common Problems is telling me they are still there

Does it also tell you that pool is read-only?

[Fogey]

No, neither. But of course, it doesn't do anything anyway

 

[trurl]

You want the empty appdata folder removed from the pool named "board"?

 

What do you get from command line with this?

ls -lah /mnt/board/appdata

 

[Fogey]

total 106K
drwxrwxrwx 18 nobody users 18 Mar 24 10:23 ./
drwxrwxrwx  5 nobody users  5 Mar 24 16:22 ../
drwxrwxrwx  8 nobody users 13 Mar 24 10:15 FileBot/
drwxrwxrwx  8 nobody users  8 Mar 23 09:09 bazarr/
drwxrwxrwx  8 nobody users 25 Mar 24 11:28 binhex-delugevpn/
drwxrwxrwx  3 nobody users 10 Mar 24 10:09 binhex-krusader/
drwxrwxrwx  6 nobody users  8 Mar 24 10:12 binhex-plex/
drwxrwxr-x  3 nobody users  5 Mar 24 10:12 binhex-prowlarr/
drwxrwxrwx  6 nobody users 21 Mar 24 11:26 binhex-radarr/
drwxrwxrwx  6 nobody users 15 Mar 24 10:13 binhex-sabnzbd/
drwxrwxrwx  7 nobody users 22 Mar 24 11:08 binhex-sonarr/
drwxrwxrwx  2 nobody users  2 May  3  2023 data/
drwxrwxrwx  2 nobody users  2 Jul 24  2023 duckdns/
drwxrwxrwx  2 nobody users  2 Sep  1  2023 firefox/
drwxrwxr-x  6 nobody users 12 Mar 24 10:18 prowlarr/
drwxrwxrwx  2 nobody users  2 Sep  1  2023 transmission/
drwxrwxrwx  6 nobody users  6 Mar 24 10:18 unmanic/
drwxrwxrwx  2 nobody users  2 Jul 13  2023 wireguard-easy/

[trurl]

Obviously that is not empty. Do you mean each of those folders are empty? You can't delete appdata until you delete each of those folders.

[Fogey]

I might have a solution.
As you suggested, I copied the appdata from the old cache to the new cache and it merged. All fine at this stage.

Next, as the old cache was zfs, and the new one was btfs, I followed Spaceinvaders video and had Mover move the files to the array, then formatted the new cache to zfs and then had mover bring the files back onto the new cache.

That leaves me with the old cache empty, apart from a bunch of non-deletable folders.

So I wondered if I simply reformat that drive - its zfs at the moment, so I could format it as xfs to clear the folders andf thenformat it again to zfs.

Maybe notr the most elegant solution, but it should work

 

[Fogey]

Sorry my message crossed with yours. Yes, each of the folders is empty - it's just I can't delete them. My post above might be a solution.