Mover taking forever after cache drive replace


Recommended Posts

I followed all the instructions here to replace my cache drive. I went from 1x250GB SSD to 2x1TB SSD. The mover took overnight to move everything off the old drive and I put the new drives in this morning (~8am EST, over 8 hours as of my posting). I started the mover and it's process has been terribly slow, as in after 8 hours the cache drive reports 11.9GB of data on it.

 

To be fair it's moving my appdata folder which contains my plex config (which has a ton of tiny files) and right now my best guess is that this is causing the issues but I want to make sure. The odd thing is mover seems to hang. Here are some example from /var/log/syslog: (Note the timestamps, you can see multiple minute gaps)

 

 

Nov 26 15:25:59 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/e3bdfba0e3d3daab01d9e855d98fe5e66530fe9.bundle/Contents/Subtitles.xml
Nov 26 15:26:00 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/e3bdfba0e3d3daab01d9e855d98fe5e66530fe9.bundle/Contents/GoP-0.xml
Nov 26 15:28:33 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/ca69d866762df5930206a3b0ba4930ca925e8c2.bundle/Contents/Thumbnails/thumb1.jpg
Nov 26 15:28:33 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/ca69d866762df5930206a3b0ba4930ca925e8c2.bundle/Contents/GoP-0.xml
Nov 26 15:28:33 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/ca69d866762df5930206a3b0ba4930ca925e8c2.bundle/Contents/Subtitles.xml
Nov 26 15:28:34 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/c40d8c94d68ee0f39b93ae9b5f483cfa9251c37.bundle/Contents/Thumbnails/thumb1.jpg
Nov 26 15:30:26 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/c40d8c94d68ee0f39b93ae9b5f483cfa9251c37.bundle/Contents/GoP-0.xml
Nov 26 15:30:26 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/c40d8c94d68ee0f39b93ae9b5f483cfa9251c37.bundle/Contents/Subtitles.xml
Nov 26 15:30:26 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/76aceb7500df142ab69670a8976ea1ddd421a6e.bundle/Contents/Thumbnails/thumb1.jpg
Nov 26 15:30:27 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/76aceb7500df142ab69670a8976ea1ddd421a6e.bundle/Contents/GoP-0.xml
Nov 26 15:30:32 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/76aceb7500df142ab69670a8976ea1ddd421a6e.bundle/Contents/Subtitles.xml
Nov 26 15:33:34 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/2ad72506324b98ab0320884a3d09ad543490aad.bundle/Contents/Thumbnails/thumb1.jpg
Nov 26 15:33:34 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/2ad72506324b98ab0320884a3d09ad543490aad.bundle/Contents/GoP-0.xml
Nov 26 15:33:35 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/2ad72506324b98ab0320884a3d09ad543490aad.bundle/Contents/Subtitles.xml
Nov 26 15:33:35 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/30c418f92066540ac190d94ddb0da37d83f1d54.bundle/Contents/Thumbnails/thumb1.jpg
Nov 26 15:33:37 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/30c418f92066540ac190d94ddb0da37d83f1d54.bundle/Contents/GoP-0.xml
Nov 26 15:36:05 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/30c418f92066540ac190d94ddb0da37d83f1d54.bundle/Contents/Subtitles.xml
Nov 26 15:36:05 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/f01ea2e455bb1896e411bb568babf67a0379039.bundle/Contents/Thumbnails/thumb1.jpg
Nov 26 15:36:06 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/f01ea2e455bb1896e411bb568babf67a0379039.bundle/Contents/GoP-0.xml
Nov 26 15:36:07 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/f01ea2e455bb1896e411bb568babf67a0379039.bundle/Contents/Subtitles.xml
Nov 26 15:36:17 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/0cc916c70ff86ceabec3e7dc0135751f3acaeae.bundle/Contents/Subtitle Contributions/com.plexapp.agents.localmedia.xml
Nov 26 15:39:21 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/0cc916c70ff86ceabec3e7dc0135751f3acaeae.bundle/Contents/Thumbnails/thumb1.jpg
Nov 26 15:39:21 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/0cc916c70ff86ceabec3e7dc0135751f3acaeae.bundle/Contents/GoP-0.xml
Nov 26 15:39:21 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/0cc916c70ff86ceabec3e7dc0135751f3acaeae.bundle/Contents/Subtitles.xml
Nov 26 15:39:21 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/e1e4d45d549eb0fb7b2fcaf749b67e12f52c84b.bundle/Contents/Subtitle Contributions/com.plexapp.agents.subzero.xml
Nov 26 15:39:23 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/e1e4d45d549eb0fb7b2fcaf749b67e12f52c84b.bundle/Contents/Subtitle Contributions/com.plexapp.agents.localmedia.xml
Nov 26 15:42:07 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/e1e4d45d549eb0fb7b2fcaf749b67e12f52c84b.bundle/Contents/Thumbnails/thumb1.jpg
Nov 26 15:42:07 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/e1e4d45d549eb0fb7b2fcaf749b67e12f52c84b.bundle/Contents/GoP-0.xml
Nov 26 15:42:07 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/e1e4d45d549eb0fb7b2fcaf749b67e12f52c84b.bundle/Contents/Subtitles.xml
Nov 26 15:42:08 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/809985010e8a1df8000a0a6f764d6df294c5c9f.bundle/Contents/Subtitle Contributions/com.plexapp.agents.subzero.xml
Nov 26 15:42:10 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/809985010e8a1df8000a0a6f764d6df294c5c9f.bundle/Contents/Subtitle Contributions/com.plexapp.agents.localmedia.xml
Nov 26 15:44:54 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/809985010e8a1df8000a0a6f764d6df294c5c9f.bundle/Contents/GoP-0.xml
Nov 26 15:44:54 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/809985010e8a1df8000a0a6f764d6df294c5c9f.bundle/Contents/Thumbnails/thumb1.jpg
Nov 26 15:44:54 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/809985010e8a1df8000a0a6f764d6df294c5c9f.bundle/Contents/Subtitles.xml
Nov 26 15:44:55 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/00ab1d74a1841af6f0a4e7e6d746e516e7a3e8a.bundle/Contents/Subtitle Contributions/com.plexapp.agents.subzero.xml
Nov 26 15:44:55 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/00ab1d74a1841af6f0a4e7e6d746e516e7a3e8a.bundle/Contents/Subtitle Contributions/com.plexapp.agents.localmedia.xml
Nov 26 15:44:55 Tower move: move: file /mnt/disk2/Config/plex/Plex Media Server/Media/localhost/a/00ab1d74a1841af6f0a4e7e6d746e516e7a3e8a.bundle/Contents/Thumbnails/thumb1.jpg

 

 

Is this just to be expected? I'm not exactly mr. popular over here with coming up on 24 hours of downtime (covering 2 primetime viewing times) and no known end in sight. I'm guessing I'll just wake up to it completed tomorrow given it took overnight to move off the SSD in the first place.

Edited by joshstrange
Formatting "1 256GB" -> "1x256GB"
Link to comment

syslog snippets are seldom sufficient😉

 

What you provided doesn't give any indication of hanging though.

 

Of course the move will copy the data back to cache but it will also delete from disk2, and that delete is a write operation in the parity array so it updates parity.

 

Not enough information to know if anything actually wrong, or just a very large number of small file deletes in the array.

Link to comment
5 minutes ago, johnnie.black said:

Mover is not efficient for moving very small files, you should use cp, mc, or any other copy tool.

Ok, I'll look into stopping the mover then using mv in screen.

 

4 minutes ago, trurl said:

syslog snippets are seldom sufficient😉

 

What you provided doesn't give any indication of hanging though.

 

Of course the move will copy the data back to cache but it will also delete from disk2, and that delete is a write operation in the parity array so it updates parity.

 

Not enough information to know if anything actually wrong, or just a very large number of small file deletes in the array.

Ok, I don't want to waste anyone's time, I was just seeing if it turned on a light in anyone else's head. Like I said I think it will finish by the morning and I've only ever needed to do this once.

Link to comment
Just now, John_M said:

It isn't obvious from your last post what your decision was - aborting the mover or leaving it to run its course. Personally, and having let it run for so long, I would just let it continue. Assuming, of course, that diagnostics don't reveal any problems.

I ended up stopping it "mover stop" and then I used rsync to copy the files over. That process is still going but already I've moved 20GB more in less than 3 hours so I'm probably going to move my appdata folder by hand with rsync then let mover run again to move my VM/Docker/etc since those things are big size-wise but only a handful of files.

 

Just to anyone that runs across this the command I am using is:

 

rsync -Pavh --remove-source-files /mnt/user0/appdata/ /mnt/cache/appdata/

 

This won't remove the directories (of which I have MANY nested) but it will clear the files out behind it. My plan is to then just "rm -rf" each folder inside of appdata once I've doubled checked they are all empty. 

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.