Mover not moving


Recommended Posts

OK, so I'm not having a good day. I've noticed all my shares were set to use cache and they didn't just use the cache for new files. It kept using the cache and refused to empty the cache drive. I've suspected something was going on for a while, but couldn't put a finger on it. I figured I was just improperly utilizing cache due to constant complaints of cache being full or near full. I decided it was time to start marking shares as don't use cache. I began rsyncing files over. from /mnt/cache to /mnt/user/  . I had one VM being used as a transparent bridge firewall, I decided rsyncing was taking too long and checked both /mnt/user and /mnt/cache to make sure they both had the VM. Then proceeded with deleting the VM once I noticed they were both there. NOPE! now the VM is gone completely. I'm not sure what was happening with the mover. even with the VM halted, the mover refused to empty all the files off the cache drive.

 

Now I'm praying that the entire library of videos I used for my plex docker actually decided to move when I rsynced from the cache to the user (because invoking mover didn't move the files off). wish me luck guys. I'm thinking I'm in for a nightmare.

Link to comment

Unfortunately your attempt to rsync the files from the cache disc to /mnt/user will have probably caused the rsynced files to be truncated to zero size.    If you wanted to do this you should have copied them to /mnt/user0 just as mover usually does.

 

The /mnt/user share already includes the cache disc, while the /mnt/user0 specifically does not include the cache disk.

 

i suspect that if you used the option to rsync to delete the original file then it would have then deleted the file as well.

 

 

Edited by remotevisitor
  • Upvote 1
Link to comment

The /mnt/user location is a consolidated view of all the top level folders on the array disks AND /mnt/cache.   The problem is that /mnt/cache is a disk Share and /mnt/user is a user share.   Copying files from /mnt/cache to /mnt/user can result in you trying to copy a file to itself and result in the file being truncated (this leading to data loss).   

Link to comment

Nope, didn't even give the zero size. 500G worth of crap gone due to mover refusing to move the files. SSD is a 1TB. I guess its not all bad. at least I know whats missing. I could probably just acquire it all again and reinstall pfsense on a new VM and start over there. its only a couple weeks worth of work. I still feel like I could crawl in a hole right now.

Link to comment

The real answer would have been to work out why mover was not behaving as expected.    The way to investigate this would be to involve mover manually from the Main screen and then post the diagnostics zip file (obtained via Tools->Diagnostics) so others can try and spot what is set up incorrectly.

Link to comment

Yep, you would be correct.  the issue occurred before moving to 6.4-rc6. I was previously on 6.3 when the issue began. I'm also not the only one who uses the shares so I'd rather not make the friends and family mad by loosing their data lol. Luckily the stuff I lost was only mine, but the rest starts getting into shared territory.

Edited by Darksurf
Link to comment

Also, your VMs share is set to cache prefer, so the mover is trying to move it to cache:

 

Jun 25 16:41:53 cold-rewind root: move: file /mnt/disk1/VMs/Windows10Nvidia.cfg
Jun 25 16:41:53 cold-rewind root: move: skip /mnt/disk1/VMs/Windows10/vdisk1.img
Jun 25 16:41:53 cold-rewind root: move:  dir /mnt/disk1/VMs/Windows10
Jun 25 16:41:53 cold-rewind root: move:  dir /mnt/disk1/VMs/Windows10: Directory not empty
Jun 25 16:41:53 cold-rewind root: move:  dir /mnt/disk1/VMs
Jun 25 16:41:53 cold-rewind root: move:  dir /mnt/disk1/VMs: Directory not empty
Jun 25 16:41:54 cold-rewind root: move: skip /mnt/disk1/system/libvirt/libvirt.img
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk1/system/libvirt
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk1/system/libvirt: Directory not empty
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk1/system
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk1/system: Directory not empty
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk2/VMs/ISOs
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk2/VMs/Windows10
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk2/VMs
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk3/VMs/ISOs
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk3/VMs

 

Link to comment
2 hours ago, johnnie.black said:

Also, your VMs share is set to cache prefer, so the mover is trying to move it to cache:

 


Jun 25 16:41:53 cold-rewind root: move: file /mnt/disk1/VMs/Windows10Nvidia.cfg
Jun 25 16:41:53 cold-rewind root: move: skip /mnt/disk1/VMs/Windows10/vdisk1.img
Jun 25 16:41:53 cold-rewind root: move:  dir /mnt/disk1/VMs/Windows10
Jun 25 16:41:53 cold-rewind root: move:  dir /mnt/disk1/VMs/Windows10: Directory not empty
Jun 25 16:41:53 cold-rewind root: move:  dir /mnt/disk1/VMs
Jun 25 16:41:53 cold-rewind root: move:  dir /mnt/disk1/VMs: Directory not empty
Jun 25 16:41:54 cold-rewind root: move: skip /mnt/disk1/system/libvirt/libvirt.img
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk1/system/libvirt
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk1/system/libvirt: Directory not empty
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk1/system
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk1/system: Directory not empty
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk2/VMs/ISOs
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk2/VMs/Windows10
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk2/VMs
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk3/VMs/ISOs
Jun 25 16:41:54 cold-rewind root: move:  dir /mnt/disk3/VMs

 

Which is appropriate, but you will need to stop the VM service before mover can succeed.

Link to comment

Thanks so much guys! This instruction has been extremely helpful! I've got my cache drive emptied! I'll now halt my VMs to get them moved to SSD cache. Another question. if something is using prefer cache such as my VMs it sounds like it wouldn't be protected by the parity drive. Can you suggest a method to backup VM disks?

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.