(Solved)No errors from Mover


Recommended Posts

Hi guys. My server crashed a few weeks ago so I upgraded the hardware. Installed new MB and CPU + new PSU. Transferred all disks and did a parity check. Everything is working fine. I installed Deluge docker and downloads are ok. I seem to have a problem with mover. I don't know if the problem appeared before or after updating unraid to 6.3.5. Mover is not moving my files even if invoked manually and I can't see any error in the logs. I tried copying a file outside the completed folder to see if it would be a problem with Deluge but, that did not work either. I included a copy of the Diagnostic.

Don

tower-diagnostics-20170725-0954.zip

Link to comment
11 hours ago, itimpi said:

Which share are you expecting mover to work with.

 

The download share which is under /mnt/user/downloads and set to utilize cash = yes. As far as the mover, isn't that what is meant on lines :Jul 25 09:28:47 Tower root: mover started
Jul 25 09:28:47 Tower root: mover finished at the end of the syslog. As you can see, nothing was moved. I am far from an unraid and linux guru so there may be something I did not set correctly but, I know that at one point, everything was working fine.

Don

Link to comment

Got to   'Settings'    >>>  'Scheduler'    >>>   'Mover Settings'  .   There look for the  Mover logging:  and, if it is set to 'Disable', set it to 'Enable'  (However, depending on the complexity of the folder tree on the cache drive, this can result in a massive number of entries in your syslog.  (I would change the setting and then involve the Mover manually to see what is going on...)

Link to comment

Sorry for the delay. Logging is enabled. This is from a few days ago:

Jul 26 02:00:01 Tower root: mover started
Jul 26 02:00:01 Tower root: moving "downloads" to array
Jul 26 02:00:01 Tower root: .d..t...... ./
Jul 26 02:00:01 Tower root: .d..t...... downloads/
Jul 26 02:00:01 Tower root: .d..t...... downloads/torrents/
Jul 26 02:00:01 Tower root: >f+++++++++ downloads/torrents/Snatched.2017.720p.BluRay.x264-GECKOS-[rarbg.to].torrent
Jul 26 02:00:17 Tower root: .d..t...... downloads/torrents/
Jul 26 02:00:17 Tower root: .d..t...... downloads/
Jul 26 02:00:17 Tower root: .d..t...... downloads/incomplete/
Jul 26 02:00:17 Tower root: .d..t...... downloads/complete/
Jul 26 02:00:17 Tower root: cd+++++++++ downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/
Jul 26 02:00:17 Tower root: >f+++++++++ downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/Snatched.2017.720p.BluRay.x264-GECKOS.mkv
Jul 26 02:01:44 Tower root: .d..t...... downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/
Jul 26 02:01:44 Tower root: cd+++++++++ downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/Subs/
Jul 26 02:01:44 Tower root: >f+++++++++ downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/Subs/Snatched.2017.720p.BluRay.x264-GECKOS.sub
Jul 26 02:01:45 Tower root: .d..t...... downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/Subs/
Jul 26 02:01:45 Tower root: >f+++++++++ downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/Subs/Snatched.2017.720p.BluRay.x264-GECKOS.idx
Jul 26 02:01:45 Tower root: .d..t...... downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/
Jul 26 02:01:45 Tower root: .d..t...... downloads/complete/
Jul 26 02:01:45 Tower root: .d..t...... downloads/
Jul 26 02:01:45 Tower root: mover finished

  It looks like it is working but nothing gets moved. When invoked manually, it just adds 3 liness to the syslog:

Jul 28 21:10:42 Tower emhttp: shcmd (45518): /usr/local/sbin/mover |& logger &
Jul 28 21:10:42 Tower root: mover started
Jul 28 21:10:42 Tower root: mover finished
Link to comment
Quote

And did those files listed above get moved or not?

No they did not and they were not in use. I moved them with mc but would like for  mover to work as it should. Looking at the syslog, it seems that the mover can find the files in the complete folder and judging by the difference in time from start to finish, you would think that everything is fine but it's not.

Don

Link to comment

If you understand the command line in any way, let's try this.  First login to the server using either the console or a PuTTY session.   (PuTTY is preferable as it is easier to get the information for posting back to the forum.)

 

Then enter the following

 

ls -al /mnt/cache

You will now see a list containing your shares.  Pick the one that has the files that didn't get moved.  Add that name to the end of the string (You can redisplay the original command that you had to type by hitting the <up-arrow> key) as in this example:

 

ls -al /mnt/cache/download

Continue until you get the directory where the files are that didn't get moved.  If you are using PuTTY, you can copy the information in the listing by right-clicking and dragging the cursor until you get something like this:
 

-rw-rw-rw-  1 nobody users 10737418240 Jul 31 00:10 docker.img

You can now paste it in your post with a control-V. 

Link to comment

Thanks' Frank. My folder is under /mnt/user/downloads and this is what I get:

root@Tower:/mnt/user/downloads/complete# ls -all
total 4
drwxrwxr-x 1 nobody users 4096 Aug  3 14:53 ./
drwxrwxr-x 1 nobody users   24 Aug  3 14:53 ../
drwxrwxr-x 1 nobody users   81 Aug  3 14:46 Orphan.Black.S05E01.1080p.AMZN.WEBRip.DD5.1.x264-ViSUM[rarbg]/
drwxrwxr-x 1 nobody users   62 Aug  3 14:49 Orphan.Black.S05E02.1080p.WEBRip.x264-STRiFE[rarbg]/
drwxrwxr-x 1 nobody users   70 Aug  3 14:47 Orphan.Black.S05E03.1080p.WEBRip.x264-STRiFE[rarbg]/
drwxrwxr-x 1 nobody users   62 Aug  3 14:48 Orphan.Black.S05E04.1080p.WEBRip.x264-STRiFE[rarbg]/
drwxrwxr-x 1 nobody users   70 Aug  3 14:50 Orphan.Black.S05E05.1080p.WEBRip.x264-STRiFE[rarbg]/
drwxrwxr-x 1 nobody users   70 Aug  3 14:51 Orphan.Black.S05E06.1080p.WEBRip.x264-STRiFE[rarbg]/
drwxrwxr-x 1 nobody users   62 Aug  3 14:52 Orphan.Black.S05E07.1080p.WEBRip.x264-STRiFE[rarbg]/
drwxrwxr-x 1 nobody users   62 Aug  3 14:53 Orphan.Black.S05E08.1080p.WEBRip.x264-STRiFE[rarbg]/
root@Tower:/mnt/user/downloads/complete#

 

Even after invoking the mover, none of those files got moved. Are permissions set correctly?

Don

Link to comment

From the permissions, What you are calling 'files' (When I was learning UNIX, I was told that everything in UNIX is a file-- even directories and hardware devices like hard drives!)  are actually directories.  (That is indicated by the "d"  in the permissions. Permissions are he block of letters that look as like this  drwxrwxr-x  )  You need to move (at least) one more step down in the tree.  With those long directory names, I would copy the directory name (you already know how to do that).  Use the up-arrow and down-arrow keys to get the ls command that got you to this point.  Now enter a " /   "  and then right -click to paste that directory name you copied earlier.  Repeat until you to come to entries with that "d" missing --- Looking more like this   -rw-rw-rw-      Now copy and paste that into your reply.

 

EDIT:  Adding this link as a reference for some possible future use....
    
      https://forums.lime-technology.com/topic/27051-extended-attributes-fix/

 

Edited by Frank1940
Link to comment

Well I went to 1 episode and this is what I have. Do I need to add the write permission for everyone because that is the only one missing  in the file tree? All other directories that did not get moved have the same permissions.

root@Tower:/mnt/user/downloads/complete/Orphan.Black.S05E01.1080p.AMZN.WEBRip.DD5.1.x264-ViSUM[rarbg]# ls -all
total 4074832
drwxrwxr-x 1 nobody users         81 Aug  3 14:46 ./
drwxrwxr-x 1 nobody users       4096 Aug  4 02:08 ../
-rwxrwxr-x 1 nobody users 4172621022 Aug  3 10:47 Orphan.Black.S05E01.1080p.AMZN.WEBRip.DDP5.1.x264-ViSUM.mkv*

 

This is a copy of yesterdays sys log when the scheduler invoked the mover to move a large season folder. Again, nothing got moved:

 

Aug 4 02:04:22 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Orphan.Black.S04E05.720p.BluRay.x264-DEPTH.mkv
Aug 4 02:05:11 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/
Aug 4 02:05:11 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Orphan.Black.S04E04.720p.BluRay.x264-DEPTH.mkv
Aug 4 02:06:00 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/
Aug 4 02:06:00 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Orphan.Black.S04E01.720p.BluRay.x264-DEPTH.mkv
Aug 4 02:06:53 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/
Aug 4 02:06:53 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Orphan.Black.S04E10.720p.BluRay.x264-DEPTH.mkv
Aug 4 02:07:42 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/
Aug 4 02:07:42 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Orphan.Black.S04E09.720p.BluRay.x264-DEPTH.mkv
Aug 4 02:08:32 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/
Aug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E08.720p.BluRay.x264-DEPTH.sub
Aug 4 02:08:32 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/
Aug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E09.720p.BluRay.x264-DEPTH.idx
Aug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E09.720p.BluRay.x264-DEPTH.sub
Aug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E10.720p.BluRay.x264-DEPTH.idx
Aug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E10.720p.BluRay.x264-DEPTH.sub
Aug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E04.720p.BluRay.x264-DEPTH.sub
Aug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E05.720p.BluRay.x264-DEPTH.idx
Aug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E05.720p.BluRay.x264-DEPTH.sub
Aug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E07.720p.BluRay.x264-DEPTH.idx
Aug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E07.720p.BluRay.x264-DEPTH.sub
Aug 4 02:08:33 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/
Aug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E08.720p.BluRay.x264-DEPTH.idx
Aug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E01.720p.BluRay.x264-DEPTH.idx
Aug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E01.720p.BluRay.x264-DEPTH.sub
Aug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E02.720p.BluRay.x264-DEPTH.idx
Aug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E02.720p.BluRay.x264-DEPTH.sub
Aug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E03.720p.BluRay.x264-DEPTH.idx
Aug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E03.720p.BluRay.x264-DEPTH.sub
Aug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E04.720p.BluRay.x264-DEPTH.idx
Aug 4 02:08:33 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/
Aug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Orphan.Black.S04.720p.BluRay.x264-DEPTH.nfo
Aug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/RARBG.com.txt
Aug 4 02:08:33 Tower root: .d..t...... downloads/complete/
Aug 4 02:08:33 Tower root: .d..t...... downloads/
Aug 4 02:08:33 Tower root: mover finished
Aug 4 02:22:53 Tower kernel: mdcmd (134): spindown 1
Aug 4 02:25:22 Tower kernel: mdcmd (135): spindown 0
Aug 4 02:25:23 Tower kernel: mdcmd (136): spindown 5

 

Permissions are again, as above. I don't know if this is important but I did notice that when I invoke the mover, the prompt says "Tower move" if the file is in use and does not get moved which I understand is normal behavior but, when the mover is invoked on completed jobs, it says "Tower root" instead. I know that root is the top user but is nowhere mentioned in the permissions unless he is part of the users group.

Don

 

Link to comment

I am not sure under what user the mover script is setup to run.  BUT I do know that unRAID expects that all files will have the permissions as   -rw-rw-rw-   and the directories to   drwxrwxrwx  (The execution attribute has be set on for directories so you can access them).   You can easily (and safely) change them by running the Docker Safe New Permissions script in the Tools menu. 

 

(There is a problem with this tool as I think it is a part of either the Fix Command Problems plugin ---most likely candidate--- or the Tips and Tweaks plugin and I can't seem to figure out which one. The default New Permissions script will some times cobbler file permissions in the appdata share.)

 

You should be looking at the setup for the application that is saving these files to change its default file creation permissions.

 

EDIT:  Found it!  The Docker Safe New Permissions script is a part of the the Fix Common Problems plugin.

Edited by Frank1940
Link to comment

Ok, I have noticed a few things that seem peculiar. First, my downloads share is set to use cache disk = yes. Every time a file or folder goes to the download share, this share is unprotected. The cache drive indicates the same amount of data as there is in the downloads  share. After running the mover, which if you noticed took almost 22 minutes to move the data from yesterday, the download share becomes a protected share but all the files are still in that share and not moved to the Media share where it should go plus, the cache drive no longer indicates that amount of data residing on the cache. It is though, it has moved the data that was in the /mnt/cache/downloads to /mnt/user/downloads. I don't know if this makes any sense!!

Don

Link to comment
19 hours ago, gubbgnutten said:

It makes perfect sense! Mover is doing exactly what it should from the sound of it. In this case (yes), it moves data for a share from the cache drive to (the same share on) the array.

 

Moving stuff from the downloads share to the media share is not something mover is supposed to do.

Well then, my bad. I thought that mover was suppose to take the files from the download share and move it onto the array in my /Media/TV_Shows share. Is there a way to do that, perhaps by mapping my download share to use cache only or prefer?

Don

Link to comment
18 minutes ago, donr said:

I thought that mover was suppose to take the files from the download share and move it onto the array in my /Media/TV_Shows share

The mover only transfers from one physical disk to another, same name and folder. To sort your downloads into the correct show folder you need a program that is file name aware, like Sonarr or Sickrage. Typically you would set up sonarr to send a request to your downloader app, then when the downloader app tells sonarr it's done, sonarr moves it from the cache:only download folder to the specific tv show season folder which is on a cache:yes share.

 

Pretty sure @gridrunner has some youtube video outlining this kind of thing. Just in general I recommend looking at his videos, he has a wealth of information on how to accomplish things on unraid.

Link to comment
  • donr changed the title to (Solved)No errors from Mover

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.