donr Posted July 25, 2017 Share Posted July 25, 2017 Hi guys. My server crashed a few weeks ago so I upgraded the hardware. Installed new MB and CPU + new PSU. Transferred all disks and did a parity check. Everything is working fine. I installed Deluge docker and downloads are ok. I seem to have a problem with mover. I don't know if the problem appeared before or after updating unraid to 6.3.5. Mover is not moving my files even if invoked manually and I can't see any error in the logs. I tried copying a file outside the completed folder to see if it would be a problem with Deluge but, that did not work either. I included a copy of the Diagnostic. Don tower-diagnostics-20170725-0954.zip Quote Link to comment
itimpi Posted July 25, 2017 Share Posted July 25, 2017 Which share are you expecting mover to work with (the names are obscured in the diagnostics). Also as far as I can see the diagnostics do not seem to include an attempt to run mover - did you think you had done so? Quote Link to comment
donr Posted July 26, 2017 Author Share Posted July 26, 2017 11 hours ago, itimpi said: Which share are you expecting mover to work with. The download share which is under /mnt/user/downloads and set to utilize cash = yes. As far as the mover, isn't that what is meant on lines :Jul 25 09:28:47 Tower root: mover started Jul 25 09:28:47 Tower root: mover finished at the end of the syslog. As you can see, nothing was moved. I am far from an unraid and linux guru so there may be something I did not set correctly but, I know that at one point, everything was working fine. Don Quote Link to comment
Frank1940 Posted July 26, 2017 Share Posted July 26, 2017 Got to 'Settings' >>> 'Scheduler' >>> 'Mover Settings' . There look for the Mover logging: and, if it is set to 'Disable', set it to 'Enable' (However, depending on the complexity of the folder tree on the cache drive, this can result in a massive number of entries in your syslog. (I would change the setting and then involve the Mover manually to see what is going on...) Quote Link to comment
donr Posted July 29, 2017 Author Share Posted July 29, 2017 Sorry for the delay. Logging is enabled. This is from a few days ago: Jul 26 02:00:01 Tower root: mover started Jul 26 02:00:01 Tower root: moving "downloads" to array Jul 26 02:00:01 Tower root: .d..t...... ./ Jul 26 02:00:01 Tower root: .d..t...... downloads/ Jul 26 02:00:01 Tower root: .d..t...... downloads/torrents/ Jul 26 02:00:01 Tower root: >f+++++++++ downloads/torrents/Snatched.2017.720p.BluRay.x264-GECKOS-[rarbg.to].torrent Jul 26 02:00:17 Tower root: .d..t...... downloads/torrents/ Jul 26 02:00:17 Tower root: .d..t...... downloads/ Jul 26 02:00:17 Tower root: .d..t...... downloads/incomplete/ Jul 26 02:00:17 Tower root: .d..t...... downloads/complete/ Jul 26 02:00:17 Tower root: cd+++++++++ downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/ Jul 26 02:00:17 Tower root: >f+++++++++ downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/Snatched.2017.720p.BluRay.x264-GECKOS.mkv Jul 26 02:01:44 Tower root: .d..t...... downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/ Jul 26 02:01:44 Tower root: cd+++++++++ downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/Subs/ Jul 26 02:01:44 Tower root: >f+++++++++ downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/Subs/Snatched.2017.720p.BluRay.x264-GECKOS.sub Jul 26 02:01:45 Tower root: .d..t...... downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/Subs/ Jul 26 02:01:45 Tower root: >f+++++++++ downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/Subs/Snatched.2017.720p.BluRay.x264-GECKOS.idx Jul 26 02:01:45 Tower root: .d..t...... downloads/complete/Snatched.2017.720p.BluRay.x264-GECKOS[rarbg]/ Jul 26 02:01:45 Tower root: .d..t...... downloads/complete/ Jul 26 02:01:45 Tower root: .d..t...... downloads/ Jul 26 02:01:45 Tower root: mover finished It looks like it is working but nothing gets moved. When invoked manually, it just adds 3 liness to the syslog: Jul 28 21:10:42 Tower emhttp: shcmd (45518): /usr/local/sbin/mover |& logger & Jul 28 21:10:42 Tower root: mover started Jul 28 21:10:42 Tower root: mover finished Quote Link to comment
Squid Posted July 29, 2017 Share Posted July 29, 2017 (edited) Any files in use will be skipped. And did those files listed above get moved or not? Edited July 29, 2017 by Squid Quote Link to comment
donr Posted July 30, 2017 Author Share Posted July 30, 2017 Quote And did those files listed above get moved or not? No they did not and they were not in use. I moved them with mc but would like for mover to work as it should. Looking at the syslog, it seems that the mover can find the files in the complete folder and judging by the difference in time from start to finish, you would think that everything is fine but it's not. Don Quote Link to comment
donr Posted August 2, 2017 Author Share Posted August 2, 2017 So it seems no one has had this happen to them before! Don Quote Link to comment
Frank1940 Posted August 2, 2017 Share Posted August 2, 2017 If you understand the command line in any way, let's try this. First login to the server using either the console or a PuTTY session. (PuTTY is preferable as it is easier to get the information for posting back to the forum.) Then enter the following ls -al /mnt/cache You will now see a list containing your shares. Pick the one that has the files that didn't get moved. Add that name to the end of the string (You can redisplay the original command that you had to type by hitting the <up-arrow> key) as in this example: ls -al /mnt/cache/download Continue until you get the directory where the files are that didn't get moved. If you are using PuTTY, you can copy the information in the listing by right-clicking and dragging the cursor until you get something like this: -rw-rw-rw- 1 nobody users 10737418240 Jul 31 00:10 docker.img You can now paste it in your post with a control-V. Quote Link to comment
donr Posted August 3, 2017 Author Share Posted August 3, 2017 Thanks' Frank. My folder is under /mnt/user/downloads and this is what I get: root@Tower:/mnt/user/downloads/complete# ls -all total 4 drwxrwxr-x 1 nobody users 4096 Aug 3 14:53 ./ drwxrwxr-x 1 nobody users 24 Aug 3 14:53 ../ drwxrwxr-x 1 nobody users 81 Aug 3 14:46 Orphan.Black.S05E01.1080p.AMZN.WEBRip.DD5.1.x264-ViSUM[rarbg]/ drwxrwxr-x 1 nobody users 62 Aug 3 14:49 Orphan.Black.S05E02.1080p.WEBRip.x264-STRiFE[rarbg]/ drwxrwxr-x 1 nobody users 70 Aug 3 14:47 Orphan.Black.S05E03.1080p.WEBRip.x264-STRiFE[rarbg]/ drwxrwxr-x 1 nobody users 62 Aug 3 14:48 Orphan.Black.S05E04.1080p.WEBRip.x264-STRiFE[rarbg]/ drwxrwxr-x 1 nobody users 70 Aug 3 14:50 Orphan.Black.S05E05.1080p.WEBRip.x264-STRiFE[rarbg]/ drwxrwxr-x 1 nobody users 70 Aug 3 14:51 Orphan.Black.S05E06.1080p.WEBRip.x264-STRiFE[rarbg]/ drwxrwxr-x 1 nobody users 62 Aug 3 14:52 Orphan.Black.S05E07.1080p.WEBRip.x264-STRiFE[rarbg]/ drwxrwxr-x 1 nobody users 62 Aug 3 14:53 Orphan.Black.S05E08.1080p.WEBRip.x264-STRiFE[rarbg]/ root@Tower:/mnt/user/downloads/complete# Even after invoking the mover, none of those files got moved. Are permissions set correctly? Don Quote Link to comment
Frank1940 Posted August 3, 2017 Share Posted August 3, 2017 (edited) From the permissions, What you are calling 'files' (When I was learning UNIX, I was told that everything in UNIX is a file-- even directories and hardware devices like hard drives!) are actually directories. (That is indicated by the "d" in the permissions. Permissions are he block of letters that look as like this drwxrwxr-x ) You need to move (at least) one more step down in the tree. With those long directory names, I would copy the directory name (you already know how to do that). Use the up-arrow and down-arrow keys to get the ls command that got you to this point. Now enter a " / " and then right -click to paste that directory name you copied earlier. Repeat until you to come to entries with that "d" missing --- Looking more like this -rw-rw-rw- Now copy and paste that into your reply. EDIT: Adding this link as a reference for some possible future use.... https://forums.lime-technology.com/topic/27051-extended-attributes-fix/ Edited August 4, 2017 by Frank1940 Quote Link to comment
donr Posted August 4, 2017 Author Share Posted August 4, 2017 Well I went to 1 episode and this is what I have. Do I need to add the write permission for everyone because that is the only one missing in the file tree? All other directories that did not get moved have the same permissions. root@Tower:/mnt/user/downloads/complete/Orphan.Black.S05E01.1080p.AMZN.WEBRip.DD5.1.x264-ViSUM[rarbg]# ls -all total 4074832 drwxrwxr-x 1 nobody users 81 Aug 3 14:46 ./ drwxrwxr-x 1 nobody users 4096 Aug 4 02:08 ../ -rwxrwxr-x 1 nobody users 4172621022 Aug 3 10:47 Orphan.Black.S05E01.1080p.AMZN.WEBRip.DDP5.1.x264-ViSUM.mkv* This is a copy of yesterdays sys log when the scheduler invoked the mover to move a large season folder. Again, nothing got moved: Aug 4 02:04:22 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Orphan.Black.S04E05.720p.BluRay.x264-DEPTH.mkvAug 4 02:05:11 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Aug 4 02:05:11 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Orphan.Black.S04E04.720p.BluRay.x264-DEPTH.mkvAug 4 02:06:00 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Aug 4 02:06:00 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Orphan.Black.S04E01.720p.BluRay.x264-DEPTH.mkvAug 4 02:06:53 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Aug 4 02:06:53 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Orphan.Black.S04E10.720p.BluRay.x264-DEPTH.mkvAug 4 02:07:42 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Aug 4 02:07:42 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Orphan.Black.S04E09.720p.BluRay.x264-DEPTH.mkvAug 4 02:08:32 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Aug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E08.720p.BluRay.x264-DEPTH.subAug 4 02:08:32 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Aug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E09.720p.BluRay.x264-DEPTH.idxAug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E09.720p.BluRay.x264-DEPTH.subAug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E10.720p.BluRay.x264-DEPTH.idxAug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E10.720p.BluRay.x264-DEPTH.subAug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E04.720p.BluRay.x264-DEPTH.subAug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E05.720p.BluRay.x264-DEPTH.idxAug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E05.720p.BluRay.x264-DEPTH.subAug 4 02:08:32 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E07.720p.BluRay.x264-DEPTH.idxAug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E07.720p.BluRay.x264-DEPTH.subAug 4 02:08:33 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Aug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E08.720p.BluRay.x264-DEPTH.idxAug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E01.720p.BluRay.x264-DEPTH.idxAug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E01.720p.BluRay.x264-DEPTH.subAug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E02.720p.BluRay.x264-DEPTH.idxAug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E02.720p.BluRay.x264-DEPTH.subAug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E03.720p.BluRay.x264-DEPTH.idxAug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E03.720p.BluRay.x264-DEPTH.subAug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Subs/Orphan.Black.S04E04.720p.BluRay.x264-DEPTH.idxAug 4 02:08:33 Tower root: .d..t...... downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Aug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/Orphan.Black.S04.720p.BluRay.x264-DEPTH.nfoAug 4 02:08:33 Tower root: >f+++++++++ downloads/complete/Orphan.Black.S04.720p.BluRay.x264-DEPTH[rartv]/RARBG.com.txtAug 4 02:08:33 Tower root: .d..t...... downloads/complete/Aug 4 02:08:33 Tower root: .d..t...... downloads/Aug 4 02:08:33 Tower root: mover finishedAug 4 02:22:53 Tower kernel: mdcmd (134): spindown 1Aug 4 02:25:22 Tower kernel: mdcmd (135): spindown 0Aug 4 02:25:23 Tower kernel: mdcmd (136): spindown 5 Permissions are again, as above. I don't know if this is important but I did notice that when I invoke the mover, the prompt says "Tower move" if the file is in use and does not get moved which I understand is normal behavior but, when the mover is invoked on completed jobs, it says "Tower root" instead. I know that root is the top user but is nowhere mentioned in the permissions unless he is part of the users group. Don Quote Link to comment
Frank1940 Posted August 4, 2017 Share Posted August 4, 2017 (edited) I am not sure under what user the mover script is setup to run. BUT I do know that unRAID expects that all files will have the permissions as -rw-rw-rw- and the directories to drwxrwxrwx (The execution attribute has be set on for directories so you can access them). You can easily (and safely) change them by running the Docker Safe New Permissions script in the Tools menu. (There is a problem with this tool as I think it is a part of either the Fix Command Problems plugin ---most likely candidate--- or the Tips and Tweaks plugin and I can't seem to figure out which one. The default New Permissions script will some times cobbler file permissions in the appdata share.) You should be looking at the setup for the application that is saving these files to change its default file creation permissions. EDIT: Found it! The Docker Safe New Permissions script is a part of the the Fix Common Problems plugin. Edited August 4, 2017 by Frank1940 Quote Link to comment
donr Posted August 4, 2017 Author Share Posted August 4, 2017 Ok, I have noticed a few things that seem peculiar. First, my downloads share is set to use cache disk = yes. Every time a file or folder goes to the download share, this share is unprotected. The cache drive indicates the same amount of data as there is in the downloads share. After running the mover, which if you noticed took almost 22 minutes to move the data from yesterday, the download share becomes a protected share but all the files are still in that share and not moved to the Media share where it should go plus, the cache drive no longer indicates that amount of data residing on the cache. It is though, it has moved the data that was in the /mnt/cache/downloads to /mnt/user/downloads. I don't know if this makes any sense!! Don Quote Link to comment
gubbgnutten Posted August 4, 2017 Share Posted August 4, 2017 It makes perfect sense! Mover is doing exactly what it should from the sound of it. In this case (yes), it moves data for a share from the cache drive to (the same share on) the array. Moving stuff from the downloads share to the media share is not something mover is supposed to do. Quote Link to comment
donr Posted August 5, 2017 Author Share Posted August 5, 2017 19 hours ago, gubbgnutten said: It makes perfect sense! Mover is doing exactly what it should from the sound of it. In this case (yes), it moves data for a share from the cache drive to (the same share on) the array. Moving stuff from the downloads share to the media share is not something mover is supposed to do. Well then, my bad. I thought that mover was suppose to take the files from the download share and move it onto the array in my /Media/TV_Shows share. Is there a way to do that, perhaps by mapping my download share to use cache only or prefer? Don Quote Link to comment
JonathanM Posted August 5, 2017 Share Posted August 5, 2017 18 minutes ago, donr said: I thought that mover was suppose to take the files from the download share and move it onto the array in my /Media/TV_Shows share The mover only transfers from one physical disk to another, same name and folder. To sort your downloads into the correct show folder you need a program that is file name aware, like Sonarr or Sickrage. Typically you would set up sonarr to send a request to your downloader app, then when the downloader app tells sonarr it's done, sonarr moves it from the cache:only download folder to the specific tv show season folder which is on a cache:yes share. Pretty sure @gridrunner has some youtube video outlining this kind of thing. Just in general I recommend looking at his videos, he has a wealth of information on how to accomplish things on unraid. Quote Link to comment
donr Posted August 5, 2017 Author Share Posted August 5, 2017 Thanks's jonathanm. I installed Sickrage so that should take care of it. Will definately watch gridrunner's video. Don Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.