June 26, 200917 yr I know this is a subject that has come up before but I could not find anything pertaining to my situation exactly. Just recently I started getting dup file messages in the syslog. Here is what it looks like when I hit the "Dup Files" button in unMenu: -rw-r--r-- 1 root root 204505918 Jun 25 19:11 /mnt/disk1/Anime/07-Ghost/07-Ghost-11.avi -rw-r--r-- 1 root root 204505918 Jun 25 19:11 /mnt/user/Anime/07-Ghost/07-Ghost-11.avi -rw-r--r-- 1 root root 204505918 Jun 25 19:11 /mnt/user0/Anime/07-Ghost/07-Ghost-11.avi -rw-r--r-- 1 root root 204805222 Jun 23 23:30 /mnt/disk1/Anime/07-Ghost/07-Ghost-12.avi -rw-r--r-- 1 root root 204805222 Jun 23 23:30 /mnt/user/Anime/07-Ghost/07-Ghost-12.avi -rw-r--r-- 1 root root 204805222 Jun 23 23:30 /mnt/user0/Anime/07-Ghost/07-Ghost-12.avi -rw-r--r-- 1 root root 178375900 Jun 25 19:06 /mnt/disk1/Anime/Bleach/Bleach-224.avi -rw-r--r-- 1 root root 178375900 Jun 25 19:06 /mnt/user/Anime/Bleach/Bleach-224.avi -rw-r--r-- 1 root root 178375900 Jun 25 19:06 /mnt/user0/Anime/Bleach/Bleach-224.avi -rw-r--r-- 1 root root 178366224 Jun 23 21:09 /mnt/disk1/Anime/Bleach/Bleach-225.avi -rw-r--r-- 1 root root 178366224 Jun 23 21:09 /mnt/user/Anime/Bleach/Bleach-225.avi -rw-r--r-- 1 root root 178366224 Jun 23 21:09 /mnt/user0/Anime/Bleach/Bleach-225.avi -rw-r--r-- 1 root root 158157094 Jun 25 14:20 /mnt/disk1/Anime/Naruto/Naruto Shippuuden-115.mkv -rw-r--r-- 1 root root 158157094 Jun 25 14:20 /mnt/user/Anime/Naruto/Naruto Shippuuden-115.mkv -rw-r--r-- 1 root root 158157094 Jun 25 14:20 /mnt/user0/Anime/Naruto/Naruto Shippuuden-115.mkv So for some reason I am getting the report there are dupes in user and user0. Thanks for any help and guidance
June 27, 200917 yr I know this is a subject that has come up before but I could not find anything pertaining to my situation exactly. Just recently I started getting dup file messages in the syslog. Here is what it looks like when I hit the "Dup Files" button in unMenu: -rw-r--r-- 1 root root 204505918 Jun 25 19:11 /mnt/disk1/Anime/07-Ghost/07-Ghost-11.avi -rw-r--r-- 1 root root 204505918 Jun 25 19:11 /mnt/user/Anime/07-Ghost/07-Ghost-11.avi -rw-r--r-- 1 root root 204505918 Jun 25 19:11 /mnt/user0/Anime/07-Ghost/07-Ghost-11.avi -rw-r--r-- 1 root root 204805222 Jun 23 23:30 /mnt/disk1/Anime/07-Ghost/07-Ghost-12.avi -rw-r--r-- 1 root root 204805222 Jun 23 23:30 /mnt/user/Anime/07-Ghost/07-Ghost-12.avi -rw-r--r-- 1 root root 204805222 Jun 23 23:30 /mnt/user0/Anime/07-Ghost/07-Ghost-12.avi -rw-r--r-- 1 root root 178375900 Jun 25 19:06 /mnt/disk1/Anime/Bleach/Bleach-224.avi -rw-r--r-- 1 root root 178375900 Jun 25 19:06 /mnt/user/Anime/Bleach/Bleach-224.avi -rw-r--r-- 1 root root 178375900 Jun 25 19:06 /mnt/user0/Anime/Bleach/Bleach-224.avi -rw-r--r-- 1 root root 178366224 Jun 23 21:09 /mnt/disk1/Anime/Bleach/Bleach-225.avi -rw-r--r-- 1 root root 178366224 Jun 23 21:09 /mnt/user/Anime/Bleach/Bleach-225.avi -rw-r--r-- 1 root root 178366224 Jun 23 21:09 /mnt/user0/Anime/Bleach/Bleach-225.avi -rw-r--r-- 1 root root 158157094 Jun 25 14:20 /mnt/disk1/Anime/Naruto/Naruto Shippuuden-115.mkv -rw-r--r-- 1 root root 158157094 Jun 25 14:20 /mnt/user/Anime/Naruto/Naruto Shippuuden-115.mkv -rw-r--r-- 1 root root 158157094 Jun 25 14:20 /mnt/user0/Anime/Naruto/Naruto Shippuuden-115.mkv So for some reason I am getting the report there are dupes in user and user0. Thanks for any help and guidance According to Tom @ lim-tech: /mnt/user0 is only present when there is a cache disk. It is a view of the user share file system that excludes the contents of the cache disk. It is used by the mover to copy files from the cache disk to the array, ie, /mnt/cache to /mnt/user0. Therefore, you can ignore dupes in /mnt/user and /mnt/user0. They will be expected. Apparently, at a point in time recently, you had a few duplicate files on disk1 and another "disk" share. At that time the entry was made to the syslog. According to the output of the dupe-files plug-in, they only exist on one disk share at this time. If they currently existed on more than one disk then they would show on /mnt/disk1 and another /mnt/diskNN in the dupe-files output as well. Did you by chance move some files? (It would explain why they were on both disks for a short time while being moved, but only exist on one disk now.) As I already siad, /mnt/user and /mnt/user0 will always exist if you have a cache drive, and I suppose the routine in unMENU could be enhanced to not display those. (I never saw those lines here, since I have no cache drive defined) Joe L.
June 27, 200917 yr Author According to Tom @ lim-tech: /mnt/user0 is only present when there is a cache disk. It is a view of the user share file system that excludes the contents of the cache disk. It is used by the mover to copy files from the cache disk to the array, ie, /mnt/cache to /mnt/user0. Therefore, you can ignore dupes in /mnt/user and /mnt/user0. They will be expected. Apparently, at a point in time recently, you had a few duplicate files on disk1 and another "disk" share. At that time the entry was made to the syslog. According to the output of the dupe-files plug-in, they only exist on one disk share at this time. If they currently existed on more than one disk then they would show on /mnt/disk1 and another /mnt/diskNN in the dupe-files output as well. Did you by chance move some files? (It would explain why they were on both disks for a short time while being moved, but only exist on one disk now.) As I already siad, /mnt/user and /mnt/user0 will always exist if you have a cache drive, and I suppose the routine in unMENU could be enhanced to not display those. (I never saw those lines here, since I have no cache drive defined) Joe L. The odd thing is that the files do not currently exist on the cache drive, at least not that I can see via Finder on my Mac, but I can see them just fine in the user share "Anime" I copied the files to the share last night just like I do for every other file and then let the mover script do its job. If I try to delete them from the user0 folder via the "rm" command in a telnet session then it deleted the one that is currently showing up in the user share. I am using includes and excludes on disks to limit the share to only one disk, but I don't think that is the problem. I have no idea why it just now started to do this. The share is set up as follows: ALLOCATION: Highwater SPLIT LEVEL: 0 INCLUDE DISKS: disk1 USE CACHE DISK: Yes If there is any other info I can give let me know.
June 27, 200917 yr . If I try to delete them from the user0 folder via the "rm" command in a telnet session then it deleted the one that is currently showing up in the user share. I am using includes and excludes on disks to limit the share to only one disk, but I don't think that is the problem. I have no idea why it just now started to do this. I have no first-hand knowledge what happens if you try to remove a file from /mnt/user0, but since it is a view of the user-file-system, removing a file from it will probably remove the file from your server. (remember, the "user" and "user0" file system are just pointers to the actual files and folders... Therefore, I hope those files you removed from under /mnt/user0 were not important.. as you might have removed the actual files on the data disk from your server, wherever they were. All I can say is save a copy of your syslog to your flash drive or to a data drive, then reboot. See if the "dupe-files" messages return in the new syslog. I'm guessing they will not, since the plug-in under unMENU does not find any dupes when you run it now. Joe L.
June 27, 200917 yr Author Yup, a restart did clear up the duplicates listing. Good to know that that fixed it but I am still wondering why it happened. Oh well, I will see if it happens again and then investigate further.
July 1, 200917 yr Author Ok, so I copied some more stuff to the server last night, specifically the Anime folder. This folder is a user share and is set up to use the cache drive for copying. The dupe files plugin in unmenu is again reporting a dupe file and the syslog is saying that there is a dupe file, which I know to know be the case. The Anime share is only set to use disk1 so it is impossible to have it on another disk. Any insight and guidance is appreciated.
July 1, 200917 yr Ok, so I copied some more stuff to the server last night, specifically the Anime folder. This folder is a user share and is set up to use the cache drive for copying. The dupe files plugin in unmenu is again reporting a dupe file and the syslog is saying that there is a dupe file, which I know to know be the case. The Anime share is only set to use disk1 so it is impossible to have it on another disk. Any insight and guidance is appreciated. Can you past here the exact message being reported by the plug-in. Obviously, at a point in time, the file existed on both the cache drive and the one it was being copied to. That is what resulted in the syslog entry. I just want to see what is showing in the unMENU plugin. Joe L.
July 1, 200917 yr Author See below for the exact message that the dupe files plugin returns. File -rwx------ 1 root root 178306918 Jun 30 22:19 /mnt/disk1/Anime/Bleach/Bleach-226.avi -rwx------ 1 root root 178306918 Jun 30 22:19 /mnt/user/Anime/Bleach/Bleach-226.avi -rwx------ 1 root root 178306918 Jun 30 22:19 /mnt/user0/Anime/Bleach/Bleach-226.avi I know for a fact that the file does not exist on the cache drive. If I mount it via smb or telnet to the appropriate folders and do an ls on the folder nothing appears. If I navigate to /mnt/user or /mnt/user0 the files do exist. This problem will probably appear again as I did some more copying to the array this morning and I have no doubt that I will get more of these messages.
July 1, 200917 yr See below for the exact message that the dupe files plugin returns. File -rwx------ 1 root root 178306918 Jun 30 22:19 /mnt/disk1/Anime/Bleach/Bleach-226.avi -rwx------ 1 root root 178306918 Jun 30 22:19 /mnt/user/Anime/Bleach/Bleach-226.avi -rwx------ 1 root root 178306918 Jun 30 22:19 /mnt/user0/Anime/Bleach/Bleach-226.avi I know for a fact that the file does not exist on the cache drive. If I mount it via smb or telnet to the appropriate folders and do an ls on the folder nothing appears. If I navigate to /mnt/user or /mnt/user0 the files do exist. This problem will probably appear again as I did some more copying to the array this morning and I have no doubt that I will get more of these messages. Quick answer... If a file exists on only ONE disk drive, you can ignore the output. If it shows on disk1 and disk4, then you have a real dupe. I had originally wanted to also show the "user" share entry since you could then more easily know which of the disk entries you might want to keep, and which to delete. My desire was to show three entries on a "dupe" This is complicated by the user0 entry. I think it is "bug" in the way the syslog entry is being made when a file is moved from the cache drive. I do not think it should trigger the message in the syslog. (the real cause of this confusion) Longer answer... I can probably fix it with additional logic. Hummm... the quick answer is longer than the long answer... Joe L.
Archived
This topic is now archived and is closed to further replies.