Helmonder

I would not create an auto-delete option.. However if, with the -v switch off, the list only containts the duplicate and not the original (alas: only one version), then it would be very easy for every USER to put an RM before that and create a little script.. That would however then be the users own thing .. Very understandable if you do not want to put this in the tool..

The tool absolutely works but with a big list of files it is quite undoable to work with it (eg: I am to lazy). So I am taking a different route. I seem to have two disks (both 2TB) that contain the majority of the duplicates. I also have an empty 4TB. I will now move the first 2TB to the 4TB, then I will move the 2nd 2TB to the 4TB telling it to "replace when file size is different", that way I should have an unduped combination of the two drives on the 4TB. Whatever remains on the second 2TB are dupes and can be deleted..

Would it be possible to only list the duplicate entry instead of both ? With that it would be extremely easy to an editor to add "RM" in front of that and simply delete the duplicate entries..

I just started it for my Movies share: ./unRAIDFindDuplicates.sh -i Movies -v It throws one error directly after starting: ./unRAIDFindDuplicates.sh: line 153: [!: command not found Tools appears to run after that though and also find results: First thing I notice that it appears to be REALLY fast... IT scanned my moves folder (allmost 7TB) in a minute. It found only a few dupes which I have now deleted. I also notice it finds duplicates between the array disks and the cache drive, since files only briefly reside on the cache drive I figure it might be better to exclude the cache drive ? Now scanning series (10.1 TB). Appears to also run quick (also a lot more dupes ;-) I stopped the scan and restarted rerouting the results to a file to analyse later, really a lot of dupes here..

Great ! My REISERFS - XFS conversion cycle has allmost ended (98% of the latest disk), after that I will start your tool to find my dupes..

Does anyone have cache_Dirs running on unraid 6 beta 6 ? I just moved to v6 and it works great but I -REALLY- miss cache_dirs... Actually it is only now I notice how usefull it really is...

Anyone have vcenter 5.1 and willing to share ?

Beta or others: I am now running unraid from my flashdrive in esxi, that works without an issue EXCEPT for the fact that booting is really, really slow.. My unraid test image runs from beta's vdmk and that works WAY faster. How would I go about changing my unraid boot sequence to run of the vdmk instead of usb in esxi ?

You are going to be so happy with it... Sliced bread, really.. Sent from my iPad using Tapatalk HD

Also using the mv8's (two of them). Rockstable since initial setup a few weeks back.

Beta, have you or anyone seen the SASLP-MV8 working on ESXi. Some googling around seems to indicate that it is not well supported on ESXi 5.1. I noticed that your Orion build was originally going to have the MV8. For me, I need something that is x4 PCI-X. The mobo I have and want to use does not have an x8 slot. Thanks. Check out my build. works like a charm and was a breeze to setup..

I must admit that the whole concept of snapshots is an absolute dream out of management point of view, so even with only one vm there is benefit .. Allthough I now have 3 (plain unraid, mediabeast for all nntp/torrent stuff and a test unraid I use for preclears and stuff).

Not that I know of, I googled around and found it on several other fora, also when totally not related to unraid or the MV8''s... easiest to do is google for pciPassthru0.msiEnabled = "FALSE" I guess. I remember reading it is some kind of switch telling esxi how to do the passthru..

I would do a little more research to see if your board supports VT-D and if ESX will handle the Pass through. I don't know enough to guide you, but I'm not sure the i3 will support it either. What we know works is the popular Supermicro X9SCM boards and the Sandy Bridge XEON CPU along with the IBM 1015 controller. I believe there is a hack for the super micro controller. Again. I'm not advanced on the topic. I would suggest reading JohnM's atlas thread. Supermicro works, and its not really a "hack", its just a specific piece of configuration you need to do for a lot of passthru devices..

Or not... I have been using cache dirs and I have noticed that when I disable it my disks are more spun down then when it is enabled.... I am trying several routes to try and understand, this because the base behind cache_dirs is sound and -should- work. So something else is going on that is causing an adverse effect. Joe: Cache_Dirs -basically- (extremely oversimplified) does repeated drive dir listings to make sure those listings are kept in memory. Now suppose you are in a situation where memory is extremely overstressed, could that cause cache dirs to actually keep the disks spun UP because the actions cache_dirs is taking are actually causing disk spinup ?

I just installed the supermicro 5in3 case in my server. Wanted to let people know that installing it was very easy, there are several threads on it fitting very badly but I cannot confirm this, worked great in my Fractal Design Define XL USB 3.0 Black Pearl. Although you have to be carefull in removing or bending the drive tabs in the case, I can imagine that if you do that to quickly you will bend the casing and THEN it willbe difficult to fit stuff..

I restarted without the parameters and am at 100+ again ..

Go back to page 73 of this thread for more discussion of these parameters. I was trying to do 3TB. Increased -b parameter is what you need. Did that but did not find anything concerning a -b parameter... Since there does appear to be a relation with these parameters (I conclude this from your reply) I will take my chances and do the preclear without the extra parameters, if only to see if that makes the difference..

I started preclearing a new 4TB Hitachi drive yesterday, I do not do this weekly so I would like to verify: I am at 36% of phase 1 at the moment and this has taken a little over 26 hours... Sounds a bit long not ? Specific command: preclear_disk.sh -w 65536 -r 65536 -b 200 -c 3 /dev/sdc First time I use the commands Joe provided to reduce effect on memory, can it be that those same paramters make the process longer like this ? Speed is like 50 to 60 MB/s

Yeah,me to... proud of the product and would like to show it !

Thanks ! I have excluded Music now, there is no real reason for me to keep it up as all dirs are on one disk and WHEN I browse my music collection I will play songs to.

My array refuses to shut down and the following process is active, is this cache_dirs ? 4 D root 11947 8743 0 80 0 - 620 sleep_ 08:56 ? 00:00:01 find /mnt/disk8/Music -noleaf My music dir is kind of large, could it be that it just needs to finish this dir (and since it is a large itunes library it might take some time) before it picks up the quit command in the syslog ?

Sign up with hop shop go. Its free and it will get you anything from the us you want from companies not shipping to your country..

I would also use this on selected shares..

This will not work for several reasons: 1) If cache_dirs would spin up a disk you were browing on it would spin up all disks if you access a share that is spread over several disks, something that you do not want (or at least, the majority of users will not) 2) cache_dirs, though great in what it does, is basically just using a standard linux function, directories are kept in memory to speed up browsing, this is however removed from memory if the memory is needed somewhere else. Cache_dirs continuasly access the directories making the system believe they are constantly used and therefor the info stays in memory. However, this might help you: I to have a share that IF I browse will allmost allways also result in a file beiing accessed, for me this is my Music share (itunes). I have excluded this drive from cache_dirs, this means that the disk spins up as soon as the share is accessed. I have also made sure that this share is only on one disk so it does not spin up stuff unnecessary.