I'm updating a lot of files at the moment.  Basically I got off my butt and did a better encode of a lot of my DVD collection... boring I know.

 

Anyways I have noticed that I seem to be "Losing" space", ie:  My nearly empty drive is now nearly full, and the old locations where I expect space to lower in conjunction are not.

 

Is there a way to find out if I have some ghost space going on?    Is there a normalizer script for the v5 release that I can use to reorg some of the Raw drive files with out losing my sanity?

 

 

I think there is a script by Joe L. that does this.

I have had time to look at this more:  Given the following Example:

 

Share:  Television

Allocation method:  High-water

Min. Free space: 200000

Split Level: 3

Include Disks: all

Use Cache Disk:  Yes

 

From Windows Explorer a Typical area is:

 

\\Tower\Television\MASH\Season 0\

\\Tower\Television\MASH\Season 1\

\\Tower\Television\MASH\Season 2\

\\Tower\Television\MASH\Season 3\

 

What I have found however in this example is:

/mnt/disk1/Television/MASH/Season 0/ -- 3 files

/mnt/disk10/Television/MASH/Season 0/ -- 5 files

/mnt/disk5/Television/MASH/Season 0/ -- 13 files

 

Now checking through Windows Explorer I can see that disk5 is the proper directory as all the files are showing up.

 

I have spot checked 6 of my DVD collections and this issue appears to be occurring A LOT.  I counted close to 90GB of space lost just glancing around.

 

I am running unRaid 5.0RC8a, and upgraded from 4.7 to 5.0RC2 -> RC3 -> RC5 -> RC8

 

Any help figuring out how to clean this up and what is causing it would be appreciated.  Right now I'm using Ajaxplorer to quickly spot check directories (and then checking via telnet to confirm).

I think there is a script also by Joe L. that does this.

where would I find this script then? I have had no luck

A script to clean things up is all fine and dandy, but if I'm understanding correctly, this problem shouldn't be happening in the first place.  Is there any clear indication of why? and a plan to fix?

I think this may be a bug in the way the Mover is working, moving items from the CACHE drive to the disk system... I haven't looked into the Mover code yet but the fragments I have been able to piece together are leading me in that direction.

 

Still investigating, any help would help

I still don't understand what the problem is. Do you have duplicate files on multiple disks?

 

When you over-write files unRAID should write the new file directly to the disk where the old file was stored. So, I'm not following what your problem is?

 

Also, set your split level to 2 and then each season won't split.

Or copy your files directly to your disk opposed to the share. That's what I do what I want to make sure files go where I tell them to.

Example.

 

I'm ripping all of my videos from my Disk 3 Because I want to convert them to MPV for iDevices in my house. I move them off that drive rip em, and then place them directly back on that drive and obviously they are reducing in size quite a bit and its showing in Web Gui interface.

So far I can see this:

 

The same directory (Example Season 02) is in multiple MASH directories but is empty in some of them.

In other locations there are Files that have been replaced by new versions of the file, but the same name.

In more locations only 1-2 files exist as if the system suddenly decided to move the files to a new location.

 

I also found a set of Shows that I had moved from one Share to anther Share existing as empty directories on multiple locations.  Sometimes with a single image file in them.

 

I'm trying to find the root cause of this, and it may be due to known bugs in a few of the RC's but I can't pin-point them to any one.  So far in my mini-hunt-and-clean I am up to 45gb of space being eaten up... and this is just a spot audit.

 

Going to have to write a script I think to do this right

The split level being set too high is causing the multiple directory issue.

 

If you delete the old file and then place a new replacement file that too high split level allows this new file to go to a different disk. So, you end up with the old empty directory structure left behind on the disk where the old file was stored and a new directory structure on another disk that contains the new file.

 

Poor file management techniques could also explain some of these issues.

 

I have yet to read anything that would lead me to believe unRAID has a fundamental flaw that is causing your issues.

 

 

I am willing to believe that. 

I'm willing to believe this is an issue with Split Level causing the Different Levels to go to different locations.

I'm still trying to understand why I have directories with just folder icons in them or empty folders but I am accepting this to be a user issue.

 

Just weird.