No space left on device message - plenty of space in array

[chrishorton7]

Hi,

 

My cache disk has been working fine for the last 8 months but all of a sudden I have noticed the mover is not working properly. I have about 800gb worth of data sitting on my cache drive that won't copy across. I have over 2tb free on my array so not sure why its not copying over. There seems to be one drive that isn't getting any data on it (disk 4 (hdc)

 

Below are my settings and attached is my syslog and a screenshot of my drives

 

 

Version - 5.0-beta12a

 

Share settings:

 

Allocation method: High-water

Min free space: 4000000

Split level: 2

Use cache disk: No

 

Cache settings:

 

Use cache disk: Yes

Min free space: 2000000

 

Folder structure:

 

Tower - Media - Movies - Movie folder (year) - Movie file

Tower - Media - TV Shows - TV show folder - Season - TV show episodes files

 

[chrishorton7]

Syslog file was too large to attach so please find at the below url:

 

http://www.brokenbrolly.co.uk/syslog-2012-01-06.txt

[Lacehim]

Did you recently add this drive?  I know that when I set my shares I spread them across 2 disks by setting disk1,disk2 under my media, photos, music share.  I would have to change that when I add another drive.  That's something to check at least.

[chrishorton7]

Hi Lacehim,

 

The cache drive and this drive (hdc) were added at the same time (not very recently) I have the disk included setting in the share left blank which allows the share to be spread across all disks in the array

[lionelhutz]

The split level setting is likely too low. Describe what you want to keep together and what you will allow to spread to multiple drives.

[mr-hexen]

Hi,

 

Share settings:

 

Allocation method: High-water

Min free space: 4000000

Split level: 2

Use cache disk: No

 

 

 

set use cache drive to 'yes'

[chrishorton7]

Hi

 

lionelhutz - the folder structure is as follows:

 

Tower - Media - Movies - Movie folder (year) - Movie file

Tower - Media - TV Shows - TV show folder - Season - TV show episodes files

 

and the split level setting is set to 2

 

I want to keep the individual movie folders and tv show folder together and not split across different drives. Having this set to 2 has always worked fine

 

mr-hexen - I have changed this setting to yes - and run the mover again but it is still getting the same error

 

Interestingly I manually moved some of the movies that were in my share (Media) but on the cache drive, to disk4 (the one that wasnt filling up) manually with midnight commander. These moved fine and I could see them on my windows machine on the share Media, but when trying to play the video files it said cannot render the file. They also failed to play in XBMC

[chrishorton7]

Just a further bit of information. I noticed earlier that in windows under the Media Share - Movie folder I created a new folder and copied a file from my desktop into it. I then looked in MC and this folder has been created on the cache drive. Is this right? I thought it would create the file on one of the disks, not the cache drive?

[lionelhutz]

I want to keep the individual movie folders and tv show folder together and not split across different drives. Having this set to 2 has always worked fine.

 

 

The move will fail when you try to put a new TV episode onto the array and the existing series is on a full disk. You just described your problem.

[chrishorton7]

Hi lionelhutz - thanks for your help so far, much appreciated.

 

Just to clarify my folder structure:

 

-Folder - Media

        --Folder - Movies

---Folder - Movie (year)

----Files - Movie files

        --Folder – TV Shows

        ---Folder – TV Show

      ---- Folder – Season

        ----- Files – TV episode files

        --Folder – Temporary Videos

        ---Files – Temporary video files

 

My split level is currently set to 2.

 

I use the unraid for xbmc, I'm not particularly bothered how the files are organised, just so I can easily access them. I thought this split was correct but obviously not.

 

What would you recommend? Is it better for me to have different shares for TV Shows, Movies and Temporary Videos as the structures are different?

[dgaschk]

Hi

 

lionelhutz - the folder structure is as follows:

 

Tower - Media - Movies - Movie folder (year) - Movie file

Tower - Media - TV Shows - TV show folder - Season - TV show episodes files

 

and the split level setting is set to 2

 

I want to keep the individual movie folders and tv show folder together and not split across different drives. Having this set to 2 has always worked fine

 

mr-hexen - I have changed this setting to yes - and run the mover again but it is still getting the same error

 

Interestingly I manually moved some of the movies that were in my share (Media) but on the cache drive, to disk4 (the one that wasnt filling up) manually with midnight commander. These moved fine and I could see them on my windows machine on the share Media, but when trying to play the video files it said cannot render the file. They also failed to play in XBMC

 

Run the New Permissions script.

[dgaschk]

Hi lionelhutz - thanks for your help so far, much appreciated.

 

Just to clarify my folder structure:

 

-Folder - Media

        --Folder - Movies

---Folder - Movie (year)

----Files - Movie files

        --Folder – TV Shows

        ---Folder – TV Show

      ---- Folder – Season

        ----- Files – TV episode files

        --Folder – Temporary Videos

        ---Files – Temporary video files

 

My split level is currently set to 2.

 

I use the unraid for xbmc, I'm not particularly bothered how the files are organised, just so I can easily access them. I thought this split was correct but obviously not.

 

What would you recommend? Is it better for me to have different shares for TV Shows, Movies and Temporary Videos as the structures are different?

 

Since XBMC supports multiple sources you can make a separate shares for movies and TV shows. Leave Movies at split 2 and make TV split 3.

[chrishorton7]

Thanks dgaschk. A couple of questions:

 

I will need to create a share for temporary videos too then. What split level would that be set at? I use this for videos I watch the once then delete, I don't have any other subfolders underneath it.

 

I have the existing share (Media), how do I go about changing to having multiple shares, can I just delete the share media? That won't affect my files will it?

 

If so when I create the shares TV Shows and Movies how do I set them up to the folders needed? Currently I have folders called Movies, TV Shows and Temporary Videos under the folder Media. Can I move them to the same level as Media, delete the empty folder and then delete the share and create the new shares?

 

[lionelhutz]

I personally use different shares for the different media types. You can go to each disk and move the sub-folders to the root of the disk and that will create new shares with the default settings. You could then delete the empty Media folder. Then, go to the shares pages and set them up. 1 for movies and 2  for TV, which would allow different seasons of TV to go to different drives but the whole season would stay together on that drive. This doesn't eliminate the problem you have but it would keep things somewhat organized and clean.

 

You would have to also go to the full disks and move some of the working TV series to an empty disk. I just use Windows and right click drag and drop to move and then let it work. You could also move them to the cache drive so that the double parity editing isn't necessary meaning the move would be quicker. The mover would then put them back onto the appropriate more empty disk.

 

Peter

 

[chrishorton7]

Hi Peter,

 

Thanks for the quick response, I think thats what I will do. Do you know what split-level I should set the temporary videos share at?

 

Also, when you say this won't solve the problem I have, what do you mean? I thought this would sort the issue of the cache drive not moving items onto the array each night?

 

I have been moving some of the movies from the cache drive over to the drive that was empty (disk4) and noticed that my media share that previously had a orange ball next to it, is now green.

[lionelhutz]

A new TV share with a split level of 2 will keep each season on a single drive. You will fail if you try to put a new show into a season that exists on a full drive. So, move some of the shows from the full drives to the empty one and free up space for new episodes.

 

Peter

[chrishorton7]

Is this normal with unraid for this to happen? I didn't think I would constantly have to keep an eye on the amount of data I had on each disk. I thought that's what the high water setting was for

[dgaschk]

The issue is that keeping entire seasons together takes a lot of space and unRAID can't know how much space the season will take. If you start writing a season and its assigned to arrive that does not have space for the complete season you'll have this problem. Since each season has a limited amount of episodes it shouldn't be hard for you to determine if enough space is available for the remainder of the season. You could move completed seasons together on a single drive (or drives) and make sure that the current season is on a drive with plenty of space.

[lionelhutz]

Is this normal with unraid for this to happen? I didn't think I would constantly have to keep an eye on the amount of data I had on each disk. I thought that's what the high water setting was for

 

It's dependent on the split level. If  you set it to keep certain things together on a drive then that drive could end up full.

 

Set the split level high and the file will go where there is space.

 

Peter

[chrishorton7]

Thanks for all your help guys. One last thing any recommendations on what the min free space setting should be for the individual new shares I will be creating (Movies/TV Shows) I tend to download everything in HD using Sickbeard so movies are between 4gb-12gb and tv episodes are between 500mb-2gb

[lionelhutz]

The free space setting really means little unless you are using the fill-up method or all your drives are close to full. If the split level calls for the new TV episode to go on a full disk then it will fail regardless of the free space setting. If all your drives are close to full then you would likely have to start manually placing files on the different disks anyways.

 

Peter

 

[chrishorton7]

Cheers Peter

 

Thanks for everyone with their quick help.

 

I am transferring the files off the cache drive manually (via MC) at the moment to disk4. I'm then going to have a  bit of a sort out of files so current tv shows (with new episodes coming weekly) are on a drive with lots of space and put the older finished tv shows on another drive. I'm then going to delete my existing share and create the new ones.

[dgaschk]

If your running a 5.0 beta you may need to run the New Permissions script after using mc or any command line command to manipulate files.

[chrishorton7]

Cheers dgaschk, will do

[dgaschk]

You may be better of using "most free" and Min Free Space to larger than the largest file that you'll ever write. I copy uncompressed blu-ray rips and use a min free space of 50GB. I can always top off the disks manually.

 

This won't help completely because you still have to monitor whether an entire season will fit on the disk with the most free space. When you see that the season will not fit then you'll still have to manually move it to a new empty disk.