April 7, 201016 yr I'm running the pro version of 4.5.3 Have a total of 4.5TB in available space on 5 drives not including the parity drive.. I have the following shares setup: Share name: Movies Allocation method: High Water Min. free space: 40000000 Split level: 1 Included disk(s): Excluded disk(s): Export (SMB): read-only Exceptions: mike Valid users: Invalid users: Export (NFS): Share name: Series Allocation method: High Water Min. free space: 10000000 Split level: 2 Included disk(s): Excluded disk(s): Export (SMB): read-only Exceptions: mike Valid users: Invalid users: Export (NFS): I have an external USB drive hooked up to the unraid box and am copying via mc to /mnt/user/Movies It started filling drive1 and started to fill drive2 as well, but after it created a few directories on drive2 I am getting the message "cannot write to target /mnt/user/Movies.. No space left on device (28)" I have shut down the array and brought it back up, no errrors. I tried copying again.. getting the same "no space" message This should work, shouldnt it? I know I could just write to drive2, but that kinda defeats the purpose.. Anyone know whats going on? Syslog attached after reboot and started copy again and it failed.. syslog-2010-04-07.txt
April 7, 201016 yr You need to set "split level" to a value greater than 1. Otherwise, it will never use the other drive for any directory under Movies. Joe L.
April 7, 201016 yr Author Damn split levels.. I thought I had it figured out.. So I guess I should increase all my shares by 1 level then.. Structure: Movies/Moviename/Movie.avi Series/SeriesName/Season x/Episode.avi Movies should not be split across disks, tv series can be split but the seasons should be together..
April 8, 201016 yr Here is a basic visual rule of Split Levels in this below example: Server Share Split Split 2 Your Name Name Level 1 Level 2 File(s) Here | | | | | \\Tower\Movies\Comedy\A Movie Name\Your_movie_file.avi - (In this example, you need Split level 2 set) \\Tower\Movies\Horror..\Another Name\Your_movie_file.avi or Server Share Split Your Name Name Level 1 File(s) Here | | | | \\Tower\Pictures\HolidaySnaps08\IMG000001.jpg - (In this example, you need Split level 1 set) \\Tower\Pictures\HolidaySnaps09\IMG000001.jpg Also refer the links below: http://lime-technology.com/forum/index.php?topic=1928.0 and http://lime-technology.com/forum/index.php?topic=3483.msg30193#msg30193 which should give you a good visual on Split Levels. Believe me, it took a bit to wrap my head around this too.
April 8, 201016 yr Here is a basic visual rule of Split Levels in this below example: Server Share Split Split 2 Your Name Name Level 1 Level 2 File(s) Here | | | | | \\Tower\Movies\Comedy\A Movie Name\Your_movie_file.avi - (In this example, you need Split level 2 set) \\Tower\Movies\Horror..\Another Name\Your_movie_file.avi or Server Share Split Your Name Name Level 1 File(s) Here | | | | \\Tower\Pictures\HolidaySnaps08\IMG000001.jpg - (In this example, you need Split level 1 set) \\Tower\Pictures\HolidaySnaps09\IMG000001.jpg Also refer the links below: http://lime-technology.com/forum/index.php?topic=1928.0 and http://lime-technology.com/forum/index.php?topic=3483.msg30193#msg30193 which should give you a good visual on Split Levels. Believe me, it took a bit to wrap my head around this too. Based on this post from limetech http://lime-technology.com/forum/index.php?topic=1928.msg13748#msg13748 I believe you are off by 1. The Share is split level 1, the next directory under it 2, etc. According to Tom's post, it is this: Server Share Split Your Name Name Level 2 File(s) Here Level 1 | | | | \\Tower\Pictures\HolidaySnaps08\IMG000001.jpg - (In this example, you need Split level 2 set) \\Tower\Pictures\HolidaySnaps09\IMG000001.jpg Joe L.
April 8, 201016 yr Oh, your right Joe L, my apologies. Correction on my example below: Server Split Split 2 Split Your Name Level 1 Level 2 Level 3 File(s) Here | | | | | \\Tower\Movies\Comedy\A Movie Name\Your_movie_file.avi - (In this example, you need Split level 3 set) \\Tower\Movies\Horror..\Another Name\Your_movie_file.avi | Share Name and Server Split Split Your Name Level 1 Level 2 File(s) Here | | | | \\Tower\Pictures\HolidaySnaps08\IMG000001.jpg - (In this example, you need Split level 2 set) \\Tower\Pictures\HolidaySnaps09\IMG000001.jpg | Share Name
April 8, 201016 yr Author Thanks Guys, I increased the split level by 1 and it seems to be working fine so far..
April 9, 201016 yr Your directory structure is not the same as the above example so level 2 is the wrong choice. You have Movies\A Movie Name\file.avi 1 = "Movies" can be on multiple drives 2 = "A Movie Name" can be on multiple drives If "A Movie Name" can be on multiple drives then the different files stored under "A Movie Name" can also be on multiple drives. You might find the "file.avi" on one drive and the metadata such as the folder.jpg and backdrop.jpg on a different drive. Your level 2 for the series seems to be OK as well. I would delete the minimum free space and try again. Also, check for "A Movie Name" directories that are on multiple drives now. Server Share Split Split 2 Your Name Name Level 1 Level 2 File(s) Here | | | | | \\Tower\Movies\Comedy\A Movie Name\Your_movie_file.avi - (In this example, you need Split level 2 set) \\Tower\Movies\Horror..\Another Name\Your_movie_file.avi Yes, this should be level 2. However, the numbering is still out according to the standard way of numbering shares. According the the official unRAID manual and explanations, the split level is the last directory you want to split across multiple drives. Your (unraided's) convention is numbered so that the split level is set to the first directory you want to keep on a single drive. You can use either but make sure you know which one you are using. Honestly, I almost believe your (unraided's) convention would be better since the official way seems to create more confusion. You don't want 3 (or all the files stored in "A Movie Name" could be on different disks) which means 2 is the correct choice. You need to set "split level" to a value greater than 1. Otherwise, it will never use the other drive for any directory under Movies. Joe L. This isn't true. Level 1 will allow the Movies to share all the drives. Peter
April 9, 201016 yr Author Ok, I'm confused now.. I had Movies with level one, but it would not span more than one disk.. After I set it to level 2 it worked ok..
April 9, 201016 yr You need to set "split level" to a value greater than 1. Otherwise, it will never use the other drive for any directory under Movies. Joe L. This isn't true. Level 1 will allow the Movies to share all the drives. Peter Respectfully, it is true. For level=1, I did not say that "Movies" would not use the other drives, but that directories UNDER IT would not.
April 9, 201016 yr Ok, I'm confused now.. I had Movies with level one, but it would not span more than one disk.. After I set it to level 2 it worked ok.. Well, level 1 should allow "Movies" to be on more than one drive. Your Movie share all go "Movies\Movie Name\File.mkv" right? Try removing the min free number. Check that each seperate movie directory is only on one drive now and not with files scattered across multiple drives. Respectfully, it is true. For level=1, I did not say that "Movies" would not use the other drives, but that directories UNDER IT would not. You are right, I misread that line. Peter
April 9, 201016 yr Author My share name is called Movies So \\tower\Movies\MovieName\Movie.avi I played with the min free and nothing worked until I changed the split level to 2. And no, the files are not scattered, each complete movie is on a disk (so far)
April 9, 201016 yr Did you delete the min free space so it was blank? If you read what level 1 means then your Movies share should split to every drive just fine. I'm sure that's why you picked 1 for the movies and 2 for the series, because you actually read and understood that. I had high level and split level of 1 with same structure as you and my share was splitting between 2 drives just fine using 4.4.3. I upgraded to 4.5.3 and put in a min free and fill-up with level 1 and I got splits I didn't want. Personally, I think some combinations of settings are broken in the new unRAID version and it seems to involve the new min-free setting. My disks were not full to what the min free is supposed to mean and the split level of 1 meant to only split the "Movies" directory but non the less, I still had subdirectories in my Movies share split. I posted to ask why I got the split and no answer meaning no-one here knows why or they just ignored me. I emailed Limetech and got not response. I've read other posts here where the settings did not work like they should with no explanation why and no real resolution. So ya, right now I'm concluding that the share settings are broken somehow in the new version. Peter
April 9, 201016 yr Author Hmm, I'm pretty sure I started out blank until it started complaining about free space.. I'll do some more tests over the weekend as I still have to copy a ton of stuff from my old and SLOW synology raid-5 server..
April 9, 201016 yr Ok all of this is starting to put doubt on my Split Level knowledge too . What I understand and what is quoted below, you start with the server name, then it is the network share which starts with split level 1, the root folder below the share is split level 2 and you have your files underneath the root folder, the split level structure ends there. Being in this example, split level 2 would make sure your second split level and the files in it do not span across multiple disks and only stay on the one disk, that is my understanding on this. If this were to fill up, I think what should happen is you'll get a disk full message. Joe L, is this correct? My share name is called Movies So \\tower\Movies\MovieName\Movie.avi I played with the min free and nothing worked until I changed the split level to 2. And no, the files are not scattered, each complete movie is on a disk (so far)
April 9, 201016 yr Check the disk that was being filled. I'm thinking it is full. I'm also thinking that you created a "Movie Title" directory on that disk yet the disk could not hold the contents of this directory. Once that directory was created, the only way to make room to fill it was to change the Split Level so that it could be created on a disk with more space. So, you had played with the settings and tried to copy that file again but there would never be enough room unless you deleted something on that disk first or changed the split level. Do you remember the problem movie? Check to see if that movie has directories on 2 disks. Peter
April 9, 201016 yr Ok all of this is starting to put doubt on my Split Level knowledge too . What I understand and what is quoted below, you start with the server name, then it is the network share which starts with split level 1, the root folder below the share is split level 2 and you have your files underneath the root folder, the split level structure ends there. Being in this example, split level 2 would make sure your second split level and the files in it do not span across multiple disks and only stay on the one disk, that is my understanding on this. If this were to fill up, I think what should happen is you'll get a disk full message. Joe L, is this correct? My share name is called Movies So \\tower\Movies\MovieName\Movie.avi I played with the min free and nothing worked until I changed the split level to 2. And no, the files are not scattered, each complete movie is on a disk (so far) Movies = 1 MovieName = 2 Setting Split Level = 1 means that Movies can boht be created on more than one disk. Setting Split Level = 2 means that Movies and MovieName can both be created on more than one disk. Peter
April 9, 201016 yr Author Ok all of this is starting to put doubt on my Split Level knowledge too . What I understand and what is quoted below, you start with the server name, then it is the network share which starts with split level 1, the root folder below the share is split level 2 and you have your files underneath the root folder, the split level structure ends there. Being in this example, split level 2 would make sure your second split level and the files in it do not span across multiple disks and only stay on the one disk, that is my understanding on this. If this were to fill up, I think what should happen is you'll get a disk full message. Joe L, is this correct? My share name is called Movies So \\tower\Movies\MovieName\Movie.avi I played with the min free and nothing worked until I changed the split level to 2. And no, the files are not scattered, each complete movie is on a disk (so far) Movies = 1 MovieName = 2 Setting Split Level = 1 means that Movies can boht be created on more than one disk. Setting Split Level = 2 means that Movies and MovieName can both be created on more than one disk. Peter Thats what I have now and seems to work.. I'll still do some testing on this just to make it clear to myself with all these different options..
April 9, 201016 yr Author @Msan, assuming your referring to this example, you have Split Level 2 correct? My share name is called Movies So \\tower\Movies\MovieName\Movie.avi Movies = 1 MovieName = 2 Setting Split Level = 1 means that Movies can boht be created on more than one disk. Setting Split Level = 2 means that Movies and MovieName can both be created on more than one disk. Yes, this was what I was referring to.. An yes, I have the Movie share set to split level 2 currently (and seems to work)
April 9, 201016 yr Great, my entire directory struture on my unraid server share goes two directories deeper then in this example demostrated, so I have a spilt level 4 setup and it works for me too. @Msan, assuming your referring to this example, you have Split Level 2 correct? My share name is called Movies So \\tower\Movies\MovieName\Movie.avi Movies = 1 MovieName = 2 Setting Split Level = 1 means that Movies can boht be created on more than one disk. Setting Split Level = 2 means that Movies and MovieName can both be created on more than one disk. Yes, this was what I was referring to.. An yes, I have the Movie share set to split level 2 currently (and seems to work)
April 9, 201016 yr Author Great, my entire directory struture on my unraid server share goes two directories deeper then in this example demostrated, so I have a spilt level 4 setup and it works for me too. @Msan, assuming your referring to this example, you have Split Level 2 correct? My share name is called Movies So \\tower\Movies\MovieName\Movie.avi Movies = 1 MovieName = 2 Setting Split Level = 1 means that Movies can boht be created on more than one disk. Setting Split Level = 2 means that Movies and MovieName can both be created on more than one disk. Yes, this was what I was referring to.. An yes, I have the Movie share set to split level 2 currently (and seems to work) That's good.. seems we're on the right track then
April 9, 201016 yr Did you check if the directory was created on the almost full disk and then there was not enough room on the disk for the file? Once you get a movie directory on a full disk the copy to it will fail unless you delete it or change to split level 2. The other problem could be that your program you are copying with will first create an empty file and then try to fill the file with content. The empty file can be created on an almost full disk but the write will fail as the file size is expanded to include the file contents and the disk runs out of space. One other thing, if you only have one file in each movie directory then it doesn't matter too much because unRAID only needs to put that single file on one disk and there is no other files to spread out to another disk. Peter
April 9, 201016 yr Author Did you check if the directory was created on the almost full disk and then there was not enough room on the disk for the file? Once you get a movie directory on a full disk the copy to it will fail unless you delete it or change to split level 2. The other problem could be that your program you are copying with will first create an empty file and then try to fill the file with content. The empty file can be created on an almost full disk but the write will fail as the file size is expanded to include the file contents and the disk runs out of space. One other thing, if you only have one file in each movie directory then it doesn't matter too much because unRAID only needs to put that single file on one disk and there is no other files to spread out to another disk. Peter I'm not sure if it created a dir on the 1st disk, as I cleaned out all the empty dirs since then.. But I will create a new share and will try this out again..
April 10, 201016 yr I notice your concern lionelhutz. From my recent monitoring of my unraid server, when I create a folder on the last folder level (ie: split level 4 in my setup and circumstance), the disk with the most space (as I'm using High Water scheme) the newly created folder gets placed only on the disk with the most space at that given point of time. This works well as every split level 4th folder I create in the forsee future will always be placed on the disk with the most space, not on other disks. This is handly to keep all the files grouped together, an example you would want a DVD folder structure to remain on the same disk, but another DVD folder struture would be fine to be placed on another disk. I only place one set of file(s) into the split level 4th folder and no more files after that, ie: Server Split Split Split Split Name Level 1 Level 2 Level 3 Level 4 | | | | | \\tower\mysharename\music&moves\dvds\silver_streak\vob_file1.vob | |-----\vob_file2.vob | |-----\vob_file3.vob Share Name | | Server Split Split Split Split Name Level 1 Level 2 Level 3 Level 4 | | | | | \\tower\mysharename\music&moves\dvds\something_about_mary\vob_file1.vob |---------\vob_file2.vob |---------\vob_file3.vob as this example demostrates too: Server Split Split Split Split Name Level 1 Level 2 Level 3 Level 4 | | | | | \\tower\mysharename\music&moves\mp3s\ministry_of_sound2010!\track01.mp3 |------------\track02.mp3 |------------\track02.mp3 \\tower\mysharename\music&moves\mp3s\ministry_of_sound2009!\track01.mp3 |------------\track02.mp3 |------------\track02.mp3 Did you check if the directory was created on the almost full disk and then there was not enough room on the disk for the file? Once you get a movie directory on a full disk the copy to it will fail unless you delete it or change to split level 2. The other problem could be that your program you are copying with will first create an empty file and then try to fill the file with content. The empty file can be created on an almost full disk but the write will fail as the file size is expanded to include the file contents and the disk runs out of space. One other thing, if you only have one file in each movie directory then it doesn't matter too much because unRAID only needs to put that single file on one disk and there is no other files to spread out to another disk. Peter
Archived
This topic is now archived and is closed to further replies.