April 28, 201115 yr Ok, I've read a ton of stuff on this, but still cannot figure out how to best go about this... I have a 1.5tb and a 1tb disk on a share...they are both included in the share and allocation is set to high water... Here's my file system ||Media(share) ||Movies ||Directory A ||Directory B ||ETC.... I set the split level to 3. Wouldn't this be correct? I want each individual movie folder to stay on the same hard drive. However, the files are only going on disk2. Here's what my disks look like as of now... disk2 ||Media ||Movies ||Directory A ||Directory B ||ETC.... disk1 ||Movies As of writing this, there is only 600gb free on the 1.5tb drive, so it's over halfway. Why hasn't it started to put movies onto the other drive? Any help would be appreciated. Also, if I have the wrong split level, is there anyway to automatically have the unRAID server move the files to the correct share level?
April 28, 201115 yr You want to use split level 2. You have a share setting wrong because high water would first put files on disk1 and then on disk2. High-water attempts to keep the free space equal, not the disks filled equally. With different size disks, the percent used on each disk is not kept equal. 1st pass - fill each disk until < 750gig is free. Will 25% fill disk1 and then 50% fill disk2. 2nd pass - fill each disk until < 375gig is free. Will 62.5% fill disk1 and then 75% fill disk2. 2rd pass - fill each disk until < 187gig is free. Will 81.3% fill disk1 and then 87.5% fill disk2. etc Peter
April 28, 201115 yr Author You want to use split level 2. You have a share setting wrong because high water would first put files on disk1 and then on disk2. High-water attempts to keep the free space equal, not the disks filled equally. With different size disks, the percent used on each disk is not kept equal. 1st pass - fill each disk until < 750gig is free. Will 25% fill disk1 and then 50% fill disk2. 2nd pass - fill each disk until < 375gig is free. Will 62.5% fill disk1 and then 75% fill disk2. 2rd pass - fill each disk until < 187gig is free. Will 81.3% fill disk1 and then 87.5% fill disk2. etc Peter Ok, I have included disks listed like this: disk2, disk1 Is that not acceptable? Do I need to rewrite all of the data to fix the split disk error?
April 28, 201115 yr Author I'm confused I guess as to why it's 2 not 3...can you explain that... 0||disk1 1||Media(share) 2 ||Movies 3 ||Directory A ||Directory B ||ETC.... Wouldn't a split level of 3 keep everything in Dir A together, but allow Dir A, Dir B to be on different drives?
April 28, 201115 yr Do I need to rewrite all of the data to fix the split disk error? You aren't the first/only one to decide later that split-level ought to be different. Others of us didn't bother to set split level correctly (too low, or not at all) and have the directories split between seperate disks. There is a thread going on about fixing that. In your case, if the data is still correct 'per directory, on one disk' - I don't think you need to 'fix' anything by moving the data around. You can just change the split level. When the files were written, nothing was "memorized" about the split level they were created with {somebody correct me if I'm wrong} How to rearrange media after split level change
April 28, 201115 yr Since you have 2 different sizes, it will take a bit to sort out no matter which allocation method used. With HighWater, it will fill a disk until it has 750gb free (50% of largest disk) then the next disk until 750gb free, etc until all disks have 750gb free. Then repeat but until 375gb free (50% of largest free space) With Most Free allocation, it would use the 1.5TB until it has 1TB free, then it will balance out between the 1.5 & 1tb drives keeping the free space as equal as possible based on the split level also. So what you see is normal action now. Current setup, it will use disk 1 once there is < 750gb free on disk 2 (dependant upon split level restrictions)
April 28, 201115 yr Since you haven't hit the point where the disk allocation will use the other disk, you can change split level any time. It only affects when files are written. So since disk allocation is writing everything to disk2 right now (because you had it listed first in your disk list), you can change the split level, then when it goes to use disk 1 because of disk allocation, it will check the split level at that time to determine if it can write to disk 1 or it needs to keep it on disk 2.
April 28, 201115 yr Author Since you haven't hit the point where the disk allocation will use the other disk, you can change split level any time. It only affects when files are written. So since disk allocation is writing everything to disk2 right now (because you had it listed first in your disk list), you can change the split level, then when it goes to use disk 1 because of disk allocation, it will check the split level at that time to determine if it can write to disk 1 or it needs to keep it on disk 2. ok, I switched to split level 2 right now. BUT it's still not writing to disk1. There's only 585gb free on the 1.5tb drive, so it should have switched over correct?
April 28, 201115 yr 0||disk1 1||Media(share) 2 ||Movies 3 ||Red red (2010).mkv ||Expendables 4 || video_ts 4 || audio_ts ||ETC.... If you want Directory Expendables to be able to span disks so that video_ts & audio_ts can be on different disks but the contents of video_ts to be all on the same disk, you want split level 3 If you want Directory Expendables (and the sub-folders) and the video_ts & audio_ts directorys (and files in them) are on the same disk, you want split level 2
April 28, 201115 yr Since you haven't hit the point where the disk allocation will use the other disk, you can change split level any time. It only affects when files are written. So since disk allocation is writing everything to disk2 right now (because you had it listed first in your disk list), you can change the split level, then when it goes to use disk 1 because of disk allocation, it will check the split level at that time to determine if it can write to disk 1 or it needs to keep it on disk 2. ok, I switched to split level 2 right now. BUT it's still not writing to disk1. There's only 585gb free on the 1.5tb drive, so it should have switched over correct? Write something new to the Movies that doesn't already have a folder under movies and it should go to the next disk. How much free space is on disk 1?
April 28, 201115 yr Author 0||disk1 1||Media(share) 2 ||Movies 3 ||Red red (2010).mkv ||Expendables 4 || video_ts 4 || audio_ts ||ETC.... If you want Directory Expendables to be able to span disks so that video_ts & audio_ts can be on different disks but the contents of video_ts to be all on the same disk, you want split level 3 If you want Directory Expendables (and the sub-folders) and the video_ts & audio_ts directorys (and files in them) are on the same disk, you want split level 2 Thanks
April 28, 201115 yr Author Since you haven't hit the point where the disk allocation will use the other disk, you can change split level any time. It only affects when files are written. So since disk allocation is writing everything to disk2 right now (because you had it listed first in your disk list), you can change the split level, then when it goes to use disk 1 because of disk allocation, it will check the split level at that time to determine if it can write to disk 1 or it needs to keep it on disk 2. ok, I switched to split level 2 right now. BUT it's still not writing to disk1. There's only 585gb free on the 1.5tb drive, so it should have switched over correct? Write something new to the Movies that doesn't already have a folder under movies and it should go to the next disk. How much free space is on disk 1? I'm actively transferring files via FTP to my server right now, there's a whole queue of files waiting to be written, but none of them are moving over to disk1 There's is 998gb free on disk1
April 28, 201115 yr Author Ok so also, another question. When I created the media share, this is how it showed up on the disks. disk2 ||Media ||Movies ||Red ||Unstopable disk1 ||Movies As you see, disk1 didn't have media before movies, is this why? My included disks say: disk2, disk1 Should there not be a space in there? Does it need to be: disk2,disk1
April 28, 201115 yr unRAID will not create the share directory until writing files to that disk. Did you create a "Movies" share at one time? Try going to disk1 and deleting it and then see what happens. In some cases, programs will first create all the directories and then fill them when you do a big move command. In these cases, the disks will over-fill since there is lots of free space when the directories are created but not as much after they are filled. I think your disk settings is ok. You could try just a space or just a comma. Peter
April 28, 201115 yr Author unRAID will not create the share directory until writing files to that disk. Did you create a "Movies" share at one time? Try going to disk1 and deleting it and then see what happens. In some cases, programs will first create all the directories and then fill them when you do a big move command. In these cases, the disks will over-fill since there is lots of free space when the directories are created but not as much after they are filled. I think your disk settings is ok. You could try just a space or just a comma. Peter Come to think of it, yes I did create a Movies share. I later deleted it as I decided I wanted to do a Media share instead.... The FTP is not creating directories before writing files. I check to see if they files in the queue already have folders, but they do not. Thoughts?
April 28, 201115 yr Author Alright, so I deleted the "Movies" folder off of disk1. I agree that that was from a previous share. However, the "Media" share is never recreated on disk1. How do I make an existing share expand to another disk?
April 28, 201115 yr Author Ok, another development. Upon trying to figure this out, I thought I would switch the included disks. When I go to the shares home page it shows only 500gb free out of the 2500. I've written about 1tb to the drives. So that number wasn't right. If I changed the included disks on the share to just say: disk1 the free space changed to 0. SO.... I decided to try to create a new share to see if it would show up. So I created Media Test and set the included disks to: disk1 However, upon returning to the shares page, it only shows my original Media share. The new share is not showing up on the disk?! What's going on here? Here's what I get when I try to create a new share on disk1 Apr 28 22:57:55 tower emhttp: shcmd (273): mkdir '/mnt/user/123' Apr 28 22:57:55 tower shfs: shfs_mkdir: assign_disk: 123 (28) No space left on device Apr 28 22:57:55 tower emhttp: _shcmd: shcmd (273): exit status: 1 Apr 28 22:57:55 tower emhttp: shcmd (274): rm /etc/samba/smb-shares.conf >/dev/null 2>&1 Apr 28 22:57:55 tower emhttp: shcmd (275): cp /etc/netatalk/AppleVolumes.default- /etc/netatalk/AppleVolumes.default Apr 28 22:57:55 tower emhttp: Restart SMB... Apr 28 22:57:55 tower emhttp: shcmd (276): killall -HUP smbd Apr 28 22:57:55 tower emhttp: Restart AFP... Apr 28 22:57:55 tower emhttp: shcmd (277): killall -HUP afpd Apr 28 22:57:55 tower afpd[5221]: re-reading configuration file Apr 28 22:57:55 tower afpd[5221]: Loading ConfigFile Apr 28 22:57:55 tower emhttp: shcmd (278): /usr/local/sbin/emhttp_event svcs_restarted Apr 28 22:57:55 tower emhttp_event: svcs_restarted Apr 28 22:57:55 tower afpd[5221]: main: atp_open: Address family not supported by protocol Apr 28 22:57:55 tower afpd[5221]: dsi_tcp: hostname 'tower' resolves to loopback address Apr 28 22:57:55 tower afpd[5221]: dsi_tcp: '192.168.2.2' on interface 'eth0' will be used instead. Apr 28 22:57:55 tower afpd[5221]: ASIP started on 192.168.2.2:548( (2.0.5) Apr 28 22:57:55 tower afpd[5221]: uam: loading (/etc/netatalk/uams/uams_guest.so) Apr 28 22:57:55 tower afpd[5221]: uam: uams_guest.so loaded Apr 28 22:57:55 tower afpd[5221]: uam: loading (/etc/netatalk/uams/uams_dhx2.so) Apr 28 22:57:55 tower afpd[5221]: uam: uams_dhx2.so loaded Apr 28 22:57:55 tower afpd[5221]: uam: "DHX2" available Apr 28 22:57:55 tower afpd[5221]: uam: "No User Authent" available Apr 28 22:57:55 tower afpd[5221]: Finished parsing Config File It says no space left on device? But under the disk management it says 998gb free When logged into TOWER, it also gives this error message upon trying to create a new share: mkdir: cannot create directory '/mnt/user/Teset': No space left on device My file system space says this: Filesystem 1K-blocks Used Available Use% Mounted on /dev/sda1 4006020 118936 3887084 3% /boot /dev/sdc1 78122536 32840 78089696 1% /mnt/cache /dev/md2 1465089704 922460844 542628860 63% /mnt/disk2 shfs 1465089704 922460844 542628860 63% /mnt/user /dev/md1 976732736 352808 976379928 1% /mnt/disk1 I will also attach 2 screen shots... Share Settings
April 28, 201115 yr My share also has an orange ball by it instead of a green ball...which I've read that mean there are files on the cache drive waiting to be written...but I haven't used the cache drive? You don't really "use" the cache drive when you write to a share. It just "goes there" behind the scenes. In other words, you don't say to "use the cache" -- it just happens, as long as that cache drive is configured to be used for that share. (You can, specify the /mnt/share, but you aren't doing that) Just the fact you have it configured and assigned to a share is sufficient. And then on the cache drive schedule, it'll be moved onto your real disks based on the split-level. And, data living on your cache drive isn't going to "deduct" from your disks free space until that data gets moved.
April 28, 201115 yr You are writing the files to //tower/Media, right? What free space are you setting? On the server itself the share is located at /mnt/user/Media. Post a screen shot of your share settings. Peter
April 28, 201115 yr I'm confused I guess as to why it's 2 not 3...can you explain that... 0||disk1 1||Media(share) 2 ||Movies 3 ||Directory A ||Directory B ||ETC.... Wouldn't a split level of 3 keep everything in Dir A together, but allow Dir A, Dir B to be on different drives? Number them as you have done and then pick the number that corresponds to the last directory level you want to split. Use 2 because you want Movies to split. If you use 3 then you are allowing the directories for each individual movie to split. Peter
April 28, 201115 yr Author You are writing the files to //tower/Media, right? What free space are you setting? On the server itself the share is located at /mnt/user/Media. Post a screen shot of your share settings. Peter The share settings screenshot are posted above.... I'm writing the files directly to the share.... So over my FTP, I connect, and then navigate to the folder in the tree that says Media/Movies and then write them there....
April 28, 201115 yr Author My share also has an orange ball by it instead of a green ball...which I've read that mean there are files on the cache drive waiting to be written...but I haven't used the cache drive? You don't really "use" the cache drive when you write to a share. It just "goes there" behind the scenes. In other words, you don't say to "use the cache" -- it just happens, as long as that cache drive is configured to be used for that share. (You can, specify the /mnt/share, but you aren't doing that) Just the fact you have it configured and assigned to a share is sufficient. And then on the cache drive schedule, it'll be moved onto your real disks based on the split-level. And, data living on your cache drive isn't going to "deduct" from your disks free space until that data gets moved. Right, what I mean by I haven't used the cache drive yet, is that it is not even assigned to the share...I'm writing a ton of files, and my cache drive is not big enough...
April 28, 201115 yr Your share settings look OK. It's almost like disk1 has got an issue of some sort. Check your syslog for some indication of disk1 being mounted read-only. Peter
April 28, 201115 yr Author Your share settings look OK. It's almost like disk1 has got an issue of some sort. Check your syslog for some indication of disk1 being mounted read-only. Peter I will check this when I get home thanks.
Archived
This topic is now archived and is closed to further replies.