I'm having an issue getting a newly installed disk to be written to via the usershares. The new drive has been precleared and added to the array. I can write to it through the disk share and copy data via mc. My setup is 3x3TB drives, a 3TB parity and a 500gb cache drive. I have a usershare for films and a separate one for TV. Running v5 beta 14.

 

I have my TV shows set up split level 2, using high water and 100000000 min free space in the format: "Series\Season". I have Films set to High Water, 100000000 min free space and split level 1.

 

Both disk 1 and disk 2 were about 95% full so I tried manually moving some series over using mc. However they didn't show up in the usershare so I copied of them onto a local pc and back to the tower. Now I have that test series sitting on my cache drive throwing up errors. Both drives 1 & 2 are sitting at 99% free and drive 3 is sitting pretty.

 

Some relevant logs:

Nov 26 06:41:48 Tower logger: moving TV/
Nov 26 06:41:48 Tower logger: ./TV/Vikings/season01.tbn
Nov 26 06:41:48 Tower logger: .d..t...... ./
Nov 26 06:41:48 Tower shfs/user0: shfs_mkdir: assign_disk: TV/Vikings (28) No space left on device
Nov 26 06:41:48 Tower logger: .d..t...... TV/
Nov 26 06:41:48 Tower logger: cd+++++++++ TV/Vikings/
Nov 26 06:41:48 Tower logger: rsync: recv_generator: mkdir "/mnt/user0/TV/Vikings" failed: No space left on device (28)
Nov 26 06:41:48 Tower logger: *** Skipping any contents from this failed directory ***

 

The show in the log isn't on disk1 or disk2 so I was expecting it to get moved to disk3 overnight. Any clues?

Check the share settings to be sure you haven't used "Includes" => if you did, then you have to add the new disk to the list of included disks.

 

Also check the Global share setting -- which applies to ALL shares -- it would have the same impact if you've used "Includes".

 

Thanks I double checked that, I haven't used any "includes" or "excludes" in either the share or the global share settings. It's a weird one!

Increase the split level.

As noted above, your split levels are too restrictive -- that's what's keeping the system from switching to another drive.    I missed that in my initial scan of your question, as this is a very frequent question and is almost always due to user's using Includes for their shares and forgetting to add the new drive to the list.

 

But in your case, the very restrictive split level is almost certainly the issue.

 

Hmm I tried increasing my split levels, I set the Films usershare to 2 and TV usershare to 3 but I still have items on my cache drive not copying over. Mover script is giving the same errors on both films and tv.

 

My split levels have always worked in the past, putting each film onto a different drive and putting each series on to a different drive.

 

What's weird is when I manually copied over a TV show myself it doesn't show in the usershare even though it's on the disk, it's like the usershares are ignoring disk3 all together.

 

Could this be a permissions issue?

Just to confirm:

 

=>  On the Settings tab, under Share settings, you DO have shares enabled, and you DO NOT have any "Includes" or "Excludes" ... is that correct?

 

=>  On the Shares tab, your shares do NOT have any "Includes" or "Excludes" ... right?

 

=>  Do you have any "Minimum Free Space" settings?

 

=>  What is the full path that you're writing to for the troublesome files?    Just want to confirm that you've relaxed the split levels enough -- your settings are pretty restrictive if you're writing to a 2nd or 3rd level subfolder.

 

What's weird is when I manually copied over a TV show myself it doesn't show in the usershare even though it's on the disk, it's like the usershares are ignoring disk3 all together.

 

Could this be a permissions issue?

Permissions issues can definitely stop files showing up at the network level. If you were copying data at the MC level unless you took special action to preserve permissions then they would have been changed to root being the owner of the files.  I would run the new permissions option again to see if that rectifies the issue.

Just to confirm:

 

=>  On the Settings tab, under Share settings, you DO have shares enabled, and you DO NOT have any "Includes" or "Excludes" ... is that correct?

 

Yes correct.

 

=>  On the Shares tab, your shares do NOT have any "Includes" or "Excludes" ... right?

Yes correct.

 

=>  Do you have any "Minimum Free Space" settings?

Yes I have TV and Films set to 100000000.

 

=>  What is the full path that you're writing to for the troublesome files?    Just want to confirm that you've relaxed the split levels enough -- your settings are pretty restrictive if you're writing to a 2nd or 3rd level subfolder.

 

Here's a few examples of the folders that are residing on my cache and not moving:

\\TOWER\cache\TV\Vikings\*

\\TOWER\cache\Films\Guardians of the Galaxy (2014)\*

 

Excuse the windows paths but you get the idea. In those instances, neither of those folders exist on disk 1 or 2, so should write to disk 3.

 

Permissions issues can definitely stop files showing up at the network level. If you were copying data at the MC level unless you took special action to preserve permissions then they would have been changed to root being the owner of the files.  I would run the new permissions option again to see if that rectifies the issue.

 

I changed the owner and permissions with a command I found on the forums, "newperms /mnt/disk3". I thought that'd deal with it? I'd want to avoid doing the permissions on the cache disk where I have apps installed.

100GB is a very high "minimum free space setting" ... but shouldn't be the cause of this problem.

 

Change your split levels to blank (i.e. none) and see if that resolves the issue.  Also, try writing some additional files after you've changed the setting.  I'm not sure if the split level is applied when a file is cached, or when it's moved.    Changes only impact FUTURE writes, so if it's applied when it's cached, the changes you've made to date would not have had any impact on the files you already have in the cache.

 

Yes I set the min free space setting relatively high to try and get things moving to disk3. I have 38gb and 46gb free on disk1 and disk2 respectively. Disk 3 has 2.99TB free.

 

I just tried setting the split level on films to blank and writing a test file and invoking mover manually. Unfortunately its had no effect:

 

Nov 30 12:59:31 Tower logger: mover started

Nov 30 12:59:31 Tower logger: moving Films/

Nov 30 12:59:31 Tower logger: ./Films/Test/320.49-desktop-win8-win7-winvista-64bit-international-whql.exe

Nov 30 12:59:31 Tower shfs/user0: shfs_mkdir: assign_disk: Films/Test (28) No space left on device

Nov 30 12:59:31 Tower logger: .d..t...... Films/

Nov 30 12:59:31 Tower logger: cd+++++++++ Films/Test/

Nov 30 12:59:31 Tower logger: rsync: recv_generator: mkdir "/mnt/user0/Films/Test" failed: No space left on device (28)

Nov 30 12:59:31 Tower logger: *** Skipping any contents from this failed directory ***

 

 

Sorry to double post but it I got finally got data onto disk3 using usershares!

 

I simply restarted the array, when I shutdown the array the filesync did take a while. I'm none the wiser!

You had never restarted ??!!  That's the first thing you should always do when something's not working right -- the old "kick-in-the-pants" technique 

 

... I tend to forget to suggest it as it's something I always assume has been done already.