I've got about 13TB of data that I want to copy over to my new server but I haven't been able to get SNAP to work and have run out of ideas and questions to post <link> so thought I'd ask about other ways I could copy other than over a 100Mbps network? I'd really like to connect the drives I have this data on (NTFS formatted) via SATA and just copy it over, I am no command line guru but can kinda get around. I was trying to read up on how to just mount a drive via command line and copy it to a share; it seems like if I figured out the mounting part (if unraid shows it as sdj could I mount it as sdj1?) I could just cp to say disk1/folder and unraid would distribute it across other drives automatically? (still trying to understand unraid share magic). Apologies for the noobness of the post. Thanks!

Not done this myself but found this in the Wiki:

http://lime-technology.com/wiki/index.php/Copy_files_from_a_NTFS_drive

This is probably written for unRAID5. If you need the ntfs-3g driver its different for unRAID5 than unRAID6 (32/64 bit OS).

 

I could just cp to say disk1/folder and unraid would distribute it across other drives automatically? (still trying to understand unraid share magic). Apologies for the noobness of the post. Thanks!

I can answer this part of your question.

 

Unraid has the following places that you'll likely want to copy to.

#1 Copy to a specific Disk /mnt/diskx/Folder (where x is the disk number)
#2 Copy to a user share including cache disk /mnt/user/Folder
#3 Copy to a user share exluding cache disk /mnt/user0/Folder

 

So no if you cp to /mnt/disk1/folder it won't distribute it across other drives automatically, it'll save it to that folder on disk1. If you want it to automatically spread the data based on your user share settings you should cp to /mnt/user/folder

 

Hope that makes sense.

 

 

Not done this myself but found this in the Wiki:

http://lime-technology.com/wiki/index.php/Copy_files_from_a_NTFS_drive

This is probably written for unRAID5. If you need the ntfs-3g driver its different for unRAID5 than unRAID6 (32/64 bit OS).

 

Thanks for this, I will take a look at it. I am on on unRAID6 and do have the ntfs-3g driver/plugin installed, perhaps this will get me a bit closer though. Cheers!

I could just cp to say disk1/folder and unraid would distribute it across other drives automatically? (still trying to understand unraid share magic). Apologies for the noobness of the post. Thanks!

I can answer this part of your question.

 

Unraid has the following places that you'll likely want to copy to.

#1 Copy to a specific Disk /mnt/diskx/Folder (where x is the disk number)
#2 Copy to a user share including cache disk /mnt/user/Folder
#3 Copy to a user share exluding cache disk /mnt/user0/Folder

 

So no if you cp to /mnt/disk1/folder it won't distribute it across other drives automatically, it'll save it to that folder on disk1. If you want it to automatically spread the data based on your user share settings you should cp to /mnt/user/folder

 

Hope that makes sense.

 

Thanks! Your explanation totally makes sense, much appreciated, and is exactly what i needed to know about where to copy it so if i can get the mounting part right I will be set. Cheers!

Might be wrong, as I've been drinking, but I think Unmenu can mount NTFS devices/partitions.

 

I know when I was migrating my data from 4TB NTFS drives that I could not use SNAP as it would only mount the first partition and my data was on the second.

 

I'll see if I can dig out any more stuff if you need as I know I've posted about this before.

 

Cool username by the way!

Hey thanks, I don't have unMenu installed but would be totally willing to try to install it to try to resolve this problem. If you have any extra info on how you did this I would of course appreciate it! As for the username, thanks, most people don't notice  it was an old college joke (as I tend to be the opposite  )

Hey thanks, I don't have unMenu installed but would be totally willing to try to install it to try to resolve this problem. If you have any extra info on how you did this I would of course appreciate it! As for the username, thanks, most people don't notice  it was an old college joke (as I tend to be the opposite  )

 

I can't find any good posts in my history explaining the process, but one did confirm this was my method.  If you can't figure it out let me know and I'll see if I can replicate it on my box and post how.

Hi, as far as I know the ntfs-3g driver/plugin is installed correctly but when i try to mount the drive it is refusing to cooperate. One thing I had not noticed at first and someone in another post astutely pointed out, my drive has a tiny little extra partition (must be a windows thing since I was using it as a data drive on windows before) but regardless I have tried mounting both partitions. SNAP is telling me that the partition it is seeing (presumabily the tiny one sdf1?) is not formatted, but I am not getting an error when i try to mount either partition using:

mount -t ntfs-3g /dev/sdf2 /mnt/tmpdrv -o umask=111,dmask=000 -v

or

mount -t ntfs-3g /dev/sdf1 /mnt/tmpdrv -o umask=111,dmask=000 -v

or just plain

mount -t ntfs-3g /dev/sdf2 /mnt/tmpdrv

 

despite not getting an error when i go to the tmpdrv dir it is empty and ditto when i do df, its not showing up as a mounted device.

 

Thoughts anyone? please? 

 

Have you tried Unmenu yet?  I had the same problem with SNAP.  SNAP will only mount the first partition and you need to mount the second.  Pretty sure there is a way to do this with Unmenu.  In fact I'm almost certain.

I've got about 13TB of data that I want to copy over to my new server but I haven't been able to get SNAP to work and have run out of ideas and questions to post <link> so thought I'd ask about other ways I could copy other than over a 100Mbps network?

 

Just upgrade to a Gb network 

 

If you're copying over a Gb network, it's just as fast as a locally attached drive (assuming your array is fault tolerant).

 

You don't need to change your router ... an inexpensive Gb switch is all you need => just plug it into your router and then plug the server and your client with the data you need to copy both into the switch.

 

Have you tried Unmenu yet?  I had the same problem with SNAP.  SNAP will only mount the first partition and you need to mount the second.  Pretty sure there is a way to do this with Unmenu.  In fact I'm almost certain.

 

Yeah, just tried it out, pretty nice (unMENU that is). Unfortunately, assuming I am using it right, it doesn't seem to be able to mount drives either. It tried the following cmd, a bit different than what i tried:

mount -r -o umask=111,dmask=000 -t ntfs-3g /dev/sdf1 /mnt/disk/sdf1 2>&1

 

And this is on another drive that I checked before trying, and this drive has one large NTFS partition, no other partitions on it so i could rule out the second partition issue, SNAP wasn't cooperating either but I posted about that in a SNAP specific post. As with SNAP I'm about out of ideas again (not that I had many to begin with, still climbing the learning curve  )

I've got about 13TB of data that I want to copy over to my new server but I haven't been able to get SNAP to work and have run out of ideas and questions to post <link> so thought I'd ask about other ways I could copy other than over a 100Mbps network?

 

Just upgrade to a Gb network 

 

If you're copying over a Gb network, it's just as fast as a locally attached drive (assuming your array is fault tolerant).

 

You don't need to change your router ... an inexpensive Gb switch is all you need => just plug it into your router and then plug the server and your client with the data you need to copy both into the switch.

Thats a thought, I was hoping to get the software side just working instead of purchasing a hardware work around however I was actually thinking about getting an openwrt gigabit router that I can mod with various goodies so something along that line is a thought. Still, it seems like I am so close yet so far, I just want to be able to connect a few drives and copy the stuff over, unraid sees the drives, as far as i can tell there isn't anything wrong with them, its a proverbial pebble in my shoe (switch or not).

Simple fact is you'll definitely want to upgrade to Gb ... so doing it now would let you eliminate the speed bottleneck for writing data to the array.

 

And as I noted, you don't need to bother with a new router (unless you just want to) ... a simple (and inexpensive) Gb switch is all  you need.

 

Have you tried Unmenu yet?  I had the same problem with SNAP.  SNAP will only mount the first partition and you need to mount the second.  Pretty sure there is a way to do this with Unmenu.  In fact I'm almost certain.

 

Yeah, just tried it out, pretty nice (unMENU that is). Unfortunately, assuming I am using it right, it doesn't seem to be able to mount drives either. It tried the following cmd, a bit different than what i tried:

mount -r -o umask=111,dmask=000 -t ntfs-3g /dev/sdf1 /mnt/disk/sdf1 2>&1

 

And this is on another drive that I checked before trying, and this drive has one large NTFS partition, no other partitions on it so i could rule out the second partition issue, SNAP wasn't cooperating either but I posted about that in a SNAP specific post. As with SNAP I'm about out of ideas again (not that I had many to begin with, still climbing the learning curve  )

 

Sorry mate, but I've just had a play with unmenu and that's exactly how I mounted mine, so I've got no more ideas unfortunately.  Although I would echo gary's sentiment that in general file copies aside, an upgrade to gb networking would be a good idea.