Need NTFS file transfer help! [SOLVED]

[Skrumpy]

Background: I want to transfer files from 3tb NTFS drive (fdisk -l|grep NTFS reports /dev/sde1 as HPFS/NTFS/exFAT) in my NAS to my NAS array drives. As you can see, the drive shows up in unRAID

 

Originally I tried copying the data via shares over Win8 network (as you can see sdc has 28% used), but it would stop after a couple of hours and give me weird permission errors and refuse to copy any more data. So I looked for other measures. I tried using SNAP but after 2 hours of trying to get it to work, found out that it is not supported on V6.0 b5a (which I am using because I have a newer Mobo and the latest stable release wouldn't recognize my onboard intel NIC).

 

So then I deleted SNAP and its version of ntfs-3g and installed and ran the latest version of ntfs-3g (ntfs-3g-2012.1.15-i486-2.txz). Then I tried using the following commands to mount the drive (after downloading and installing ntfs-3g and creating the mnt/old_data directory):

 

mount -r -t ntfs-3g /dev/sde1 /mnt/old_data -o umask=111,dmask=000 -v 

(Also tried sde for good measure with same result)

 

No errors were reported (just brought me back to the prompt) but it just refuses to mount the drive.. nothing would show up in /mnt/old_data/ (checked using ls and mc) and the mount status never changed in unRAID. I've tried restarting my NAS and all that just to see if it would help, but to no avail.

 

I've seen every wiki article out there regarding NTFS file transfer in unRAID and can't figure out what I am missing. Obviously I'm new to this but after extensive searches to try to figure this out on my own I am at a loss as to what to try next. I must be missing something simple. I just want to copy my data over so that I can format that drive and add it to the array. Any advice is appreciated!

[Skrumpy]

Hmm I'm wondering if it won't let me mount the drive because I'm currently using unRAID basic? Not trying to add it to the array but perhaps it's still restricting me from mounting it? Probably a long shot but I'm going to upgrade to Plus (was going to anyways) to see if that resolves it.. could still use some guidance from any of the professional lurkers out there!

 

Edit: Well it apparently takes 24-48 hours to get my key so going to have to hope that is the issue (would love to get verification from someone that this would clear up my problem). I don't even see the option to mount it in Disk Management.

 

[Skrumpy]

Really no responses yet eh?  Figured this would be something easy.. hehe

 

Well I got my Plus license and have that installed and I was able to get a bit further, so it does look like you can't mount a 3rd non-parity non-array drive in basic. Either way now I get some error messages when I try to mount.

 

Command I'm using:

mount -t ntfs-3g /dev/sde1 /mnt/old_data -o umask=111,dmask=000 -v

(also tried sde, and got the same result)

 

I even tried using a different version of ntfs-3g (ntfs-3g-2013.1.13-x86_64-1.txz)

 

Output:

Failed to mount '/dev/sde1': Invalid argument

The device '/dev/sde1' doesn't seem to have a valid NTFS.

Maybe the wrong device is used? Or the whole disk instead of a

partition (e.g. /dev/sda, not /dev/sda1)? Or the other way around?

 

Read another forum that said to use:

gdisk -l /dev/sde

 

Output: (from sde)

GPT fdisk (gdisk) version 0.8.7

 

Partition table scan:

  MBR: MBR only

  BSD: not present

  APM: not present

  GPT: not present

 

 

***************************************************************

Found invalid GPT and valid MBR; converting MBR to GPT format

in memory.

***************************************************************

 

Disk /dev/sde: 5860533168 sectors, 2.7 TiB

Logical sector size: 512 bytes

Disk identifier (GUID): 35B78C6B-7535-4B12-9DE5-5BEC62A60160

Partition table holds up to 128 entries

First usable sector is 34, last usable sector is 5860533134

Partitions will be aligned on 8-sector boundaries

Total free space is 5127969101 sectors (2.4 TiB)

 

Number  Start (sector)    End (sector)  Size      Code  Name

  1              63      732564062  349.3 GiB  0700  Microsoft basic data

 

 

Output: (from sde1)

GPT fdisk (gdisk) version 0.8.7

 

Partition table scan:

  MBR: not present

  BSD: not present

  APM: not present

  GPT: not present

 

Creating new GPT entries.

Disk /dev/sde1: 732564000 sectors, 349.3 GiB

Logical sector size: 512 bytes

Disk identifier (GUID): 6410F5B0-8D4E-4DDB-967B-6D0F16514216

Partition table holds up to 128 entries

First usable sector is 34, last usable sector is 732563966

Partitions will be aligned on 2048-sector boundaries

Total free space is 732563933 sectors (349.3 GiB)

 

Number  Start (sector)    End (sector)  Size      Code  Name

 

This was a Seagate Freeagent Goflex 3tb drive (was in a usb casing) that I removed from the casing and put in my NAS. Still not sure what I should do next.. any takers? Who knew copying files could be so difficult? 

 

[Skrumpy]

Anyone? Anything? Guesses? Hints? Conjecture? Willing to try some voodoo magic at this point.. will bust out the virgin blood and prayer beads.. this 1 thing is holding up my entire project atm, just staring at a worthless box and I'm about to just say f**k it and go with something else at this point.

[Skrumpy]

Am i making any sense? or should I give up? I wouldn't mind a single response, even if it was someone telling me to GTFO =p.

[dgaschk]

http://lime-technology.com/wiki/index.php/Copy_files_from_a_NTFS_drive

[Skrumpy]

Yep, saw that one.. tried all that.. thanks for responding though at least.. now I know at least 1 person has at least opened up this thread 

[Freddie]

Looks like that goflex USB enclosure translated the sector size. See here for details:

http://forums.justlinux.com/showthread.php?153881-3TB-hard-disk-used-as-external-USB-connection-or-internal-Sata-connection

 

Try connecting the drive through the original enclosure through USB to unraid.

 

Use ntfs-3g-2013.1.13-x86_64-1.txz to mount it. It is 64 bit like unraid 6. The i486 version is 32 bit and not compatible with unraid 6.

[megalodon]

Skrumpy how did you get on with this, I have 14 x 3TB NTFS drives that I was going to transfer data to unRAID over the network but if you can get this working I will give it a go. Anything to get away from windows. Although I will be running 5.05 stable and mine are WD 3TB reds so I shouldn't have an issue with sectors like your drives.

[Skrumpy]

Looks like that goflex USB enclosure translated the sector size. See here for details:

http://forums.justlinux.com/showthread.php?153881-3TB-hard-disk-used-as-external-USB-connection-or-internal-Sata-connection

 

Try connecting the drive through the original enclosure through USB to unraid.

 

Use ntfs-3g-2013.1.13-x86_64-1.txz to mount it. It is 64 bit like unraid 6. The i486 version is 32 bit and not compatible with unraid 6.

 

Hey thanks so much Freddie, this link looks like it may help.. there are some commands he included that I am going to run (as soon as I figure out how to install gnu parted). Don't suppose anyone knows how to do that? I figured it would be a part of UNRAID already but I get an error that parted command is not found. Also I did end up switching to the newer version of ntfs-3g later on, I was just trying multiple ones to make sure it wasn't a version issue.

 

 

Skrumpy how did you get on with this, I have 14 x 3TB NTFS drives that I was going to transfer data to unRAID over the network but if you can get this working I will give it a go. Anything to get away from windows. Although I will be running 5.05 stable and mine are WD 3TB reds so I shouldn't have an issue with sectors like your drives.

 

Well originally I started to transfer 3tb of files over the network but it only got about 28% of the way there before it would just quit out. After doing a little research I found that while it is possible, transfering over the network like that is not ideal because it apparently has to transfer the data twice? I'm not into the specifics of it but from what I read somewhere (don't have the forum post handy) it transfers it to the NAS then has to transfer it back to windows (to maybe verify the transfer? not really sure). Either way people were saying it would take a lot longer that way. Also file/folder names can be an issue when transferring that way as well. Honestly, I think your standard NTFS drive would be fine.. the problem with this one of mine, however, is that it came from a USB enclosure where the manufacturer had a secondary card in there to translate their funky settings into something readable by the PC. It looks like it may be fixable with gnu parted, but I think I will just try piecing together the old enclosure and drive into some sort of Frankenstein setup until I can get the data over. I'll report back on if that resolves the issue.

[Skrumpy]

So I have it hooked up as a regular USB drive now using the old enclosure and was able to get it mounted. Shame I have to go through the USB port, but there doesn't look like another reasonable option given that I tried using those parted commands and it said I would lose all data on the drive. Moral of the story: if you have a Seagate Goflex Freeagent drive, don't just think you can take the drive out and put it in as a regular drive. The drive only uses the standard 512 bytes per sector but the USB housing has a special SATA controller which reports 4096 bytes per sector. If you throw the disk into your NAS it will show up fine, you just will never be able to mount it. Of course once you get all the data off of it and repartition/format it you can THEN use it as a regular drive in your NAS.

[megalodon]

So I have it hooked up as a regular USB drive now using the old enclosure and was able to get it mounted. Shame I have to go through the USB port, but there doesn't look like another reasonable option given that I tried using those parted commands and it said I would lose all data on the drive. Moral of the story: if you have a Seagate Goflex Freeagent drive, don't just think you can take the drive out and put it in as a regular drive. The drive only uses the standard 512 bytes per sector but the USB housing has a special SATA controller which reports 4096 bytes per sector. If you throw the disk into your NAS it will show up fine, you just will never be able to mount it. Of course once you get all the data off of it and repartition/format it you can THEN use it as a regular drive in your NAS.

 

Its really lucky you kept the old drive case. Yes I read somewhere about the slow network transfers so I will give it a go in the server as you did at first and see how that goes before I use the usb dock. Thanks

[Skrumpy]

Well, after getting everything mounted and after trying twice now to get everything transferred.. my NAS keeps encountering faults and freezing and or exhibiting odd behavior. I just tried copying files from that other HDD and got a "Fixing recursive fault but reboot needed" error. Not sure what is causing it as all my hardware is new and has been tested (memtest, etc). Possibly, Beta 6.0a5 that's causing it.

[itimpi]

Its really lucky you kept the old drive case. Yes I read somewhere about the slow network transfers so I will give it a go in the server as you did at first and see how that goes before I use the usb dock. Thanks

I have had no trouble copying data off NTFS format drives as long as the ntfs-3g package is loaded so that NTFS format drives larger than 2TB can be handled.  If the drive is less than 2TB you do not need to load the ntfs-3g package (although I now do it as a matter of course).  I have used both drives plugged in via USB with generic SATA/USB adapters, and directly into SATA ports.

[megalodon]

Its really lucky you kept the old drive case. Yes I read somewhere about the slow network transfers so I will give it a go in the server as you did at first and see how that goes before I use the usb dock. Thanks

I have had no trouble copying data off NTFS format drives as long as the ntfs-3g package is loaded so that NTFS format drives larger than 2TB can be handled.  If the drive is less than 2TB you do not need to load the ntfs-3g package (although I now do it as a matter of course).  I have used both drives plugged in via USB with generic SATA/USB adapters, and directly into SATA ports.

 

Thank you that is good to hear.