[Solved] Migrate 4 single drives fron QNAP NAS to Unraid


Recommended Posts

Hi,

I have 4 drives in QNAP NAS that are configured as single disks (no raid) in the following sizes - 12TB. 10TB, 8TB, 6TB.

The total space used is 23TB.

 

What is the best way to move the drives and all their data to a new unraid build?

I purchased another 14TB to be used as a parity, and 500GB SSD for cache.

Link to comment
  • ds123 changed the title to Migrate 4 single drives fron QNAP NAS to Unraid
Posted (edited)

Here is my plan -

1. Create an array without a parity and add the new 14 TB as a data drive.

2. Copy the files from an existing drive, let's say HDD1, to the 14 TB drive.

3. Add the HDD1 to the array and format as a data drive.

4. Copy the HDD1's data from the 14 TB back to HDD1.

5. Repeat the process with the other drives.

6. Eventully, after assigning all the drives and transferring all the data to them, set the 14 TB as a parity + add the SSD as a cache.

 

How does that sound? Would it work without damaging the drives or files? Is there a better approach?

Please advice :)

 

Thanks

 

Edited by ds123
Link to comment
47 minutes ago, ds123 said:

Here is my plan -

1. Create an array without a parity and add the new 14 TB as a data drive.

2. Copy the files from an existing drive, let's say HDD1, to the 14 TB drive.

3. Add the HDD1 to the array and format as a data drive.

4. Copy the HDD1's data from the 14 TB back to HDD1.

5. Repeat the process with the other drives.

6. Eventully, after assigning all the drives and transferring all the data to them, set the 14 TB as a parity + add the SSD as a cache.

 

How does that sound? Would it work without damaging the drives or files? Is there a better approach?

Please advice :)

 

Thanks

 


in principle that plan should work.    One step you have omitted is a step 5a where you use Tools->New Config to reset the array to an uninitialised state so you can now assign the 14TB as parity and the data drives as you want them.   When you start the array the data drives will be left with their contents intact and unRaid will start building parity on the 14TB drive.   Just make sure that you have cleared all data off the 14TB drive as building parity will completely over-write its contents.

Link to comment

It seems like you're having to copy every file twice - to the 14 TB drive and back again - which can certainly work but will take a long time, though I don't see an alternative that doesn't involve buying another disk. Are you planning to use rsync or similar to make the copying process as painless as possible?

 

Link to comment
23 hours ago, itimpi said:


in principle that plan should work.    One step you have omitted is a step 5a where you use Tools->New Config to reset the array to an uninitialised state so you can now assign the 14TB as parity and the data drives as you want them.   When you start the array the data drives will be left with their contents intact and unRaid will start building parity on the 14TB drive.   Just make sure that you have cleared all data off the 14TB drive as building parity will completely over-write its contents.

Thanks for the clarification, I'm new to Unraid 😊

Link to comment
19 hours ago, John_M said:

It seems like you're having to copy every file twice - to the 14 TB drive and back again - which can certainly work but will take a long time, though I don't see an alternative that doesn't involve buying another disk. Are you planning to use rsync or similar to make the copying process as painless as possible?

 

Since I'm not using Raid in QNAP, I can simply install the drives as unassigned and copy them directly. QNAP uses linux file system so it should be possible.

Link to comment
Posted (edited)

What would be best the way to copy the files?

Eventually I want a media share with all the files. So I will create a Media share, and exclude the 14 TB (because it will be formatted as parity once the transfer is complete).

When I copy the data to the 14 TB drive (labeled as disk1), of course it will be copied directly to mnt/disk1. But after each transfer from existing disk to the 14 TB disk, I will copy the files from mnt/disk1 to mnt/Media (which is a user share).

Is that okay?

Edited by ds123
Link to comment
1 minute ago, ds123 said:

Is that okay?

No.

If you want the files to end up in a user share named Media, just copy them to /mnt/disk1/Media/

All folders in the root of the disks ARE user shares already. Creating folders directly on the disk automatically creates a user share with that name.

 

5 minutes ago, ds123 said:

because it will be formatted as parity

parity doesn't have a filesystem or a format.

Link to comment

Since  the total space on your current QNAP NAS is 36TB and you say there is only 23TB of data on them you might be able to minimise the amount of copying involved by looking at the free space on each drive and working out if you can get the drives into unRaid in an order that means only some of the data needs to go via the 14TB drive. 

Link to comment
Posted (edited)
12 minutes ago, jonathanm said:

No.

If you want the files to end up in a user share named Media, just copy them to /mnt/disk1/Media/

All folders in the root of the disks ARE user shares already. Creating folders directly on the disk automatically creates a user share with that name.

 

parity doesn't have a filesystem or a format.

 

But disk1 eventually will be assigned as partity, and building parity will completely over-write its content. 

So I can't create this share on disk1.

Disk 1 (which is the 14 TB) is currently used just to transfer the files from existing QNAP disk, and then back to the same disk once added and formatted as data disk.

After migrating all the disks, it will be assigned as parity.

Edited by ds123
Link to comment
9 minutes ago, itimpi said:

Since  the total space on your current QNAP NAS is 36TB and you say there is only 23TB of data on them you might be able to minimise the amount of copying involved by looking at the free space on each drive and working out if you can get the drives into unRaid in an order that means only some of the data needs to go via the 14TB drive. 

If I move the two larger disks first, I will have enough space for one disk without the data need to go via the 14 TB.

But the fourth drive will need to go via the 14 TB.

Link to comment
5 minutes ago, ds123 said:

 

But disk1 eventually will be assigned as partity, and building parity will completely over-write its content. 

So I can't create this share on disk1.

Disk 1 (which is the 14 TB) is currently used just to transfer the files from existing QNAP disk, and then to the existing QNAP disk once it added and formatted as data disk.

After migrating all the disks, it will be assigned as parity.


Why bother to even assign the 14TB drive to the unRaid array?   You could simply use it as an Unassigned Device (mounted using the UD plugin) as it is only a temporary home for files. 

Link to comment
2 minutes ago, itimpi said:


Why bother to even assign the 14TB drive to the unRaid array?   You could simply use it as an Unassigned Device (mounted using the UD plugin) as it is only a temporary home for files. 

 

Good question, I already assigned the 14TB drive. So I guess I need to proceed this way.

Anyway, the question is how to create the share that eventually will contains all data from the disks.

Link to comment
18 minutes ago, ds123 said:

Anyway, the question is how to create the share that eventually will contains all data from the disks.

As was mentioned if you simply create a top level folder on one of the array drives you intend to keep in the array that will automatically be treated as a User Share with the same name as the folder.

Link to comment
Posted (edited)
7 minutes ago, itimpi said:

As was mentioned if you simply create a top level folder on one of the array drives you intend to keep in the array that will automatically be treated as a User Share with the same name as the folder.

 

Cool. I can also create this share via the web gui, right?

And once I finish to copy all the content to this share, and reset the array (to assign the parity disk), would the share remain intact? 

Sorry for the questions, this is my first experience with unraid

Edited by ds123
Link to comment
1 minute ago, ds123 said:

 

Cool. I can also create this share via the web gui, right?

And once I finish to copy all the content to this share, and reset the array (to assign the parity disk), would it be okay? 

Sorry for the questions, this is my first experience with unraid


you can create the share either via the GUI (which will then create the folder to hold share data) or manually by copying explicitly to a disk using the folder name which you want the share to have.

 

when you later rest the array to use the 14TB drive as parity any data on the remaining array data drives will be left intact.

Link to comment
Posted (edited)
11 minutes ago, itimpi said:


you can create the share either via the GUI (which will then create the folder to hold share data) or manually by copying explicitly to a disk using the folder name which you want the share to have.

 

when you later rest the array to use the 14TB drive as parity any data on the remaining array data drives will be left intact.

 

Thanks.

One last question before starting the process - I see there is no file manager in unraid (I know that I can install).

What is best option to copy the data?

As I wrote before, I will mount the QNAP disks as unassigned drives, to copy the files directly and not over the LAN.

It should be as fast as possioble, and I need also a way to see the progress, via the GUI if possible.

Edited by ds123
Link to comment

Common ways are:

  • from the command line using Midnight Commander (‘mc’ command) or some other tool such as rsync.   This is probably the fastest.
  • from a docker container such as Krusader.  Gives good graphical interface.
  • over the network from your favorite Client OS.
Link to comment
  • ChatNoir changed the title to [Solved] Migrate 4 single drives fron QNAP NAS to Unraid

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.