Hey guys!  My NMVE is the cache drive and I am moving a lot of data onto the unraid tonight. The nvme is 500GB and right now it is at 90% full. Shouldn't it start to move data to the array?  I'm worried something isn't setup right and its going to corrupt or something.  Does the cache have to get completely full before it starts moving data to the array?  I just want to make sure this is normal behavior....it has me second guessing if I set something up wrong

 

The files are being saved to a share /download  and it is set to "yes" for using cache drive, but shouldnt it automatically start offloading onto the hdd array?

 

*nervous*

Edited September 8, 20205 yr by SPOautos

By default the Mover is schedule to run once a day during the off hours (around 3am).

 

"Yes" is the correct set up to move the files to the array.

 

If you are frequently loading more than your cache size per day you can change the frequency of the mover in the scheduler.

4 hours ago, ChatNoir said:

By default the Mover is schedule to run once a day during the off hours (around 3am).

 

"Yes" is the correct set up to move the files to the array.

 

If you are frequently loading more than your cache size per day you can change the frequency of the mover in the scheduler.

 

Thanks, I changed it to hourly since I still have a long way to go in data transfer.

 

Something else, it seems like its loading all my data up on disk 1 instead of spreading it out between disk 1 and 2 (my array has 2 data disks and 1 parity disk). I don't particularly care but I am under the impression its supposed to spread the data out somewhat evenly on the data disks. I am loading data into Unraid for the first time and Disk 1 has 1,089,474 writes at 533GB and disk 2 has 100 writes at 42.5GB.  I'm fairly certain that Disk 2 only has system stuff stored on it and all the data moving across is only going to Disk 1.  Is this nornal???

 

Is there a way I can look at what data is on disk 1 and disk 2?  I don't see disk 1 and 2 listed in Krusader but maybe I'm just not looking in the right place.

Edited September 8, 20205 yr by SPOautos

8 minutes ago, SPOautos said:

I still have a long way to go in data transfer.

Until you are done with that, I'd set the share cache: no and enable "turbo write"

5 minutes ago, jonathanm said:

Until you are done with that, I'd set the share cache: no and enable "turbo write"

 

I'm in the middle of moving 900GB file and my cache is 400GB available for cache.....if I pause the transfer and turn off cache will it mess up my data? Do I need pause the transfer, do a "mover" to get data from cache to disk, then turn off cache, then start transfer back up? I'm not sure how to say what I'm thinking.....will the data pick back up correctly?  It 'seems' (to a highly uneducated person) that changing the disk I'm writing to in the middle of a file transfer might corrupt the file......but Unraid may handle that beautifully, I dont know. I know very little about computers.

As said by jonathanm, It is advised not to use a cache drive during the initial data transfer, exactly to prevent the issue you have.

 

I don't know how it will behave if you pause, make some changes and restart. But as you said, the file being pause would probably be an issue.

Are you moving or copying the data from your original location ?

 

Regarding the file allocation, it seems normal to me. It is specified in the share settings. The Default is High Water : the first disk is filed to half it's size then it can go to another disk depending of the size of each drive.

 

You can see what is in each drive on the Main tab.

Click on the small folder with the magnifing glass. You will not be able to see the files, but you will be able to see the directories.

4 minutes ago, ChatNoir said:

As said by jonathanm, It is advised not to use a cache drive during the initial data transfer, exactly to prevent the issue you have.

 

I don't know how it will behave if you pause, make some changes and restart. But as you said, the file being pause would probably be an issue.

Are you moving or copying the data from your original location ?

 

Regarding the file allocation, it seems normal to me. It is specified in the share settings. The Default is High Water : the first disk is filed to half it's size then it can go to another disk depending of the size of each drive.

 

You can see what is in each drive on the Main tab.

Click on the small folder with the magnifing glass. You will not be able to see the files, but you will be able to see the directories.

 

High Water explains it....didnt know what that was.

 

I'll try to figure out a good place to pause the transfer and see what I can figure out....hopefully it wont ruin the data. I was under the impression it moved data off cache once a day but also as the cache got filled to a certain point that it started off loading to make room for more.

5 minutes ago, SPOautos said:

High Water explains it....didnt know what that was.

Most (maybe all ?) menu line have a built-in explaination.

 

You can either:

1. click on each line to see the details
2. temporarly activate the Help on the top right corner

 

42 minutes ago, SPOautos said:

 

I'm in the middle of moving 900GB file and my cache is 400GB available

Is that statement accurate? Unraid cannot split files across disks, so a 900GB file should be writing directly to one of the data disks anyway.

 

Be sure to set the minimum free for the share and the global cache to sane values.

54 minutes ago, jonathanm said:

Is that statement accurate? Unraid cannot split files across disks, so a 900GB file should be writing directly to one of the data disks anyway.

 

Be sure to set the minimum free for the share and the global cache to sane values.

 

I have the transfer paused.....went to the settings of the specific share I'm transferring too and just change "use cache" to "no"......ran the mover, and crossed my fingers  lol

 

Seems to be working. I restarted the transfer and it started working right away and seems to be okay!

 

Thanks!!!

Edited September 8, 20205 yr by SPOautos

42 minutes ago, SPOautos said:

change "use cache" to "no"......ran the mover

That setting applies to new files written, not existing files, so when you are done transferring, set the cache back to yes and run the mover. It won't hurt anything to leave things as they are until you are done with the transfer though.

 

Did you search and figure out "turbo write"?