So I have a mirrored ZFS pool for my cache drive of two 1TB drives.  I just upgraded processor and motherboard and wanted to go ahead and change my cache drives out for gen.4 nvme drives.  My thought process was to just replace one at a time.  But after removing one cache drive and trying to add a WD_BLACK SN770 1TB to the cache pool I get an error saying that the new drive is not the same size.  It is a 1TB just like the two I have in now.

 

What is the problem?  Is it because the new drive is gen4 or am I missing something?

 

I have 4 NVME slots on my motherboard, Maybe now is a good time to split my appdata and cache drives up.  Just curious what that process would look like now that I am using ZFS on my cache pool only?

Stop Docker and VMs

Move appdata and VMs to array

Create new Zpool with two new nvmes (appstorage pool)

Move appdata to new Zpool

 

What happens to my current snapshots if anything?  I dont need them and can delete them if needed.  Is there any issue with the array being in XFS?

 

I also have the backup plug in so I could restore from that as well.  Just not 100% on that since it will be in a different location. What steps do I need to do to move the data?  All my dockers are mapped to /mnt/user/appdata so in theory I should only have to change primary storage on the appdata/VM shares to the new ZPool(appstorage) not worry about mapping docker containers again. 

 

So I guess I am asking two questions here.  Why cant I replace a 1TB nvme with another 1TB NVME and what is the correct or best practice way to move appdata to a new zpool. 

 

 

Edited May 2, 20242 yr by DeepSee

Please post the diagnostics.

skynet-diagnostics-20240502-1207.zip

And it Says "wrong pool state cache replacement device too small"  But it is another 1TB NVME I have tried reformatting it with no luck.

Toshiba NMVe is 1024GB:

 

Total NVM Capacity:                 1,024,209,543,168 [1.02 TB]

 

6.12 only checks the largest device, 6.13 should allow you to replace it.

@JorgeB Just to make sure I understand, that old toshiba I threw in there for a replacement is slightly bigger, but on what is hopefully the next update (6.13) I should be able to replace it.  I appreciate you looking into this, guess Ill wait to change out my NVME for a bit.  

 

Dont suppose you could give an update on when 6.13 will be arriving.......

 

Thanks again.

 

Yes, it should be replaceable with v6.13, first public beta/rc is expected very soon, maybe in a week or two if all goes well, but it's not official.

@JorgeB I know its been awhile but can you confirm that the issue above has been addressed either in 6.13 or 7.0.0?  

It should work with v7.0