Unraid OS version 6.12.0-rc1 available

Found the offending plugin. It is the GPU statistics plugin. I have removed it.  Corrected the display issue.  Reinstalled problem was back.  So temporarily I have decided to remove it.

 

4 minutes ago, ximian said:

Found the offending plugin. It is the GPU statistics plugin. I have removed it.  Corrected the display issue.  Reinstalled problem was back.  So temporarily I have decided to remove it.

 

There is my 6.12 version, it is awaiting merge of the PR by the owner. But I have as test load if you want to use until the offical release.:

 

https://raw.githubusercontent.com/SimonFair/gpustat-unraid/master/gpustat.plg

11 minutes ago, SimonF said:

it is awaiting merge of the PR by the owner

Thanks.  I had thought that this had already been handled.  Since the current release crashes the dashboard now, it is also being marked as incompatible.

 

Once the PR is merged and released and  I'm notified of this then the incompatibility will be lifted.

What are the resource requirements for UnRaid ZFS?   Is it unrealistic to expect my old Intel Core 2 Duo, 4GB ram to run a ZFS pool?

 

I am assuming a current XFS/BTRFs array/pool cannot be converted to a ZFS pool without data loss?  Current drives have to be reformatted and wiped and data reloaded, right?

Edited March 18, 2023 by hendrst1

7 hours ago, hendrst1 said:

I am assuming a current XFS/BTRFs array/pool cannot be converted to a ZFS pool without data loss?  Current drives have to be reformatted and wiped and data reloaded, right?

Yes, need to clear up the disks to be reformatted to switch filesystem. I'll be moving data off pools to array, disabling pools and then reconstruct them. For array drives, best bet to move data off disk one by one and replace, or rebuild whole array and copy data back from backup. Not fun like any major storage change

Right, I think I already knew the answer to that question.  Sorry, I shouldn't have asked it.  I am more interested in the resource requirements but I suspect I know the answer to that one as well - more resources than my old pc has.   I guess I will not be moving to ZFS until/unless I get a new machine.   

 

For a few years I ran Open ZFS on Mac OS and came to know it quite well.  It was quite the cat's meow but had issues with Mac OS.  However,  think it will run quite well under Unraid.  I look forward to trying it out one day.

4GB is already minimum requirement for unraid in general, so yeah not going to be great if you add zfs unless you do nothing but storage.

Is the button to collapse categories (like the list of threads under the CPU etc) entirely gone for everyone else or just me?

All I see is the settings cog and the "X" to remove.

This is on the dashboard and all other pages. Perhaps it is a plugin but I have already removed anything that was incompatible.

Edited March 20, 2023 by LordShad0w

Collapsing is gone, and now you remove items instead to set it up how you like

On 3/17/2023 at 9:10 AM, JorgeB said:

Note that for now you can only offline one device at a time even if the pool has more redundancy, like a raidz2 pool or stripped mirrors.

Just to be clear (cos I'm just about to try it), can I only take one HDD offline at a time? I'm trying to copy data onto a fresh ZFS array and it's taken 12 hours to copy 200Gb, so ~4Mb/s. Copying directly from another NAS that I normally get 100Mb/s read speed from and both servers are LAG bonded. Thinking of trying to disable the 2 x parity drives but that won't work if I can only take down one.

6 minutes ago, infidel said:

Just to be clear (cos I'm just about to try it), can I only take one HDD offline at a time? I'm trying to copy data onto a fresh ZFS array and it's taken 12 hours to copy 200Gb, so ~4Mb/s. Copying directly from another NAS that I normally get 100Mb/s read speed from and both servers are LAG bonded. Thinking of trying to disable the 2 x parity drives but that won't work if I can only take down one.

That is for a pool, for zfs drives on the array you can have has many disabled data drives as there are parity drives, and of course you can also disable parity (one or both), also note that I've found some write performance issues with zfs when used as array data drives, it can vary with the disks used and other things, still needs more investigating.

34 minutes ago, JorgeB said:

That is for a pool, for zfs drives on the array you can have has many disabled data drives as there are parity drives, and of course you can also disable parity (one or both), also note that I've found some write performance issues with zfs when used as array data drives, it can vary with the disks used and other things, still needs more investigating.

Ah, I thought I HAD created a pool, seeing as "Add pool" apparently creates a cache and not a pool (at least, I don't see any raidz2 options there). Sorry, I've only been using Unraid a couple of days as a potential move from TrueNAS Scale. Native ZFS support is light on documentation being so new, so can you create ZFS pools from the UI or is this CLI only for now?

Edited March 21, 2023 by infidel

17 minutes ago, infidel said:

seeing as "Add pool" apparently creates a cache and not a pool

Add pool creates a pool, but because you were talking about disabling the parity drives I assumed array.

 

17 minutes ago, infidel said:

at least, I don't see any raidz2 options there

After assigning the pool devices and before starting the array click on the first one and change the appropriate filesystem options:

 

 

 

 

 

 

22 minutes ago, JorgeB said:

Add pool creates a pool, but because you were talking about disabling the parity drives I assumed array.

Yeah, I had an array but wanted a pool

 

Quote

After assigning the pool devices and before starting the array click on the first one and change the appropriate filesystem options

OK, did that. I unassigned all 8 drives from the array, created an 8-slot pool, changed the file type of the first one to raidz2, 1 group of 8 devices. I don't see anything on that page to init the pool. The Main page now shows 8 missing array drives (can't select any fewer than 8 slots), and 8 pools (only the first of which is zfs). If I unassign a drive from the extra pools, the first pool shrinks. The array is stopped with "Invalid configuration" and "Too many wrong and/or missing disks!". No messages about what I can do to fix that. Falls short of intuitive so far! If you're still willing to help, we can move this to Discord if it's easier.

3 minutes ago, infidel said:

The Main page now shows 8 missing array drives

You have to do a new config to clear the array (Tools -> New config), also note that for now Unraid still requires at least one data device assigned to the array, this can be a spare flash drive for example.

Plex Streams has now been updated and will no longer break Unraid 6.12

1 hour ago, JorgeB said:

You have to do a new config

OK, that's got me a bit further! The pool is now up and running. After a bit of playing, creating datasets from the Share page seems to fail silently*, but it works if I use zfs create, at which point I can manage it from Shares. Transfer speed is back up to what I'd expect. Thanks for your help!

 

*running RC2 now

Edited March 21, 2023 by infidel

1 minute ago, infidel said:

creating datasets from the Share page seems to fail silently

Any new share created with cache=yes or cache=only on that pool should create a new dataset, if it's not please create a bug report and don't forget to post the diagnostics.

Awesome! Thank you for the update, can't wait to start using this. Looks like I may need to upgrade my server now.

Is it now possible to use zfs for an array drive? Can I have multiple filesystems mixed up within one array? Lets say... two disks with xfs and three disks with zfs?

 

Is there any benefit for using zfs for an array drive instead of xfs?

 

Thanks!

24 minutes ago, enJOyIT said:

Thanks!

 

These two posts should answer your questions:

https://forums.unraid.net/topic/131857-soon™️-612-series/?do=findComment&comment=1243087

https://forums.unraid.net/topic/131857-soon™️-612-series/?do=findComment&comment=1243024

 

23 minutes ago, enJOyIT said:

Is it now possible to use zfs for an array drive?

Yes if you are running Unraid 6.12 rc2

24 minutes ago, enJOyIT said:

Can I have multiple filesystems mixed up within one array? Lets say... two disks with xfs and three disks with zfs?

Yes.  Each disk is a self-contained file system and can be any of the types supported by Unraid.

24 minutes ago, enJOyIT said:

Is there any benefit for using zfs for an array drive instead of xfs?

I would think that the main benefit is data corruption being detected in real time.   You get similar detection if using btrfs

Just now, itimpi said:

Yes if you are running Unraid 6.12 rc2

Yes.  Each disk is a self-contained file system and can be any of the types supported by Unraid.

I would think that the main benefit is data corruption being detected in real time.   You get similar detection if using btrfs

 

Thanks for replying!

 

To migrate every of my single disks to zfs I have to copy via cli from diskXX (xfs) to diskXX (zfs), right? Would the parity recognize these copy actions?

35 minutes ago, enJOyIT said:

 

Thanks for replying!

 

To migrate every of my single disks to zfs I have to copy via cli from diskXX (xfs) to diskXX (zfs), right? Would the parity recognize these copy actions?

 

Yes, if you do it properly.  The proper procedure has been documented and can be found here:

 

https://wiki.unraid.net/index.php/File_System_Conversion#Mirror_each_disk_with_rsync.2C_preserving_parity

 

You want to use the "Mirror each disk with rsync, preserving parity" method.   I did both of my servers a few years back.  Read the entire procedure first so you know exactly what you will be doing.  (I made a table that had step-by-step instructions with the actual disk identification numbers for each step.  I checked off each step as it was completed. {Some steps take many hours to complete...}  Be prepared as it will take two-to-three hours per TB of data!)

Ok, maybe I'll do it like this...

Add a new drive

format it to zfs

copy from xfs-drive to this new drive via mc (/mnt/driveXX to /mnt/driveXY)

 

and so on... until the last drive is switched to zfs.

 

then rebuild the parity (two drive parity)

 

I think this would be faster?