You can check SpaceInvader One video and check if it is a good fit for your use case: 

 

16 hours ago, Iker said:

You can check SpaceInvader One video and check if it is a good fit for your use case: 

 

 

Thanks for the feedback.  This is good if your root directories are datasets but doesn't work if they're folders. 

 

I took the long route of having mover move everything off the array to the cache and then having it move everything back which created all root folders on cache as datasets.  That said, I just found that if I use the plugin to create a dataset, I can then move all sub-folders/files into that dataset, delete the original folder, and rename the dataset.  If I'm correct that it works in this way, this would have saved me several hours ... hopefully this helps somebody else down the road ...

1 hour ago, bugsysiegals said:

That said, I just found that if I use the plugin to create a dataset, I can then move all sub-folders/files into that dataset, delete the original folder, and rename the dataset.

 

Essentially what the Si1 userscript in the video does. Albeit automated with some additional safety checks.

@Iker Thanks for Update, the plugin is still cant be auto updated by CA Auto update plugin? 

 

 

 

Maybe it can be fixed in future ?

On 11/30/2023 at 11:00 AM, positronicP said:

 

Essentially what the Si1 userscript in the video does. Albeit automated with some additional safety checks.

 

Do you know if the script will convert a root folder into a dataset if it's not already or will it only convert sub-folders into datasets if the root folder is already a dataset?

40 minutes ago, bugsysiegals said:

 

Do you know if the script will convert a root folder into a dataset if it's not already or will it only convert sub-folders into datasets if the root folder is already a dataset?

 Appdata and domains are usually root folders and it converts them by default.

Many Thanks for the Update!

 

What's the Changelog? He was not showing.

Edited December 3, 20232 yr by Revan335

On 12/2/2023 at 12:13 AM, Masterwishx said:

@Iker Thanks for Update, the plugin is still cant be auto updated by CA Auto update plugin? 

 

 

 

Maybe it can be fixed in future ?

That was great!

This was improved the sorting in Plugins Overview too!

 

Every Plugin have the same Version Schema.

@Revan335 It was a empty update, no new functionality or fixes, just a test release fo the new (again) CI/CD pipeline; I'm finishing some fixes and I release the new version with minor improvements in the coming days.

 

@Masterwishx I'm not so sure what Squid means for "standard" versioning scheme, but I'll check.

Thanks for this amazing plugin!

Just to clarify - if we make a snapshot and then replicate than to another local ZFS pool, from the 'backup' pool, we cannot rollback the 'original' snapshot right? - the only way to access this data is by cloning and then copying back to the original pool?

58 minutes ago, Iker said:

 I'm not so sure what Squid means for "standard" versioning scheme, but I'll check.

Maybe he main 2023.12.01 not 2023.12.01.main or v2023.12.01./main/... in the Past.

Edited December 3, 20232 yr by Revan335

59 minutes ago, Iker said:

It was a empty update, no new functionality or fixes, just a test release fo the new (again) CI/CD pipeline; I'm finishing some fixes and I release the new version with minor improvements in the coming days.

Many Thanks for the Info's!

@concerned-contour2481 No, you can't, however, you can send snashots incrementally and in replicate mode, Check https://docs.oracle.com/cd/E19253-01/819-5461/gfwqb/index.html

 

@Revan335 Yeah, that's my guess, however I use those tags to work in the plugin using multiple branches. I have to check how to remove the branch name when is from the main one; it shouln't be too complicated, so you can count on the version name change ;).

Hi Folks, a new update is live with the following changelog:

 

2023.12.4

• Fix - Used and Free % bars/texts are now consistent with unraid theme and config
• Fix - Set time format for the last refresh to short date and time
• Fix - Detect Pools with used % under 0%
• Fix - ZPool regex not caching some pools with dots or Underscore in the name

 

10 hours ago, Iker said:

Hi Folks, a new update is live with the following changelog:

 

2023.12.4

• Fix - Used and Free % bars/texts are now consistent with unraid theme and config
• Fix - Set time format for the last refresh to short date and time
• Fix - Detect Pools with used % under 0%
• Fix - ZPool regex not caching some pools with dots or Underscore in the name

 

 

Thanks for the Update and Fixes , also for autoupdate plugin is fixed now .

On 11/14/2023 at 4:22 PM, wacko37 said:

The command will upgrade (downgrade really) the ZFS disk to the 6.12 ZFS features.

 

I was able to reproduce the bug, and unfortunately, ZFS Master is not compatible with legacy pools created by UD; this is due to specific features used by the plugin currently missing in legacy pools, so the only way for those pools to be detected and listed within the plugin is as you mention upgrade the pool. @dlandon for viz.

46 minutes ago, Iker said:

 

I was able to reproduce the bug, and unfortunately, ZFS Master is not compatible with legacy pools created by UD; this is due to specific features used by the plugin currently missing in legacy pools, so the only way for those pools to be detected and listed within the plugin is as you mention upgrade the pool. @dlandon for viz.

I'm not surprised by that.  We'll have to remember to let users know that they need to upgrade the UD disk so it will show.

On the new Version: 6.12.6

Getting a zfs pool spinning up constantly (when not on the main drive page). and no disks reading happening.

Stops if I remove this plugin.

It's possible that the plugin backend keep working for a little bit (10-15 secs) after you change tabs; however, it's not possible for the plugin to execute any additional actions once you navigate to other pages. Do you have any other insights on how this situation happens and your configuration for the plugin?

Hi Folks, a new update is live with the following changelog:

 

2023.12.8

• Add - Directory Listing functionality
• Fix - Optimize multiple operations

How Directory Listing Works?

Directory Listing is a new feature (You should enable it per Dataset or in the plugin configuration) that lists the top-level folders for a given dataset. This functionality should give you better visibility over your pools, allowing you to spot possible duplicates and directories that may be associated with leftovers of a migration. 

 

The folders are listed after the datasets, under the dataset children with a different icon (a folder); the plugin doesn't gather any information about the directory besides its name. Given that a Dataset Snapshot covers his subfolders, the Snapshots count is associated with all the subfolders, even if the folders are brand new and not present in any snapshot; this is by design.

 

This new feature needs to be enabled per Dataset, using the Actions menu or the plugin configuration; it's important to note that it may impact loading times up to 5 or 10% depending on the number of folders under the Dataset.

 

Finally, this version required many changes, so multiple bugs are expected to appear here and there; please don't hesitate to report them here.

This is most likely the last update of the year, so best wishes to you Unraid community, and I'll see you next year with more functionalities 😃.

 

Best

Edited December 8, 20232 yr by Iker

It's working!

Many Thanks!

 

Can you add a Delay Option?

First load ZFS Master than the Folders? The ZFS Master under Main its not showing until the Folders are loaded finished.

 

Best wishes to you and all others too!

Edited December 9, 20232 yr by Revan335

Unfortunately, this is not possible, as the directory and dataset listing are highly coupled on the plugin; on the other hand, I don't foresee this functionality as something you folks end up using on a daily basis, but to check that "everything is working as expected" and there are no ghost folders lying around, you can always remove datasets from directory listing and add them only when you need the information.

Your latest version has a php warning:

[12-Dec-2023 09:45:19 America/Chicago] PHP Warning:  filemtime(): stat failed for /boot/config/plugins/zfs.master/zfs.master.cfg in /usr/local/emhttp/plugins/zfs.master/nchan/zfs_master on line 25

 

When I uninstall the plugin, the warning continues.

 

Just found more:

[12-Dec-2023 09:47:13 America/Chicago] PHP Warning:  Trying to access array offset on value of type null in /usr/local/emhttp/plugins/zfs.master/include/ZFSMHelpers.php on line 141
[12-Dec-2023 09:47:13 America/Chicago] PHP Warning:  Trying to access array offset on value of type null in /usr/local/emhttp/plugins/zfs.master/include/ZFSMHelpers.php on line 173
[12-Dec-2023 09:47:13 America/Chicago] PHP Warning:  Trying to access array offset on value of type null in /usr/local/emhttp/plugins/zfs.master/nchan/zfs_master on line 38
[12-Dec-2023 09:47:13 America/Chicago] PHP Warning:  Trying to access array offset on value of type null in /usr/local/emhttp/plugins/zfs.master/nchan/zfs_master on line 42

 

@Iker - Thanks for the great plugin!

 

I'd like to propose two possible enhancements for a future version:

1. Have a refresh icon per pool.  Right now there is only a global refresh icon.  This will cause disks in the array to spin up if any of them are formatted as zfs even if I'm only interested in getting updates for a 'cache' pool at the moment.  A 'refresh' icon per pool would allow targeted refreshing.  I could refresh just a 'cache' or UD' pool and let the array drives stay spun down.  Another possible option is to ignore refreshing pools where the datasets are currently hidden.
2. Would it be possible to add the 'written' property to the Snapshot Admin table view.  It can be queried with `zfs list -o written` similar to how you are getting the other properties.  I usually find 'written' is more meaningful to me than 'used' when looking at historical snapshots.  My understanding is that 'written' refers to how much space was written to a filesystem or snapshot relative to the previous snapshot, whereas 'used' refers to the amount of unique data that applies to only that snapshot (not reused by any other further snapshots) and the amount that would be freed if it was deleted.  Both are useful, but I think 'written' is actually more relevant usually (at least to me).

Hi @dlandon Good catch; the first one is shown because you haven't made any config changes to the plugin config, and it doesn't check if the file exits. I'll submit a new build with a fix for that case. About the continued logging even when the plugin is uninstalled, it's probably related to the Nchan process not being terminated automatically by Unraid.

 

About the other ones, are you sure you have a mounted Pool? The plugin seems to be unable to parse the pool config or the datasets. If you happen to have one or more pools, can you please share (As text via PM) the result of the following commands:

 

zpool list -v

zfs list -r <pool>