Dynamix File Integrity plugin


bonienl

Recommended Posts

I'm also on Unraid 6.11.5 and the updated plugin was not working properly and hashing new files added to the array.

 

I did an uninstall and rolled back to the version below.  The older version of the plugin immediately picked up and started hashing thousands of files that had been added/changed recently.

 

https://raw.githubusercontent.com/bergware/dynamix/fbd863f64ce1af8ea97ac2d13cc906a410925b9f/unRAIDv6/dynamix.file.integrity.plg

 

Link to comment
On 3/5/2023 at 3:51 PM, remowilliams said:

I'm also on Unraid 6.11.5 and the updated plugin was not working properly and hashing new files added to the array.

 

I did an uninstall and rolled back to the version below.  The older version of the plugin immediately picked up and started hashing thousands of files that had been added/changed recently.

 

https://raw.githubusercontent.com/bergware/dynamix/fbd863f64ce1af8ea97ac2d13cc906a410925b9f/unRAIDv6/dynamix.file.integrity.plg

 

Interesting. I'm experiencing the same issue of no files being added. I tried to install the older plugin but it comes back with a bad checksum so it won't install...

Link to comment

Got the same issue and im also on unRAID 6.11.5,

 

0 Files have been added.

 

i tried everything uninstalling and reinstalling. Set the plugin to automaticly hash new files and manually started the process but nothing is working new files wont get a hash added to them :(

Edited by Pixelshading
Link to comment
On 3/9/2023 at 5:34 PM, Pixelshading said:

Got the same issue and im also on unRAID 6.11.5,

 

0 Files have been added.

 

i tried everything uninstalling and reinstalling. Set the plugin to automaticly hash new files and manually started the process but nothing is working new files wont get a hash added to them :(

I'm on 6.10.3, and it's happening the same for me as well.

I will try to downgrade to the suggested older version a post back and I will report it.

Link to comment
On 3/19/2023 at 12:16 PM, bonienl said:

 

I don't see this happening on my system and need to investigate.

Currently busy with the Unraid 6.12 release, but will look into this later.

 

Thanks bonienl :)

 

No worrys take ya time, just knowing it will get looked into later gives me a peace of mind.

 

 

Link to comment

I tested this and everything works as expected.

Selecting all disks and then "Build" will create hashes for all new files.

 

image.png

 

image.png

 

These are my settings

 

Note 1: I have not enabled "Automatic protect", which is used to automatically generate a hash when a file is new or updated.

 

Note 2: I have not enabled "Verification schedule", which is used to do period verification of the existing hashes to confirm integrity.

 

image.png

 

 

Link to comment

Well,

 

still no luck for me. Tried the same Settings as you @bonienl

 

but still nothing happend:

 

First selected all disks

1.thumb.png.1595833a40549013602ae32f83467057.png

 

Now to be safe tried the remove command but here as well nothing happened:

 

2.thumb.png.aa7870c3c30cd036a7ac9640603d71c0.png

 

Then used the build option:

 

3.thumb.png.0fcb6ba3ff1c17eb9cce48ae1c77fa02.png

 

as you can see nothing happened.

 

 

Now i checked to command line:

 

3a.thumb.png.da3acbfa19fc32b9aa27bf41e6c32fcc.png

 

No hash has been added.

 

Also the next file was hashed before the plugin broke for me and yeah the Blake 3 hash attribute was added, however this attribute should have been remove from the previous remove command and as you can see it wasn't

 

image.thumb.png.530b35b003a460ab6df75a307a0aa997.png

Link to comment

You have a number of extra user attributes, which I am not familiar with.

Here is an example of a file on my system.

 

# getfattr -d 01-pihole.conf
# file: 01-pihole.conf
user.blake3="1df3f0fadee4bba95db9a2b5c513ff28ad6752c1e9d340532b468e22cef4285b"
user.filedate="1650279012"
user.filesize="1564"
user.scandate="1679741030"

 

What happens when you manually delete the hash attribute?

 

setfattr -x user.blake3 <filename>

 

The maximum size of the extended attributes depends on the file system in use. A file system like BTRFS is much more limited than e.g. XFS. Just wondering if you are reaching limits here!

 

Link to comment

The setfattr -x user.blake3 command does indeed work

 

image.thumb.png.15ff20dbe7a6f733e16114a74c6310ea.png

 

well only my cache drives are formatted with BTRFS the main array drives are formatted as XFS

 

however running the normal build command from the plugin via the GUI doesnt work 

 

image.thumb.png.d7f81bcc5cffd2464ae7c362f60308bd.png

 

still 0 files hashed

 

 

Here is a output from a LSI 9211 Flash utility exe:

 

root@Phoenix:/mnt/user/NAS-Drive/Transfer/Firmware/LSI 9211/9211# getfattr -d sas2flash.exe
# file: sas2flash.exe
user.blake3="22332d1a7d12035f9a5691e65f901be421a768ab94bc7482a15250ff03ccc2ba"
user.filedate="1457710188"
user.filesize="166912"
user.scandate="1677715201"

root@Phoenix:/mnt/user/NAS-Drive/Transfer/Firmware/LSI 9211/9211# setfattr -x user.blake3 sas2flash.exe 
root@Phoenix:/mnt/user/NAS-Drive/Transfer/Firmware/LSI 9211/9211# getfattr -d sas2flash.exe
# file: sas2flash.exe
user.filedate="1457710188"
user.filesize="166912"
user.scandate="1677715201"

 

Edited by Pixelshading
Link to comment

For me both Add and Remove work perfect. No issues on three of my servers.

 

The GUI is a frontend for the script "bunker" which performs the actual operations.

Can you open a terminal window and try the following

 

# Add hashes
/usr/local/emhttp/plugins/dynamix.file.integrity/scripts/bunker -a -b3 /mnt/disk1

# Remove attributes
/usr/local/emhttp/plugins/dynamix.file.integrity/scripts/bunker -R -b3 /mnt/disk1

 

The example has disk1, but you can choose whatever disk you want

 

Link to comment

Using the command from the Terminal is working:

 

root@Phoenix:~# /usr/local/emhttp/plugins/dynamix.file.integrity/scripts/bunker -R -b3 /mnt/disk4
Finished - cleared 2220 files, skipped 0 files. Duration: 00:00:21

root@Phoenix:~# /usr/local/emhttp/plugins/dynamix.file.integrity/scripts/bunker -a -b3 /mnt/disk4
Finished - added 2220 files. Duration: 00:02:27. Average speed: 184 MB/s

 

Link to comment
On 3/27/2023 at 1:06 AM, SantyC93 said:

Was wondering, is there a way to trigger the automatic check via command?
I would like to execute the check with a script to have a better control on the schedule.


Thanks for the help :D

 

 

 

No one knows?

Would really help a lot if someone knew the commands for check, build and export so that we can use them in scripts :D

Link to comment
3 hours ago, SantyC93 said:

I only see the commands for build and clear, I was asking for check (and maybe export). If I missed them could please quote them? I can be quite blind sometimes XD Ty :D

If no parameters behind bunker, then you will got text help.

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.