Avoid data Corruption

[mika91]

Hi,

 

I like evey feature od Unraid exept one: data corruption protection!

Is there a way (or addin) to avoid it with unraid?

Thanks

[BLKMGK]

Not ever experienced this. What exactly is the scenario you're protecting against? If a program writes bad data I don't know of anything that will stop it on any storage platform...

[mika91]

ok,

Let's assume my server has 3 HDD + 1 parity HDD.

In case of a silent corruption (or bit rot) on a single file, a new parity will be computed.

And now way to detect or prevent the file corruption, neither restore it to its healthy state.

Because there ar no checksum verification.

[Chris Pollard]

you could generate and check sfv files for all your files....  probably not ideal...  on my system this takes a long time.

 

Also if you do find corruption there is no way to restore it, you just know its occurring.

[dgaschk]

There is a hashdeep package available via unMenu. It's mostly useful for drives with static content, e.g., archive or full media drives. It takes about 8 hours to create hashes for a 2T drive. A shell script should be able to limit it to only processing only new or updated files which should be much faster.

[BLKMGK]

Again I would ask, where are you experiencing this? I've read plenty of ZFS arguments about this but I remain pretty unconvinced that it's as common as asserted. My movies play, my compressed files aren't corrupted, and people with encrypted file systems aren't having them drop like flies. All of these things would be occurring if this issue was so common. HDD have a great deal of error correction built in, overcoming this is isn't trivial.

 

Create hashes for your files to detect it, create PAR files to correct for it, but I don't think you'll find yourself utilizing them and a great deal of effort maintaining them....