mika91 Posted December 12, 2012 Share Posted December 12, 2012 Hi, I like evey feature od Unraid exept one: data corruption protection! Is there a way (or addin) to avoid it with unraid? Thanks Quote Link to comment
BLKMGK Posted December 12, 2012 Share Posted December 12, 2012 Not ever experienced this. What exactly is the scenario you're protecting against? If a program writes bad data I don't know of anything that will stop it on any storage platform... Quote Link to comment
mika91 Posted December 12, 2012 Author Share Posted December 12, 2012 ok, Let's assume my server has 3 HDD + 1 parity HDD. In case of a silent corruption (or bit rot) on a single file, a new parity will be computed. And now way to detect or prevent the file corruption, neither restore it to its healthy state. Because there ar no checksum verification. Quote Link to comment
Chris Pollard Posted December 12, 2012 Share Posted December 12, 2012 you could generate and check sfv files for all your files.... probably not ideal... on my system this takes a long time. Also if you do find corruption there is no way to restore it, you just know its occurring. Quote Link to comment
dgaschk Posted December 12, 2012 Share Posted December 12, 2012 There is a hashdeep package available via unMenu. It's mostly useful for drives with static content, e.g., archive or full media drives. It takes about 8 hours to create hashes for a 2T drive. A shell script should be able to limit it to only processing only new or updated files which should be much faster. Quote Link to comment
BLKMGK Posted December 12, 2012 Share Posted December 12, 2012 Again I would ask, where are you experiencing this? I've read plenty of ZFS arguments about this but I remain pretty unconvinced that it's as common as asserted. My movies play, my compressed files aren't corrupted, and people with encrypted file systems aren't having them drop like flies. All of these things would be occurring if this issue was so common. HDD have a great deal of error correction built in, overcoming this is isn't trivial. Create hashes for your files to detect it, create PAR files to correct for it, but I don't think you'll find yourself utilizing them and a great deal of effort maintaining them.... Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.