EqualEgg

With the first part, I got lost not with what it does, but how it does it. But thanks for explaining anyway. For the second thing: Ok then, we are on the same page.

I don't know what you mean. If you imply that it makes sense to combine ZFS Raid-z1 or Raid-z2 with Unraid, then I disagree. I don't really feel like convincing you, or explaining why, but if that's what you meant, then with all respect, I think you are wrong on this one.

Well, I’m getting offtopic here, it has nothing to do with Unraid, but I really don’t know what to think about btrfs! The number of comments I have read about btrfs volumes crashing for no reason is really alarming. I just cannot trust it. I mean I haven’t used it much, apart from my Synology NAS, where it worked fine, but I have a very uneasy feeling about it. Part of the reason why I’m moving away from Synology too. For me it’s either ZFS-raid, or something simpler like Unraid, Snapraid, simple mdraid, or just no raid with XFS, ext4 or ZFS, depending on the use-case. I have made a decision to avoid btrfs for now! But your comment makes a lot of sense, and if everything works as it should, you are probably right!

I get it, but it wasn’t my main question though. Maybe I wasn’t clear enough, I’m sorry. My question was regarding the reliability and robustness specifically of the recovery process. For example, a disk in the array dies suddenly. The filesystem on it was btrfs. Unraid restores the disk, block by block, but there is one, tiny, single bit error that slips in, and gets written to the ‘recovered’ disk. This is not unimaginable. Can be caused by a controller error, a cable issue etc. That one single bit error makes btrfs go crazy once the filesystem is mounted again, i.e. the recovery was unsuccessful for reasons outside of btrfs’ control. But your comment on using something simple and stupid still applies regardless, I guess. XFS is less likely to go crazy, and is probably more resilient against total failure. Understandable. And makes sense. However, I’m not sure about the ZFS rearranging stuff. Maybe on raid-z1 and raid-z2? But in that case, why would you use Unraid under it? Or if for single-drive volumes, I’m not sure how different ZFS is from btrfs in terms of workload. Both are copy-on-write. But if you say ZFS is worse, I believe you. Drive sizes and flexibility etc. etc. That’s fine, I get that part. Edit: Thanks for your comment btw!

Thanks for the response, @itimpi! Ok, that explains it. I mean, this was sort of my suspicion. But still, it’s nice to hear it from someone who knows about it more than me. Now, if it works like this, my only remaining question is, how is reliability and robustness guaranteed? If there is any error during the recovery process, that could potentially damage the filesystem on the disk. Btrfs is fragile, but that’s just a feeling based on the many Reddit comments about broken btrfs volumes. (XFS may be more resilient at the expense of no integrity.) We could of course say that any redundancy, even without strong guarantees, is better than none. Is that what Unraid is? By the way, even if it’s like that, don’t misunderstand, I’m not talking down what Unraid does. I’m just trying to better understand it. And the above concerns are equally true for Synology’s solution, and for pure mdraid too. Considering that, Unraid is better.

Hi, I’m trying to understand how Unraid works exactly under the hood. I’ve been looking into different solutions, such as Snapraid, mdraid/mdadm, ZFS, Btrfs, Synology. For most of these systems, I think, I have a reasonable understanding of how they work. But I still have questions about Unraid. This is what I know so far: Unraid works on the block level, and uses 1 or 2 parity disk(s). It writes the parity data to the parity disk(s). Thus, if a disk fails in the array, it can recover the data. Clear and understandable. It works on the block level when calculating parity, but you still have to format the individual disks, and put a filesystem on them. – And this is where I get lost. Unraid supports btrfs. You can format disks with btrfs. But it’s also known that Unraid has no integrity checks. – Another thing I can’t wrap my head around, since btrfs does have integrity checking features. Questions: Does Unraid have an intermediate layer between the filesystem (and system calls to that filesystem) and the underlying block devices? Does it intercept the block level (i.e. not file system level) writes, and is this the point where it does its magic? The documentation talks about disks and block level parity. Then boom, all of a sudden, filesystems and shares. I’m curious about what’s in between! Why is it said that Unraid has no integrity checks while it supports btrfs? (Talking about the base system, not plugins.) I understand that on the block level, where it calculates parity, there are no integrity checks or checksums. This is fine. But when a btrfs filesystem is read, it does perform integrity checks, regardless of the underlying block device, or underlying Unraid layer. So, my data would still have integrity. Am I getting it wrong? Am I missing something? I understand that Unraid is proprietary. There is no problem with that. But it’s a little bit frustrating that there is literally zero information on how it works internally. This is also a problem with Synology by the way. If I don’t know how something works, I find it difficult to fully trust it. I understand that it works well, and it’s stable and reliable, but still. Thanks in advance for any replies or explanation!