[Request] File de-duplication

[bobbintb]

I haven't seen any dockers/plugin for file deduplication. I'm not sure which options exist for linux. I have a large server and a lot of times I end up with duplicate files. I usually use a program on Windows to regularly search for duplicates but it would be nice if unraid handled it. I'd like it to have the option to dedupe by checksum and the option to hardlink or softlink if possible.

[datahaus]

Second that motion ! Here is a candidate https://www.hardcoded.net/dupeguru/

[bobbintb]

Another few notes, hard linking and soft linking only works on disk shares. Blake2 checksum would also be preferable.

[maplesyrupghost]

+1 for deduplication!!! 

[JonathanM]