[SUPPORT] Daman20 Deduper


Recommended Posts

  • 2 weeks later...

This is a great tool! and really happy to see a GUI.
I assume this is a work in progress, after the hash process is done it gives a horizontal list of files that will be deleted and so runs off the screen.
excited to use it once the UI gets an update.

Link to comment
  • 1 month later...

Is it Safe to use, is it going to cause any data loss?, I used to dedup my data on windows server box, when I specify a drive it dose dedup on that drive, if you copy data out the drive it will undo the dedup it uses chunk store to do the dedup, sorry if my question sounded stupid since I am a windows guy and a total newbie to linux and unraid and I just built and migrated my data to the unraid box and I saw this docker today and decided to use it but wanted to make sure this will not cause any data loss, I am currently targeting multiple folders by manually pointing the docker container to it to scan, wanted to make sure it is configured correctly.

/Familyscan to /mnt/user/Family/
/appdata/mnt to /user/appdata/deduper
/software-2scan to /mnt/user/Software-2/
/MediaServerScan to /mnt/user/MediaServer/

please advise.

 

Thank you!

deduper.JPG

Edited by Shandidy
fixing typos
Link to comment
  • 1 year later...
  • 3 weeks later...

I have installed this and allowed it to index but stopped the process before it completed.  I have not been able to find good docs regarding what it will actually delete since it sounds like the user has no control...  I will have some dupes, they will not have the same name and some may end up in odd places.  The odd places contain the content that I want gone, not my photo/media/music folders that I want the removed from.

 

Am I overlooking docs somewhere?

 

Matt

Link to comment
  • 2 weeks later...

I keep getting this error message below but nothing delete's itself.

Traceback (most recent call last):

File "/main.py", line 9, in <module>

with open("/appdata/hashes.json", "a+") as myfile:

FileNotFoundError: [Errno 2] No such file or directory: '/appdata/hashes.json'

[app] starting Deduper...

 

Link to comment
  • 9 months later...
On 6/23/2021 at 6:38 PM, daman12 said:

Deduper is a Python script bundled into a Docker container that automatically deletes any files with the same content, regardless of name. This is done based off of the SHA512 hash.

How long it will take to finish a 4TB storage volume?

Link to comment
  • 1 month later...

I can't suggest enough that you use an actual duplicate finder software instead of a script. You have little to no control over what gets deleted with a script.

I run DupeGuru from my computer via SMB, and that has always yielded exactly the results I want.

Not trying to undermine thee effort of thee OP or anything, but we need to be conscious about how we handle our data.

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.