I ran fix common problems extended test and got the following error in the results:

 

Quote

The following files exist within the same folder on more than one disk. This duplicated file means that only the version on the lowest numbered disk will be readable, and the others are only going to confuse unRaid and take up excess space:

 

It lists like 3500 files on disks 6, 7, 8 that are duplicates.

 

I found docker called Dupeguru and had it scan all my disks for duplicates and it found a bunch across those same three disks.

 

I had a SAS expander card go bad and had all sorts of disk issues. I copied a bunch of files back into the array that were on disks showing bad and disabled in Unraid, but weren't really bad. It was the SAS card causing disk errors. That's the only thing I can think of that caused the issue.

 

Is it safe to delete all but one copy of the files using Dupeguru? Is there a better way to clean up the duplicates?

Edited February 27, 20188 yr by drawmonster

I would suggest testing with Dupeguru. Copy a few of the duplicate files to another location/machine as a backup and then have Dupeguru remove those same duplicates.

 

There is also a support thread for Dupeguru. You might want the raise this question there.