Anyone know of a good duplicate image detector? Most can't handle the large res scans on moe and tend to miss or give false positives.

I use a little program called DupDetector, does the job fine and I haven't come across any problems with large files (it finds ALL duplicates, not just images). Just add paths you want to check and hit go. There are probably better programs out there but since I don't actually use it that often I don't see much point searching, especially since DupDetector is free.

There is another one but crashes every now or so often who is declared the absolute best one LOL.... except so fast it gets close to an damaged file or not complete jpeg or any picture and anything of that sort the entire program crash :P not very well coded.

Anyhow have also been coding one but nowhere near release for my app :P been to lazy to work with it LOL.

So yes your best bet right now is http://www.keronsoft.com/dupdetector.html

http://en.wikipedia.org/wiki/GQview used to work quite well on my collection.

progged my own to search for exact same md5s

MDGeist said:
progged my own to search for exact same md5s

That would be for 100% duplicates though?

yep
but comes in handy when doing folder searches for whole moe (~60k), whole konachan (~80k) and whole danbooru ( ~330k ) images...

filtered mtokyo/apaper that way (more than 3000 dups, lol)

reminds me, need to do new rename.txt lists

Thank you for this thread happyhobo898, thanks for the suggestion Radiosity and thanks for the link MugiMugi~.

After an extensive battle with many different apps, I finally found the one that does the best job and finds the most.

It beat DupDetector, GQView, and Image Similarity in the comparison tests I ran on large moe scans. It even found dups when one image was slightly cropped.

So I thought I'd share:
http://rs247.rapidshare.com/files/67211325/Image_comparer.rar

Enjoy :)