Windows 7 Forums
Welcome to Windows 7 Forums. Our forum is dedicated to helping you find support and solutions for any problems regarding your Windows 7 PC be it Dell, HP, Acer, Asus or a custom build. We also provide an extensive Windows 7 tutorial section that covers a wide range of tips and tricks.

Windows 7: Managing a large Photo/Video Collection

21 Dec 2010   #1

Windows 7 Ultimate
Managing a large Photo/Video Collection

Background: Over the years I have collected somewhere between 60 and 100 thousand photos and thousands of hours of video in all kinds of formats (mostly jpg and muv). What's worse, doing backups and copies, I may have as many as 5 or 6 copies of any one photo or video. These are spread across two computers and dozens of CD's and DVD's.
Problem: I need to find a program that will go in and tell me not only how many copies of the same photo or video I have, but more importantly which is the best copy(ies) of/or the original, so that I can manage the files down to an original (or best copy) and one backup (next best copy). It needs to have batch capabilities because with that many photos/videos I could never do them one by one. Once I do it for the first time, it needs to be able to scan a CD or DVD of photos or videos and do the same job against the master file(s). Memory space and speed are not a problem because I'm getting a new computer with max memory and the fastest Intel chip.
Can anyone help me to find the best program to manage my collection? Thank You

My System SpecsSystem Spec

21 Dec 2010   #2

Windows 7 Home Premium x64

Welcome to SF, garyguertin!

The only one I've found that doesn't cost a ton of cash and that I use all the time is DupDetector.
It is designed solely for the purpose of finding duplicate Pictures.
I'm not sure if it is even supported anymore. It's one of those old, rare gems.

I used it on XP for years without a hitch; however, on Windows 7 it has a few display snags.
It still works, though- you just have to deal with them.

Anyway, here's the link:

Edit: I just looked at mine and it is version 3.201. Google around and you'll find the latest version, I'm sure.
Incidentally, notice the date? 2005! Too bad because it's a great utility.

You can fine-tune the settings until you're happy with the results, otherwise, it will give you a lot of false matches.

Enjoy! and I hope this helps...
My System SpecsSystem Spec
22 Dec 2010   #3

Windows 7 Ultimate

Rap33042, Thanks for the advice. I'll give it a try. In the meantime if you or anyone else has some other programs to try let me know Again, many thanks. GG
My System SpecsSystem Spec

22 Dec 2010   #4

Microsoft Windows 7 Home Premium 64-bit 7601 Multiprocessor Free Service Pack 1

I think your main problem will be finding a program that can "decide" which of a multiple choice of files is the best. The parameters for this are endless especially in the realm of video clips. Have you got the same files on the PC's as are on one or more of your backup discs? If so this is going to be an added problem.
My System SpecsSystem Spec
22 Dec 2010   #5

Windows 7 Ultimate

You are right, the only thing I can thank of is that everyfile (jpg, etc.) should have a date and some a time included. I would need a program that would put the same files (which it would determine) in an order by date. I could then erase all but the oldest two, which should be the original or first copy plus the next copy. Those should have the best quality. As to what's on CD's and DVD's, most of them (98%) are backup copies of files on my computer, but because I have changed computers about every 2 or 3 years I may have better quality files on those discs than I have on my current computer. You can see why I really need a good program to do this job and not just your normal dup file program. I have not tried keronsoft's DupDector, but I have a program called Duplicate Finder and Easy Duplicate Finder, which does an excellent jop of finding duplicate files but does not address quality or date of the file, it only shows location on your computer or DVD.. I will try DupDector, but if you or anyone has other programs to recommend, i'll try them. Thank You for your comments, GG
My System SpecsSystem Spec
23 Dec 2010   #6

Microsoft Community Contributor Award Recipient

Windows 7 SP1, Home Premium, 64-bit

I used to use a dupe finder program--maybe 6 to 10 years ago.

As I recall, all it could do is find identical file names and/or identical file sizes.

The user then had to do an eyeball inspection to confirm that the 3 files with the same name were in fact the same image---or that the files with the same sizes were in fact the same video.

Etcetera. I suspect you are going to be up against that situation.

Even if you found a program that could supposedly do what you need, would you trust it without manually confirming its opinion?

And I'd guess you are completely hosed if you have two identical images that have different file names. Or can software be savvy enough to know that Jones.jpg and Smith.jpg are otherwise identical---or that 2 files with the same name and extension are in fact completely unrelated??

If you find anything, let us know.
My System SpecsSystem Spec
23 Dec 2010   #7

Windows 7 Home Premium x64

DupDetector doesn't pay any attention to file names or file sizes unless you specify it in the options.
It can be set to 3 deletion types: Manual, Semi-auto, and Auto
It will detect flipped images, color vs gray-scale, and can be set to 1%-100% (mine's set at 96%) match and sort the list accordingly.
It will build a list from a directory, or two or more directories. It will save those lists for future use if you want.
It has several matching algorithms to choose from.
The list goes on...

It's display in Windows 7 is a bit quirky but the program works flawlessly.
I use it all the time and my only gripe is that it hasn't been updated in years.

I have about 80000 pictures and that number is still growing.
Anyone who needs to check through large numbers of pictures for duplications should really give it a try!
My System SpecsSystem Spec
23 Dec 2010   #8

Microsoft Community Contributor Award Recipient

Windows 7 SP1, Home Premium, 64-bit

OK; I will try DupeDetector out. I will only occasionally have use for it, but I can envision situations when it might be handy.
My System SpecsSystem Spec
23 Dec 2010   #9

Windows 7 Ultimate

Thanks rap33042, I'll give the program a try. Again, if anyone knows of other programs let us know. Again, Thanks, GG
My System SpecsSystem Spec
23 Dec 2010   #10

Microsoft Community Contributor Award Recipient

Windows 7 SP1, Home Premium, 64-bit

I tried it. It works pretty well:

Choose get data tab and hit “build”. Navigate to chosen folder with browse. Choose OK. It will scan through all files in the chosen directory and its subdirectories. Takes less than 10 minutes for 10,000 files. When that finishes, choose “find dupes” tab. On that tab you can choose a percentage for the match algorithm.

I chose 96% per advice above.

It will then scan the scanned files, looking for file pairs that are 96% or better matches. After that, choose view images. You are shown each image pair, along with each picture’s path, size, and dimensions. You can choose to delete one of the pair or move on to the next pair.

In 3 or 4 cases out of a hundred or so, the matched pairs in fact were not matches at all or even close--entirely different subjects in fact.

But you can pick that up by eye. I assume choosing a percentage above 96% would reduce these "false positives".

I didn't see a way to bring up full size images of each of the images in the pair to take a real good look. I just used a second program to do that.

So, I'm happy---I deleted a hundred or so dupes and then uninstalled the app. I can reinstall it a year from now and run through the routine again.
My System SpecsSystem Spec

 Managing a large Photo/Video Collection

Thread Tools

Similar help and support threads for2: Managing a large Photo/Video Collection
Thread Forum
Video and photo editing hunting Music, Pictures & Video
Manually seeking in a large video doesn't resume right away Music, Pictures & Video
Extra large icons for video files - tweaking the screenshot? Customization
Photo Gallery can't open this picture or video. Music, Pictures & Video
photo + video presentation Music, Pictures & Video
Default Photo and Video Import Music, Pictures & Video
Sharing LARGE video file Network & Sharing

Our Sites

Site Links

About Us

Find Us

Windows 7 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 7" and related materials are trademarks of Microsoft Corp.

Designer Media Ltd

All times are GMT -5. The time now is 03:42 PM.
Twitter Facebook Google+

Windows 7 Forums

Seven Forums Android App Seven Forums IOS App

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33