Managing a large Photo/Video Collection

Page 1 of 2 12 LastLast

  1. Posts : 6
    Windows 7 Ultimate
       #1

    Managing a large Photo/Video Collection


    Background: Over the years I have collected somewhere between 60 and 100 thousand photos and thousands of hours of video in all kinds of formats (mostly jpg and muv). What's worse, doing backups and copies, I may have as many as 5 or 6 copies of any one photo or video. These are spread across two computers and dozens of CD's and DVD's.
    Problem: I need to find a program that will go in and tell me not only how many copies of the same photo or video I have, but more importantly which is the best copy(ies) of/or the original, so that I can manage the files down to an original (or best copy) and one backup (next best copy). It needs to have batch capabilities because with that many photos/videos I could never do them one by one. Once I do it for the first time, it needs to be able to scan a CD or DVD of photos or videos and do the same job against the master file(s). Memory space and speed are not a problem because I'm getting a new computer with max memory and the fastest Intel chip.
    Can anyone help me to find the best program to manage my collection? Thank You
      My Computer


  2. Posts : 571
    Windows 7 Home Premium x64
       #2

    Welcome to SF, garyguertin!


    The only one I've found that doesn't cost a ton of cash and that I use all the time is DupDetector.
    It is designed solely for the purpose of finding duplicate Pictures.
    I'm not sure if it is even supported anymore. It's one of those old, rare gems.

    I used it on XP for years without a hitch; however, on Windows 7 it has a few display snags.
    It still works, though- you just have to deal with them.

    Anyway, here's the link: http://www.keronsoft.com/dupdetector.html

    Edit: I just looked at mine and it is version 3.201. Google around and you'll find the latest version, I'm sure.
    Incidentally, notice the date? 2005! Too bad because it's a great utility.

    You can fine-tune the settings until you're happy with the results, otherwise, it will give you a lot of false matches.

    Enjoy! and I hope this helps...
      My Computer


  3. Posts : 6
    Windows 7 Ultimate
    Thread Starter
       #3

    Rap33042, Thanks for the advice. I'll give it a try. In the meantime if you or anyone else has some other programs to try let me know Again, many thanks. GG
      My Computer


  4. Posts : 5,440
    Microsoft Windows 7 Home Premium 64-bit 7601 Multiprocessor Free Service Pack 1
       #4

    I think your main problem will be finding a program that can "decide" which of a multiple choice of files is the best. The parameters for this are endless especially in the realm of video clips. Have you got the same files on the PC's as are on one or more of your backup discs? If so this is going to be an added problem.
      My Computer


  5. Posts : 6
    Windows 7 Ultimate
    Thread Starter
       #5

    Mitchell65,
    You are right, the only thing I can thank of is that everyfile (jpg, etc.) should have a date and some a time included. I would need a program that would put the same files (which it would determine) in an order by date. I could then erase all but the oldest two, which should be the original or first copy plus the next copy. Those should have the best quality. As to what's on CD's and DVD's, most of them (98%) are backup copies of files on my computer, but because I have changed computers about every 2 or 3 years I may have better quality files on those discs than I have on my current computer. You can see why I really need a good program to do this job and not just your normal dup file program. I have not tried keronsoft's DupDector, but I have a program called Duplicate Finder and Easy Duplicate Finder, which does an excellent jop of finding duplicate files but does not address quality or date of the file, it only shows location on your computer or DVD.. I will try DupDector, but if you or anyone has other programs to recommend, i'll try them. Thank You for your comments, GG
      My Computer


  6. Posts : 12,012
    Windows 7 Home Premium SP1, 64-bit
       #6

    I used to use a dupe finder program--maybe 6 to 10 years ago.

    As I recall, all it could do is find identical file names and/or identical file sizes.

    The user then had to do an eyeball inspection to confirm that the 3 files with the same name were in fact the same image---or that the files with the same sizes were in fact the same video.

    Etcetera. I suspect you are going to be up against that situation.

    Even if you found a program that could supposedly do what you need, would you trust it without manually confirming its opinion?

    And I'd guess you are completely hosed if you have two identical images that have different file names. Or can software be savvy enough to know that Jones.jpg and Smith.jpg are otherwise identical---or that 2 files with the same name and extension are in fact completely unrelated??

    If you find anything, let us know.
      My Computer


  7. Posts : 571
    Windows 7 Home Premium x64
       #7

    DupDetector doesn't pay any attention to file names or file sizes unless you specify it in the options.
    It can be set to 3 deletion types: Manual, Semi-auto, and Auto
    It will detect flipped images, color vs gray-scale, and can be set to 1%-100% (mine's set at 96%) match and sort the list accordingly.
    It will build a list from a directory, or two or more directories. It will save those lists for future use if you want.
    It has several matching algorithms to choose from.
    The list goes on...

    It's display in Windows 7 is a bit quirky but the program works flawlessly.
    I use it all the time and my only gripe is that it hasn't been updated in years.

    I have about 80000 pictures and that number is still growing.
    Anyone who needs to check through large numbers of pictures for duplications should really give it a try! :)
      My Computer


  8. Posts : 12,012
    Windows 7 Home Premium SP1, 64-bit
       #8

    OK; I will try DupeDetector out. I will only occasionally have use for it, but I can envision situations when it might be handy.
      My Computer


  9. Posts : 6
    Windows 7 Ultimate
    Thread Starter
       #9

    Thanks rap33042, I'll give the program a try. Again, if anyone knows of other programs let us know. Again, Thanks, GG
      My Computer


  10. Posts : 12,012
    Windows 7 Home Premium SP1, 64-bit
       #10

    I tried it. It works pretty well:

    Choose get data tab and hit “build”. Navigate to chosen folder with browse. Choose OK. It will scan through all files in the chosen directory and its subdirectories. Takes less than 10 minutes for 10,000 files. When that finishes, choose “find dupes” tab. On that tab you can choose a percentage for the match algorithm.

    I chose 96% per advice above.

    It will then scan the scanned files, looking for file pairs that are 96% or better matches. After that, choose view images. You are shown each image pair, along with each picture’s path, size, and dimensions. You can choose to delete one of the pair or move on to the next pair.


    In 3 or 4 cases out of a hundred or so, the matched pairs in fact were not matches at all or even close--entirely different subjects in fact.

    But you can pick that up by eye. I assume choosing a percentage above 96% would reduce these "false positives".

    I didn't see a way to bring up full size images of each of the images in the pair to take a real good look. I just used a second program to do that.

    So, I'm happy---I deleted a hundred or so dupes and then uninstalled the app. I can reinstall it a year from now and run through the routine again.
    Last edited by ignatzatsonic; 23 Dec 2010 at 20:28.
      My Computer


 
Page 1 of 2 12 LastLast

  Related Discussions
Our Sites
Site Links
About Us
Windows 7 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 7" and related materials are trademarks of Microsoft Corp.

© Designer Media Ltd
All times are GMT -5. The time now is 08:25.
Find Us