Suggestion for a duplicate file scanner/remover?

Status
Not open for further replies.

rbico

New member
Local time
9:24 AM
Messages
31
Not sure if this is the right forum, but I am looking for a good program to search all of my many hard drives for duplicate photos and music and such so I can get rid of them. I have done searches to fond one, but most of the results are from 2004-2005.

thanks!
 

My Computer My Computer

OS
windows 7
Not sure if this is the right forum, but I am looking for a good program to search all of my many hard drives for duplicate photos and music and such so I can get rid of them. I have done searches to fond one, but most of the results are from 2004-2005.

thanks!

Have a look at this one,

Find duplicate files with Auslogics Duplicate File Finder

It's free but make sure you uncheck the toolbar offer when installing.
 

My Computer My Computer

Computer type
PC/Desktop
Computer Manufacturer/Model Number
Self Built
OS
Win 10 Pro x64
CPU
Intel I5-2500K @3.3GHz
Motherboard
Asrock P67 Extreme4
Memory
16GB G.Skill Ripjaws X (4x4GB)
Graphics Card(s)
EVGA GeForce 750 Ti SC 2GB
Sound Card
ASUS Xonar DG 5.1 Channels 24-bit 96KHz PCI Interface Sound
Monitor(s) Displays
auria eq2367
Screen Resolution
1920 x 1080
Hard Drives
250GB Samsung 850 EVO SSD
1TB WD Blue
1TB Hitachi
PSU
SeaSonic X 650W 80 Plus Gold
Case
Corsair Obsidian 750D
Cooling
Corsair H60, Three 140mm case fans
Keyboard
Logitech Wireless Keyboard K520
Mouse
Logitech Wireless Mouse M310
Internet Speed
Wave Broadband ~ 100 dn 5 up
Antivirus
Windows Defender, Malwarebytes Premium
Browser
Edge, IE11, Chrome
Other Info
Laptop specs: HP g7-1365dx /
CPU: AMD A6-3420M APU with Radeon(tm) HD Graphics /
RAM: Crucial 8Gb (2x4Gb) /
SSD: Crucial M4-CT128M4SSD2 ATA Device/ FW 000F /
GFX: AMD Radeon HD 6520G /
OS: Windows 10 Pro x64
I use this free one--works fine on Windows 7:

DupDetector
 

My Computer My Computer

Computer type
PC/Desktop
Computer Manufacturer/Model Number
Ignatz Special; 4 speed manual gearbox; factory air conditioning; one of one
OS
Windows 7 Home Premium SP1, 64-bit
CPU
Intel Skylake i5-6600K, not overclocked
Motherboard
AsRock Z170M Extreme 4, micro ATX
Memory
8 GB HyperX DDR4-2666 (2 x 4 GB)
Graphics Card(s)
none; graphics are integrated on CPU
Sound Card
onboard: Realtek ALC1150; external: USB Behringer UF0-202
Monitor(s) Displays
Dell S2340M 23 inch IPS
Screen Resolution
1600 x 900
Hard Drives
System: Crucial MX100 series SSD, 128 GB;
Data: Samsung Spinpoint 103SJ, 1 TB;
Backup: WD Caviar Green WD30EZRX-00D8PB0, 3 TB
PSU
Rosewill SilentNight 500 watt fanless, semi-modular
Case
Antec Solo II
Cooling
Noctua NH-U12S; Noctua F12 intake, Noctua S12A exhaust
Keyboard
Microsoft 200 6JH-00001 USB
Mouse
Dell or Microsoft optical wired; USB
Antivirus
Microsoft Security Essentials and Malwarebytes Premium
Browser
Pale Moon
Other Info
All fans PWM; speeds at idle: CPU circa 500 rpm; intake circa 600 rpm; exhaust circa 600 rpm; CPU temps 27 idle and 47 C load in a warm room (27 C/81 F) when running Intel Extreme Tuning Utility stress test.
I will check these both out. Thanks for the suggestions.
 

My Computer My Computer

OS
windows 7

My Computer My Computer

Computer type
Laptop
Computer Manufacturer/Model Number
HP pavilion DV6
OS
win7 home premium-64bit-SP1-IE10
CPU
T6600 2.2Ghz
Motherboard
HP Model 3628
Memory
4 Gb
Graphics Card(s)
ATI Mobility Radeon HD 4530
Sound Card
IDT High Definition
Screen Resolution
1366x768 @ 60Hz
Hard Drives
500Gb Western Digital
Antivirus
MSE
Other Info
Malwarebytes Antimalware + Spybot-Search&Destroy
Not sure if this is the right forum, but I am looking for a good program to search all of my many hard drives for duplicate photos and music and such so I can get rid of them. I have done searches to fond one, but most of the results are from 2004-2005.

thanks!

You might consider using a file sychronizer instead of a dupe finder.
It would require you to do some manual file organizing first, but once you do that
you'll never need a dupe finder anyway.
Part of a sync tool's function is finding dupes.
That might be why you're only finding older dupe finder programs - they've been overtaken by sycn tools. Just guessing. I quit looking at dupe finders years ago when I began using sync tools.

Could be safer to use and do more for you in organizing your data.
Since you have plenty of disks, a backup or 2 of the files you know you want to keep would get done at the same time.
MS SyncToy works pretty well. Whatever you use, be careful you know how it works so you don't delete something you want.
 

My Computer My Computer

Computer Manufacturer/Model Number
Home Built
OS
Windows 7 Ultimate x64
CPU
QuadCore Intel Core i7 920, 2666 MHz (20 x 133)
Motherboard
Asus P6T
Memory
6134 MB (DDR3-1333 DDR3 SDRAM)
Graphics Card(s)
(2 - SLI) NVIDIA GeForce GTS 250 (1024 MB)
Sound Card
Onboard Realtek ALC888/1200 @ Intel 82801JB IC
Monitor(s) Displays
HDMII
Screen Resolution
1280 x 800
Hard Drives
Crucial M4 (64 GB SSD)
WD Caviar Blacks
WD5001AALS-00J7B1 ATA Device (465 GB)
WD5001AALS-00J7B1 ATA Device (465 GB)
WD5001AALS-00L3B2 ATA Device (465 GB)
WD Elements USB External (250 GB)
PSU
Corsair 550
Case
iStarUSA S-10000BL Black
Part of a sync tool's function is finding dupes.

How do sync tools distinguish between 2 identical pictures in the same folder when one is named X.jpg and the other is named Y.jpg?

Tell me the name of such apps and I will check them out.
 

My Computer My Computer

Computer type
PC/Desktop
Computer Manufacturer/Model Number
Ignatz Special; 4 speed manual gearbox; factory air conditioning; one of one
OS
Windows 7 Home Premium SP1, 64-bit
CPU
Intel Skylake i5-6600K, not overclocked
Motherboard
AsRock Z170M Extreme 4, micro ATX
Memory
8 GB HyperX DDR4-2666 (2 x 4 GB)
Graphics Card(s)
none; graphics are integrated on CPU
Sound Card
onboard: Realtek ALC1150; external: USB Behringer UF0-202
Monitor(s) Displays
Dell S2340M 23 inch IPS
Screen Resolution
1600 x 900
Hard Drives
System: Crucial MX100 series SSD, 128 GB;
Data: Samsung Spinpoint 103SJ, 1 TB;
Backup: WD Caviar Green WD30EZRX-00D8PB0, 3 TB
PSU
Rosewill SilentNight 500 watt fanless, semi-modular
Case
Antec Solo II
Cooling
Noctua NH-U12S; Noctua F12 intake, Noctua S12A exhaust
Keyboard
Microsoft 200 6JH-00001 USB
Mouse
Dell or Microsoft optical wired; USB
Antivirus
Microsoft Security Essentials and Malwarebytes Premium
Browser
Pale Moon
Other Info
All fans PWM; speeds at idle: CPU circa 500 rpm; intake circa 600 rpm; exhaust circa 600 rpm; CPU temps 27 idle and 47 C load in a warm room (27 C/81 F) when running Intel Extreme Tuning Utility stress test.
Part of a sync tool's function is finding dupes.

How do sync tools distinguish between 2 identical pictures in the same folder when one is named X.jpg and the other is named Y.jpg?

Tell me the name of such apps and I will check them out.

How does it happen that the same picture has 2 names in the same folder?
Or any other folder for that matter. Because it's a different file.
Has a different timestamp too, which syncing tools look at.
As soon as a file is renamed it is a different file. Name has always been part of the file definition to me, and I suspect most people.
If somebody else wants to use a different definition, fine with me.
If I do something with x.jpg in photoshop and save it as y.jpg it's because I had a purpose for the new file name. Even if I made no changes, I did that myself for some purpose. Hopefully named it according to that purpose, and not "y."
That kind of situation is a manual process, and IMO should be fixed manually.
Sure, you can do byte by byte compares of 2 files regardless of name.
Kludgey process, requiring for example that every file sized 2048 bytes be compared to every other file sized 2048 bytes, regardless of name or timestamp.
Doubt you'll ever find 2 different named files with the same byte by byte contents unless you did it yourself with some purpose in mind. You can even put your timestamp on files. In the past as least.
Anyway, I don't care what anybody uses to take care of duplicate files.
Just suggested an alternative.
 

My Computer My Computer

Computer Manufacturer/Model Number
Home Built
OS
Windows 7 Ultimate x64
CPU
QuadCore Intel Core i7 920, 2666 MHz (20 x 133)
Motherboard
Asus P6T
Memory
6134 MB (DDR3-1333 DDR3 SDRAM)
Graphics Card(s)
(2 - SLI) NVIDIA GeForce GTS 250 (1024 MB)
Sound Card
Onboard Realtek ALC888/1200 @ Intel 82801JB IC
Monitor(s) Displays
HDMII
Screen Resolution
1280 x 800
Hard Drives
Crucial M4 (64 GB SSD)
WD Caviar Blacks
WD5001AALS-00J7B1 ATA Device (465 GB)
WD5001AALS-00J7B1 ATA Device (465 GB)
WD5001AALS-00L3B2 ATA Device (465 GB)
WD Elements USB External (250 GB)
PSU
Corsair 550
Case
iStarUSA S-10000BL Black
How does it happen that the same picture has 2 names in the same folder?

Because I downloaded the same pic of the same 1957 Chevrolet twice, maybe 3 years apart, and put them in my 1957 Chevrolet folder?

I downloaded the second pic without realizing I already had it. They are likely different sizes and have different names.

Maybe one is of higher quality than the other, in which case I would want to keep the better pic.

I'd love a sync program that can reveal all of that to me.
 

My Computer My Computer

Computer type
PC/Desktop
Computer Manufacturer/Model Number
Ignatz Special; 4 speed manual gearbox; factory air conditioning; one of one
OS
Windows 7 Home Premium SP1, 64-bit
CPU
Intel Skylake i5-6600K, not overclocked
Motherboard
AsRock Z170M Extreme 4, micro ATX
Memory
8 GB HyperX DDR4-2666 (2 x 4 GB)
Graphics Card(s)
none; graphics are integrated on CPU
Sound Card
onboard: Realtek ALC1150; external: USB Behringer UF0-202
Monitor(s) Displays
Dell S2340M 23 inch IPS
Screen Resolution
1600 x 900
Hard Drives
System: Crucial MX100 series SSD, 128 GB;
Data: Samsung Spinpoint 103SJ, 1 TB;
Backup: WD Caviar Green WD30EZRX-00D8PB0, 3 TB
PSU
Rosewill SilentNight 500 watt fanless, semi-modular
Case
Antec Solo II
Cooling
Noctua NH-U12S; Noctua F12 intake, Noctua S12A exhaust
Keyboard
Microsoft 200 6JH-00001 USB
Mouse
Dell or Microsoft optical wired; USB
Antivirus
Microsoft Security Essentials and Malwarebytes Premium
Browser
Pale Moon
Other Info
All fans PWM; speeds at idle: CPU circa 500 rpm; intake circa 600 rpm; exhaust circa 600 rpm; CPU temps 27 idle and 47 C load in a warm room (27 C/81 F) when running Intel Extreme Tuning Utility stress test.
How does it happen that the same picture has 2 names in the same folder?

Because I downloaded the same pic of the same 1957 Chevrolet twice, maybe 3 years apart, and put them in my 1957 Chevrolet folder?

I downloaded the second pic without realizing I already had it. They are likely different sizes and have different names.

Maybe one is of higher quality than the other, in which case I would want to keep the better pic.

I'd love a sync program that can reveal all of that to me.

Dream on. Besides, it's good to have 2 pics of a '57 Chevy. Maybe more, even if they're the same pic.
 

My Computer My Computer

Computer Manufacturer/Model Number
Home Built
OS
Windows 7 Ultimate x64
CPU
QuadCore Intel Core i7 920, 2666 MHz (20 x 133)
Motherboard
Asus P6T
Memory
6134 MB (DDR3-1333 DDR3 SDRAM)
Graphics Card(s)
(2 - SLI) NVIDIA GeForce GTS 250 (1024 MB)
Sound Card
Onboard Realtek ALC888/1200 @ Intel 82801JB IC
Monitor(s) Displays
HDMII
Screen Resolution
1280 x 800
Hard Drives
Crucial M4 (64 GB SSD)
WD Caviar Blacks
WD5001AALS-00J7B1 ATA Device (465 GB)
WD5001AALS-00J7B1 ATA Device (465 GB)
WD5001AALS-00L3B2 ATA Device (465 GB)
WD Elements USB External (250 GB)
PSU
Corsair 550
Case
iStarUSA S-10000BL Black
How does it happen that the same picture has 2 names in the same folder?

Because I downloaded the same pic of the same 1957 Chevrolet twice, maybe 3 years apart, and put them in my 1957 Chevrolet folder?

I downloaded the second pic without realizing I already had it. They are likely different sizes and have different names.

Maybe one is of higher quality than the other, in which case I would want to keep the better pic.

I'd love a sync program that can reveal all of that to me.

I've used this free software for exactly the same situation and it works fine. Was able to find same images of different resolutions. You can change the filter for the search based on your preferences.
VisiPics
Faster than most commercial software
Uses dualcore processors
Highly efficient results with adjustable similarity levels
Easy to use Interface, preview your duplicates easily and pick the ones to delete with a simple click
Starts to display the results while scanning, you don't have to wait to delete your duplicates
Smart Auto-Select mode, to save time while deleting pictures
Tested on a 100.000 pictures 15Gb archive, full results in 3 hours only
 

My Computer My Computer

Computer type
Laptop
Computer Manufacturer/Model Number
HP EliteBook 8530w Mobile Workstation
OS
Windows 7 Ultimate x64 (XP, 98SE, 95, 3.11, DOS 7.10 on VM) + Ubuntu 10.04 LTS Lucid Lynx
CPU
Intel Core 2 Duo Processor P8600 (2.40 GHz, 3 MB L2 cache)
Motherboard
Mobile Intel PM45 Express Chipset ICH9M-Enhanced
Memory
4GB 800 MHz DDR2 SDRAM
Graphics Card(s)
ATI Mobility FireGL V5700 with 256 MB
Sound Card
SoundMAX Integrated Digital HD Audio
Monitor(s) Displays
15.4-inch WXGA anti-glare (1280 x 800 resolution)
Screen Resolution
1280 x 800
Hard Drives
500GB + 1TB
Mouse
Synaptics PS/2 Port Touchpad, USB Mouse
Internet Speed
4 Mbps
Antivirus
MSE
Browser
Firefox, Chrome, IE
Other Info
Authentec AES2810 Fingerprint Reader

My Computer My Computer

Computer type
PC/Desktop
OS
Windows 10 Home x64
CPU
INTEL Core i5-750 Quad-Core 3.37GHz
Motherboard
ASUS P7P55D
Memory
HyperX Fury Black Series 8GB (2 x 4GB) 1866Mhz
Graphics Card(s)
EVGA GeForce GTX 750 Superclocked 1GB 128-Bit GDDR5
Monitor(s) Displays
LG 32MA68HY 32" IPS
Screen Resolution
1920 x 1080
Hard Drives
Samsung 840 Evo 120GB, SEAGATE 500GB Barracuda® 7200.12, SATA 3 Gb/s, 7200 RPM, 16MB cache
PSU
ANTEC TruePower New TP-550, 80 PLUS, 550W
Case
ANTEC Three Hundred Illusion
Cooling
COOLER MASTER Hyper 212 Plus, 4 x 120mm 1 x 140mm Noctua's
Internet Speed
85 + Mbps
Antivirus
Avast
Browser
Vivaldi
If you just want to find duplicate pictures ignatzatsonic. Try Awesome Duplicate Photo Finder , it doesn't care about names :)

A Guy

A Guy:

Thanks, but all of my questions were rhetorical on behalf of the OP. Apparently, that got lost in the translation.

See post 3.

I have no problems finding dupes.
 

My Computer My Computer

Computer type
PC/Desktop
Computer Manufacturer/Model Number
Ignatz Special; 4 speed manual gearbox; factory air conditioning; one of one
OS
Windows 7 Home Premium SP1, 64-bit
CPU
Intel Skylake i5-6600K, not overclocked
Motherboard
AsRock Z170M Extreme 4, micro ATX
Memory
8 GB HyperX DDR4-2666 (2 x 4 GB)
Graphics Card(s)
none; graphics are integrated on CPU
Sound Card
onboard: Realtek ALC1150; external: USB Behringer UF0-202
Monitor(s) Displays
Dell S2340M 23 inch IPS
Screen Resolution
1600 x 900
Hard Drives
System: Crucial MX100 series SSD, 128 GB;
Data: Samsung Spinpoint 103SJ, 1 TB;
Backup: WD Caviar Green WD30EZRX-00D8PB0, 3 TB
PSU
Rosewill SilentNight 500 watt fanless, semi-modular
Case
Antec Solo II
Cooling
Noctua NH-U12S; Noctua F12 intake, Noctua S12A exhaust
Keyboard
Microsoft 200 6JH-00001 USB
Mouse
Dell or Microsoft optical wired; USB
Antivirus
Microsoft Security Essentials and Malwarebytes Premium
Browser
Pale Moon
Other Info
All fans PWM; speeds at idle: CPU circa 500 rpm; intake circa 600 rpm; exhaust circa 600 rpm; CPU temps 27 idle and 47 C load in a warm room (27 C/81 F) when running Intel Extreme Tuning Utility stress test.
DOH! Me no understand rhetorical, me only bash keys on keyboard :D

A Guy
 

My Computer My Computer

Computer type
PC/Desktop
OS
Windows 10 Home x64
CPU
INTEL Core i5-750 Quad-Core 3.37GHz
Motherboard
ASUS P7P55D
Memory
HyperX Fury Black Series 8GB (2 x 4GB) 1866Mhz
Graphics Card(s)
EVGA GeForce GTX 750 Superclocked 1GB 128-Bit GDDR5
Monitor(s) Displays
LG 32MA68HY 32" IPS
Screen Resolution
1920 x 1080
Hard Drives
Samsung 840 Evo 120GB, SEAGATE 500GB Barracuda® 7200.12, SATA 3 Gb/s, 7200 RPM, 16MB cache
PSU
ANTEC TruePower New TP-550, 80 PLUS, 550W
Case
ANTEC Three Hundred Illusion
Cooling
COOLER MASTER Hyper 212 Plus, 4 x 120mm 1 x 140mm Noctua's
Internet Speed
85 + Mbps
Antivirus
Avast
Browser
Vivaldi
Not sure if this is the right forum, but I am looking for a good program to search all of my many hard drives for duplicate photos and music and such so I can get rid of them. I have done searches to fond one, but most of the results are from 2004-2005.

thanks!

In addition to the other suggestions.. some freeware sites likely to have pertinent programs:

Free Windows Downloads - Softpedia
FileHippo.com - Download Free Software
SnapFiles freeware and shareware downloads and reviews, trusted for quality since 1997

also it may be a good idea to sign up on zdnet
Technology News, Analysis, Comments and Product Reviews for IT Professionals | ZDNet

I haven't used it much lately. But when I signed up it was free. Some downloads are unique and only downloadable by members.

Also for syncing files there's a nice built in sync feature in FreeCommander
FreeCommander - Guide
FreeCommander - Download

There are some dupe finders that don't care about names or even file type. They totally depend on checksum. Like running MD5Sum. Might be fine for scanning a bunch of small text files. But GB videos are slow to calculate MD5Sums for. At least it's slow if you have 100 to slog though.
 

My Computer My Computer

Computer Manufacturer/Model Number
HP Media Center
OS
Windows 7 32 bit
CPU
AMD 5200+ dual core
Memory
2 GB
Graphics Card(s)
NVidia GeForce 6150SE 128 MB
Monitor(s) Displays
CRT
Screen Resolution
1280x1024
Hard Drives
500 GB Sata internal :

SIIG USB 3.0 docking stations w/WD Caviar Black 6 Gb/s drives
Keyboard
PS/2
Mouse
PS/2 Wheel Mouse
Other Info
SIIG USB 3.0 PCIexpress card.

My Computer My Computer

OS
Win 7 Ultimate x86
thank you all for your suggestions. Still working through this one.
 

My Computer My Computer

OS
windows 7
Welcome to Seven Forums jseal1987. A Guy
 

My Computer My Computer

Computer type
PC/Desktop
OS
Windows 10 Home x64
CPU
INTEL Core i5-750 Quad-Core 3.37GHz
Motherboard
ASUS P7P55D
Memory
HyperX Fury Black Series 8GB (2 x 4GB) 1866Mhz
Graphics Card(s)
EVGA GeForce GTX 750 Superclocked 1GB 128-Bit GDDR5
Monitor(s) Displays
LG 32MA68HY 32" IPS
Screen Resolution
1920 x 1080
Hard Drives
Samsung 840 Evo 120GB, SEAGATE 500GB Barracuda® 7200.12, SATA 3 Gb/s, 7200 RPM, 16MB cache
PSU
ANTEC TruePower New TP-550, 80 PLUS, 550W
Case
ANTEC Three Hundred Illusion
Cooling
COOLER MASTER Hyper 212 Plus, 4 x 120mm 1 x 140mm Noctua's
Internet Speed
85 + Mbps
Antivirus
Avast
Browser
Vivaldi
Not sure if this is the right forum, but I am looking for a good program to search all of my many hard drives for duplicate photos and music and such so I can get rid of them. I have done searches to fond one, but most of the results are from 2004-2005.

thanks!

Have a look at this one,

Find duplicate files with Auslogics Duplicate File Finder

It's free but make sure you uncheck the toolbar offer when installing.

Is this still a good program to use and is it safe to use on a SSD ?
 

My Computer My Computer

Computer type
Laptop
Computer Manufacturer/Model Number
Lenovo Z710 #59400485
OS
Windows 8.1.1 64bit
CPU
i7-4700MQ
Memory
8.0GB PC3-12800 DDR3L SDRAM 1600 MHz
Graphics Card(s)
Intel® HD Graphics 4600
Sound Card
on-board
Monitor(s) Displays
17.3"
Screen Resolution
1920x1080
Hard Drives
1TB 5400 RPM;(OS,programs)



Hitachi, 1Tb external,(B'up)
PSU
4 Cell 41 Watt Hour Lithium-Ion
Case
Lenovo
Cooling
Air in, Air out.
Keyboard
Logitech - Y-UY95 - Illuminated
Mouse
M$ - Arc Touch
Internet Speed
59 Mb down / 25 Mb up
Antivirus
Defender
Browser
Firefox (newest)
Other Info
MBAM Pro, SAS Pro, Revo Pro.

Ext. HP 2311 Monitor
"Is this still a good program to use and is it safe to use on a SSD ?" If all it does is read what's on the SSD, how can it not be safe? Most programs are only as good as its interface. I've tried Auslogics' program. It does what it does. But can the user, me, do what was intended, organize and eliminate duplicates?
 

My Computer My Computer

OS
Windows 7 Home Premium x64
Status
Not open for further replies.
Back
Top