De-duplicate my picture collection
So I want to make a backup of my picture collection.
How can I make it so when I want to make a backup of a folder to my backup drive (with many subfolders) that it only backups file that havn't ever been copied to that drive?
Is there a program that will only copy a file if its MD5 or some other check is unique to the destination area?
Re: De-duplicate my picture collection
why don't u burn them to dvd !
Re: De-duplicate my picture collection
i use this whenever making backups to my external drive, was amazed at how quick it was at checking files, it can even replicate file deletions if you choose too, definitely worth having a look at, GL
http://www.karenware.com/powertools/ptreplicator.asp
Re: De-duplicate my picture collection
That is a useful program josh, but it doesn't include any duplication functionality.
I wonder if there is something out there that will find a dup based on its hash or filesize or something..
Re: De-duplicate my picture collection
windows: adobe elements does what you want, but its bit and overkill for your task
linux : gthumb or GQview both get the job done , a more guru way is using some piped md5 or sha1 magic or "diff -s"
a universal solution will be search *.jpg and look for the same sized files
Re: De-duplicate my picture collection
If you decide to store your files with a compression algorithm like WinRar, don't use the "normal" compression as you will lose a little quality during the compress. Use the "store" selection instead and the files will be rared as is. You will not save any room, as a matter of fact you will lose a little if you choose to put a recovery record (I recommend it). But, its a great solution if you want to pass protect some files from prying eyes or ftp thieves.
Re: De-duplicate my picture collection
Quote:
Originally Posted by
Appzalien
If you decide to store your files with a compression algorithm like WinRar, don't use the "normal" compression as you will lose a little quality during the compress. Use the "store" selection instead and the files will be rared as is.
That tip applies to any kind of file that's already compressed, for example the already mentioned JPEG images and MP3 audio. Many people don't know that and just RAR them up, with no real filesize reduction, but a waste of processing power.