Rockbox.org home
release
dev builds
extras
themes manual
wiki
device status forums
mailing lists
IRC bugs
patches
dev guide



Rockbox mail archive

Subject: Re: Folder Synching & Removing Dups
From: Brian Wolven (brian.wolven_at_verizon.net)
Date: 2003-12-08


lovelearn wrote:
> Windows folder synchronization and duplicate file removal is handled
> differently by various software. It's easy to generate multiple files
> named identically in different folders which contain the same song by
> the artist but from different performances. Typically (but not always)
> these will have different file lengths. So a first screening test for
> identifying duplicates would be to look for identical file names. A
> second minimally required step for prudence is to compare file sizes.
> While only an exhaustive and agonizingly slow byte for byte file
> comparison can guarantee that files are 100% identical, comparatively
> fast "hatch mark" mathematical comparison screening is an intermediate
> step that "Space Hound 32" allows as a screening option. That is a
> very high standard. By comparison, "PowerDesk 5" ran a folder
> comparison which generated a "duplicate file" list which contained
> many identically named examples which WERE NOT EVEN THE SAME SIZE! So
> before following automatically generated advice about what
> "duplicate" files to delete, I suggest that you make sure you're
> using software that does more than perform a naive file name
> comparison in generating a duplicate file candidate list before
> accepting that advice by pressing delete. LoveLearn

I've used an app called DoubleKiller that compares by any or all of the
following four criteria:

1) Name
2) Date
3) Size
4) CRC-32 checksum

IIRC, you can also set size thresholds (> or <) and file attribute
filters. AFAIK it's freeware, also.



Page was last modified "Jan 10 2012" The Rockbox Crew
aaa