Say no to duplicate lines!
Editor: Dupli Find locates duplicate lines in textfiles, Excel spreadsheets and Word documents. Found duplicates are reported and can be easily removed from the file. Custom scripts can be used to narrow down the search for better results. Dupli Find can also be used as a general text utility that provides many functions for manipulating text files. Everything can be automated using command lines to save time and effort.

Use Dupli Find to.
Delete duplicate emails in mailing lists.
Extract emails from various sources.
Sort textfiles, ascending or descending.
Convert from Unix / Mac OS X format to Dos / Windows textfiles.
Gather statistics from your data files.
Modify each line in a file using your own scripts.
Verify serial number generators, where each line must be unique.
Merge several newsletter lists into one.
Apply blacklists to files.
new:Changed: Many improvements to user interface for a more intuitive way of working.
Added: Load and save dialogs with options that were previously located in the settings.
Added: New load options: Ignore whitespace & ignore empty lines.
Added: Pre-Processing filters in load & save options.
Added: Bubble tooltips with convenient help.
Added: Quickstart image for first time users.
Added: Duplicate Frequency listing in tools window.
Added: Support for all kinds of Word & Excel FileTypes, including the new docx/xlsx.
Added: New select mode: all/none of marked kind.
Fixed: Major bugfixes and improvements to Word and Excel support!
Fixed: Better compatability with 64-bit systems.
Changed: you can free download Dupli Find 5.0 now.