Removing multiple occurrences of a line

Used with its -u option the sort command removes duplicate lines from a file. For example:

   sort -u -o mail/labels addresses

This removes all duplicate lines from the file addresses and places the output in the file mail/labels.

Duplicate lines do not have to be consecutive for the sort command to identify and remove them.

This site maintained by unixhelp@ed.ac.uk