I’ve already written that i like the GNU Textutils a lot. Today someone had the following problem: A textfile with words. It’s possible that a word is repeated a couple of times. He wants to generate a newfile without duplicate words. The solution is pretty simple:
sort words.txt | uniq > newfile.txt