Remove Duplicate Lines from Text

When you collect an email list, a set of keywords, a script’s output or a list of links, duplicates quietly pile up. This tool works line by line: it compares each line with the ones before it and keeps only the first occurrence. Three options are available: ignore case (so Ali and ali count as one), trim leading and trailing spaces, and sort the result alphabetically. Original order is kept when sorting is off.

This tool runs entirely in your browser. No data is sent to any server.

How to use it

1. 1

   Paste the list into the box, one item per line.

2. 2

   Choose your options: ignore case, trim spaces, sort the result.

3. 3

   Press clean and copy the de-duplicated output.

Frequently asked questions

Which copy of a duplicate line is kept?

Always the first one, spelled exactly as it was. With case-insensitive matching, Ali and ali count as one and Ali survives because it came first.

Can it remove repeated words inside a line?

No, it is line oriented. To deduplicate words, put each word on its own line or use the code editor.

Are blank lines removed as well?

With trimming on, a line containing only spaces becomes an empty line and is then dropped as a duplicate.