Duplicate Line Remover
Clean a pasted list while preserving the spelling and order of the occurrence you choose.
A QUICK WALKTHROUGH
How to use this tool
- Paste up to 100,000 characters, one line per entry.
- Choose how lines match, whether to keep the first or last occurrence, and how blank lines are handled.
- Remove duplicates, review the count, then copy or download the TXT result.
Defined matching and retention
Exact mode compares line text as entered. Trimmed mode ignores leading and trailing whitespace for matching while preserving the selected occurrence’s original spelling. Case options use Unicode lowercasing. First retention scans top to bottom; last retention scans from the end while restoring original order.
Bounded local processing
The browser processes up to 100,000 UTF-16 characters and keeps the output within that input boundary. Blank lines can be retained as one matching value or omitted before duplicate detection. No text is uploaded.
GOOD TO KNOW
Common questions
Does trimming change the output?
No. Trimming only changes the comparison key; the retained line keeps its original whitespace.
What does last occurrence mean?
For each matching group, the final line in the input is kept, and the retained lines remain in their original order.
How many duplicates were removed?
The result status reports the number of removed matching lines after the blank-line setting is applied.