Free tool
Remove Duplicate Lines
Paste a list and get it back with the repeats removed. Useful for email lists, log files, exported spreadsheet columns and anything else that accumulated duplicates.
Everything runs inside your browser. Nothing you paste is uploaded or stored.
How to use it
Doing this more than once? Do it on your Mac.
★ 4.8 from 176 ratings
This page handles one paste at a time. Text Workflow runs 45+ text actions on your Mac, chains them into workflows you save once and reuse, and applies them to whole folders of files. Everything happens on-device, and it syncs to your iPhone.
Questions
Does it keep the first or the last copy of a duplicate?
The first. The original order is preserved unless you choose to sort, so the earliest occurrence of each line stays where it was.
Why are two lines that look identical not being merged?
They probably differ by invisible whitespace or by capitalisation. Turn on Trim spaces and Ignore case and they will be treated as the same line.
Can it deduplicate a spreadsheet column?
Yes. Copy the column out of Excel or Numbers and paste it here, since a copied column arrives as one value per line.
Is there a size limit?
It's limited only by your browser's memory, and lists of tens of thousands of lines are fine. For very large files, or to repeat this across many files, use the Text Workflow Mac app.