Remove duplicate lines from text

Paste any list below (emails, URLs, keywords, log lines) and get it back with duplicates removed, original order preserved. Runs in your browser; nothing is uploaded.

Drop a .xlsx / .csv file here or

Processed locally. Check your Network tab: no uploads.

Alternatives, honestly compared

sort file.txt | uniq works but sorts your list. awk '!seen[$0]++' preserves order but lives in a terminal. Excel needs the data in a column first. This page is the paste-and-done version of the same operation, with trim/case/blank handling built in. Deduping emails or contact names? See the contact dedupe workflow.

FAQ

Frequently asked questions

How do I remove duplicate lines from a list?

Paste the list into the tool above and press Remove duplicates. Options let you trim whitespace, ignore case, and drop blank lines. The first occurrence is kept and order is preserved.

Does it preserve the original order?

Yes. Unlike sort | uniq, which must sort the list first, this keeps your original order and simply drops later repeats.

Is there a limit?

Hundreds of thousands of lines are fine. It's a simple in-browser operation.

Last updated