About Remove Duplicate Lines
This tool removes duplicate lines from your text. Paste a list of names, emails, URLs or keywords, one per line, and the Result keeps the first copy of each line in its original order and drops the repeats. It is free, needs no sign-up and runs in your browser, so nothing you enter is uploaded.
Matching is exact apart from trailing spaces: "apple" and "Apple" count as different lines, and a line that differs only by spaces at the end of it counts as the same. If you want capitals ignored, convert the text to lowercase with the Text Case Converter first. Blank lines are lines too, so only the first blank line is kept.
The order of the list is preserved, so nothing is sorted. The cleanup runs after any find and replace rules, so you can tidy the lines first, for example by removing extra spaces, and then drop duplicates.
How to use Remove Duplicate Lines
- Paste your text into the Text box.
- Type the text to look for in Find and its replacement in Replace with. The Result below shows the new text and says how many replacements were made.
- Tick Case sensitive, Whole word, or Regex as needed. Untick Replace all to change only the first match.
- Press Add rule to run several replacements in order. Each rule works on the output of the one before it.
- Tick Remove line breaks, Remove extra spaces or Remove duplicate lines for a cleanup. Then Copy, Download .txt, or Move to input to work on the result.
Features
- Plain text or regular expression (JavaScript syntax) rules.
- Case sensitive and Whole word options, and Replace all or first match only.
- Regex options for multiline (^ and $ match at each line) and dot matches newline.
- Capture groups in the replacement: $1, $2, $&, $$ and named $<name>.
- Several rules in one pass, applied in order, with a replacement count for each.
- Cleanups for line breaks, extra spaces and duplicate lines.
- A clear message when a regular expression is invalid, instead of a crash.
- Move to input, Undo, Copy and Download .txt.
Worked examples
apple banana apple Apple banana cherry gives apple banana Apple cherry
The second "apple" and the "banana" with trailing spaces are dropped. "Apple" stays because the match is case sensitive.
Privacy: how it works
- The replacing runs in your browser tab. Your text is not sent to Ulkaa or to any other server.
- This tool does not save your text. Close or reload the page and it is gone.
Tips
- Turn on Whole word when you replace short words, or "cat" will also change "category".
- Test a regex on a small piece of text before you run it on a long one. The count tells you whether it matched what you expected.
- Use Move to input to continue from the result, and Undo if a step went wrong.
- Keep a copy of the original text. This tool does not save it for you.
Frequently asked questions
Is it really free?
Yes. There is no price, no trial and no credit card. Ulkaa Tool does the work with your own device, so there is no server bill to pass on to you.
Do I need an account?
No. There is no sign-up and no login. Open the page and use it. An Ulkaa account is not needed for anything on this tool.
Does it run in my browser?
Yes. Your text are processed by code running in your browser tab, on your own device.
Is my data uploaded?
No. Your text are never sent to Ulkaa or to anyone else. You can check this yourself by watching the Network tab in your browser developer tools while you use the tool.
How do I remove duplicate lines from a list?
Paste the list with one item per line. This page has Remove duplicate lines ticked already, so the Result is the list without repeats.
Is the comparison case sensitive?
Yes. "Apple" and "apple" are different. Lowercase the list first to treat them as the same.
Does it keep the original order?
Yes. The first copy of each line stays in place, and later copies are removed.
More Find and Replace Text pages
- Find and Replace TextPaste your text, set one or more rules and see the replaced result with a count.
- Find and ReplaceReplace every copy of a word or phrase in your text at once.
- Regex ReplaceReplace text by pattern, with capture groups, in your browser.
- Remove Line BreaksJoin your text into one line by removing every line break.
- Remove Extra SpacesCollapse double spaces and trim every line.
- Replace Multiple Words at OnceRun several find and replace rules on your text in one go.