World's simplest browser-based utility for removing repeated lines from text. Load your text in the input form on the left and you'll instantly get text with no duplicate lines in the output area. Powerful, free, and fast. Load text lines – get unique text lines. Created by developers from team Browserling.
World's simplest browser-based utility for removing repeated lines from text. Load your text in the input form on the left and you'll instantly get text with no duplicate lines in the output area. Powerful, free, and fast. Load text lines – get unique text lines. Created by developers from team Browserling.
With this tool, you can remove repeated text lines from any text. It offers three different processing modes for doing this operation. The first mode removes all duplicate lines across the entire text (i.e. leaving only the first unique instance of each line). The second mode removes only the duplicate lines that are consecutive (i.e. if three equivalent lines follow each other, it removes the second and third ones). The third mode removes all lines of text that occur two or more times (i.e. leaving only absolutely unique lines of text). You can further refine these operations by adjusting five different options. The first option preserves all newlines. What this means is that newlines get passed through and never get removed. This is useful if you're working with paragraphs of text and want to preserve the logical separation that newlines provide between the paragraphs. The second option filters all newlines. What this means is that all newlines are treated as regular lines and are checked for uniqueness. The third option deletes all newlines from the input and only non-blank lines are left. The fourth option trims lines before processing them. What this means is that all whitespace symbols (such as tabs and newlines) at the beginning of every text line are removed prior to continuing with finding unique lines. The fifth option allows you to sort the lines after they have been filtered. Textabulous!
With this tool, you can remove repeated text lines from any text. It offers three different processing modes for doing this operation. The first mode removes all duplicate lines across the entire text (i.e. leaving only the first unique instance of each line). The second mode removes only the duplicate lines that are consecutive (i.e. if three equivalent lines follow each other, it removes the second and third ones). The third mode removes all lines of text that occur two or more times (i.e. leaving only absolutely unique lines of text). You can further refine these operations by adjusting five different options. The first option preserves all newlines. What this means is that newlines get passed through and never get removed. This is useful if you're working with paragraphs of text and want to preserve the logical separation that newlines provide between the paragraphs. The second option filters all newlines. What this means is that all newlines are treated as regular lines and are checked for uniqueness. The third option deletes all newlines from the input and only non-blank lines are left. The fourth option trims lines before processing them. What this means is that all whitespace symbols (such as tabs and newlines) at the beginning of every text line are removed prior to continuing with finding unique lines. The fifth option allows you to sort the lines after they have been filtered. Textabulous!
This example loads a lengthy movie list in the input but there are a lot of duplicates. After processing the input, all repeated movie titles are removed and only unique text lines are left in the output. Also all accidental blank lines are removed and the output is alphabetically sorted.
In this example, we remove only the repeated duplicate lines from a summer ideas list. When performing this operation, the algorithm only looks at the previous line to find out if it's duplicated. Some ideas have whitespace symbols in front so we delete them as well.
In this example, we're trying to find people whom we have forgotten to reply to. We load a list of the most recent emails we have corresponded with from our inbox in the input of this tool. The emails which we have already replied to are duplicated in the list, while those which we haven't replied to yet appear in the list only once. To quickly extract the unique emails and remove all duplicate ones, we select the "Leave Absolutely Unique Text Lines" mode and find two addresses in the out of this tool.
You can pass input to this tool via ?input query argument and it will automatically compute output. Here's how to type it in your browser's address bar. Click to try!
Find Levenstein distance of two text fragments.
Create a list of all words in text.
Lemmatize all words in text.
Apply stemming to all words in text.
Add color to punctuation symbols in text.
Add color to letters in text.
Add color to words in text.
Add color to sentences in text.
Add color to paragraphs in text.
Add slight perturbations to the given text.
Mess up characters in your text.
Generate text using random words.
Generate lorem ipsum placeholder text.
Generate a crossword puzzle from the given words.
Convert English text to Braille writing system.
Convert Braille symbols to English text.
Convert text characters to their corresponding code points.
Convert numeric character code points to text.
Convert CSV data to plain text columns.
Convert plain text columns to a CSV file.
Create a list of all 3-grams.
Encode the entire text to a single number.
Decode text that was encoded as a number back to text.
Divide text into chunks of certain size.
Apply formatting and modification functions to text.
Count the number of punctuation marks and other sybmols in text.
Count the number of letters in text.
Count the number of sentences in text.
Count the number of paragraphs in text.
Apply text transformation rules to any text.
Analyze text for interesting patterns.
Add accent marks to text letters.
Add a counter before every letter in text.
Add a counter before every word in text.
Add a counter before every sentence in text.
Add a counter before every paragraph in text.
Interleave the letters or words of the given text fragments.
Mess up the spacing between letters in any text.
Extract all emails from text.
Extract all URLs from text.
Extract all numbers from text.
Extract all countries from text.
Extract all cities from text.
Convert text to punycode.
Convert punycode to text.
Encode text to Baudot encoding.
Decode Baudot-encoded text.
Encode text to base32 encoding.
Decode base32-encoded text.
Encode text to base45 encoding.
Decode base45-encoded text.
Encode text to base58 encoding.
Decode base58-encoded text.
Encode text to Ascii85 encoding.
Decode Ascii85-encoded text.
Encode text to base65536 encoding.
Decode base65536-encoded text.
Encode text to nettext encoding.
Decode nettext-encoded text.
Convert written text into natural sounding voice.
Convert a voice recording to text.
Encode text to UTF8 encoding.
Decode UTF8-encoded text.
Encode text to UTF16 encoding.
Decode UTF8-encoded text.
Encode text to UTF32 encoding.
Decode UTF32-encoded text.
Encode text to IDN.
Decode IDN-encoded text.
Convert text to Unix-to-Unix encoding.
Decode Unix-to-Unix-encoded text.
Convert text to Xxencoding.
Decode Xxencoded text.
Encode text to QP encoding.
Decode QP-encoded text.
Remove all HTML tags from Text.
Remove all XML tags from Text.
Remove new line symbols from the end of each text line.
Find the difference between two text fragments.
Generate various text typos.
Generate a mirror reflection of text.
Cut out a piece of text.
Grep text for regular expression matches.
Extract first symbols, words, or lines from text.
Extract last symbols, words, or lines from text
Return the first letter of each word in text.
Make every paragraph to be two paragraphs in the given text.
Create an image from all words in text.
Create a circle from all letters in text.
Create a spiral from all letters in text.
Create a circle from all words in text.
Create a matrix of any dimensions from letters in text.
Create a matrix of any dimensions from words in text.
Create a spiral from all words in text.
Split the input text into syllables.
Write any text on an LCD display (with LCD font).
Convert text to 2-dimensional drawing.
Convert text to 3-dimensional drawing.
Create a horizontally or vertically scrolling text.
Create a GIF animation of a text message.
Create a GIF animation that slowly reveals a text message.
Decode text using the wrong encoding and create garbled text.
Try to find original text from garbled mojibaked text.
Make text harder to read.
Generate the entire alphabet from a to z.
Print the alphabet in random order.
Delete swear words from text.
Edit text in a neat browser-based editor.
Subscribe to our updates. We'll let you know when we release new tools, features, and organize online workshops.
Enter your email here
We're Browserling — a friendly and fun cross-browser testing company powered by alien technology. At Browserling we love to make people's lives easier, so we created this collection of online text tools. Our tools are focused on getting things done and as soon as you load your text in the input of any of our tools, you'll instantly get the result. Behind the scenes, our online text tools are actually powered by our web developer tools that we created over the last couple of years. Check them out!
