UtilityNest

Remove Duplicates from Excel or CSV

Choose the columns that define a duplicate, see which rows will be removed and download a cleaned Excel or CSV file. Matching can ignore capital letters and stray spaces, and your original file is never changed.

Works withMicrosoft ExcelGoogle Sheets

How to use Remove Duplicates from Excel or CSV

  1. 1Open an Excel, ODS, CSV or TSV file up to 20 MB and select a sheet if there is more than one.
  2. 2Leave First row contains column names on if the top row holds headings.
  3. 3Compare all columns or select a key such as Email or Order ID. Turn on Ignore letter case or Ignore spaces at the ends if needed.
  4. 4Choose whether to keep the first or last match, then click Preview result.
  5. 5Check the count and open Review removed rows to see a sample. Download Excel or CSV.

Where duplicates come from

A mailing list that was exported twice and pasted together, a sign-up form where people submitted more than once, a contact list combined from two teams, or an order export that overlaps the previous one by a few days. In each case some rows are exact copies and some differ only in how an email was typed. Picking the right key decides which of those are caught.

Choose a key that matches your goal

In a test with two email addresses that differed only in case and surrounding spaces, selecting Email with both ignore options kept the later row when Last occurrence was selected. With all columns selected, both rows stay because their notes differ. Select the last occurrence when later rows contain the updates you want to keep.

What happened when we tested it

We used a contact list of 5,000 rows with four columns and 300 planted repeats: 100 exact copies, 100 with the email typed in capitals and 100 with a trailing space after the email. Comparing all columns removed 101 rows, the exact copies plus one pair of altered copies that happened to match each other. Selecting only Email gave the same 101. Adding Ignore letter case raised it to 200, and adding Ignore spaces at the ends caught all 300, leaving 4,700 rows. Each preview took under half a second in headless Chromium, and the cleaned Excel file was 110 KB.

Picking the right key

Compare all columns when you only want to remove rows that are copies in every detail. Choose a single identifier, such as Email, Order ID or an employee number, when the same record may appear with small differences elsewhere, for example an updated phone number. Combine columns, such as Date and Invoice number, when neither one alone is unique. Avoid columns like Country or Plan as the only key, because many different people share those values.

First or last occurrence?

First occurrence keeps the earliest row in the file and removes later copies. It suits lists where the first entry is the original, such as the first time someone signed up. Last occurrence keeps the row nearest the bottom, which suits exports and logs where newer rows carry corrected details. The kept rows stay in their original order either way.

Review before you export

You can ignore capitalization and spaces at the beginning or end of a cell during matching. Those choices affect comparison only. The values in the kept rows retain their original spelling and spacing. Excel numbers are compared by their stored values, so rounding on screen does not make different numbers match. The removed rows list shows the original row number of each removed row, so you can find it in your source file.

What it does not do

It finds exact matches after the case and spacing options, not similar spellings, so Jon Lee and John Lee stay separate. Spaces inside a value, such as a double space between words, still count. Completely blank rows are left in place. It works on one sheet at a time; to find duplicates across several files, combine them first with Merge Excel and CSV Files. Formulas and formatting are not carried into the new file, only values.

Common problems and fixes

If far fewer rows are removed than you expected, try the ignore options or narrow the key to the column that really identifies a record. If too many are removed, you probably chose a column with repeated values, such as Plan or City, as the only key. If the workbook will not open, remove its password in Excel first. For tables over 200 columns or 1 million cells, split them with Split Excel.

Frequently asked questions

Will it modify the original workbook?

No. The tool creates a new table from the selected sheet and leaves your original file alone.

Does it look for similar spelling?

It matches the selected cells exactly after applying the case and spacing options you chose. Similar names and typos are not automatically grouped.

Which row is kept, the first or the last?

You decide. First occurrence keeps the row nearest the top. Last occurrence keeps the one nearest the bottom, which is usually the newest entry in a log or export.

Can I use two columns together as the key?

Yes. Tick several columns, for example First name and Last name, and a row only counts as a duplicate when all of them match.

Can I see exactly which rows were removed?

Open Review removed rows after the preview. It lists the first removed rows with their original row numbers, and the summary shows the total count.

Is my spreadsheet uploaded?

No. The file is read and cleaned in your browser.