Easy-to-follow video tutorials help you learn software, creative, and business skills.Become a member

Using the Remove Duplicates command

From: Managing and Analyzing Data in Excel 2010

Video: Using the Remove Duplicates command

Getting rid of duplicate records in a database, or a large list, addresses a problem that occurs frequently in large lists of data. Finally, as of Excel 2007, a new command called Remove Duplicates is now available on the Data tab. In large lists sometimes you don't see duplicates that easily. I happen to see one here in Row 5. That's Juan Bishop. Here is another Juan Bishop here in Row 10. Now, the names being the same alone isn't enough to indicate that the record is duplicated, but a quick look here, I think you can see pretty clearly with Social Security number's and phone number's duplicated. That's a duplicate record.

Using the Remove Duplicates command

Getting rid of duplicate records in a database, or a large list, addresses a problem that occurs frequently in large lists of data. Finally, as of Excel 2007, a new command called Remove Duplicates is now available on the Data tab. In large lists sometimes you don't see duplicates that easily. I happen to see one here in Row 5. That's Juan Bishop. Here is another Juan Bishop here in Row 10. Now, the names being the same alone isn't enough to indicate that the record is duplicated, but a quick look here, I think you can see pretty clearly with Social Security number's and phone number's duplicated. That's a duplicate record.

Now, in prior versions of Excel, you needed to use something called the Advanced Filter. But with this new capability-- and by the way, the data does not have to be in any particular order. It doesn't have to be sorted here. We can remove duplicates relatively quickly. In this list here, I am going to double- click the bottom edge of a cell first of all just to see how far down it goes. It goes to Row 762. Double- click the top edge down here. Let's proceed with Remove Duplicates. As with other commands in the Data tab, as always before proceeding with commands, if you know that your data is altogether with no empty rows or no empty columns, we can simply click on a single cell on our data and start the process.

Remove Duplicates. Now we possibly don't need to check every single column. In fact, you could say here well, as long as the Social Security number and the phone numbers are the same, we know we've got a duplicate. But on the other hand, these are all checked and it's not going to hurt anything here. If one of those is different though, will not have a duplicate record. It will not be deleted. So we had 762 rows. Let's proceed here using all these columns. Click OK. 20 duplicate values.

Now, I would quibble a little bit with the wording there, but we're talking about rows or portions of rows, records perhaps, found and removed. We're down to 741. So we get down to Row 742 because of the titles. You could see only there is a Juan Bishop here. There had been one in Row 10. Not there anymore. Down at the bottom, used to go to Row 762. Now it goes to row 742. So we did eliminate 20 rows here. Excel's new feature called Remove Duplicates is fast and easy. It works ideally with large or small lists to quickly eliminate duplicate information.

Show transcript

This video is part of

Image for Managing and Analyzing Data in Excel 2010
Managing and Analyzing Data in Excel 2010

27 video lessons · 22352 viewers

Dennis Taylor
Author

 
Expand all | Collapse all
  1. 1m 32s
    1. Welcome
      54s
    2. Using the exercise files
      38s
  2. 25m 18s
    1. Sorting from the Sort menu
      4m 37s
    2. Sorting from the toolbar
      4m 2s
    3. Multi-key sorting
      3m 4s
    4. Sorting based on the order of data in custom lists
      4m 44s
    5. Sorting by color font, color background, or icon
      3m 57s
    6. Sorting columns
      2m 11s
    7. Sorting data in random order
      2m 43s
  3. 19m 1s
    1. Using single- and multiple-column text filtering
      5m 8s
    2. Taking a look at special numeric filters
      1m 54s
    3. Harnessing special date filters
      2m 5s
    4. Creating a top-ten list by value or percent
      3m 11s
    5. Creating custom filters
      1m 40s
    6. Copying and sorting filtered lists
      3m 7s
    7. Recognizing the limitations of standard filtering
      1m 56s
  4. 11m 16s
    1. Setting up subtotals
      4m 20s
    2. Creating multiple levels and copying subtotals
      6m 56s
  5. 13m 22s
    1. Using the Advanced Filter for complex OR criteria
      4m 30s
    2. Using the Advanced Filter for complex multiple-field criteria
      5m 37s
    3. Using the Advanced Filter to create unique lists from repeating field data
      3m 15s
  6. 10m 44s
    1. Using the Remove Duplicates command
      2m 30s
    2. Using a specialized array formula to identify data that's been duplicated
      5m 10s
    3. Using an array formula to count the number of unique items in a list
      3m 4s
  7. 10m 31s
    1. Using SUMIF, COUNTIF, and related functions for quick data analysis
      6m 48s
    2. Using database functions like DSUM, DAVERAGE, and DMAX
      3m 43s
  8. 34s
    1. Next steps
      34s

Start learning today

Get unlimited access to all courses for just $25/month.

Become a member
Sometimes @lynda teaches me how to use a program and sometimes Lynda.com changes my life forever. @JosefShutter
@lynda lynda.com is an absolute life saver when it comes to learning todays software. Definitely recommend it! #higherlearning @Michael_Caraway
@lynda The best thing online! Your database of courses is great! To the mark and very helpful. Thanks! @ru22more
Got to create something yesterday I never thought I could do. #thanks @lynda @Ngventurella
I really do love @lynda as a learning platform. Never stop learning and developing, it’s probably our greatest gift as a species! @soundslikedavid
@lynda just subscribed to lynda.com all I can say its brilliant join now trust me @ButchSamurai
@lynda is an awesome resource. The membership is priceless if you take advantage of it. @diabetic_techie
One of the best decision I made this year. Buy a 1yr subscription to @lynda @cybercaptive
guys lynda.com (@lynda) is the best. So far I’ve learned Java, principles of OO programming, and now learning about MS project @lucasmitchell
Signed back up to @lynda dot com. I’ve missed it!! Proper geeking out right now! #timetolearn #geek @JayGodbold
Share a link to this course

What are exercise files?

Exercise files are the same files the author uses in the course. Save time by downloading the author's files instead of setting up your own files, and learn by following along with the instructor.

Can I take this course without the exercise files?

Yes! If you decide you would like the exercise files later, you can upgrade to a premium account any time.

Become a member Download sample files See plans and pricing

Please wait... please wait ...
Upgrade to get access to exercise files.

Exercise files video

How to use exercise files.

Learn by watching, listening, and doing, Exercise files are the same files the author uses in the course, so you can download them and follow along Premium memberships include access to all exercise files in the library.


Exercise files

Exercise files video

How to use exercise files.

For additional information on downloading and using exercise files, watch our instructional video or read the instructions in the FAQ.

This course includes free exercise files, so you can practice while you watch the course. To access all the exercise files in our library, become a Premium Member.

Join now "Already a member? Log in

Are you sure you want to mark all the videos in this course as unwatched?

This will not affect your course history, your reports, or your certificates of completion for this course.


Mark all as unwatched Cancel

Congratulations

You have completed Managing and Analyzing Data in Excel 2010.

Return to your organization's learning portal to continue training, or close this page.


OK
Become a member to add this course to a playlist

Join today and get unlimited access to the entire library of video courses—and create as many playlists as you like.

Get started

Already a member?

Become a member to like this course.

Join today and get unlimited access to the entire library of video courses.

Get started

Already a member?

Exercise files

Learn by watching, listening, and doing! Exercise files are the same files the author uses in the course, so you can download them and follow along. Exercise files are available with all Premium memberships. Learn more

Get started

Already a Premium member?

Exercise files video

How to use exercise files.

Ask a question

Thanks for contacting us.
You’ll hear from our Customer Service team within 24 hours.

Please enter the text shown below:

The classic layout automatically defaults to the latest Flash Player.

To choose a different player, hold the cursor over your name at the top right of any lynda.com page and choose Site preferencesfrom the dropdown menu.

Continue to classic layout Stay on new layout
Exercise files

Access exercise files from a button right under the course name.

Mark videos as unwatched

Remove icons showing you already watched videos if you want to start over.

Control your viewing experience

Make the video wide, narrow, full-screen, or pop the player out of the page into its own window.

Interactive transcripts

Click on text in the transcript to jump to that spot in the video. As the video plays, the relevant spot in the transcript will be highlighted.

Are you sure you want to delete this note?

No

Your file was successfully uploaded.

Thanks for signing up.

We’ll send you a confirmation email shortly.


Sign up and receive emails about lynda.com and our online training library:

Here’s our privacy policy with more details about how we handle your information.

Keep up with news, tips, and latest courses with emails from lynda.com.

Sign up and receive emails about lynda.com and our online training library:

Here’s our privacy policy with more details about how we handle your information.

   
submit Lightbox submit clicked
Terms and conditions of use

We've updated our terms and conditions (now called terms of service).Go
Review and accept our updated terms of service.