Learn about cleaning data in a spreadsheet.
- [Instructor] Before getting to work in Python,…let's see an example of how we may reorganize…and clean a data set before ingesting it.…As we will see later in the course,…we can clean data directly in Python.…However, sometimes it's easier…to do it manually in a spreadsheet.…Furthermore, often experimental data…are collected using a spreadsheet.…In the 2017 article Data Organization in Spreadsheets,…Broman and Woo give a number of very good tips.…
First of all, organize the data in a big rectangle,…with rows for subjects and columns for variables.…Create a data dictionary for units.…Leave no empty cells.…And save the data in plain text files.…And also, always be consistent.…There are many details for which…we may need to worry about consistency.…Use consistent case or subject identifiers,…use consistent variable names.…
For categorical variables, use consistent codes.…Use the same code for all missing values.…If your data are divided in multiple files,…use a consistent format for all dates.…Divide data between files in a consistent fashion.…
- Installing and setting up Python
- Importing and cleaning data
- Visualizing data
- Describing distributions and categorical variables
- Using basic statistical inference and modeling techniques
- Bayesian inference
Skill Level Intermediate
R Statistics Essential Trainingwith Barton Poulson5h 59m Intermediate
SPSS Statistics Essential Trainingwith Barton Poulson4h 57m Beginner
1. Installation and Setup
2. Importing and Cleaning Data
3. Visualizing and Describing Data
4. Introduction to Statistical Inference
5. Introduction to Statistical Modeling
Next steps1m 55s
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.