In this video, learn how to deconstruct model error and how to achieve the optimal tradeoff.
- [Narrator] In the last few lessons,…we've talked about bias, variance,…underfitting, and overfitting.…In this lesson,…we're going to put all of these concepts together…to try to explain what it means…to find the optimal trade-off to minimize that total error.…So let's revisit this plot just one more time.…It highlights that underfitting is on the left,…overfitting is on the right,…and it calls out that there are…some optimal model complexity right in the middle…where we have an ideal trade-off between bias and variance…to achieve minimum total error.…
That's what we're trying to find.…Now let's look at this in a slightly different way.…Just looking at a scale of complexity,…we have this very simple model.…The simple model will underfit our data…and won't learn the true pattern,…and based on the plot in the prior slide,…we know that this means high bias and low variance.…Now on the other extreme,…we have an overly complex model.…This model is overfitting…and essentially just memorizing the training set,…and we know this means low bias and high variance.…
Author
Released
5/10/2019- What is machine learning (ML)?
- ML vs. deep learning vs. AI
- Handling common challenges in ML
- Plotting continuous features
- Continuous and categorical data cleaning
- Measuring success
- Overfitting and underfitting
- Tuning hyperparameters
- Evaluating a model
Skill Level Beginner
Duration
Views
Related Courses
-
Deploying Scalable Machine Learning for Data Science
with Dan Sullivan1h 43m Intermediate
-
Introduction
-
Leveraging machine learning1m 57s
-
What you should know1m 6s
-
Using the exercise files1m 24s
-
-
1. Machine Learning Basics
-
Why Python?5m 49s
-
Common challenges6m 4s
-
2. Exploratory Data Analysis and Data Cleaning
-
Plotting continuous features7m 35s
-
Continuous data cleaning5m 44s
-
Categorical data cleaning4m 33s
-
3. Measuring Success
-
Why do we split up our data?5m 54s
-
-
4. Optimizing a Model
-
What is underfitting?2m 26s
-
What is overfitting?2m 47s
-
Finding the optimal tradeoff3m 16s
-
Hyperparameter tuning6m 22s
-
Regularization2m 31s
-
5. End-to-End Pipeline
-
Overview of the process1m 48s
-
Clean categorical features4m 18s
-
Tune hyperparameters6m 34s
-
-
Conclusion
-
Next steps1m 23s
-
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.
CancelTake notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.
Share this video
Embed this video
Video: Finding the optimal tradeoff