Join Keith McCormick for an in-depth discussion in this video Model assessment vs. business evaluation, part of Machine Learning and AI Foundations: Classification Modeling.
- [Instructor] There are two different aspects…to evaluating the performance of your models,…and they're both important.…So I wanna reference the cross-industry…standard process for data mining.…It's a document that was written about 20 years ago,…and it's a powerful way to help you organize your thinking…and organize your work…when doing predictive analytics projects.…If you wanna read it, the most reliable way…is to simply go down to the references section…of the CRISP-DM Wikipedia page…and you can find the document.…In particular, I wanna reference the following diagram…inside the document.…
Model assessment is ranking your models…on technical criteria.…Criteria like lift…and the performance in a confusion matrix.…And we're gonna be covering multiple methods…of model assessment in this course.…Something that we won't be covering…in this course is evaluation.…Evaluation, really a kind of business evaluation,…is looking at that model performance through the lens…of things like return on investment,…key performance indicators, and management criteria.…
Note: These tutorials are focused on the theory and practical application of binary classification algorithms. No software is required to follow along with the course.
- Why do you need classification?
- Statistical algorithms versus machine learning algorithms
- Combining models using ensembles
- Classification modeling challenges
Skill Level Intermediate
SPSS Statistics Essential Trainingwith Barton Poulson4h 57m Beginner
Machine Learning and AI Foundations: Recommendationswith Adam Geitgey58m 7s Intermediate
1. The Big Picture: Defining Your Classification Strategy
2. How Do I Choose a "Winner"?
3. Algorithms on Parade
4. Common Modeling Challenges
Next steps3m 17s
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.