From the course: Machine Learning and AI Foundations: Value Estimations
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Gradient boosting: A versatile machine learning algorithm
From the course: Machine Learning and AI Foundations: Value Estimations
Gradient boosting: A versatile machine learning algorithm
- [Instructor] In this section we'll learn about gradient boosting, a powerful machine learning algorithm that works well in many different kinds of real-world problems. It can handle complex patterns and data that linear models can't handle. Gradient boosting is an ensemble learning algorithm. Ensemble learning algorithms use many simple machine learning models that work together to give a more accurate answer than any individual model could by itself. The basic data structure behind gradient boosting is a decision tree. A decision tree is a model where you have branching decision points and you determine a final value by following a path through the tree. A simple decision tree looks like this. This decision tree has one decision point. If the house if larger than 1,000 square feet, it predicts that the house should be worth an extra $50,000. And if it's smaller, then $50,000 less. To create more nuance predictions, we can add a second layer to this decision tree with more decision…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.