From the course: Spark for Machine Learning & AI

Welcome - Apache Spark Tutorial

From the course: Spark for Machine Learning & AI

Start my 1-month free trial

Welcome

- [Dan] Hi, I'm Dan Sullivan and in this course I'll be describing how to use the Apache Spark Platform for machine learning. We'll start by installing Spark and reviewing the basics of the data frame data structure. We'll cover how to pre-process both numeric and text data so that's ready to use with Spark's MLlib machine learning library. We'll describe multiple algorithms for clustering, classification, and regression. We'll briefly describe a recommendation system as well. Through the course we'll see a common pattern of pre-processing, model training, and evaluation that helps streamline the building of machine learning pipelines. So let's dive into to learning with Spark MLlib.

Contents