From the course: Spark for Machine Learning & AI
Welcome - Apache Spark Tutorial
From the course: Spark for Machine Learning & AI
Welcome
- [Dan] Hi, I'm Dan Sullivan and in this course I'll be describing how to use the Apache Spark Platform for machine learning. We'll start by installing Spark and reviewing the basics of the data frame data structure. We'll cover how to pre-process both numeric and text data so that's ready to use with Spark's MLlib machine learning library. We'll describe multiple algorithms for clustering, classification, and regression. We'll briefly describe a recommendation system as well. Through the course we'll see a common pattern of pre-processing, model training, and evaluation that helps streamline the building of machine learning pipelines. So let's dive into to learning with Spark MLlib.
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.