From the course: Amazon Web Services Machine Learning Essential Training
Join today to access over 22,500 courses taught by industry experts or purchase this course individually.
Spark ML and Databricks AWS for real-time apps - Amazon Web Services (AWS) Tutorial
From the course: Amazon Web Services Machine Learning Essential Training
Spark ML and Databricks AWS for real-time apps
- [Instructor] In this next example we're going to consider a solution using Machine Learning for near real time predictions. Now this is a scenario where virtual servers are often used because you want to have a persistent running compute set of instances. You could of course use plain old EC2 or EMR with Hadoop Spark. In this case this architecture shows databricks, and you might remember that databricks is a commercial vendor that runs on top of either Amazon or Azure, and they're the home of the majority of the open source Apache Spark commuter community. So I've found because databricks packages their solution as software as a service, very easy to setup and use as you might remember from our movies earlier in this course. Databricks includes a notebook interface that allows you to quickly setup clusters and work with notebooks to try out your experiments, and then you can actually turn them into production jobs. In addition to that, they have a very optimized implementation of…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.