Learn how to set up a Databricks Runtime ML cluster for advanced machine learning scenarios.
- So today, in this course,…we've been focusing on the notebook…as the driving interface for our workflows.…We've been running notebooks, which have been…training machine learning models for most of our workflows,…although that's not required, there are Spark workflows…that don't include machine learning models.…In some cases, we've been creating streams,…and we haven't got yet to the point of serving models.…Now, in the previous section, we looked at…scaling machine learning models that we wrote.…
Of course, distributed machine learning…is really a key workload for Spark and Databricks.…So we're going to dive a little bit deeper…into very complex machine learning workloads.…So as of this recording, Databricks offers…the Databricks runtime for machine learning…as a cluster type, and what this is…is an environment for machine learning and data science.…And I would add the word advanced.…Now this is an area of active development on the platform…and what I'm going to be showing you here is in beta,…so it may have some feature changes…
Author
Released
1/31/2019- Business scenarios for Apache Spark
- Setting up a cluster
- Using Python, R, and Scala notebooks
- Scaling Azure Databricks workflows
- Data pipelines with Azure Databricks
- Machine learning architectures
- Using Azure Databricks for data warehousing
Skill Level Intermediate
Duration
Views
Related Courses
-
Microsoft Azure: Core Functionalities
with David Elfassy2h 52m Intermediate -
Apache Spark Essential Training
with Ben Sullins1h 27m Intermediate
-
Introduction
-
1. Big Data on Azure Databricks
-
Business scenarios for Spark1m 45s
-
Azure Databricks concepts5m 25s
-
2. Core Azure Databricks Workloads
-
Use a notebook with scikit-learn11m 29s
-
3. Scaling Azure Databricks Workloads
-
Optimize a cluster and job4m 31s
-
Run a production-size job7m 32s
-
4. Data Pipelines with Azure Databricks
-
Use Databricks Runtime ML2m 52s
-
Understand ML Pipelines API4m 16s
-
Use ML Pipelines API8m 39s
-
Use distributed ML training9m 59s
-
Understand Databricks Delta3m 41s
-
Use Databricks Delta5m 10s
-
Use Azure Blob storage2m 41s
-
Understand MLflow7m 34s
-
5. Machine Learning Architectures
-
Conclusion
-
Next steps1m 1s
-
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.
CancelTake notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.
Share this video
Embed this video
Video: Use Databricks Runtime ML