From the course: Azure Spark Databricks Essential Training

Unlock the full course today

Join today to access over 22,600 courses taught by industry experts or purchase this course individually.

Azure Databricks and machine learning

Azure Databricks and machine learning

From the course: Azure Spark Databricks Essential Training

Start my 1-month free trial

Azure Databricks and machine learning

“

- [Instructor] Another pattern in pipelining is Azure Machine Learning and Databricks. Now Databricks as we've seen in the earlier patterns in this section is used for preprocessing, so cleaning up data if you were on a massive scale. And that is a perfectly legitimate use for Databricks. However, in addition to that, I really commonly see Databricks being used for scaling machine learning because of the complexity of the compute. And we spent a good amount of time in this course looking at the implementation of various types of machine learning, whether it's SciKit Learn, Spark ML, or even some of the newer, highly distributive networks, such as Tensor Flow in this course. So there's a great variety of choices with in Databricks itself. Now in addition to that, in the Azure ecosystem, there's an ever growing variety of machine learning services which are manifested as APIs. There's also Azure Cognitive services which supports custom ML models and other types of machine learning which…

Contents