From the course: Apache Spark Deep Learning Essential Training
Unlock the full course today
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Working with images - Spark DataFrames Tutorial
From the course: Apache Spark Deep Learning Essential Training
Working with images
- [Instructor] In the past, it's been a challenge working with images in Spark, as getting images into data frames was difficult. This has changed with the introduction of deep learning pipelines. Deep learning pipelines now include functions that can load millions of images into a Spark data frame. In typical Spark fashion, this can be done automatically in a distributed way. So let's load an image into a data frame on Spark and head over to our Databricks notebook. Now just to make it easier to see, I'm going to bump up the font on the screen. So let's upload an image to Databricks. So I select data. I select add data. I select browse. I head over to my exercise files to the images folder, and I'm going to select the typewriter. So we want to make a note of where this file is stored in Databricks. So I'm just going to copy that. So that's /FileStore/tables/typewriter.jpg. I'm going to copy that path, and now I'm going to go to workspace. I'm going to select the arrow that points…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.