Learn the basics of how Spark executes jobs and how to use the notebook interface.
- [Instructor] In this section,…we're going to get comfortable…with the environment we'll be using…for the rest of the course, notebooks.…Spark Notebooks are a collection of cells…containing code and markdown.…These cells are used to perform all of our tasks…and our analysis.…Code in Spark Notebooks in addition to markdown…can run Scala, Python, Java, and SQL…and we'll be using a number of these,…mostly Python and SQL.…Now let's dive in.…What we're going to do is we're going to upload…our exercise files to our Databricks Community Edition…which we've already signed up for.…
Then we're going to explore a sample notebook.…And then lastly, we'll create a cluster.…And here in my Databricks Community Edition,…what I'm going to do is go to Workspace,…I'm going to right click and choose Import.…From here, I'm going to click…on where it says Drop File Here,…look for the exercise files from this course…and find the Spark Essentials.dbc then click Open.…Once I get my green check mark, I'll click Import.…And when I have a new folder here,…
- Understanding Spark
- Reviewing Spark components
- Where Spark shines
- Understanding data interfaces
- Working with text files
- Loading CSV data into DataFrames
- Using Spark SQL to analyze data
- Running machine learning algorithms using MLib
- Querying streaming data
- Connecting BI tools to Spark
Skill Level Intermediate
Amazon Web Services for Data Sciencewith Lynn Langit3h 56m Intermediate
1. Introducing Apache Spark
2. Analyzing Data in Spark
3. Using Spark SQL to Analyze Data
4. Running Machine Learning Algorithms Using MLlib
5. Real-Time Data Analysis with Spark Streaming
6. Connecting BI Tools to Spark
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.