Create a scatter plot with the two linear regression models using pandas and ggplot from Python.
- [Narrator] Okay,…now that we've evaluated…our linear regression model…we've built it, we've pulled in data…we've done everything we need to do…it's time to bring it home…and actually visualize our results.…So, we'll start by visualizing…a linear regression model here…and we need to first create SQL tableS.…So that's the easiest way in Spark…to actually then come to visualization.…We'll join those tables together…and then we'll set up our visualization.…Here in Databricks…I have the exercise file 4.5 loaded…and I'm going to attach this to our cluster…running Spark 1.6.…
I'm going to go ahead and run all of these steps…above here…just to load my data…pull everything in…make sure it's good to go.…And once all that is ready to go…I want to create my table…with the predictions…so I want these tables to have call names.…So I'm going to specify a little array here…of the columns…and it's going to be OrderMonthYear, SaleAmount,…and Prediction.…Then I'm going to create a dataframe…using parallelize…and I'm going to look…at the predictions results set…
- Understanding Spark
- Reviewing Spark components
- Where Spark shines
- Understanding data interfaces
- Working with text files
- Loading CSV data into DataFrames
- Using Spark SQL to analyze data
- Running machine learning algorithms using MLib
- Querying streaming data
- Connecting BI tools to Spark
Skill Level Intermediate
1. Introducing Apache Spark
2. Analyzing Data in Spark
3. Using Spark SQL to Analyze Data
4. Running Machine Learning Algorithms Using MLlib
5. Real-Time Data Analysis with Spark Streaming
6. Connecting BI Tools to Spark
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.