Learn how to connect Jupyter Notebooks to Spark.
- [Instructor] So, the last thing to talk about here are…other ways to connect to Spark.…So, it now supports a lot of BI Tools,…and it does that through JDBC and ODBC connections.…So Simba, a company that makes drivers…for a lot of other platforms…made one back in 2014 enabling JDBC and ODBC connections…from your BI Tools,…whether that be QlikView, Tableau, Power BI,…or whatever else you may be using…directly into Spark.…So, if you have something that uses ODBC or JDBC…you can connect to Spark using those drivers.…
Of course, you can also use Spark SQL directly…from a cloud environment like Databricks,…from a notebook like Jupyter, or from the command shell.…
Author
Ben Sullins
Released
4/3/2017- Understanding Spark
- Reviewing Spark components
- Where Spark shines
- Understanding data interfaces
- Working with text files
- Loading CSV data into DataFrames
- Using Spark SQL to analyze data
- Running machine learning algorithms using MLib
- Querying streaming data
- Connecting BI tools to Spark
Skill Level Intermediate
Duration
Views
-
Introduction
-
Welcome1m 7s
-
-
1. Introducing Apache Spark
-
Understanding Spark3m 4s
-
Origins of Spark1m 56s
-
Where Spark shines2m 1s
-
Overview of Databricks4m 18s
-
-
2. Analyzing Data in Spark
-
Working with text files7m 36s
-
Exploring data in DataFrames4m 47s
-
Saving your results1m 53s
-
3. Using Spark SQL to Analyze Data
-
Creating tables3m 48s
-
Querying data with Spark SQL3m 20s
-
-
4. Running Machine Learning Algorithms Using MLlib
-
5. Real-Time Data Analysis with Spark Streaming
-
Streaming context setup5m 1s
-
Querying streaming data4m 29s
-
6. Connecting BI Tools to Spark
-
Conclusion
-
Next steps54s
-
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.
Share this video
Embed this video
Video: Other connection options