From the course: Cloud Hadoop: Scaling Apache Spark

Unlock the full course today

Join today to access over 22,600 courses taught by industry experts or purchase this course individually.

Spark shell

Spark shell - Apache Spark Tutorial

From the course: Cloud Hadoop: Scaling Apache Spark

Start my 1-month free trial

Spark shell

“

- [Instructor] Gosh, that was a lot of concepts to go over. I bet you're eager to get started programming. Well, here we are in our community edition of Databricks. But if we go to Clusters, we took so long going over concepts that our cluster actually stopped. So, as I said when I talked about this earlier, one of the great things about this is, all of your objects are persistent. So you'll remember, for example, we added the avro-tools library, and we added the iris table. So those are still there. We just don't have a cluster. So what we're going to need to do is just re-create the cluster. Let's call it demo again and just create the cluster. And this'll take a minute or two. And then once it comes up, we'll start programming against it. Okay, so here's my cluster. So what I'm going to do is I'm going to go back Databricks here. And I'm going to say New Notebook. And I'm going to call this one demo, and it's going…

Contents