From the course: Data Science Tools of the Trade: First Steps

Unlock the full course today

Join today to access over 22,600 courses taught by industry experts or purchase this course individually.

Spark: Installation

Spark: Installation

From the course: Data Science Tools of the Trade: First Steps

Start my 1-month free trial

Spark: Installation

“

- [Instructor] Let's download Spark first by visiting spark.apache.org. Click on download. Choose the latest version of Spark and use the option Pre-built for Apache Hadoop 2.7 and later. Click on the download Spark link. Pick your favorite mirror link and click. Click on okay. Type cd ~/Downloads, press enter. Type ls. You can see the Spark file we just downloaded here. It is in a zipped TAR archive format and we need to unzip and unTAR it by typing tar - zxvf and then the name of the file, spark -2.3.0. Press enter. Let's check what's in the newly created Spark directory by typing ls and then cd spark-2.3.0-bin-hadoop 2.7. Type ls. Looks like everything went well. Now, let's become root by typing sudo -i. Press enter. Type the password. Let's move the temporary directory in the downloads folder to a proper location by first creating a slash user slash local slash Spark directory. Type mkdir, make directory, /usr/local/spark. Press enter. Type mv /home/jungwooryoo/Downloads/spark/…

Contents