Spark, YARN, and Hadoop

[Instructor] Once our HDFS is operational,…we can start YARN on top of it.…Though let me correct something…in our directory structure first,…if you've been following along,…you currently have two folders under the Root directory,…the User,…and the Hduser.…What we need to do is create another Hduser folder…under the User folder.…Let's do that now by using the command…H-D-F-S space D-F-S space dash…M-K-D-I-R space slash user slash hduser…Now, we need to copy some files from the local directory…into a new directory called Input…because later on…we'll be running MapReduce which will need some Input files.…

Type:…H-D-F-S space D-F-S space…dash…put…space…slash…usr…slash local…slash hadoop…slash E-T-C…slash hadoop…input…press Enter.…Now we are ready run YARN.…Type:…slash usr…slash local…slash hadoop…slash sbin…slash start…hyphen…yarn dot S-H.…

Press Enter.…You see that YARN is starting…its ResourceManager and NodeManager.…To test our YARN installation,…let's first try to run…a MapReduce distributed processing engine.…Let's open another terminal window.…