Learn how to test a Hadoop installation with a sample Java program.
- [Instructor] Let's test our Hadoop installation…by running a simply Java program on it.…This program uses MapReduce as its processing engine…and reports the frequencies of words appearing…in a text file.…It specifies a class called TokenizerMapper…which extends the mapper class defined in Hadoop MapReduce.…
The TokenizerMapper reads a text and produces…a key value pair like hello, one.…The second class is IntSumReducer…which extends the reducer class defined in Hadoop MapReduce.…All it does is to combine and reduce…the results provided by the TokenizerMapper class.…Now, let's try to run this program on Hadoop.…
First, create a new directory called wdct under/user/local/…hadoop/bin as I did here.…Next, create a file called word count to Java.…I already created the file and the directory.…Let's see if it's there.…Type ls.…Copy the program from the Hadoop tutorial website.…
You can see the content of the word count that Java file…by typing more WordCount.Java.…Press q, and let's clear the screen.…For our program to compile properly,…
- Enabling technologies in data science
- Cloud computing and virtualization
- Installing and working with Proxmox, Hadoop, Spark, and Weka
- Managing virtual machines on Proxmox
- Distributed processing with Spark
- Fundamental applications of machine learning
- Distributed systems and distributed processing
- How Hadoop, Spark, and Weka can work together
Skill Level Beginner
Course organization1m 17s
1. Introduction to Data Science
2. Cloud Computing
3. Distributed File Systems
4. Distributed Processing
5. Machine Learning
6. Case Study
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.