Learn about and be able to explain the concept of Hadoop.
- Hadoop is an innovative open-source software solution…that allows you to create a computer cluster quickly.…The two main components of Hadoop are MapReduce and HDFS.…And they are what makes Hadoop…a distributed computing platform.…HDFS stands for Hadoop Distributed File System.…Beyond this, there are also many tools building…on MapReduce and HDFS to provide additional…and specialized features.…
MapReduce divides up a job to multiple computers…and uses task trackers…to ensure that processing can be done on different servers.…HDFS splits up a big dataset…into smaller, more manageable, file sizes…and stores them on multiple computers.…The main computer is called a master…and the other computers are called slaves.…
Let's look at how Hadoop works.…A typical scenario involves applications posting jobs…to a queue, monitored by a Hadoop master,…which in turn, processes them one-by-one…in the sequence of their arrival.…This type of handling tasks is called batch processing.…Fault tolerance is especially critical…in a distributed computing environment like Hadoop.…
- Enabling technologies in data science
- Cloud computing and virtualization
- Installing and working with Proxmox, Hadoop, Spark, and Weka
- Managing virtual machines on Proxmox
- Distributed processing with Spark
- Fundamental applications of machine learning
- Distributed systems and distributed processing
- How Hadoop, Spark, and Weka can work together
Skill Level Beginner
Course organization1m 17s
1. Introduction to Data Science
2. Cloud Computing
3. Distributed File Systems
4. Distributed Processing
5. Machine Learning
6. Case Study
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.