From the course: Analyzing Big Data with Hive

Unlock the full course today

Join today to access over 22,600 courses taught by industry experts or purchase this course individually.

How Hive works

How Hive works - Hive Tutorial

From the course: Analyzing Big Data with Hive

Start my 1-month free trial

How Hive works

- [Narrator] Before we move on to using Hive, I thought it's important to understand how Hive actually works, at least at a high level. So let's start here by understanding just how this modern data ecosystem typically goes. First, you have data providers that generate data. These are external events on things like social networks, business systems that handle all of your organization's processes, and internal apps that may be home-grown and designed with a very different storage and access method in mind. So from these systems, all the data flow in to HDFS, that's the Hadoop File System. And it literally is like placing files on a shared drive. It's really not much different, other than how Hadoop actually handles that and distributes them across multiple different nodes to create that reliable platform. There are a number of ways to do this and literally dozens of platforms to make it happen. But in the end, your data lives in HDFS typically. The format can be anything from tab…

Contents