From the course: Analyzing Big Data with Hive
Unlock the full course today
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
How Hive works - Hive Tutorial
From the course: Analyzing Big Data with Hive
How Hive works
- [Narrator] Before we move on to using Hive, I thought it's important to understand how Hive actually works, at least at a high level. So let's start here by understanding just how this modern data ecosystem typically goes. First, you have data providers that generate data. These are external events on things like social networks, business systems that handle all of your organization's processes, and internal apps that may be home-grown and designed with a very different storage and access method in mind. So from these systems, all the data flow in to HDFS, that's the Hadoop File System. And it literally is like placing files on a shared drive. It's really not much different, other than how Hadoop actually handles that and distributes them across multiple different nodes to create that reliable platform. There are a number of ways to do this and literally dozens of platforms to make it happen. But in the end, your data lives in HDFS typically. The format can be anything from tab…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.