At the end of this video the student will know how to calculate differences in time using date functions as well as other options available in Hive.
- [Narrator] So at this point you've heard me talk…about dates and how they're special.…Here,…we're going to dive into working with dates in Hive.…Now Hive has date functions,…just like all data platforms do.…And these functions handle different date formats,…and perform operations on dates,…such as addition and subtraction.…What we're going to do to start,…is find the difference between two dates,…a simple operation.…Then,…we'll calculate monthly aggregations,…using a date value.…And lastly,…we'll find the last day of the month from a given day.…
Here in my clutter environment,…I'm going to open up my scripts…and we're looking at seven dash four.…I'm going to copy this into my editor.…And we'll start by just finding the difference…between two dates.…So,…here we have our project complete date…and our order date,…so we're going to use the date diff function,…which will tell us the number of days between those two.…That would be in our case as a consulting company…with our sales data here,…the duration of the project.…
This course shows how to use Hive to process data. Instructor Ben Sullins starts by showing you how to structure and optimize your data. Next, he explains how to get Hue, the Hadoop user interface, to leverage HiveQL when analyzing data. Using the newly configured option, he then demonstrates how to load data, create aggregate tables for fast query access, and run advanced analytics. He also takes you through managing tables and putting functions to use. This course is designed to help you find new ways to work with datasets so you can answer the tough data science questions that come your way.
- Defining data structures in Hive
- Selecting data
- Joining tables
- Manipulating data
- Filtering results
- Aggregating data
- Using built-in aggregate functions
- Mastering built-in table-generating functions
- Using CUBE and ROLLUP
- Using clauses: WHERE and HAVING
- Using LIKE, JOIN, and SEMI JOIN
- Using functions: String, math, date, and conditional