From the course: Data Science Foundations: Data Engineering

Unlock the full course today

Join today to access over 22,600 courses taught by industry experts or purchase this course individually.

Performing master data lookups

Performing master data lookups

From the course: Data Science Foundations: Data Engineering

Start my 1-month free trial

Performing master data lookups

- [Instructor] Alright, now we're going to get in and look at how to actually do some master data lookups. First, we're going to create a client staging table for our client information. Then we'll create the cleansed version of that, so the second step in actually processing our client data. We'll load that table, and then we'll use that table to update the ClientID in Cleansed_Sales. So, we have a client table which has the IDs and then we have our sales table, which doesn't have them. So what we're going to do essentially is setup that clients table and then update our sales table. So here in my virtual environment, I have part of 4_1.sql from the exercise files. I'm going to create this table, stage_clients. As before it's just a raw dump, so everything is a string. Then we're using that custom CSV processor, and we've already loaded the data in an earlier clip into this location, so if you haven't done that, go back and check that out. Basically, we're just copying our clients…

Contents