From the course: Data Science Foundations: Data Engineering
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Handling inferred members
From the course: Data Science Foundations: Data Engineering
Handling inferred members
- [Instructor] Sometimes, when we have data coming in, there aren't dimension records for the associated event record, so we call these inferred members, and I like to think of it as the situation where when we have new dimensions, so let's say a new client appears, prior to that client record existing in our lookup table. So just like we looked at the client table previously or the zip code table, if we have a new record in there, we need to handle that new record somehow, and it looks like this. We have our client and our sales table, and we're loading these with new sales data coming in. What we have to do first is check the client table, so, if there are new clients that weren't already loaded in our new sales feed, we need to add those to the client table and then get back that business key, that client ID. Then we can finally load that new sales data into the sales table. This is what's known as inferred member support. It's sort of a traditional data warehousing term, but when…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.