Dealing with SCDs
The term slowly changing dimension, which we usually refer to with its short form, SCD, is a data warehousing concept introduced by the amazing Ralph Kimball. You can learn more about Ralph Kimball here: https://www.kimballgroup.com/about-kimball-group/.
The SCD concept deals with moving a specific set of data from one state to another. Imagine we have a human resources (HR) system; Stephen Jiang
is a Sales Manager
, having 10 sales representatives in his team. The following screenshot shows the sample data for our scenario:
Today, Stephen Jiang
has been promoted to Vice President of Sales
, so his team grows in size from 10 to 17. The following screenshot shows the changes:
Another example is when a customer's address changes in...