This section of the chapter will focus on data warehouse refresh types. The recipes we'll be working through will show you how data is usually refreshed in a data warehouse. This section will basically cover the following topics:
- Full historical load: This type of loading technique is usually used once to initialize the data warehouses when they are empty
- Incremental loads: This only loads changes in the source into the data warehouse
- Near real-time loads (on demand): This is usually used to refresh specific tables with the latest changes for reporting
This recipe will show how the data warehouse loads data in batches. The load programs (SSIS packages) are triggered via a schedule. You'll see that all the packages use the framework to filter the data loaded into the staging. This is the basis of the incremental load that...
