Using Changed Data Capture (CDC) - consistent set

Unlike the simple CDC method demonstrated in the previous section, the use of consistent set CDC does address the problem of how to coordinate the flow of data into a target system when there are explicitly defined foreign key relationships between one or more target tables. One possible problem with simple CDC is that while you are processing changes for the parent records, more data can arrive, possibly including both parent and child records. In this case, once you are done processing the parents, you want to make sure that the children records that you will process belong only to these parents, and that the children that have arrived in the middle of your processing will only be processed with the next round of processing. The KMs for consistent CDC will solve this problem by allowing us to mark all the records that are ready for processing before we start processing any of them through a windowing strategy. The essence of consistent...