Using the master package concept
By using the master package concept, it is possible to parallelize the execution of multiple child packages as determined in the control flow of the master package. Typically, this approach is used to parallelize packages that use separate data sources and data destinations (for instance, processing separate dimension tables in data warehousing scenarios), or to parallelize packages with CPU-intensive operations to run concurrently with packages with I/O-intensive operations.
In the control flow, you use precedence constraints and containers to determine which operations can be performed in parallel, and which of them must be performed in sequence. Through the MaxConcurrentExecutables
package property, you can determine the maximum number of tasks to be performed simultaneously.
For instance, in data warehousing scenarios, fact tables are processed after the associated dimension tables have been processed successfully. Prior to fact processing, most dimension...