Determining the maximum number of worker threads in a data flow
Generally, multiple operations can be performed concurrently in SSIS, as long as sufficient resources are available in the environment hosting the execution. Parallelism can be achieved at several different levels, depending on the nature of the operations and the availability of resources.
Inside a data flow task, the data movements and transformations can be performed on one or more worker threads. Generally, the execution engine will always attempt to parallelize as many of the operations of a particular data flow as possible—in line with the nature of the transformations, and restricted by the available resources.
For instance, provided that enough worker threads are available for a particular transformation, and enough system memory can be allocated for the pipeline buffers, more than one instance of the same transformation can run concurrently. By setting the EngineThreads
data flow property, you can restrict the number...