Processing multiple jobs or transformations in parallel
Running jobs or transformations serially is fine initially, but as more processes come online, the need for executing more in less time becomes very evident. Kettle has the ability to run multiple jobs and transformations at the same time, and in this recipe, we will be going over how to utilize this functionality for both jobs and transformations. The code for this recipe is available on the book's website.
How to do it...
Perform the following steps to learn how to execute job steps in parallel.
Open Spoon and create a new job.
Add a Start step to the canvas. Also, add three Transformation steps.
Create a hop between the Start step and one of the Transformation steps. Repeat the process between the Transformation step and the other two Transformation steps. Your job should now look similar to the following:
Right-click on the first Transformation step and select the Launch next entries in parallel option. Two parallel lines should now appear...
