Configuring error handling for the transformation

In all our examples of ADF pipelines till now, we have seen only success cases. ADF also provides a separate flow to handle errors and failures. In fact, ADF supports four different flows, as shown in the following screenshot:

Figure 8.29 – ADF activity flows

In case of any errors in any step of the pipeline, we can build an error-handling branch that can be used to either fix the errors or store them for future actions. The following screenshot shows one such pipeline. You will have to connect the orange line to the error-handling activity:

Figure 8.30 – Creating an error-handling pipeline

Select the Execute Pipeline activity and link the Failure flow (the orange line) from any of the other activities to it. This new Execute Pipeline activity could be a full-fledged pipeline in itself, as with the transformation pipelines that we saw earlier in the chapter, or it could...