Configuring the development, test, and production environments
A typical software development environment consists of three environments, development, test (or staging), and production. A development environment is where developers create and unit-test the code; in our case, Azure Data Factory pipelines.
When the development is complete, the pipeline is deployed (moved) to the test environment. In the test environment, testing teams perform tests to validate the pipeline against the business requirements. Any bugs raised are noted and passed on to the developers. The developers then fix the bugs in the development environment and push the changes to the test environment. This goes on until the pipeline passes all of the validation and testing. The pipeline is then pushed to the production environment where it works on the actual data.
In some cases, there can be additional environments such as performance testing, which can be used to performance-test the pipeline before it is...
