Summary

In this chapter, we went over the broad strokes of ETL pipeline design patterns, and the purpose of each layer of the respective design pattern. We then used the bulk of the chapter to prepare your environment for powerful Python modules that we’ll use to implement ETL pipeline designs in raw Python code. With the stage set, your local environment primed for development, and with an introduction to how we plan to utilize each module in our pipeline designs, we can move on to creating ETL pipelines in Python. In Chapter 4, we’ll start by getting into the nitty gritty details of sourcing insightful data for your pipeline, including some of the industry-standard strategies for data extraction.