Data analytics pipeline

Data modeling is the process of using data to build predictive models. Data can also be used for descriptive and prescriptive analysis. But before we make use of data, it has to be fetched from several sources, stored, assimilated, cleaned, and engineered to suit our goal. The sequential operations that need to be performed on data are akin to a manufacturing pipeline, where each subsequent step adds value to the potential end product and each progression requires a new person or skill set.

The various steps in a data analytics pipeline are shown in the following diagram:

Steps in data analytics pipeline

1. Extract Data
2. Transform Data
3. Load Data
4. Read & Process Data
5. Exploratory Data Analysis
6. Create Features
7. Build Predictive Models
8. Validate Models
9. Build Products

These steps can be combined into three high-level categories: data engineering, data science...