PaaS case study – storage, serverless, and database optimization

In this section, we are going to use a standard Extract, Transform, Load (ETL) architecture for our case study, which is the gold standard of data and analytics architectures for data extraction, processing, and visualization.

Our solution consists of different tiers that are used to extract and process data:

• An ETL layer dedicated to extracting and transforming the data that is fed to our solution from different data sources
• A data warehouse (DW) layer where the application stores all its data in a database or storage services
• A visualization layer on which we use data stored in the data warehouse layer to be the basis of dashboards and reports on top of our data

For this application, we imagine we would need three different environments:

• Development: Used to test new features in our data processing process. We can also use this layer to build new dashboards or to apply changes...