Traditional systems
Traditional systems are good for OLTP (online transaction processing) and some basic Data Analysis and BI use cases. Within the scope, the traditional systems are best in performance and management. The following figure shows a traditional system on a high-level overview:
The steps for typical traditional systems are as follows:
- Data resides in a database
- ETL (Extract Transform Load) processes
- Data moved into a data warehouse
- Business Intelligence Applications can have some BI reporting
- Data can be used by Data Analysis Application as well
When the data grows, traditional systems fail to process, or even store, the data; and even if they do, it comes at a very high cost and effort because of the limitations in the architecture, issue with scalability and resource constraints, incapability or difficulty to scale horizontally.
Database trend
Database technologies have evolved over a period of time. We have RDBMS (relational database), EDW (Enterprise...