Challenge #2 – Total cost of ownership (TCO) is high
Engineers are tasked with making it happen! But how they make it happen is subject to many constraints. The first is cost and the second is time. Issues such as the total cost of running and managing the solution over time and the feasibility of maintaining it operationally also come into focus. The TCO for a well-engineered data solution is affected by the extract, transform, and load (ETL)/extract, load, and transform (ELT) architecture and buy versus build tooling choices for selected adopted solutions and architecture patterns. Please refer to Figure 2.3:
Figure 2.3 – TCO mind map
After reading this section, you will have a greater understanding of ETL/ELT: what it is, its origins and historical evolution, why its costs are so high, and the advantages of build versus buy. You will also learn why legacy master data management architectures are no longer in vogue.