Architecture foundation

When developing a modern data-engineered solution, you will want to be level set on the foundational technologies required for success. There will be many themes and disrupting technology cycles to be dealt with. One such technical area is the concept of the data lake and the data mesh.

Data lake, mesh, and fabric

So, what are some examples of modern data organizations that need to be understood as you roll out a modern data engineering solution? Consider the data lake {https://packt-debp.link/PoLMQS} concept, which was coined in 2011 by James Dixon {https://packt-debp.link/oO3q9r}. A data lake is a system/repository of data stored in raw format (for example, object blobs/files). So, what has happened since 2011? The data lake became the dumping ground for everything! Unfortunately, over time, data lakes have led to a loss of value. A way of properly understanding data was also lost when the context was not captured in a time series-sensitive metadata...