Sample lakehouse project
Thus far, we have discussed the theoretical aspects of data engineering. The theory often teaches us why it happens; now, it's time to shift our focus to the practical aspects of how it happens. In the following chapters, we will build a data lake using a lakehouse architecture.
We will conduct the practical learning process as if we were part of a live project. You have been hired as a data engineer at a leading big-box store named Electroniz, which sells electronic goods. Electroniz wants to formulate a modern business strategy to diversify revenue by streamlining its data engineering and analytics operations. On the first day on your job, the chief technology officer (CTO) has shared their vision of the future in the form of the following diagram:
Figure 4.5 – Future Electroniz platform
He has also provided some high-level details that may help you kick-start the process, as follows:
- Electroniz sells electronic...
