Implementing data modeling techniques
In this section, we will look at the layers of the Medallion architecture. We will discuss the design considerations for the layers, possible data modeling techniques to employ, and how to apply Delta Lake features.
Consider the airlines dataset example that we have been working on throughout this book. Let’s extend that example here to visualize how the various layers can be brought to life on the Lakehouse.
The bronze layer
As we discussed in the previous section, the bronze layer is an as-is replica of source systems and hence the data models will follow that of source systems. Also, the bronze layer tables should ideally be in Delta format for optimal near-real-time query experience and data versioning.
A typical airlines system will contain source systems for functions such as booking, ticketing, check-in, flights, loyalty, and more. Each source system will contain a host of tables.
Consider the following diagram:
...
