Planning your platform
This section covers topics for discussion before and during the DI Platform setup process. The role of the data team often determines the platform setup. One of Databricks’ ideal attributes is that the technology stack is unified, making the setup and collaboration between teams more straightforward. The data team reporting structure frequently determines the border where one role ends and another begins, rather than the actual data product workflow. Luckily, we do not have to worry because the DI Platform serves data engineers, scientists, and analysts alike.
In Figure 2.1, you can see an end-to-end lakehouse architecture and the components in Databricks.
Figure 2.1 – Overview of a lakehouse architecture and how Databricks DI Platform fits this paradigm
The DI Platform consists of one or more Databricks accounts. Most of the time, companies only have one. However, there are situations where companies require extra...
