Architecting the Electroniz data lake
In the previous chapter, Chapter 4, Understanding Data Pipelines, we introduced the sample lakehouse project for a leading big-box store named Electroniz that sells electronic goods. We are going to assume that the final contract has been awarded, so the next step is to start building the data lakehouse. Now, it's time to put the skills that we learned in Chapter 4, Understanding Data Pipelines, to good use. Since our company is big on following best practices, the data engineering team has decided to diligently follow all of the steps in the Process of creating a data pipeline section.
As efficient data engineers, we will kick-start the process by conducting discovery sessions with customer groups. Often, conducting discovery sessions and extracting useful information from a customer can be very challenging. At times, you should expect to encounter varying personalities and pushbacks since everyone might not be on board with the global...
