From business problem to insight generation
No data science or ML is justified purely by tech; there needs to be a business problem at hand. The business team usually comes up with a prioritized list of problems to solve. The consumers could be an internal or external audience. Dashboards are a great way to communicate insights. The key metrics are constantly tracked and transparently available for everyone in the value chain.
Let us look at the four cooperating pipelines discussed in this chapter through the lens of ownership and handoffs. The skills, tools, and frameworks that these personas wield are sometimes non-overlapping, so it is interesting to consider how they collaborate with one another to create the final product or service and satisfy their stakeholders in the business.
It is fair to say that the data engineer is responsible for the Extract Transform Load (ETL) process and bringing in different data sources. However, they may not have much domain knowledge, so...