Understanding data-sharing challenges in a data mesh
A data mesh is an architecture that proposes decentralizing data ownership and centralizes governance of these decentralized data products or landing zones. While it provides agility and independence to the products and the product teams, it does raise multiple new challenges. In many previous chapters, we have discussed these challenges: deploying and managing multiple landing zones, managing data access across different data products, discovering decentralized data, and many other such challenges. We found solutions to make them easier and more manageable.
When we propose a data mesh architecture to companies, the very first thought that comes to their mind is, how will data be shared across this mesh? Will each data product pull data from across the mesh? Will that not create duplicate copies of data across the mesh? What about security across different access points (APs)?
To answer these questions and many more, let us...