Sharing data

In Chapter 1, The Story of Data Engineering and Analytics, we discussed the power of data. This has enabled organizations to realize revenue diversification using data monetization. But this dream cannot be effectively realized without sharing data with external parties. In the past, organizations used several data-sharing mechanisms such as emails, SFTP, APIs, cloud storage, and hard drives:

Figure 10.23 – State of data sharing currently

Unfortunately, there are several problems related to these data-sharing methods:

• Complex: These data sharing mechanisms can be complex to set up and use because they may require exchanging keys/passwords and using a variety of different tools.
• Insecure: These mechanisms may not be secure for data-at-rest or data-in-transit. This means the classic man-in-the-middle attack could expose data in cleartext.
• Tracking: There is no clear method available for effectively tracking who shared data...