Transactional data lakes

Let’s introduce this topic with a use case from GreatFin.

Use case for a transactional data lake

GreatFin wants to comply with the right to be forgotten General Data Protection Regulation (GDPR) compliance in Europe. It wants to have the ability in all its systems, including its analytics environments, to easily locate, update, or delete records as and when required.

The need to create transactional data lakes came about due to many business use cases and the challenges associated with them, such as the following:

Use Case	Challenge
Compliance requirements	Compliance and privacy laws—for example, the GDPR requires the deletion of certain data within a specific timeframe and/or across all datasets
Change data capture (CDC)	CDC from the source databases and incremental...