Data Security and Privacy

Scale, efficiency, design, and (possibly most importantly) security and privacy all play important roles in navigating the world of data engineering. These components govern how safely and responsibly data is handled, not just as additional layers on top of the existing data landscape. Knowing how to secure and privatize this information is essential, whether you’re working with confidential customer information, top-secret corporate documents, or even just operational data.

Security is a primary concern that must be integrated starting with the design phase and continuing through deployment and maintenance in the world of data engineering. Just as data privacy used to be a nice-to-have, it is now a must-have, thanks to regulations such as the General Data Protection Regulation (GDPR) and the California Consumer Privacy Act (CCPA).

We want you to leave this chapter with a firm grasp of the fundamental ideas and procedures underlying data security...