Microsoft Purview

Microsoft Purview is the most recently added service covered by the DP-203 exam. Its focus is on data documentation, particularly to verify and enforce regulatory compliance.

Note

This section primarily focuses on the Push new or updated data lineage to Microsoft Purview concept of the DP-203: Data Engineering on Microsoft Azure exam.

Even if you are not interested or involved in compliance, having a centralized place to collect and access information about your data services can offer other important advantages. A particularly important one is the ability to track data lineage – “what depends on what.” For instance, you might have developed a Data Factory pipeline that “copies” files from a data lake, which then calls a Spark notebook that creates “staging tables” in a Synapse Analytics dedicated SQL pool, which then calls a data flow that calculates aggregations and stores them in another dedicated SQL pool...