Monitoring Data Storage and Data Processing
In Chapter 8, Implementing Data Security, you learned to protect the most valuable asset: data. With clear policies on data retention and meticulous care in handling sensitive information, you learned how data remains secure and inviolable against the ever-present threats of the modern digital environment.
In this chapter, you will learn about the monitoring aspect of data storage and pipelines. By the end of this chapter, you should be able to set up monitoring for any of your Azure Data Services, custom logs, and process logs, using tools such as Azure Log Analytics, monitor stream processing, and schedule monitor pipeline tests. As with the previous chapters, the topic sequence will strictly follow that of the syllabus.
This chapter primarily focuses on the Monitor data storage and data processing topic of the DP-203: Data Engineering on Microsoft Azure exam.
This chapter will equip you with the confidence to effectively answer...