Notifications and changing models in production
In this chapter, we have established why the commercial impact of models can decay and ways to track this impact in the DataRobot platform. In cases where the end-to-end prediction process is fully automated and human intervention is limited, it becomes crucial that systems that notify stakeholders of any significant changes in the performance of production models are available. DataRobot can send notifications for significant changes in service health, data drift, and accuracy. These notifications can be set up and configured within the Deployment window:
- From the Settings tab, select Notifications. As shown in Figure 13.12, three options are presented: notifications being sent for all events, notifications for critical events, and no notifications being sent. Notifications for all events are sent by email; all changes to the deployments are emailed to the owner:
Figure 13.12 – Deployment Notifications setup
In Figure 13...
