Testing and troubleshooting
In Chapter 1, we discussed the idea of continuous maintenance, which included continuous integration, continuous delivery, continuous training, and continuous monitoring. This section will build on that and expand on how to test and troubleshoot issues related to ML products on an ongoing basis so that your product is set up for success. Once you’ve made your first deployment, we jump right into the continuous training and continuous maintenance portion of the continuous maintenance process we discussed in Chapter 1.
Remember, managing the performance of your models post-deployment is crucial and it will be a highly iterative, never-ending process of model maintenance. As is the case with traditional software development, you will continue to test, troubleshoot, and fix bugs for your AI/ML products as well. The only difference is that you will also screen for lags in performance and bugs related to your model.
Continuously monitoring your model...