Chapter 10: Explainable AI - Using LIME and SHAP

Let's play out a quick scenario. You are sitting in the doctor's office after having just received your annual physical. The doctor looks over your results and then casually mentions that you have a 95% chance of having a heart attack in the next month. What is your next question? "Why?" you ask. "I'm not sure," replies the doctor.

What would be your reaction to the doctor's answer in this situation? Is that good enough, or would you like a bit more information? If you are like most people, you might want to know if there was anything you could do to prevent it, or maybe there was a mix-up with your blood work and you have nothing to fear.

The use of AI models is just going to increase in the years to come with AutoML and other low and no-code options that allow those with less technical expertise to create models. You see a lot of models, but you need to be able to explain how things were...