Understanding the categories and audience of explainability
As this chapter's opening texts imply, explainability for a DL system becomes increasingly critical, sometimes even mandatory, in highly regulated industries such as financial, legal, governmental, and medical application domains. An example lawsuit partially due to the lack of ML explainability is the case of B2C2 v Quoine (https://www.scl.org/articles/12130-explainable-machine-learning-how-can-you-determine-what-a-party-knew-or-intended-when-a-decision-was-made-by-machine-learning), where automated AI trading algorithms mistakenly placed an order with 250 times the market price for bitcoin trading. The recent successful applications of DL models in production stimulate active and abundant research and development in the explainability area due to the need to understand why and how a DL model works. You may have heard of the term explainable artificial intelligence (XAI), which was started by the US Defense Advanced...