Understanding the value of interpretation

Explainable AI will be essential if users are to understand, appropriately trust, and effectively manage this incoming generation of artificially intelligent partners.

This was the outlook of DARPA in their Explainable Artificial Intelligence (XAI) report in 2016 (https://bit.ly/3JU9yql).

Whether you agree or not with AI being used in military endeavors, it is being used in this field. Being able to know why certain outcomes are achieved is critical in this space and many others. AI isn't used just in the more traditional role the military plays, but also when trying to discern the third- and fourth-order impacts on the military supply chain when resources such as planes are moved from one military base to another.

Knowing the difference between interpreting and explaining

There is a lot of value in knowing what features are giving you the results you get, and there is even more in being able to explain why it matters. One...