Reviewing the System Causability Scale (SCS)
Created in 1986 by John Brooke, the System Usability Scale (SUS) provides a simple tool to measure the usability of a system’s user interface. It consists of a 10-item questionnaire with 5 response options, allowing respondents to evaluate the quality of products and services from strongly agree to strongly disagree.
Inspired by SUS, SCS, available at https://doi.org/10.1007/s13218-020-00636-z, focuses on measuring the qualitative aspect of XAI systems. SCS meets the XAI principle of meaningfulness by NIST to determine end user perception against explanations provided by XAI systems.
SCS assesses the effectiveness of an XAI user interface in providing explanations to the target audience using a Likert scale questionnaire covering the following scopes:
- A given explanation offers accurate causal factors with relevant granularity
- The context of a given explanation makes sense to the user
- Users can tune the level...