A predictive method to measure relative effectiveness

Journal: Contemporary Ergonomics and Human Factors 2013

Pages: 43-50

ISBN: 9781138000421

DOI: 10.1201/b13826-14

Abstract:

Errors and completion are two widely used metrics for measuring the effectiveness of a system in usability testing. Since the two measures focus on different aspects of user output, a holistic view of "effectiveness" is sometimes hard to establish in a comparative studywhich eventually affects understanding different systems' relative effectiveness. The paper proposes a predictive method using an adapted confusion matrix to establish a correlation model to measure a system's relative effectiveness based on its own performance prediction. A case study is also provided to demonstrate how to use this method in real-world practice.

Source: Scopus