A predictive method to measure relative effectiveness
Authors: Jiang, N.
Editors: Anderson, M.
Publisher: Taylor & Francis
Errors and completion are two widely used metrics for measuring the effectiveness of a system in usability testing. Since the two measures focus on different aspects of user output, a holistic view of “effectiveness” is sometimes hard to establish in a comparative study which eventually affects understanding different systems’ relative effectiveness. The paper proposes a predictive method using an adapted confusion matrix to establish a correlation model to measure a system’s relative effectiveness based on its own performance prediction. A case study is also provided to demonstrate how to use this method in real-world practice.