A predictive method to measure relative effectiveness

Editors: Anderson, M.

Publisher: Taylor & Francis

ISBN: 9780203744581

Abstract:

Errors and completion are two widely used metrics for measuring the effectiveness of a system in usability testing. Since the two measures focus on different aspects of user output, a holistic view of “effectiveness” is sometimes hard to establish in a comparative study which eventually affects understanding different systems’ relative effectiveness. The paper proposes a predictive method using an adapted confusion matrix to establish a correlation model to measure a system’s relative effectiveness based on its own performance prediction. A case study is also provided to demonstrate how to use this method in real-world practice.

Source: Manual