AuthorsA. Følstad, B. C. D. Anda, and D. I. K. Sjøberg
TitleUsability Inspection: a Comparative Study of the Evaluator Performance of Work-Domain Experts Vs. Usability Experts
Publication TypeJournal Article
Year of Publication2008

When applications that are tailored to work domains of which usability experts have little knowledge are evaluated, the usefulness of usability inspection methods is challenged. To counter this challenge, usability inspections with work-domain experts have been explored, but no empirical research has been reported on such experts' performance as evaluators. The present study compares the performance of work-domain experts and usability experts, with respect to the validity and thoroughness of their evaluations. Fifteen work-domain experts and 12 usability experts participated. The applied inspection method was group-based expert walkthrough. The basis for comparison was user test results. The work-domain experts produced equally valid but less thorough evaluation results than the usability experts. On average, two work-domain experts produced results of similar quality to those of one usability expert, which implies that work-domain experts may substitute for usability experts if the number of evaluators is increased. These results should be taken into account when developing future usability inspection methods with work-domain experts as evaluators.

Citation KeySimula.SE.197