Abstract
This research study aims to investigate the use of novice crowd inspectors for usability inspection with respect to time spent and the cost incurred. This study compares the results of the novice crowd usability inspection guided by a single expert’s heuristic usability inspection (novice crowd usability inspection henceforth) with the expert heuristic usability inspection.
Traditional usability evaluation methods are time-consuming and expensive. Crowdsourcing has emerged as a cost-effective and quick means of software usability evaluation.
In this regard, we designed an experiment to evaluate the usability of two websites and a web dashboard.
The results of the experiment show that novice crowd usability inspection guided by a single expert’s heuristic usability inspection:
a) Finds the same usability issues (w.r.t. content & quantity) as expert heuristic usability inspection.
b) Is cost-effective than expert heuristic usability inspection employing less time duration.
Based on the findings of this research study, we can conclude that the novice crowd usability inspection guided by a single expert’s heuristic usability inspection and expert heuristic usability inspection, on average, gives the same results in terms of issues identified.
•The study investigates crowdsourcing for usability inspection.•The study compared results of novice crowd usability inspection with experts.•The novice crowd was guided by a single expert’s heuristic usability inspection.•The experts performed usability inspection using heuristics.•The study shows that novice crowd usability inspection is effective and economical.