Usability evaluation methods for the web: A systematic mapping study

Context: In recent years, many Usability Evaluation Methods (UEMs) have been employed toevaluate Web applications. However, many of these applications still do not meet most customers’usability expectations and many companies have folded as a result of not considering Webusability issues. No studies currently exist with regard to either the use of usability evaluationmethods for the Web or the benefits they bring. Objective: The objective of this paper is to summarize the current knowledge that is available asregards the Usability Evaluation Methods (UEMs) that have been employed to evaluate Webapplications over the last 14 years. Method: A systematic mapping study was performed to assess the UEMs that have been used byresearchers to evaluate Web applications and their relation to the Web development process.Systematic mapping studies are useful for categorizing and summarizing the existing informationconcerning a research question in an unbiased manner. Results: The results show that around 39% of the papers reviewed reported the use of evaluationmethods that had been specifically crafted for the Web. The results also show that the type ofmethod most widely used was that of User Testing. The results identify several research gaps, suchas the fact that around 90% of the studies applied evaluations during the implementation phase ofthe Web application development, which is the most costly phase in which to perform changes. Alist of the UEMs that were found is also provided in order to guide novice usability practitioners. Conclusions: From an initial set of 2703 papers, a total of 206 research papers were selected forthe mapping study. The results obtained allowed us to reach conclusions concerning the state-of-the-art of UEMs for evaluating Web applications. This allowed us to identify several researchgaps, which subsequently provided us with a framework in which new research activities can bemore appropriately positioned, and from which useful information for novice usabilitypractitioners can be extracted.