Empirical validation of an automatic usability evaluation method. (June 2015)

• Record Type: Journal Article
• Authors: Cassino, Rosanna; Tucci, Maurizio; Vitiello, Giuliana; Francese, Rita
• Is Part Of: Journal of visual languages & computing. Volume 28(2015)
• Page Start: 1
• Page End: 22
• Publication Date: 2015-06
• Subjects: Interactive systems evaluation -- Usability engineering -- Summative usability evaluation; Visual programming languages (Computer science) -- Periodicals; Visual programming (Computer science) -- Periodicals; Programming languages (Electronic computers) -- Semantics -- Periodicals; Langages de programmation visuelle -- Périodiques; Programmation visuelle -- Périodiques; Langages de programmation -- Sémantique -- Périodiques; Programming languages (Electronic computers) -- Semantics; Visual programming (Computer science); Visual programming languages (Computer science); Periodicals; Electronic journals; 005
• DOI: 10.1016/j.jvlc.2014.12.002
• Languages: English
• ISSNs: 1045-926X

Abstract

Abstract: Today, the success of a software application strongly depends on the usability of its interface, so the evaluation of interfaces has become a crucial aspect of software engineering. It is recognized that automatic tools for graphical user interface evaluation may greatly reduce the costs of traditional activities performed during expert evaluation or user testing in order to estimate the success probability of an application. However, automatic methods need to be empirically validated in order to prove their effectiveness with respect to the attributes they are supposed to evaluate. In this work, we empirically validate a usability evaluation method conceived to assess consistency aspects of a GUI with no need to analyze the back-end. We demonstrate the validity of the approach by means of a comparative experimental study, where four web sites and a stand-alone interactive application are analyzed and the results compared to those of a human-based usability evaluation. The analysis of the results and the statistical correlation between the tool׳s rating and humans׳ average ratings show that the proposed methodology can indeed be a useful complement to standard techniques of usability evaluation. Highlights: Empirical validation of the effectiveness of the automatic evaluation USherlock. Discussion on the benefits gained against human based heuristic evaluation. The ultimate goal is the combined use of automatic and ordinary evaluation methods.