Beyond mean rating: Probabilistic aggregation of star ratings based on helpfulness. (4th October 2019)

• Record Type: Journal Article
• Authors: Tay, Wenyi; Zhang, Xiuzhen; Karimi, Sarvnaz
• Is Part Of: Journal of the Association for Information Science and Technology. Volume 71:Number 7(2020:Jul.)
• Page Start: 784
• Page End: 799
• Publication Date: 2019-10-04
• Subjects: Information science -- Periodicals; Information technology -- Periodicals; 020.5
• DOI: 10.1002/asi.24297
• Languages: English
• ISSNs: 2330-1635

Abstract

Abstract: The star‐rating mechanism of customer reviews is used universally by the online population to compare and select merchants, movies, products, and services. The consensus opinion from aggregation of star ratings is used as a proxy for item quality. Online reviews are noisy and effective aggregation of star ratings to accurately reflect the "true quality" of products and services is challenging. The mean‐rating aggregation model is widely used and other aggregation models are also proposed. These existing aggregation models rely on a large number of reviews to tolerate noise. However, many products rarely have reviews. We propose probabilistic aggregation models for review ratings based on the Dirichlet distribution to combat data sparsity in reviews. We further propose to exploit the "helpfulness" social information and time to filter noisy reviews and effectively aggregate ratings to compute the consensus opinion. Our experiments on an Amazon data set show that our probabilistic aggregation models based on "helpfulness" achieve better performance than the statistical and heuristic baseline approaches.