Recommender systems, ground truth, and preference pollution. Issue 2 (23rd June 2022)

• Record Type: Journal Article
• Authors: Adomavicius, Gediminas; Bockstedt, Jesse C.; Curley, Shawn P.; Zhang, Jingjing
• Is Part Of: AI magazine. Volume 43:Issue 2 (2022)
• Page Start: 177
• Page End: 189
• Publication Date: 2022-06-23
• Subjects: Artificial intelligence -- Periodicals; Artificial intelligence -- Computer programs -- Periodicals; System design -- Periodicals; Artificial intelligence -- Technological innovations -- Periodicals; Artificial intelligence -- Industrial applications -- Periodicals; Artificial intelligence -- Educational applications -- Periodicals; Intelligence artificielle -- Périodiques; Intelligence artificielle -- Logiciels -- Périodiques; Conception de systèmes -- Périodiques; Intelligence artificielle -- Innovations -- Périodiques; Intelligence artificielle -- Applications industrielles -- Périodiques; Intelligence artificielle -- Applications en éducation -- Périodiques; Artificial intelligence; Artificial intelligence -- Computer programs; Artificial intelligence -- Educational applications; Artificial intelligence -- Industrial applications; System design; Kunstmatige intelligentie; Electronic journals; Periodicals; Periodicals; 006.305
• DOI: 10.1002/aaai.12055
• Languages: English
• ISSNs: 0738-4602

Abstract

Abstract: Interactions between individuals and recommender systems can be viewed as a continuous feedback loop, consisting of pre‐consumption and post‐consumption phases. Pre‐consumption, systems provide recommendations that are typically based on predictions of user preferences. They represent a valuable service for both providers and users as decision aids. After item consumption, the user provides post‐consumption feedback (e.g., a preference rating) to the system, often used to improve the system's subsequent recommendations, completing the feedback loop. There is a growing understanding that this feedback loop can be a significant source of unintended consequences, introducing decision‐making biases that can affect the quality of the "ground truth" preference data, which serves as the key input to modern recommender systems. This paper highlights two forms of bias that recommender systems inherently inflict on the "ground truth" preference data collected from users after item consumption: non‐representativeness of such preference data and so‐called "preference pollution, " which denotes an unintended relationship between system recommendations and the user's post‐consumption preference ratings. We provide an overview of these issues and their importance for the design and application of next‐generation recommendation systems, including directions for future research.