Agent-based Testing: An Automated Approach toward Artificial Reactions to Human Behavior. (18th May 2020)

• Record Type: Journal Article
• Authors: Haim, Mario
• Is Part Of: Journalism studies. Volume 21:Number 7(2020)
• Page Start: 895
• Page End: 911
• Publication Date: 2020-05-18
• Subjects: Algorithmic content curation -- personalization -- quantitative methods -- qualitative methods -- computational journalism -- data collection -- computational social science; Journalism -- Periodicals; 070.4
• DOI: 10.1080/1461670X.2019.1702892
• Languages: English
• ISSNs: 1461-670X

Abstract

ABSTRACT: Vast amounts of news are consumed through algorithmically curated media environments, such as search engines, social networking sites, or news aggregators. This renders algorithmic content curation with much societal relevance and highlights the urgent need for independent and resilient academic research. Therefore, a plethora of methodological approaches have been applied, such as case studies, expert interviews, observations, or agent-based approaches. The paper discusses the applicability of these methodological efforts for journalism studies, showing that all of these approaches face their limitations, especially with regard to external validity, recruitment difficulties, and data reliability. Thereby, agent-based testing represents one of the most promising approaches to overcome plenty of these methodological limitations. Agent-based testing is a systematic and experimental approach that emulates online human behavior to test algorithmically curated media environments under various conditions. For this to be achieved properly, this paper suggests a multitude of settings and requirements to adequately face the technological, legal, and ethical challenges, which come with the empirical investigation of algorithmic content curation. Ultimately, the paper presents both general considerations and practical instructions (using the "ScrapeBot") to employ agent-based testing for journalism studies.