Conducting Linguistic Experiments Online With OpenSesame and OSWeb. Issue 4 (20th June 2022)

• Record Type: Journal Article
• Authors: Mathôt, Sebastiaan; March, Jennifer
• Is Part Of: Language learning. Volume 72:Issue 4(2022)
• Page Start: 1017
• Page End: 1048
• Publication Date: 2022-06-20
• Subjects: experimental design -- data collection -- online experiments -- methods showcase; Language and languages -- Periodicals; Language and languages -- Study and teaching -- Periodicals; Linguistics; 407
• DOI: 10.1111/lang.12509
• Languages: English
• ISSNs: 0023-8333

Abstract

Abstract: In this Methods Showcase Article, we outline a workflow for running behavioral experiments online, with a focus on experiments that rely on presentation of complex stimuli and measurement of reaction times, which includes many psycholinguistic experiments. The workflow that we describe here relies on three tools: OpenSesame/OSWeb (open source) provides a user‐friendly graphical interface for developing experiments; JATOS (open source) is server software for hosting experiments; and Prolific (commercial) is a platform for recruiting participants. These three tools integrate well with each other and together provide a workflow that requires little technical expertise. We discuss, and illustrate through an example study, several challenges that are associated with running online experiments, including temporal precision, the implementation of counterbalancing, data quality, and issues related to privacy and ethics. We conclude that these challenges are real but surmountable, and that in many cases online experiments are a viable alternative to laboratory‐based experiments. Abstract :