The Video Engagement Scale (VES): measurement properties of the full and shortened VES across studies. Issue 3 (4th May 2023)

• Record Type: Journal Article
• Authors: Lehmann, Vicky; Hillen, Marij A.; Verdam, Mathilde G. E.; Pieterse, Arwen H.; Labrie, Nanon H.M.; Fruijtier, Agnetha D.; Oreel, Tom H.; Smets, Ellen M.A.; Visser, Leonie N.C.
• Is Part Of: International journal of social research methodology. Volume 26:Issue 3(2023)
• Page Start: 305
• Page End: 318
• Publication Date: 2023-05-04
• Subjects: Measurement properties -- validity -- video engagement -- experimental study design -- video-vignette; Sociology -- Research -- Periodicals; 300.72
• DOI: 10.1080/13645579.2022.2052697
• Languages: English
• ISSNs: 1364-5579

Abstract

ABSTRACT: The Video Engagement Scale (VES) is a quality indicator to assess engagement in experimental video-vignette studies, but its measurement properties warrant improvement. Data from previous studies were combined ( N = 2676) and split into three subsamples for a stepped analytical approach. We tested construct validity, criterion validity, reliability, and measurement invariance. Confirmatory factor analysis (CFA) reiterated poor fit of the previously suggested subscales. An alternative 2-factor structure is presented, which was cross-validated and further shortened (VES-sf). Reliability of both subscales ( Immersion, Emotional Impact ) was very high (α > .86). Multi-group CFAs demonstrated partial and complete measurement invariance among male/female and differently educated participants respectively. Invariance between healthy versus ill participants was not established, but CFAs supported the VES-sf structure in both groups separately. To conclude, we provide the VES-sf with sound measurement properties and demonstrated the appropriateness of comparing certain subgroups. Overall, we recommend the VES-sf to assess engagement/ecological validity in video-vignette research.