Assessing the impact of school-based mentoring: Common problems and solutions associated with evaluating nonprescriptive youth development programs. Issue 3 (2nd July 2020)

• Record Type: Journal Article
• Authors: McQuillin, Samuel D.; Lyons, Michael D.; Clayton, Rebecca J.; Anderson, Jacqueline R.
• Is Part Of: Applied developmental science. Volume 24:Issue 3(2020)
• Page Start: 215
• Page End: 229
• Publication Date: 2020-07-02
• Subjects: Child development -- Periodicals; Developmental psychology -- Periodicals; 305.231
• DOI: 10.1080/10888691.2018.1454837
• Languages: English
• ISSNs: 1088-8691

Abstract

ABSTRACT: Like many youth development programs, most youth mentoring programs do not have prescribed practices that target specific outcomes. Because the construct of mentoring represents a broad range of potential activities, researchers face a conundrum when making generalizable causal inferences about the effects of this and similar services. On the one hand, researchers cannot make valid experimental inferences if they do not describe what they manipulate. On the other hand, experiments that include prescribed protocols do not generalize to most mentoring programs. In most cases, researchers conducting school-based mentoring program evaluations err on the side of not sufficiently specifying treatment constructs, which limits the field's ability to make practically or theoretically useful inferences about this service. We discuss this reality in light of the fundamental logic of the experimental design and suggest several possible solutions to this conundrum. Our goal is to empower researchers to adequately specify treatments while still preserving the treatment construct validity of this and similar interventions.