Assessment of service provider competency for child and adolescent psychological treatments and psychosocial services in global mental health: evaluation of feasibility and reliability of the WeACT tool in Gaza, Palestine. (22nd February 2021)

• Record Type: Journal Article
• Authors: Jordans, M. J. D.; Coetzee, A.; Steen, H. F.; Koppenol-Gonzalez, G. V.; Galayini, H.; Diab, S. Y.; Aisha, S. A.; Kohrt, B. A.
• Is Part Of: Global mental health. Volume 8(2021)
• Publication Date: 2021-02-22
• Subjects: Palestine, -- psychological treatment, -- quality of care, -- therapist competency; Mental health -- Periodicals; Mental health care -- Periodicals; Mental health policy -- Periodicals; World health -- Periodicals; 362.19689
• DOI: 10.1017/gmh.2021.6
• Languages: English
• ISSNs: 2054-4251

Abstract

Abstract: Background: There is a scarcity of evaluated tools to assess whether non-specialist providers achieve minimum levels of competency to effectively and safely deliver psychological interventions in low- and middle-income countries. The objective of this study was to evaluate the reliability and utility of the newly developed Working with children – Assessment of Competencies Tool (WeACT) to assess service providers' competencies in Gaza, Palestine. Methods: The study evaluated; (1) psychometric properties of the WeACT based on observed role-plays by trainers/supervisors ( N = 8); (2) sensitivity to change among service provider competencies ( N = 25) using pre-and-post training WeACT scores on standardized role-plays; (3) in-service competencies among experienced service providers ( N = 64) using standardized role-plays. Results: We demonstrated moderate interrater reliability [intraclass correlation coefficient, single measures, ICC = 0.68 (95% CI 0.48–0.86)] after practice, with high internal consistency ( α = 0.94). WeACT assessments provided clinically relevant information on achieved levels of competencies (55% of the competencies were scored as adequate pre-training; 71% post-training; 62% in-service). Pre-post training assessment saw significant improvement in competencies ( W = −3.64; p < 0.001). Conclusion: This study demonstrated positive results on the reliability and utility of the WeACT, with sufficient inter-rater agreement, excellent internal consistency, sensitivity to assess change, and providing insight needs for remedial training. The WeACT holds promise as a tool for monitoring quality of care when implementing evidence-based care at scale.