Construct Validity of a Tool for Assessing Competency in Polypectomy. (13th March 2011)

• Record Type: Journal Article
• Authors: Gupta, S; Man, R; Suzuki, N; Vance, M E; Thomas-Gibson, S
• Is Part Of: Gut. Volume 60:(2011)Supplement 1
• Page Start: A128
• Page End: A128
• Publication Date: 2011-03-13
• Subjects: Assessment -- Competency -- construct -- polypectomy -- validity; Gastroenterology -- Periodicals; 616.33
• DOI: 10.1136/gut.2011.239301.272
• Languages: English
• ISSNs: 0017-5749

Abstract

Abstract : Introduction: There is a void in the formal assessment of technical skills in polypectomy which is now considered an integral part of colonoscopy. It has been shown to reduce the incidence of colorectal cancer but does have associated complications. Polypectomy competency assessment should arguably be a part of the certification process for all endoscopists. A polypectomy competency assessment tool (Direct Observation of Polypectomy Skills-DOPyS) has been developed and its construct validity, examined. Methods: To determine construct validity of the DOPyS. Thirty-two polypectomy videos (incorporating the endoscopic view only) were collected from real patient procedures performed by two experienced (>1000 colonoscopies) endoscopists (17 videos) and six intermediate level (100–500 colonoscopies) endoscopists (15 videos). The videos were edited to include only the entire polypectomy procedure, arranged in random order, and assessed blindly by two experienced endoscopy assessors. Both assessors underwent a polypectomy assessment training session using the DOPyS prior to scoring. The DOPyS incorporates a 33-point procedure-specific checklist and an overall competency score. The differences in overall competency scores (range 1–4; scores ≥3=competency) for the expert and intermediate groups were compared, and considered significant (p value<0.05) using Fisher's exact test. Results: Conclusion: The results of the analysis suggested that both blinded assessors were able to reliably differentiate between endoscopists of varying experience using the DOPyS (the expert group had higher scores than the intermediate group). Large-scale validation studies are required to further strengthen evidence for the use of this tool for routine polypectomy competency assessment. Table 1 PWE-009 Comparison of Overall Competency Scores for the Expert and Intermediate group of Endoscopists. Assessor Overall score Expert group number of videos (%) Intermediate group number of videos (%) p Value 1 Score <3 2 (12%) 7 (47%) 0.049 Score ≥3 15 (88%) 8 (53%) 2 Score <3 1 (6%) 12 (80%) <0.001 Score ≥3 16 (94%) 3 (20%) Competing interests: None.