Time for a Paradigm Shift With Computerized Adaptive Testing of General Physical Function Outcomes Measurements. (January 2014)

• Record Type: Journal Article
• Authors: Hung, Man; Franklin, Jeremy D.; Hon, Shirley D.; Cheng, Christine; Conrad, Jillian; Saltzman, Charles L.
• Is Part Of: Foot & ankle international. Volume 35:Number 1(2014:Jan.)
• Page Start: 1
• Page End: 7
• Publication Date: 2014-01
• Subjects: patient-reported outcomes -- orthopedics -- psychometrics -- instrument -- item response theory -- reliability -- validity; Foot -- Abnormalities -- Periodicals; Ankle -- Abnormalities -- Periodicals; Orthopedics -- Periodicals; 617.585
• DOI: 10.1177/1071100713507905
• Languages: English
• ISSNs: 1071-1007

Abstract

Background: Patient-reported outcomes (PRO) are critical to understanding the value of orthopedic treatments. We hypothesized that use of the computerized adaptive testing from a well-characterized physical function item bank would show superiority in assessing all levels of physical function compared to current standard generic physical function outcomes instruments for foot and ankle patients. Methods: In a population of 126 foot and ankle patients we compared the psychometric properties for three PROs: the Physical Function subscale of the Medical Outcomes General Health Survey (SF-36 PF) version 2, the Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF) Computerized Adaptive Test (CAT), and the Lower Extremity (LE) CAT. A Rasch item response theory (IRT) model was applied to assess and compare the fit, dimensionality, reliability, validity, and coverage. Results: The unexplained variance for the PF CAT was 3.9% and the LE CAT was 2.1%, suggesting each instrument explained a single concept. The SF-36 PF had more concerning unexplained variance of 7.6%. We found no floor or ceiling effects for the PF CAT, a minimal floor effect (1.6%) but no ceiling effect for the LE CAT, and an 11.1% floor effect and 9.5% ceiling effect for the SF-36 PF. Conclusion: Foot and ankle clinicians and researchers interested in measuring patient perceived functional outcomes with a generic instrument should consider using either the PF CAT or the LE CAT rather than the SF-36 PF. Further studies comparing these CATs to anatomic specific instruments are needed. Level of Evidence: Level I, diagnostic study.