Test-retest reliability of the Newest Vital Sign health literacy instrument: In-person and remote administration. Issue 4 (April 2019)

• Record Type: Journal Article
• Authors: Russell, Andrea M.; Patel, Deesha A.; Curtis, Laura M.; Kim, Kwang-Youn A.; Wolf, Michael S.; Rowland, Megan E.; McCarthy, Danielle M.
• Is Part Of: Patient education and counseling. Volume 102:Issue 4(2019)
• Page Start: 749
• Page End: 752
• Publication Date: 2019-04
• Subjects: Health literacy -- Telephone assessment -- Measurement; Patient education -- Periodicals; Health counseling -- Periodicals; Health education -- Periodicals; Counseling -- Periodicals; Patient Education -- Periodicals; Éducation des patients -- Périodiques; Counseling -- Périodiques; Éducation sanitaire -- Périodiques; 615.5071
• DOI: 10.1016/j.pec.2018.11.016
• Languages: English
• ISSNs: 0738-3991

Abstract

Highlights: Few objective health literacy assessments are available for distance administration. One measure, the Newest Vital Sign, is well-suited for distance administration. Reliability of the measure was similar by in-person and phone administration. Preliminary results support the use of the measure over the phone. Abstract: Objective: To determine the reliability of the Newest Vital Sign (NVS) administered via telephone by examining test-retest properties of the measure. Methods: Data were obtained from a randomized controlled trial promoting opioid safe use. Participants were 18 or older and English-speaking. NVS assessment occurred in-person at baseline and in-person or via telephone at follow-up. Intraclass correlation coefficients (ICCs) were used to assess the test-retest reliability using raw NVS scores by mode of administration of the second NVS assessment. Kappa statistics were used to examine test-retest agreement based on categorized NVS score. Internal consistency was measured with Cronbach's alpha. Results: Data from 216 patients (70 completing follow-up in-person and 146 via telephone) were included. Reliability was high (ICCs: in-person = 0.81, phone = 0.70). Agreement was lower for three category NVS score (Kappas: in-person = 0.58, 95% CI [0.39-0.77]; phone = 0.52, 95% CI [0.39-0.65]) compared to two category NVS (Kappas: in-person = 0.65, 95% CI [0.46-0.85]; phone = 0.64, 95% CI [0.51-0.78]). Correlations decreased as time between administrations increased. Internal consistency was moderately high (baseline NVS in-person (α = 0.76), follow-up NVS in-person (α = 0.76), and phone follow-up (α = 0.78). Conclusion: The test-retest properties of the NVS are similar by mode of administration. Practice implications: This data suggests the NVS measure is reliably administered by telephone.