Time to publication among completed diagnostic accuracy studies: associated with reported accuracy estimates. Issue 1 (December 2016)

• Record Type: Journal Article
• Authors: Korevaar, Daniël; van Es, Nick; Zwinderman, Aeilko; Cohen, Jérémie; Bossuyt, Patrick
• Is Part Of: BMC medical research methodology. Volume 16:Issue 1(2016)
• Page Start: 1
• Page End: 10
• Publication Date: 2016-12
• Subjects: Reporting bias -- Time lag bias -- Diagnostic accuracy -- Sensitivity and specificity -- Research waste -- Trial registration; Medicine -- Research -- Methodology -- Periodicals; 610.72
• DOI: 10.1186/s12874-016-0177-4
• Languages: English
• ISSNs: 1471-2288

Abstract

Abstract Background Previous evaluations have documented that studies evaluating the effectiveness of therapeutic interventions are not always reported, and that those with statistically significant results are published more rapidly than those without. This can lead to reporting bias in systematic reviews and other literature syntheses. We evaluated whether diagnostic accuracy studies that report promising results about the performance of medical tests are also published more rapidly. Methods We obtained all primary diagnostic accuracy studies included in meta-analyses of Medline-indexed systematic reviews that were published between September 2011 and January 2012. For each primary study, we extracted estimates of diagnostic accuracy (sensitivity, specificity, Youden's index), the completion date of participant recruitment, and the publication date. We calculated the time from completion to publication and assessed associations with reported accuracy estimates. Results Forty-nine systematic reviews were identified, containing 92 meta-analyses and 924 unique primary studies, of which 756 could be included. Study completion dates were missing for 285 (38 %) of these. Median time from completion to publication in the remaining 471 studies was 24 months (IQR 16 to 35). Primary studies that reported higher estimates of sensitivity (Spearman's rho = −0.14;p = 0.003), specificity (rho = −0.17;p < 0.001), and Youden's index (rho = −0.22;p < 0.001) had significantly shorter times to publication. When comparing time to publication in studies reporting accuracy estimates above versus below the median, the median number of months was 23 versus 25 for sensitivity (p = 0.046), 22 versus 27 for specificity (p = 0.001), and 22 versus 27 for Youden's index (p < 0.001). These differential time lags remained significant in multivariable Cox regression analyses with adjustment for other study characteristics, with hazard ratios of publication of 1.06 (95 % CI 1.02 to 1.11;p = 0.007) for logit-transformed estimates of sensitivity, 1.09 (95 % CI 1.04 to 1.14;p < 0.001) for logit-transformed estimates of specificity, and 1.09 (95 % CI 1.03 to 1.14;p = 0.001) for logit-transformed estimates of Youden's index. Conclusions Time to publication was significantly shorter for studies reporting higher estimates of diagnostic accuracy compared to those reporting lower estimates. This suggests that searching and analyzing the published literature, rather than all completed studies, can produce a biased view of the performance of medical tests.