Simulation-Based Sample-Size Calculation for Designing New Clinical Trials and Diagnostic Test Accuracy Studies to Update an Existing Meta-Analysis. (September 2013)

• Record Type: Journal Article
• Authors: Crowther, Michael J.; Hinchliffe, Sally R.; Donald, Alison; Sutton, Alex J.
• Is Part Of: Stata journal. Volume 13:Number 3(2013)
• Page Start: 451
• Page End: 473
• Publication Date: 2013-09
• Subjects: st0304 -- metasim -- metapow -- metapowplot -- meta-analysis -- diagnostic test -- sample size -- evidence-based medicine; Statistics -- Periodicals; Statistics -- Computer programs -- Periodicals; 001.422
• DOI: 10.1177/1536867X1301300302
• Languages: English
• ISSNs: 1536-867X

Abstract

In this article, we describe a suite of commands that enable the user to estimate the probability that the conclusions of a meta-analysis will change with the inclusion of a new study, as described previously by Sutton et al. (2007, Statistics in Medicine 26: 2479–2500). Using themetasim command, we take a simulation approach to estimating the effects in future studies. The method assumes that the effect sizes of future studies are consistent with those observed previously, as represented by the current meta-analysis. Two-arm randomized controlled trials and studies of diagnostic test accuracy are considered for a variety of outcome measures. Calculations are possible under both fixed- and random-effects assumptions, and several approaches to inference, including statistical significance and limits of clinical significance, are possible. Calculations for specific sample sizes can be conducted (by usingmetapow ). Plots, akin to traditional power curves, can be produced (by usingmetapowplot ) to indicate the probability that a new study will change inferences for a range of sample sizes. Finally, plots of the simulation results are overlaid on extended funnel plots by usingextfunnel, described in Crowther, Langan, and Sutton (2012, Stata Journal 12: 605–622), which can help to intuitively explain the results of such calculations of sample size. We hope the command will be useful to trialists who want to assess the potential impact new trials will have on the overall evidence base and to meta-analysts who want to assess the robustness of the current meta-analysis to the inclusion of future data.