The diamond ratio: A visual indicator of the extent of heterogeneity in meta‐analysis. (2nd November 2021)

• Record Type: Journal Article
• Authors: Cairns, Maxwell; Cumming, Geoff; Calin‐Jageman, Robert; Prendergast, Luke A.
• Is Part Of: British journal of mathematical & statistical psychology. Volume 75:Part 2(2022)
• Page Start: 201
• Page End: 219
• Publication Date: 2021-11-02
• Subjects: Heterogeneity -- Confidence Intervals -- R -- Meta‐Analysis; Psychometrics -- Periodicals; Psychology -- Mathematical models -- Periodicals; Psychology -- Statistical methods -- Periodicals; 150.727
• DOI: 10.1111/bmsp.12258
• Languages: English
• ISSNs: 0007-1102

Abstract

Abstract : The result of a meta‐analysis is conventionally pictured in the forest plot as a diamond, whose length is the 95% confidence interval (CI) for the summary measure of interest. The Diamond Ratio (DR) is the ratio of the length of the diamond given by a random effects meta‐analysis to that given by a fixed effect meta‐analysis. The DR is a simple visual indicator of the amount of change caused by moving from a fixed‐effect to a random‐effects meta‐analysis. Increasing values of DR greater than 1.0 indicate increasing heterogeneity relative to the effect variances. We investigate the properties of the DR, and its relationship to four conventional but more complex measures of heterogeneity. We propose for the first time a CI on the DR, and show that it performs well in terms of coverage. We provide example code to calculate the DR and its CI, and to show these in a forest plot. We conclude that the DR is a useful indicator that can assist students and researchers to understand heterogeneity, and to appreciate its extent in particular cases.