Evaluation of thresholding methods for activation likelihood estimation meta‐analysis via large‐scale simulations. Issue 13 (10th May 2022)

• Record Type: Journal Article
• Authors: Frahm, Lennart; Cieslik, Edna C.; Hoffstaedter, Felix; Satterthwaite, Theodore D.; Fox, Peter T.; Langner, Robert; Eickhoff, Simon B.
• Is Part Of: Human brain mapping. Volume 43:Issue 13(2022)
• Page Start: 3987
• Page End: 3997
• Publication Date: 2022-05-10
• Subjects: family‐wise error -- FWE -- multiple comparison correction -- neuroimaging meta‐analysis -- significance thresholding -- threshold‐free cluster enhancement cluster extent; Brain mapping -- Periodicals; 611.81
• DOI: 10.1002/hbm.25898
• Languages: English
• ISSNs: 1065-9471

Abstract

Abstract: In recent neuroimaging studies, threshold‐free cluster enhancement (TFCE) gained popularity as a sophisticated thresholding method for statistical inference. It was shown to feature higher sensitivity than the frequently used approach of controlling the cluster‐level family‐wise error (cFWE) and it does not require setting a cluster‐forming threshold at voxel level. Here, we examined the applicability of TFCE to a widely used method for coordinate‐based neuroimaging meta‐analysis, Activation Likelihood Estimation (ALE), by means of large‐scale simulations. We created over 200, 000 artificial meta‐analysis datasets by independently varying the total number of experiments included and the amount of spatial convergence across experiments. Next, we applied ALE to all datasets and compared the performance of TFCE to both voxel‐level and cluster‐level FWE correction approaches. All three multiple‐comparison correction methods yielded valid results, with only about 5% of the significant clusters being based on spurious convergence, which corresponds to the nominal level the methods were controlling for. On average, TFCE's sensitivity was comparable to that of cFWE correction, but it was slightly worse for a subset of parameter combinations, even after TFCE parameter optimization. cFWE yielded the largest significant clusters, closely followed by TFCE, while voxel‐level FWE correction yielded substantially smaller clusters, showcasing its high spatial specificity. Given that TFCE does not outperform the standard cFWE correction but is computationally much more expensive, we conclude that employing TFCE for ALE cannot be recommended to the general user. Abstract : In this study, large‐scale simulations were used to test the performance of threshold‐free cluster enhancement (TFCE) as a means to correct for multiple comparisons in activation likelihood estimation (ALE). We compared TFCE to the current standard cluster‐level family‐wise error correction and found TFCE to perform slightly worse on average.