Meta all the way down: An overview of neuroimaging meta-analyses

Meta-analyses are invaluable tools for navigating the rapidly expanding scientific literature. Given their high value, ensuring the quality of meta-analyses is paramount. We conducted a multifaceted overview, examining each step in a manual neuroimaging meta-analysis on a large scale. We used four novel datasets comprising over 14,000 papers, including fMRI meta-analyses, fMRI studies, studies included in meta-analyses, and studies associated with image data on NeuroVault.

Regarding successes, two-thirds of meta-analyses stated that they followed PRISMA guidelines, and 65% included a flowchart describing their inclusion process.

We point out several areas for improvement. Pre-registration was fairly rare (20%), and only half listed their exact search strategy. There could be a location bias in which papers are included, and many did not include enough studies to be robust against publication bias (68% of meta analyses have less than 30 studies included).

We also offer ideas for future directions. As image based meta-analysis is the gold standard, we have indicated which topics have the most image data available. The potential redundancy of topics can be visualized in our paper, and we recommend future meta-analyses be in conversation with past ones by citing and discussing previous similar work. By addressing these findings, the neuroimaging community can collectively improve the field of neuroimaging meta-analyses.