Risk of bias and low reproducibility of meta-analytic estimates on mental health problems epidemics during the covid-19 pandemic: a meta-research analysis of global evidence on 18,604,876 individuals across 94 countries
Discuss this preprint
Start a discussion What are Sciety discussions?Listed in
This article is not in any list yet, why not save it to one of your lists.Abstract
First-tracking publications to covid-19-related meta-analytic evidences benefited evidence-based policymaking for safeguarding public mental health in this pandemic. However, such makeshifts had been concerned to cause troubling unreliable estimates for mental health problems epidemics. From 98 meta-analytic studies with 18,604,876 individuals across 94 countries published in the pandemic, we found significant risk of bias (ROBs) in publication, with one meta-analysis for being published per five days at the peak. Despite large-scale samples in these meta-analytic evidences, third-nation populations were substantially underrepresented. Of these meta-analyses, 70.6% (57.1%) showed high ROBs in transparency (methodology), and less than one-fifth of them could be empirically reproducible. Publication in high-impact journals, gaining high citations and fast-tracked publication did not improve transparency/reproducibility. By using individual participant data after minimizing these ROBs, we finally re-estimated these mental health problems epidemics to establish benchmarks. This study indicated that research quality/integrity should be still leading when compromising in emergency conditions.