COmplete Reporting for Transparent Reproducibility Efforts (CORTRE): a reporting guideline [Stage 1 Registered Report]
Discuss this preprint
Start a discussion What are Sciety discussions?Listed in
This article is not in any list yet, why not save it to one of your lists.Abstract
Concerns about the lack of reproducibility of research have led to numerous investigations across disciplines to quantify the problem. Reproducibility efforts are projects that systematically re-examine previously published findings or previously tested hypotheses. These efforts have played an important role in shaping debates about research credibility, methodological rigour and the incentive structures in academia. Despite the impact of these efforts on science policy (e.g. journal and funder policies), their reporting practices vary. Prior research has shown that many previously published reproducibility efforts do not clearly define the type of reproducibility they are investigating, explain the reasoning for their choice of reproduction success criteria, or explain their approach to the synthesis of results across the included studies. Incomplete reporting hinders interpretation, comparison across efforts and disciplines, and limits opportunities for reanalysis and informing policy. For this reason, the CORTRE project aims to develop a consensus-based reporting guideline for reproducibility efforts. Here, we build on preparatory work identifying a preliminary list of reporting items, based on which we plan to conduct an online, modified Delphi study. Our Delphi panel will be composed of an international and interdisciplinary group of experts with documented experience in designing, conducting, reanalysing, reviewing, publishing or funding reproducibility efforts. After completion of the Delphi exercise, a hybrid consensus meeting will finalise the reporting guideline. This phase 1 registered report details our rationale, methodological approach and the analysis plan for the Delphi exercise.