Open science in qualitative evaluations

This article discusses how open science principles—often rooted in quantitative epistemologies—and qualitative evaluation practices can complement each other and explores strategies for evaluators and researchers to consider adopting in their practices. Although the qualitative and quantitative approaches to knowledge creation may be perceived as being in conflict, many practices and values can be viewed as different expressions of the shared goals of rigor and transparency. We describe practices like data, process, and outcome sharing as activities that already align with open science values and encourage evaluators to consider practices like preregistration, registered reports, and replication as possible areas for evaluators to expand into. We also encourage evaluators to contribute to conversations about transparency, community engagement, evaluating effectiveness, and avoiding harm. A flexible, additive approach to evaluation and research projects can allow all parties to draw on each other’s strengths for more rigorous, comprehensive, transparent, and community-centered work. Finally, we suggest a few starting places for evaluators who are interested in incorporating open science practices and researchers who are interested in conducting qualitative evaluations.