Fragile Evidence for an Ideological Bias in the Production of Research Findings: Comment on Borjas and Breznau

Read the full article

Discuss this preprint

Start a discussion What are Sciety discussions?

Listed in

This article is not in any list yet, why not save it to one of your lists.
Log in to save this article

Abstract

Borjas and Breznau ("Ideological bias in the production of research findings." Science Advances 12, eadz7173 (2026); hereafter referred to as B&B) recently reported that researchers' ideology influences their empirical findings. Although we were able to reproduce B&B's numerical results, our reanalysis shows that the reported association is not robust. Specifically, the association hinges on a coding error. Data from four teams that contradict the ideology hypothesis were excluded from the analysis due to idiosyncratic variable coding. Correcting this error renders the ideology effect no longer statistically significant. Also, B&B employed a different outcome variable and weighting scheme to that used in a previous paper based on the same data. These two analytical decisions further contribute to the observed ideology effect. Correcting the coding error or using the same specification as in the previous paper renders the ideology effect indistinguishable from zero. Therefore, we conclude that B&B do not provide robust evidence of ideological bias in this context. Instead, the reported association appears to be a statistical artefact resulting from questionable modelling decisions.

Article activity feed