Fragile Evidence for an Ideological Bias in the Production of Research Findings: Comment on Borjas and Breznau
Discuss this preprint
Start a discussion What are Sciety discussions?Listed in
This article is not in any list yet, why not save it to one of your lists.Abstract
Borjas and Breznau ("Ideological bias in the production of research findings." Science Advances 12, eadz7173 (2026); hereafter referred to as B&B) recently reported that researchers' ideology influences their empirical findings. Although we were able to reproduce B&B's numerical results, our reanalysis shows that the reported association is not robust. Specifically, the association hinges on a coding error. Data from four teams that contradict the ideology hypothesis were excluded from the analysis due to idiosyncratic variable coding. Correcting this error renders the ideology effect no longer statistically significant. Also, B&B employed a different outcome variable and weighting scheme to that used in a previous paper based on the same data. These two analytical decisions further contribute to the observed ideology effect. Correcting the coding error or using the same specification as in the previous paper renders the ideology effect indistinguishable from zero. Therefore, we conclude that B&B do not provide robust evidence of ideological bias in this context. Instead, the reported association appears to be a statistical artefact resulting from questionable modelling decisions.