Bayes factors cannot provide evidence for the null hypothesis
Listed in
This article is not in any list yet, why not save it to one of your lists.Abstract
It is becoming increasingly common in the psychology and neuroscience literature to use Bayes factors to provide evidence in favor of the null hypothesis. The most common approach reports a Bayes factor that compares the null hypothesis to a “default” alternative. This approach can show that the data is more likely to have been generated under the null hypothesis than under the specific alternative tested, but it cannot provide evidence for the absence of an effect. In fact, analyses using “default” alternatives can return evidence in favor of the null hypothesis when the data is consistent with medium to large effects. I show that common interpretations of these Bayes factor analyses are misleading, and I provide examples and simulations that help to understand what a Bayes factor in favor of the null does and does not tell us. I argue that Bayes factors have no special ability to help us understand null effects when compared to frequentist methods such as equivalence testing and confidence intervals.