Studying the Best Can Mislead: Selection Bias in Expertise Research

Much of what we think we know about how people reach exceptional performance could be distorted by who gets studied. Studying elite performers has been highly informative for understanding the cognitive mechanisms of expertise, but less so for explaining how expertise develops. Elite samples are filtered on the very success researchers want to explain. Predictors that appear beneficial early in development often weaken or reverse among world-class adults. These findings are commonly interpreted as evidence that the route to excellence changes at higher performance levels. We show that they can also arise from selection alone. Outstanding adult performance is rare, depends on many factors, and can be reached in more than one way. Focusing exclusively on those who succeed can create misleading trade-offs, make relationships look smaller, and make weak positive and weak negative effects look the same. Simulations and longitudinal data from chess and athletics confirm these patterns and show that they depend strongly on who remains in the sample and how narrowly elite performance is defined. We propose a framework for separating prediction within selected groups from explanations of how excellence develops more broadly. This helps researchers study excellence without mistaking selected-sample patterns for evidence about development.