Playing with the dials of belief: how controllable AI behaviours could modulate human belief and cognition across scales
Discuss this preprint
Start a discussion What are Sciety discussions?Listed in
This article is not in any list yet, why not save it to one of your lists.Abstract
Contemporary generative AI systems, increasingly adapted to human social cognition, are becoming active participants in how people form and revise beliefs. Clinicians have begun to describe AI-associated delusion-centred presentations whose onset or content appears closely associated with users’ extended dialogue with large language models. Many more users report subclinical shifts in conviction and “revelatory” experiences that alter behaviour and world-view without meeting criteria for psychosis. We argue that these phenomena can be understood within a belief-updating framework in which AI agents’ outputs function as testimony about the world, and their interaction configurations (that shape, for example, memory and interpersonal stance) weight the precision of that testimony. On this view AI-associated delusions sit at the extreme of a broader spectrum of epistemic effects, extending from gradual epistemic drift to highly crystallised conviction, situated within a wider ecology of belief shaped by personalised human-AI dyads. We develop a virtual psychopharmacology analogy in which different AI system configurations have effects on belief dynamics that resemble neuromodulatory changes in the precision assigned to social evidence, and we consider how dopaminergic and related states may alter susceptibility to belief-shifting dialogue. We consider how deliberately configured agents might be used to support wellbeing in defined clinical contexts and analyse how the same configurations could be deployed to shape belief and attention at population scale, including in products designed to induce spiritual or epiphanic states, as mechanisms of radicalisation in extremist or cultic contexts, and in persona clones used for political purposes. We conclude that interaction configurations should be treated as modifiable influences on belief and attention, and that governance must address both the concentration of control over these dials, as well as the structural biases that determine whose testimonial perspectives are amplified and whose are smoothed over or ignored.