Diverse Perceptual Representations Across Visual Pathways Emerge from A Single Objective

Read the full article See related articles

Discuss this preprint

Start a discussion What are Sciety discussions?

Listed in

This article is not in any list yet, why not save it to one of your lists.
Log in to save this article

Abstract

How the human brain supports diverse behaviours has been debated for decades. The canonical account posits distinct pathways in perceptual processing, such as the “what” and “where/how” visual streams, though their developmental origins and interdependency remain contested. Here, we show that families of deep neural network models develop features that accurately predict hours of human neural and behavioural recordings. By using these models as proxies for the brain and systematically probing developmental objectives, we identify two fundamental computations: object and appearance-free motion recognition, which drive the visual processing hierarchy and explain away alternative accounts. Strikingly, a single objective underlies both: they emerge from optimising for understanding world dynamics, with their organisation highly distributed and continuous across cortex rather than segregating into stream-like modes. Our results suggest that the human brain’s ability to integrate complex perceptual information across seemingly distinct pathways may originate from the single goal of modelling the world.

Article activity feed