The transformer as a candidate canonical cortical microcircuit

Read the full article See related articles

Listed in

This article is not in any list yet, why not save it to one of your lists.
Log in to save this article

Abstract

Neuroscience hypothesizes a canonical microcircuit subserving cortical computation across brain systems. In artificial intelligence, neural networks have become a universal computational substrate. Here, we leverage newly available large-scale data and mapping techniques to compare neural network motifs to the brain. We embedded a spectrum of candidate microcircuit architectures within a common spatial macrocircuit, measuring alignment with an extensive battery of cortical signatures. We find that one specific circuit type—the transformer—uniquely captures fine-grained unit-level circuit details, population-level functional maps and neuronal activity patterns, and systems-level wiring efficiency and behavioral demands. The key ingredient enabling the transformer’s success is a learned multiplicative component making relational information available without extensive long-range wiring. These results suggest striking convergence between computational motifs in natural and artificial intelligence.

Article activity feed

  1. Companion blog to my recent preprint out with @dyamins.bsky.social on “The transformer as a candidate canonical cortical microcircuit” www.biorxiv.org/content/10.6...

  2. Authors published a paper in Biorxiv, they used DINO in the study. Including #RRIDs will make this less ambiguous. SciScore made a table with this resource, see “Automated Services” module (download as csv, xml or #jats) #RRID #OpenScience

  3. 14/ Read the preprint at www.biorxiv.org/content/10.6... :)

  4. The transformer as a candidate canonical cortical microcircuit https://www.biorxiv.org/content/10.64898/2026.11.01.763457v1

  5. The transformer as a candidate canonical cortical microcircuit https://www.biorxiv.org/content/10.64898/2026.11.01.763457v1