The transformer as a candidate canonical cortical microcircuit
Listed in
This article is not in any list yet, why not save it to one of your lists.Abstract
Neuroscience hypothesizes a canonical microcircuit subserving cortical computation across brain systems. In artificial intelligence, neural networks have become a universal computational substrate. Here, we leverage newly available large-scale data and mapping techniques to compare neural network motifs to the brain. We embedded a spectrum of candidate microcircuit architectures within a common spatial macrocircuit, measuring alignment with an extensive battery of cortical signatures. We find that one specific circuit type—the transformer—uniquely captures fine-grained unit-level circuit details, population-level functional maps and neuronal activity patterns, and systems-level wiring efficiency and behavioral demands. The key ingredient enabling the transformer’s success is a learned multiplicative component making relational information available without extensive long-range wiring. These results suggest striking convergence between computational motifs in natural and artificial intelligence.
Article activity feed
-
Companion blog to my recent preprint out with @dyamins.bsky.social on “The transformer as a candidate canonical cortical microcircuit” www.biorxiv.org/content/10.6...
-
Authors published a paper in Biorxiv, they used DINO in the study. Including #RRIDs will make this less ambiguous. SciScore made a table with this resource, see “Automated Services” module (download as csv, xml or #jats) #RRID #OpenScience
-
14/ Read the preprint at www.biorxiv.org/content/10.6... :)
-
The transformer as a candidate canonical cortical microcircuit https://www.biorxiv.org/content/10.64898/2026.11.01.763457v1
-
The transformer as a candidate canonical cortical microcircuit https://www.biorxiv.org/content/10.64898/2026.11.01.763457v1
-