Artificial Embodied Circuits Uncover Neural Architectures of Vertebrate Visuomotor Behaviors
Listed in
This article is not in any list yet, why not save it to one of your lists.Abstract
All brains evolve within specific sensory and physical environments 1 . Traditionally, neuroscience has focused on studying neural circuits in isolation, yet holistic characterization of their function requires integrative brain-body testing 2,3 . To investigate the neural and biomechanical mechanisms of sensorimotor transformations, we constructed realistic neuromechanical simulations ( simZFish ) of the larval zebrafish optomotor response, a visual stabilization behavior 4,5 . By computationally reproducing the body, physical body-water interactions, visual environments, and experimentally derived neural architectures, we closely replicated the behavior of real zebrafish 6 . Through systematic manipulation of physiological and circuit features, impossible in biological experiments, we demonstrate how embodiment shapes neural circuit architecture and behavior. When challenged with novel visual stimuli, simZFish predicted neuronal response types, which we identified via calcium imaging in the brain of real zebrafish and used to update the simZFish neural network. In virtual rivers, simZFish performed rheotaxis by using current-induced optic flow as navigational cues, compensating for the simulated water flow. Finally, a physical robot ( ZBot ) validated the role of embodied sensorimotor circuits in maintaining position in a real river with complex fluid dynamics and visual environments. Together, by iterating between simulations, behavioral observations, neural imaging, and robotic testing, we demonstrate the power of an integrative approach to investigating sensorimotor processing.
Research Highlights
-
Developed simZFish , an open-source neuromechanical simulation modeling the zebrafish optomotor response (OMR).
-
Demonstrated that simZFish visuomotor neural circuits are sufficient to maintain position in virtual water currents without additional sensory modalities.
-
Investigated how variations in eye geometry influence neural circuit functionality and behavior.
-
Conducted optic flow analysis of simulated visual input to identify retinal connectivity requirements, uncovering the factors that shape pretectal neurons’ preference for the lower posterior visual field.
-
simZFish predicted new neural response types confirmed via real zebrafish calcium imaging.
-
Validated simZFish circuits with a physical robot, ZBot, performing rheotaxis in a natural river with rich visual and complex flow dynamics compared to idealized lab and simulation experiments.
Combining data-driven neuromechanical simulations and robotic testing, we established an integrative framework for investigating embodied neural circuit functions. Leveraging the behavioral, neurobiological, and theoretical foundations of the visually guided optomotor response in larval zebrafish (blue, left), we developed a virtual zebrafish, simZFish (red, middle), to replicate realistic hydrodynamic, anatomical, sensory, neural, and behavioral aspects, permitting the investigation of emergent properties driven by embodiment. Validating these findings using a physical, zebrafish-inspired robot, ZBot (grey, right), in naturalistic environments informs further experiments, hypotheses, and robotic design.
