Discovering compositional, interpretable structure in social behavior

Read the full article See related articles

Listed in

This article is not in any list yet, why not save it to one of your lists.
Log in to save this article

Abstract

Quantitative assessment of behavior is vital for rigorous analysis of how animals interact in the world and how behavior is generated from brain activity. Recent advances in automated pose detection have made possible data-driven discovery of movement action sequences. While many algorithms have been developed for this purpose, their categorical nature, i.e., the assumption that behavior is one action at a time, prohibits expressive quantification of social behavior. Such behavior is combinatorial and compositional, with multiple animals performing actions that may be either independent or coordinated over time. Here we show how developments in decomposed linear dynamical systems (dLDS) can instead represent action-generating dynamics as a signed, graded mixture of shared linear operators acting directly on keypoint positions. We demonstrate our approach across both single-mouse and two-mouse datasets, comparing against a state-of-the-art switching model, keypoint-MoSeq. In single-mouse data, we find that a composition of three operators can capture the full repertoire of 21 keypoint-MoSeq syllables, showing that even for a single animal, the action space is more parsimoniously described by a continuous subspace than clustered motifs. In a two-mouse resident–intruder assay, we identify, without behavioral labels, separate primitives for self-action, inter-animal-geometry, and social-action. The latter couples an animal’s action to its partner’s relative bearing, enabling the action to incorporate the social geometry in which it occurs. dLDS further decodes human-labeled social behaviors (i.e., “attack”, “investigation”, “mount”, and “other”) more accurately than behavior-selective keypoint-MoSeq syllable sets using fewer units. Together, these results demonstrate that compositional, time-varying linear dynamics can provide a path towards flexible and interpretable modeling of action-level behavior for both individual and social behavior.

Article activity feed

  1. Check out this paper that I happily contributed to: www.biorxiv.org/content/10.6... One of the many highlights of the paper: Decomposed linear dynamical systems (dLDS) maps an action space with continuous operator coordinates while keypoint-MoSeq covers it with overlapping syllables

  2. Check out this new paper from Adam Charles' group ( @baselesspursuit.bsky.social ), using decomposed linear dynamical systems to discover compositional, interpretable structure in social behavior. Looking forward to extend this method to multiple animals setting. www.biorxiv.org/content/10.6...

  3. Discovering compositional, interpretable structure in social behavior https://www.biorxiv.org/content/10.64898/2026.11.03.764108v1

  4. Discovering compositional, interpretable structure in social behavior https://www.biorxiv.org/content/10.64898/2026.11.03.764108v1