Precise 2D Mouse Pose Estimation via Multi-Scale Context and Sensitive-Aware Loss from Low Illumination Environment
Discuss this preprint
Start a discussion What are Sciety discussions?Listed in
This article is not in any list yet, why not save it to one of your lists.Abstract
Markerless pose estimation has emerged as a promising methodology for quantifying the behavior of freely moving mice. However, achieving scientifically precise 2D Mouse Pose Estimation (MPE) remains challenging, primarily due to the scarcity of large scale benchmark datasets and the underdevelopment of techniques tailored to animal behavior experiments. Existing pose estimation techniques developed for Human Pose Estimation (HPE) are rarely directly transferable to mice. One key distinction between HPE and MPE stems from the stricter precision requirements in animal behavior studies relative to human centric scenarios. In this work, we propose a novel framework that integrates Multi-Scale Context (MSC) with Sensitive-Aware Loss (SAL) to tackle this challenge. Specifically, the MSC exploits multi-scale contextual information to capture discriminative keypoint representations, while the SAL alleviates the extreme class imbalance inherently encountered in precise keypoint localization, thereby facilitating accurate localization. Experiments conducted on two public real world datasets demonstrate that our approach achieves accurate mouse keypoint localization under extremely low illumination conditions (0–15 lux).