Precise 2D Mouse Pose Estimation via Multi-Scale Context and Sensitive-Aware Loss from Low Illumination Environment

Read the full article See related articles

Discuss this preprint

Start a discussion What are Sciety discussions?

Listed in

This article is not in any list yet, why not save it to one of your lists.
Log in to save this article

Abstract

Markerless pose estimation has emerged as a promising methodology for quantifying the behavior of freely moving mice. However, achieving scientifically precise 2D Mouse Pose Estimation (MPE) remains challenging, primarily due to the scarcity of large scale benchmark datasets and the underdevelopment of techniques tailored to animal behavior experiments. Existing pose estimation techniques developed for Human Pose Estimation (HPE) are rarely directly transferable to mice. One key distinction between HPE and MPE stems from the stricter precision requirements in animal behavior studies relative to human centric scenarios. In this work, we propose a novel framework that integrates Multi-Scale Context (MSC) with Sensitive-Aware Loss (SAL) to tackle this challenge. Specifically, the MSC exploits multi-scale contextual information to capture discriminative keypoint representations, while the SAL alleviates the extreme class imbalance inherently encountered in precise keypoint localization, thereby facilitating accurate localization. Experiments conducted on two public real world datasets demonstrate that our approach achieves accurate mouse keypoint localization under extremely low illumination conditions (0–15 lux).

Article activity feed