A Markerless Pose Estimator Applicable to Limbless Animals

The analysis of kinematics, locomotion, and spatial tasks relies on the accurate detection of animal positions and pose. Pose and position can be assessed with video analysis programs, the trackers. Most available trackers represent animals as single points in space (no pose information available) or use markers to build a skeletal representation of pose. Markers are either physical objects attached to the body (white balls, stickers, or paint) or they are defined in silico using recognizable body structures (e.g., joints, limbs, color patterns). Physical markers often cannot be used if the animals are small, lack prominent body structures on which the markers can be placed, or live in environments such as aquatic ones that might detach the marker. Here, we introduce a marker-free pose-estimator (LACE Limbless Animal traCkEr) that builds the pose of the animal de novo from its contour. LACE detects the contour of the animal and derives the body mid-line, building a pseudo-skeleton by defining vertices and edges. By applying LACE to analyse the pose of larval Drosophila melanogaster and adult zebrafish, we illustrate that LACE allows to quantify, for example, genetic alterations of peristaltic movements and gender-specific locomotion patterns that are associated with different body shapes. As illustrated by these examples, LACE provides a versatile method for assessing position, pose and movement patterns, even in animals without limbs.

Automated summary

The accurate detection of animal positions and pose is essential for analyzing kinematics, locomotion, and spatial tasks. Most available trackers represent animals as single points in space or use markers to build a skeletal representation of pose. LACE is a marker-free pose-estimator that builds the pose of the animal de novo from its contour, providing a versatile method for assessing position, pose, and movement patterns even in animals without limbs.