Journal
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY
Volume 32, Issue 5, Pages 2787-2801Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCSVT.2021.3098497
Keywords
Mice; Pose estimation; Context modeling; Standards; Diseases; Graphical models; Mixers; Pose estimation; graphical model; multi-level information; Parkinson's disease; mouse behaviour dataset
Categories
Funding
- International Science and Technology Cooperation Projects of Guangdong [2019A050510030]
- Royal Society-Newton Advanced Fellowship [NA160342]
Ask authors/readers for more resources
This paper proposes a novel Hourglass network based model for pose estimation of mice, which incorporates effective modules of Structured Context Mixer and Cascaded Multi-level Supervision to enhance the robustness of the network. The proposed approach achieves accurate localization through the use of multi-level prediction information. Experimental results demonstrate its competitive performance against state-of-the-art approaches.
Automated analysis of mouse behaviours is crucial for many applications in neuroscience. However, quantifying mouse behaviours from videos or images remains a challenging problem, where pose estimation plays an important role in describing mouse behaviours. Although deep learning based methods have made promising advances in human pose estimation, they cannot be directly applied to pose estimation of mice due to different physiological natures. Particularly, since mouse body is highly deformable, it is a challenge to accurately locate different keypoints on the mouse body. In this paper, we propose a novel Hourglass network based model, namely Graphical Model based Structured Context Enhancement Network (GM-SCENet) where two effective modules, i.e., Structured Context Mixer (SCM) and Cascaded Multi-level Supervision (CMLS) are subsequently implemented. SCM can adaptively learn and enhance the proposed structured context information of each mouse part by a novel graphical model that takes into account the motion difference between body parts. Then, the CMLS module is designed to jointly train the proposed SCM and the Hourglass network by generating multi-level information, increasing the robustness of the whole network. Using the multi-level prediction information from SCM and CMLS, we develop an inference method to ensure the accuracy of the localisation results. Finally, we evaluate our proposed approach against several baselines on our Parkinson's Disease Mouse Behaviour (PDMB) and the standard DeepLabCut Mouse Pose datasets. The experimental results show that our method achieves better or competitive performance against the other state-of-the-art approaches.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available