4.7 Article

Facemap: a framework for modeling neural activity based on orofacial tracking

Related references

Note: Only part of the references are listed.
Article Biochemical Research Methods

SLEAP: A deep learning system for multi-animal pose tracking

Talmo D. Pereira et al.

Summary: This paper presents Social LEAP Estimates Animal Poses (SLEAP), a machine learning system for multi-animal pose tracking. SLEAP achieves high accuracy and speed, making it suitable for real-time applications. It features a user-friendly interface, standardized data model, and versatile workflows for data labeling, model training, and inference. The researchers applied SLEAP to various datasets and compared it with existing approaches, demonstrating its effectiveness in tracking animal behavior during social interactions.

NATURE METHODS (2022)

Article Biochemical Research Methods

Multi-animal pose estimation, identification and tracking with DeepLabCut

Jessy Lauer et al.

Summary: This research extends the DeepLabCut toolbox to enable multi-animal pose estimation, animal identification, and tracking. It is of great significance for solving computer vision problems in multi-animal scenarios and provides a benchmark dataset for algorithm development.

NATURE METHODS (2022)

Review Neurosciences

Perspective Not so spontaneous: Multi-dimensional representations of behaviors and context in sensory areas

Lilach Avitan et al.

Summary: Sensory areas exhibit spontaneous activity in the absence of sensory stimuli, and recent studies have revealed high-dimensional patterns, correlation with behavior, and dissimilarity with sensory-driven activity. These findings suggest a new role for spontaneous activity in neural sensory computation.

NEURON (2022)

Article Neurosciences

Continuous Whole-Body 3D Kinematic Recordings across the Rodent Behavioral Repertoire

Jesse D. Marshall et al.

Summary: CAPTURE is a new behavioral monitoring system that combines motion capture and deep learning techniques to continuously track the movements of a rat's head, trunk, and limbs in freely behaving animals for up to a week. This system shows significant improvement in precision and robustness compared to existing convolutional network approaches, allowing researchers to comprehensively profile natural rodent behavior and investigate its variations across individuals. By using CAPTURE, researchers can explore a wider range of behaviors and contexts and gain new insights into natural behavior and its neural basis.

NEURON (2021)

Article Neurosciences

Context-dependent representations of movement in Drosophila dopaminergic reinforcement pathways

Aryeh Zolin et al.

Summary: By recording from the dopaminergic reinforcement pathways of the Drosophila mushroom body during active odor navigation, the researchers revealed how the ongoing motor-associated activity relates to goal-directed behavior. Dopaminergic neurons correlate with different behavioral variables depending on the animal's specific navigational strategy, reflecting actions most relevant to odor pursuit. This multiplexing of context-dependent representations within the mushroom body dopaminergic pathways allows them to influence both ongoing and future behavior.

NATURE NEUROSCIENCE (2021)

Article Biology

The Mouse Action Recognition System (MARS) software pipeline for automated analysis of social behaviors in mice

Cristina Segalin et al.

Summary: The Mouse Action Recognition System (MARS) is an automated pipeline for pose estimation and behavior quantification in pairs of freely interacting mice, achieving human-level performance. It releases datasets for training to serve as community benchmarks and resources. The Behavior Ensemble and Neural Trajectory Observatory (BENTO) is a graphical user interface for analyzing multimodal neuroscience datasets, providing an end-to-end pipeline for behavior data extraction and analysis.

ELIFE (2021)

Article Biochemistry & Molecular Biology

High-precision coding in visual cortex

Carsen Stringer et al.

Summary: The study found that individual neurons in the visual cortex provide unreliable estimates of visual features, and it is unknown if single-neuron variability is correlated across large neural populations. By recording and measuring a large number of neurons from the mouse visual cortex, it was discovered that behavioral variability during a sensory discrimination task could not be explained by neural variability in V1.
Article Biology

Standardized and reproducible measurement of decision-making in mice

Valeria Aguillon-Rodriguez et al.

Summary: Research on measuring mouse behavior has yielded reproducible results across multiple laboratories, showing that once training is complete, there are no significant differences in behavior across labs. Additionally, mice in different labs adopted similar strategies for decision-making.

ELIFE (2021)

Article Neurosciences

Cerebellar granule cell axons support high-dimensional representations

Frederic Lanore et al.

Summary: Recordings from hundreds of cerebellar granule cell axons using two-photon calcium imaging showed that population activity is high-dimensional, with distinct behavioral states represented along orthogonal dimensions in neuronal activity space. These findings suggest that the cerebellar cortex supports high-dimensional representations and segregates behavioral state-dependent computations into orthogonal subspaces, similar to the neocortex.

NATURE NEUROSCIENCE (2021)

Article Multidisciplinary Sciences

B-SOiD, an open-source unsupervised algorithm for identification and fast prediction of behaviors

Alexander Hsu et al.

Summary: Studying naturalistic animal behavior remains a difficult objective, but recent advances in machine learning have led to the development of the B-SOiD algorithm, which can identify behaviors without bias and has the ability to generalize, overcoming previous temporal resolution barriers.

NATURE COMMUNICATIONS (2021)

Article Biochemical Research Methods

Partitioning variability in animal behavioral videos using semi-supervised variational autoencoders

Matthew R. Whiteway et al.

PLoS Computational Biology (2021)

Article Biology

Conserved visual capacity of rats under red light

Nader Nikbakht et al.

Summary: Recent studies have shown that rats still possess visual form discrimination capacity under red light, contradicting the assumption of red-light blindness in dichromats. It is advised that investigations on rodent functions without visual input should not assume red-light blindness.

ELIFE (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Pretraining boosts out-of-domain robustness for pose estimation

Alexander Mathis et al.

Summary: This study investigates the generalization ability of neural networks for pose estimation and introduces a new dataset of 30 horses for testing model robustness in both within- and out-of-domain scenarios. The findings suggest that architectures pretrained on ImageNet perform better on both within- and out-of-domain data, and transfer learning is beneficial for out-of-domain robustness in pose estimation tasks.

2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021) (2021)

Article Biochemical Research Methods

SciPy 1.0: fundamental algorithms for scientific computing in Python

Pauli Virtanen et al.

NATURE METHODS (2020)

Article Biochemical Research Methods

A system for tracking whisker kinematics and whisker shape in three dimensions

Rasmus S. Petersen et al.

PLOS COMPUTATIONAL BIOLOGY (2020)

Article Multidisciplinary Sciences

Facial expressions of emotion states and their neuronal correlates in mice

Nejc Dolensek et al.

SCIENCE (2020)

Article Neurosciences

Encoding of 3D Head Orienting Movements in the Primary Visual Cortex

Grigori Guitchounts et al.

NEURON (2020)

Review Multidisciplinary Sciences

Array programming with NumPy

Charles R. Harris et al.

NATURE (2020)

Article Multidisciplinary Sciences

Automated markerless pose estimation in freely moving macaques with OpenMonkeyStudio

Praneet C. Bala et al.

NATURE COMMUNICATIONS (2020)

Article Neurosciences

Locomotion-dependent remapping of distributed cortical networks

Kelly B. Clancy et al.

NATURE NEUROSCIENCE (2019)

Article Multidisciplinary Sciences

Specialized coding of sensory, motor and cognitive variables in VTA dopamine neurons

Ben Engelhard et al.

NATURE (2019)

Article Multidisciplinary Sciences

Spontaneous behaviors drive multidimensional, brainwide activity

Carsen Stringer et al.

SCIENCE (2019)

Article Biochemical Research Methods

Using DeepLabCut for 3D markerless pose estimation across species and behaviors

Tanmay Nath et al.

NATURE PROTOCOLS (2019)

Article Neurosciences

Single-trial neural dynamics are dominated by richly varied movements

Simon Musall et al.

NATURE NEUROSCIENCE (2019)

Article Neurosciences

Unsupervised identification of the internal states that shape natural behavior

Adam J. Calhoun et al.

NATURE NEUROSCIENCE (2019)

Article Multidisciplinary Sciences

Amygdala ensembles encode behavioral states

Jan Grundemann et al.

SCIENCE (2019)

Article Multidisciplinary Sciences

Behavioral state modulates the ON visual motion pathway of Drosophila

James A. Strother et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2018)

Article Neurosciences

Robustness of Spike Deconvolution for Neuronal Calcium Imaging

Marius Pachitariu et al.

JOURNAL OF NEUROSCIENCE (2018)

Article Neurosciences

DeepLabCut: markerless pose estimation of user-defined body parts with deep learning

Alexander Mathis et al.

NATURE NEUROSCIENCE (2018)

Article Neurosciences

A faithful internal representation of walking movements in the Drosophila visual system

Terufumi Fujiwara et al.

NATURE NEUROSCIENCE (2017)

Review Biology

Machine vision methods for analyzing social interactions

Alice A. Robie et al.

JOURNAL OF EXPERIMENTAL BIOLOGY (2017)

Article Biochemical Research Methods

Fast online deconvolution of calcium imaging data

Johannes Friedrich et al.

PLOS COMPUTATIONAL BIOLOGY (2017)

Article Multidisciplinary Sciences

A neuronal circuit for colour vision based on rod-cone opponency

Maximilian Joesch et al.

NATURE (2016)

Article Biochemistry & Molecular Biology

Locomotion and Task Demands Differentially Modulate Thalamic Audiovisual Processing during Active Search

Ross S. Williamson et al.

CURRENT BIOLOGY (2015)

Article Neurosciences

Mapping Sub-Second Structure in Mouse Behavior

Alexander B. Wiltschko et al.

NEURON (2015)

Article Biochemistry & Molecular Biology

Effects of Locomotion Extend throughout the Mouse Early Visual System

Sinem Erisken et al.

CURRENT BIOLOGY (2014)

Article Biochemical Research Methods

Automated Tracking of Whiskers in Videos of Head Fixed Rodents

Nathan G. Clack et al.

PLOS COMPUTATIONAL BIOLOGY (2012)

Article Computer Science, Interdisciplinary Applications

The NumPy Array: A Structure for Efficient Numerical Computation

Stefan van der Walt et al.

COMPUTING IN SCIENCE & ENGINEERING (2011)

Article Neurosciences

Modulation of Visual Responses by Behavioral State in Mouse Visual Cortex

Cristopher M. Niell et al.

NEURON (2010)

Review Neurosciences

Spontaneous and driven cortical activity: implications for computation

Dario L. Ringach

CURRENT OPINION IN NEUROBIOLOGY (2009)

Article Neurosciences

Unsupervised whisker tracking in unrestrained behaving animals

Jakob Voigts et al.

JOURNAL OF NEUROPHYSIOLOGY (2008)

Article Multidisciplinary Sciences

Spatio-temporal correlations and visual signalling in a complete neuronal population

Jonathan W. Pillow et al.

NATURE (2008)

Article Multidisciplinary Sciences

Organization of cell assemblies in the hippocampus

KD Harris et al.

NATURE (2003)