4.5 Article

A Survey on Deep Learning for Skeleton-Based Human Animation

Related references

Note: Only part of the references are listed.
Article Computer Science, Artificial Intelligence

Symbiotic Graph Neural Networks for 3D Skeleton-Based Human Action Recognition and Motion Prediction

Maosen Li et al.

Summary: In this paper, we propose a symbiotic graph neural network model to address the problems of 3D skeleton-based action recognition and motion prediction. The model utilizes graphs of two scales to capture relations among body-joints and body-parts, and achieves better performances on both tasks through joint training of a backbone, an action-recognition head, and a motion-prediction head.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Computer Science, Software Engineering

MotioNet: 3D Human Motion Reconstruction from Monocular Video with Skeleton Consistency

Mingyi Shi et al.

Summary: MotioNet is a deep neural network that reconstructs 3D human skeleton motion from monocular video. The network decomposes 2D joint position sequences into bone length-encoded skeleton and 3D joint rotation sequences, outputting 3D positions through an integrated FK layer for comparison with ground truth.

ACM TRANSACTIONS ON GRAPHICS (2021)

Article Computer Science, Software Engineering

Combining Recurrent Neural Networks and Adversarial Training for Human Motion Synthesis and Control

Zhiyong Wang et al.

Summary: This study introduces a new generative deep learning network, combining recurrent neural networks and adversarial training, for human motion synthesis and control. Experimental results demonstrate that the model generates highly realistic motions and can be applied in various scenarios.

IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS (2021)

Article Computer Science, Information Systems

Efficient human motion prediction using temporal convolutional generative adversarial network

Qiongjie Cui et al.

Summary: This paper introduces a temporal convolutional generative adversarial network (TCGAN) for predicting future human poses, which outperforms traditional RNNs in both short-term and long-term predictions and is capable of generating future poses in real-time.

INFORMATION SCIENCES (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Recovering Trajectories of Unmarked Joints in 3D Human Actions Using Latent Space Optimization

Suhas Lohit et al.

Summary: Motion capture and time-of-flight based sensing of human actions are popular modalities for activity analysis. While marker-less motion capture has made progress, marker-based systems are still considered gold-standard, especially in critical applications like healthcare. However, both modalities face practical challenges such as visibility issues and tracking errors.

2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021 (2021)

Article Computer Science, Software Engineering

LoBSTr: Real-time Lower-body Pose Prediction from Sparse Upper-body Tracking Signals

Dongseok Yang et al.

Summary: This paper introduces a method using deep neural networks to predict lower-body pose and feet contact state in real-time based on tracking signals of upper-body joints. The use of velocity representation improves modeling of correlation between upper-body and lower-body motions, increasing robustness against diverse user body proportions.

COMPUTER GRAPHICS FORUM (2021)

Article Computer Science, Software Engineering

Learning and Exploring Motor Skills with Spacetime Bounds

Li-Ke Ma et al.

Summary: This study introduces a Deep Reinforcement Learning framework for physics-based characters to learn motor skills from reference motions. By using loose spacetime bounds to limit the search space, the learning process becomes more robust and efficient. Spacetime bounds act as hard constraints that improve learning of challenging motion segments.

COMPUTER GRAPHICS FORUM (2021)

Article Computer Science, Software Engineering

Adversarial learning for modeling human motion

Qi Wang et al.

VISUAL COMPUTER (2020)

Article Computer Science, Artificial Intelligence

Modeling Human Motion with Quaternion-Based Neural Networks

Dario Pavllo et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2020)

Article Computer Science, Software Engineering

Unpaired Motion Style Transfer from Video to Animation

Kfir Aberman et al.

ACM TRANSACTIONS ON GRAPHICS (2020)

Article Computer Science, Software Engineering

Catch & Carry: Reusable Neural Controllers for Vision-Guided Whole-Body Tasks

Josh Merel et al.

ACM TRANSACTIONS ON GRAPHICS (2020)

Article Computer Science, Software Engineering

Character Controllers using Motion VAEs

Hung Yu Ling et al.

ACM TRANSACTIONS ON GRAPHICS (2020)

Article Computer Science, Software Engineering

A Scalable Approach to Control Diverse Behaviors for Physically Simulated Characters

Jungdam Won et al.

ACM TRANSACTIONS ON GRAPHICS (2020)

Article Computer Science, Software Engineering

Skeleton-Aware Networks for Deep Motion Retargeting

Kfir Aberman et al.

ACM TRANSACTIONS ON GRAPHICS (2020)

Article Computer Science, Software Engineering

Learned Motion Matching

Daniel Holden et al.

ACM TRANSACTIONS ON GRAPHICS (2020)

Article Computer Science, Software Engineering

Fast and Flexible Multilegged Locomotion Using Learned Centroidal Dynamics

Taesoo Kwon et al.

ACM TRANSACTIONS ON GRAPHICS (2020)

Article Computer Science, Software Engineering

Local Motion Phases for Learning Multi-Contact Character Movements

Sebastian Starke et al.

ACM TRANSACTIONS ON GRAPHICS (2020)

Article Computer Science, Software Engineering

Robust Motion In-betweening

Felix G. Harvey et al.

ACM TRANSACTIONS ON GRAPHICS (2020)

Article Computer Science, Software Engineering

Motion Retargetting based on Dilated Convolutions and Skeleton-specific Loss Functions

SangBin Kim et al.

COMPUTER GRAPHICS FORUM (2020)

Article Computer Science, Artificial Intelligence

NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding

Jun Liu et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2020)

Article Robotics

Socially and Contextually Aware Human Motion and Pose Forecasting

Vida Adeli et al.

IEEE ROBOTICS AND AUTOMATION LETTERS (2020)

Article Computer Science, Software Engineering

MoGlow: Probabilistic and Controllable Motion Synthesis Using Normalising Flows

Gustav Eje Henter et al.

ACM TRANSACTIONS ON GRAPHICS (2020)

Article Computer Science, Software Engineering

PhysCap: Physically Plausible Monocular 3D Motion Capture in Real Time

Soshi Shimada et al.

ACM TRANSACTIONS ON GRAPHICS (2020)

Article Computer Science, Software Engineering

Probabilistic Character Motion Synthesis using a Hierarchical Deep Latent Variable Model

S. Ghorbani et al.

COMPUTER GRAPHICS FORUM (2020)

Article Computer Science, Software Engineering

ALLSTEPS: Curriculum-driven Learning of Stepping Stone Skills

Zhaoming Xie et al.

COMPUTER GRAPHICS FORUM (2020)

Proceedings Paper Computer Science, Artificial Intelligence

Dynamic Multiscale Graph Neural Networks for 3D Skeleton-Based Human Motion Prediction

Maosen Li et al.

2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2020)

Proceedings Paper Computer Science, Artificial Intelligence

A Stochastic Conditioning Scheme for Diverse Human Motion Prediction

Sadegh Aliakbarian et al.

2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2020)

Proceedings Paper Computer Science, Artificial Intelligence

Learning Dynamic Relationships for 3D Human Motion Prediction

Qiongjie Cui et al.

2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2020)

Article Computer Science, Information Systems

A Perceptual-Based Noise-Agnostic 3D Skeleton Motion Data Refinement Network

Shu-Jie Li et al.

IEEE ACCESS (2020)

Article Computer Science, Software Engineering

Continuous Control Monte Carlo Tree Search Informed by Multiple Experts

Joose Rajamaki et al.

IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS (2019)

Article Computer Science, Software Engineering

Efficient convolutional hierarchical autoencoder for human motion prediction

Yanran Li et al.

VISUAL COMPUTER (2019)

Article Computer Science, Software Engineering

Synthesis of Biologically Realistic Human Motion Using Joint Torque Actuation

Yifeng Jiang et al.

ACM TRANSACTIONS ON GRAPHICS (2019)

Article Computer Science, Software Engineering

Scalable Muscle-Actuated Human Simulation and Control

Seunghwan Lee et al.

ACM TRANSACTIONS ON GRAPHICS (2019)

Article Computer Science, Software Engineering

Bidirectional recurrent autoencoder for 3D skeleton motion data refinement

Shujie Li et al.

COMPUTERS & GRAPHICS-UK (2019)

Article Computer Science, Software Engineering

Neural State Machine for Character-Scene Interactions

Sebastian Starke et al.

ACM TRANSACTIONS ON GRAPHICS (2019)

Article Computer Science, Software Engineering

Learning predict-and-simulate policies from unorganized human motion data

Soohwan Park et al.

ACM TRANSACTIONS ON GRAPHICS (2019)

Article Computer Science, Software Engineering

Learning Body Shape Variation in Physics-based Characters

Jungdam Won et al.

ACM TRANSACTIONS ON GRAPHICS (2019)

Article Computer Science, Software Engineering

DReCon: Data-Driven Responsive Control of Physics-Based Characters

Kevin Bergamin et al.

ACM TRANSACTIONS ON GRAPHICS (2019)

Article Computer Science, Software Engineering

Efficient Neural Networks for Real-time Motion Style Transfer

Harrison Jesse Smith et al.

PROCEEDINGS OF THE ACM ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES (2019)

Proceedings Paper Engineering, Electrical & Electronic

Action-Agnostic Human Pose Forecasting

Hsu-kuang Chiu et al.

2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV) (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Structured Prediction Helps 3D Human Motion Modelling

Emre Aksan et al.

2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Learning Trajectory Dependencies for Human Motion Prediction

Wei Mao et al.

2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Human Motion Prediction via Spatio-Temporal Inpainting

A. Hernandez Ruiz et al.

2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Imitation Learning for Human Pose Prediction

Borui Wang et al.

2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Convolutional Sequence Generation for Skeleton-Based Action Synthesis

Sijie Yan et al.

2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Towards Natural and Accurate Future Motion Prediction of Humans and Animals

Zhenguang Liu et al.

2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) (2019)

Proceedings Paper Computer Science, Theory & Methods

Fast Terrain-Adaptive Motion Generation using Deep Neural Networks

Moonwon Yu et al.

SA'19: SIGGRAPH ASIA 2019 TECHNICAL BRIEFS (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Human Motion Prediction via Pattern Completion in Latent Representation Space

Yi Tian Xu et al.

2019 16TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV 2019) (2019)

Article Computer Science, Software Engineering

Robust Solving of Optical Motion Capture Data by Denoising

Daniel Holden

ACM TRANSACTIONS ON GRAPHICS (2018)

Article Computer Science, Software Engineering

Learning Symmetric and Low-Energy Locomotion

Wenhao Yu et al.

ACM TRANSACTIONS ON GRAPHICS (2018)

Article Computer Science, Software Engineering

Learning Basketball Dribbling Skills Using Trajectory Optimization and Deep Reinforcement Learning

Libin Liu et al.

ACM TRANSACTIONS ON GRAPHICS (2018)

Article Computer Science, Software Engineering

DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills

Xue Bin Peng et al.

ACM TRANSACTIONS ON GRAPHICS (2018)

Article Computer Science, Software Engineering

Mode-Adaptive Neural Networks for Quadruped Motion Control

He Zhang et al.

ACM TRANSACTIONS ON GRAPHICS (2018)

Article Computer Science, Software Engineering

Deep Learning of Biomimetic Sensorimotor Control for Biomechanical Human Animation

Masaki Nakada et al.

ACM TRANSACTIONS ON GRAPHICS (2018)

Article Computer Science, Software Engineering

Interactive Character Animation by Learning Multi-Objective Control

Kyungho Lee et al.

ACM TRANSACTIONS ON GRAPHICS (2018)

Article Computer Science, Software Engineering

SFV: Reinforcement Learning of Physical Skills from Videos

Xue Bin Peng et al.

ACM TRANSACTIONS ON GRAPHICS (2018)

Article Computer Science, Software Engineering

Learning to Dress: Synthesizing Human Dressing Motion via Deep Reinforcement Learning

Alexander Clegg et al.

ACM TRANSACTIONS ON GRAPHICS (2018)

Article Computer Science, Software Engineering

Few-shot Learning of Homogeneous Human Locomotion Styles

I. Mason et al.

COMPUTER GRAPHICS FORUM (2018)

Proceedings Paper Computer Science, Artificial Intelligence

Convolutional Sequence to Sequence Model for Human Dynamics

Chen Li et al.

2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2018)

Proceedings Paper Computer Science, Artificial Intelligence

Neural Kinematic Networks for Unsupervised Motion Retargetting

Ruben Villegas et al.

2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2018)

Proceedings Paper Computer Science, Artificial Intelligence

HP-GAN: Probabilistic 3D human motion prediction via GAN

Emad Barsoum et al.

PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW) (2018)

Proceedings Paper Computer Science, Theory & Methods

Interactive Character Animation by Learning Multi-Objective Control

Kyungho Lee et al.

SIGGRAPH ASIA'18: SIGGRAPH ASIA 2018 TECHNICAL PAPERS (2018)

Proceedings Paper Computer Science, Theory & Methods

Learning to Dress: Synthesizing Human Dressing Motion via Deep Reinforcement Learning

Alexander Clegg et al.

SIGGRAPH ASIA'18: SIGGRAPH ASIA 2018 TECHNICAL PAPERS (2018)

Article Computer Science, Software Engineering

Fast Neural Style Transfer for Motion Data

Daniel Holden et al.

IEEE COMPUTER GRAPHICS AND APPLICATIONS (2017)

Editorial Material Engineering, Electrical & Electronic

Geometric Deep Learning Going beyond Euclidean data

Michael M. Bronstein et al.

IEEE SIGNAL PROCESSING MAGAZINE (2017)

Article Computer Science, Software Engineering

Encoder-decoder recurrent network model for interactive character animation generation

Yumeng Wang et al.

VISUAL COMPUTER (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Deep representation learning for human motion prediction and classification

Judith Butepage et al.

30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017) (2017)

Article Computer Science, Software Engineering

Learning to Schedule Control Fragments for Physics-Based Characters Using Deep Q-Learning

Libin Liu et al.

ACM TRANSACTIONS ON GRAPHICS (2017)

Article Computer Science, Software Engineering

DeepLoco: Dynamic Locomotion Skills Using Hierarchical Deep Reinforcement Learning

Xue Bin Peng et al.

ACM TRANSACTIONS ON GRAPHICS (2017)

Article Computer Science, Software Engineering

Phase-Functioned Neural Networks for Character Control

Daniel Holden et al.

ACM TRANSACTIONS ON GRAPHICS (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Learning Human Motion Models for Long-term Predictions

Partha Ghosh et al.

PROCEEDINGS 2017 INTERNATIONAL CONFERENCE ON 3D VISION (3DV) (2017)

Proceedings Paper Computer Science, Artificial Intelligence

WalkNet: A Neural-Network-Based Interactive Walking Controller

Omid Alemi et al.

INTELLIGENT VIRTUAL AGENTS, IVA 2017 (2017)

Article Computer Science, Software Engineering

Terrain-Adaptive Locomotion Skills Using Deep Reinforcement Learning

Xue Bin Peng et al.

ACM TRANSACTIONS ON GRAPHICS (2016)

Article Computer Science, Software Engineering

A Deep Learning Framework for Character Motion Synthesis and Editing

Daniel Holden et al.

ACM TRANSACTIONS ON GRAPHICS (2016)

Article Computer Science, Software Engineering

SMPL: A Skinned Multi-Person Linear Model

Matthew Loper et al.

ACM TRANSACTIONS ON GRAPHICS (2015)

Article Computer Science, Software Engineering

Realtime Style Transfer for Unlabeled Heterogeneous Human Motion

Shihong Xia et al.

ACM TRANSACTIONS ON GRAPHICS (2015)

Proceedings Paper Computer Science, Artificial Intelligence

Deep Learning of Neuromuscular Control for Biomechanical Human Animation

Masaki Nakada et al.

ADVANCES IN VISUAL COMPUTING, PT I (ISVC 2015) (2015)

Proceedings Paper Computer Science, Artificial Intelligence

Recurrent Network Models for Human Dynamics

Katerina Fragkiadaki et al.

2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV) (2015)

Review Mathematical & Computational Biology

3D Human Motion Editing and Synthesis: A Survey

Xin Wang et al.

COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE (2014)

Article Computer Science, Artificial Intelligence

Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments

Catalin Ionescu et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2014)

Article Engineering, Electrical & Electronic

The Emerging Field of Signal Processing on Graphs

David I. Shuman et al.

IEEE SIGNAL PROCESSING MAGAZINE (2013)

Article Computer Science, Artificial Intelligence

Body Movements for Affective Expression: A Survey of Automatic Recognition and Generation

Michelle Karg et al.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2013)

Article Computer Science, Software Engineering

Motion Graphs++: a Compact Generative Model for Semantic Motion Analysis and Synthesis

Jianyuan Min et al.

ACM TRANSACTIONS ON GRAPHICS (2012)

Review Computer Science, Software Engineering

Interactive Character Animation Using Simulated Physics: A State-of-the-Art Review

T. Geijtenbeek et al.

COMPUTER GRAPHICS FORUM (2012)

Review Computer Science, Software Engineering

State of the Art in Example-Based Motion Synthesis for Virtual Characters in Interactive Applications

T. Pejsa et al.

COMPUTER GRAPHICS FORUM (2010)

Article Computer Science, Software Engineering

Heads up! Biomechanical modeling and neuromuscular control of the neck

Sung-Hee Lee et al.

ACM TRANSACTIONS ON GRAPHICS (2006)

Article Computer Science, Artificial Intelligence

Training products of experts by minimizing contrastive divergence

GE Hinton

NEURAL COMPUTATION (2002)