Journal
IEEE TRANSACTIONS ON IMAGE PROCESSING
Volume 32, Issue -, Pages 415-429Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TIP.2022.3229620
Keywords
Variational autoencoder; Kalman filter; anomaly detection; multi-modality; linear prediction models
Ask authors/readers for more resources
This paper proposes a method for video-frame prediction and anomaly detection in autonomous vehicles using a Dynamic Bayesian Network framework and Deep Learning methods. The method leverages multi-modal information from different sensors and learns an appropriate latent space. The evaluation shows that this method can effectively detect abnormal behaviors in a closed environment.
The combination of different sensory information to predict upcoming situations is an innate capability of intelligent beings. Consequently, various studies in the Artificial Intelligence field are currently being conducted to transfer this ability to artificial systems. Autonomous vehicles can particularly benefit from the combination of multi-modal information from the different sensors of the agent. This paper proposes a method for video-frame prediction that leverages odometric data. It can then serve as a basis for anomaly detection. A Dynamic Bayesian Network framework is adopted, combined with the use of Deep Learning methods to learn an appropriate latent space. First, a Markov Jump Particle Filter is built over the odometric data. This odometry model comprises a set of clusters. As a second step, the video model is learned. It is composed of a Kalman Variational Autoencoder modified to leverage the odometry clusters for focusing its learning attention on features related to the dynamic tasks that the vehicle is performing. We call the obtained overall model Cluster-Guided Kalman Variational Autoencoder. Evaluation is conducted using data from a car moving in a closed environment and leveraging a part of the University of Alcala DriveSet dataset, where several drivers move in a normal and drowsy way along a secondary road.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available