Paper ID | SMR-4.4 | ||
Paper Title | LEARNING OF LINEAR VIDEO PREDICTION MODELS IN A MULTI-MODAL FRAMEWORK FOR ANOMALY DETECTION | ||
Authors | Giulia Slavic, Abrham Alemaw, Lucio Marcenaro, Carlo Regazzoni, University of Genova, Italy | ||
Session | SMR-4: Image and Video Sensing, Modeling, and Representation | ||
Location | Area F | ||
Session Time: | Wednesday, 22 September, 08:00 - 09:30 | ||
Presentation Time: | Wednesday, 22 September, 08:00 - 09:30 | ||
Presentation | Poster | ||
Topic | Image and Video Sensing, Modeling, and Representation: Statistical-model based methods | ||
IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
Abstract | This paper proposes a method for performing future-frame prediction and anomaly detection on video data in a multi-modal framework based on Dynamic Bayesian Networks (DBNs). In particular, odometry data and video data from a moving vehicle are fused. A Markov Jump Particle Filter (MJPF) is learned on odometry data, and its features are used to aid the learning of a Kalman Variational Autoencoder (KVAE) on video data. Consequently, anomaly detection can be performed on video data using the learned model. We evaluate the proposed method using multi-modal data from a vehicle performing different tasks in a closed environment. |