Paper ID | IFS-1.7 | ||
Paper Title | MULTIMODAL GAIT RECOGNITION UNDER MISSING MODALITIES | ||
Authors | Rubén Delgado-Escaño, Francisco M. Castro, Nicolás Guil, University of Málaga, Spain; Vicky Kalogeiton, Institut Polytechnique de Paris, France; Manuel J. Marín-Jiménez, University of Córdoba, Spain | ||
Session | IFS-1: Biometrics | ||
Location | Area K | ||
Session Time: | Monday, 20 September, 13:30 - 15:00 | ||
Presentation Time: | Monday, 20 September, 13:30 - 15:00 | ||
Presentation | Poster | ||
Topic | Information Forensics and Security: Biometrics | ||
IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
Abstract | Multimodal systems for gait recognition have gained a lot of attention. However, there is a clear gap in the study of missing modalities, which represents real-life scenarios where sensors fail or data get corrupted. Here, we investigate how to handle missing modalities for gait recognition. We propose a single and flexible framework that uses a variable number of input modalities. For each modality, it consists of a branch and a binary unit indicating whether the modality is available; these are gated and merged together. Finally, it generates a single and compact 'multimodal' gait signature that encodes biometric information of the input. Our framework outperforms the state of the art on TUM-GAID and extensive experiments reveal its effectiveness for handling missing modalities even in the multi-view setup of CASIA-B. |