| Paper ID | IFS-1.7 | ||
| Paper Title | MULTIMODAL GAIT RECOGNITION UNDER MISSING MODALITIES | ||
| Authors | Rubén Delgado-Escaño, Francisco M. Castro, Nicolás Guil, University of Málaga, Spain; Vicky Kalogeiton, Institut Polytechnique de Paris, France; Manuel J. Marín-Jiménez, University of Córdoba, Spain | ||
| Session | IFS-1: Biometrics | ||
| Location | Area K | ||
| Session Time: | Monday, 20 September, 13:30 - 15:00 | ||
| Presentation Time: | Monday, 20 September, 13:30 - 15:00 | ||
| Presentation | Poster | ||
| Topic | Information Forensics and Security: Biometrics | ||
| IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
| Abstract | Multimodal systems for gait recognition have gained a lot of attention. However, there is a clear gap in the study of missing modalities, which represents real-life scenarios where sensors fail or data get corrupted. Here, we investigate how to handle missing modalities for gait recognition. We propose a single and flexible framework that uses a variable number of input modalities. For each modality, it consists of a branch and a binary unit indicating whether the modality is available; these are gated and merged together. Finally, it generates a single and compact 'multimodal' gait signature that encodes biometric information of the input. Our framework outperforms the state of the art on TUM-GAID and extensive experiments reveal its effectiveness for handling missing modalities even in the multi-view setup of CASIA-B. | ||