Paper ID | MLR-APPL-IVASR-3.10 | ||
Paper Title | RGB-INFRARED PERSON RE-IDENTIFICATION VIA MULTI-MODALITY RELATION AGGREGATION AND GRAPH CONVOLUTION NETWORK | ||
Authors | Jiangshan Sun, Taiping Zhang, Chongqing University, China | ||
Session | MLR-APPL-IVASR-3: Machine learning for image and video analysis, synthesis, and retrieval 3 | ||
Location | Area E | ||
Session Time: | Tuesday, 21 September, 08:00 - 09:30 | ||
Presentation Time: | Tuesday, 21 September, 08:00 - 09:30 | ||
Presentation | Poster | ||
Topic | Applications of Machine Learning: Machine learning for image & video analysis, synthesis, and retrieval | ||
IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
Abstract | RGB-Infrared person Re-identification (RGB-IR Re-ID) task aims at using RGB (infrared) query image to matching personin infrared (RGB) gallery image, the large modality gap between two modalities makes the task very challenging. Different modality image’s feature lacked modality-shared information essentially, leading to large cross-modality discrepancy, existing method are not using modality relations to handle the discrepancy. In this paper, we proposed a novel Graph-based Modality-aware Relation Network (GMRN) to solve this problem, our method contains two parts: 1) finegranularity multi-modality feature aggregation module to incorporate cross-modality information, 2) modality-aware graph convolution network utilize intra-modality relations to further learn discriminative features under two different modalities. Extensive experiments have made on two public RGB-IR Re-ID dataset SYSU-MM01 and RegDB, experiment results show that our method outperforms current stateof-the-art methods by a large margin. Our code is available at https://github.com/clsrsun/GMRN-ReID |