2021 IEEE International Conference on Image Processing

19-22 September 2021 • Anchorage, Alaska, USA

Imaging Without Borders

2021 IEEE International Conference on Image Processing

19-22 September 2021 • Anchorage, Alaska, USA

Login Paper Search My Schedule Paper Index Help

My ICIP 2021 Schedule

Note: Your custom schedule will not be saved unless you create a new account or login to an existing account.
  1. Create a login based on your email (takes less than one minute)
  2. Perform 'Paper Search'
  3. Select papers that you desire to save in your personalized schedule
  4. Click on 'My Schedule' to see the current list of selected papers
  5. Click on 'Printable Version' to create a separate window suitable for printing (the header and menu will appear, but will not actually print)

Paper Detail

Paper IDIMT-CIF-1.10
Paper Title DEEP-FUSION: AN END-TO-END APPROACH FOR COMPRESSIVE SPECTRAL IMAGE FUSION
Authors Roman Jacome, Jorge Bacca, Henry Arguello, Univesridad Industrial de Santander, Colombia
SessionIMT-CIF-1: Computational Imaging 1
LocationArea J
Session Time:Monday, 20 September, 13:30 - 15:00
Presentation Time:Monday, 20 September, 13:30 - 15:00
Presentation Poster
Topic Computational Image Formation: Multi-image & sensor fusion
IEEE Xplore Open Preview  Click here to view in IEEE Xplore
Abstract This paper presents an end-to-end (E2E) deep learning approach for the fusion of the data from two compressive spectral imaging systems, where a single neural network is developed to simultaneously optimize the sensing matrices and the decoder operator. The proposed E2E method models the sensing operator of the systems to fuse as optical layers, where the learnable parameters are the coded apertures of these CSI systems. These optical layers are then concatenated to an inspired unrolled deep neural network, where after training, these sensing matrices remain non-trainable along the optimization stages. Finally, a loss function is proposed. Simulation results show an improvement of the proposed coupled method compared with previous work and an enhancement due to the training of the sensing matrices and the proposed loss function.