Paper ID | 3D-4.1 | ||
Paper Title | FACTORIZED MODULATION FOR SINGLE-SHOT LIGHT-FIELD ACQUISITION | ||
Authors | Kohei Tateishi, Kohei Sakai, Chihiro Tsutake, Keita Takahashi, Toshiaki Fujii, Nagoya University, Japan | ||
Session | 3D-4: 3D Image and Video Processing | ||
Location | Area J | ||
Session Time: | Tuesday, 21 September, 13:30 - 15:00 | ||
Presentation Time: | Tuesday, 21 September, 13:30 - 15:00 | ||
Presentation | Poster | ||
Topic | Three-Dimensional Image and Video Processing: Light-field Image Processing and Compression | ||
IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
Abstract | A light field (LF), which is represented as a set of dense multi-view images, has been utilized in various 3-D applications. To make LF acquisition more efficient, researchers have investigated compressive sensing methods by incorporating modulation or coding functions into the camera. In this work, we investigate an challenging case of compressive LF acquisition in which an entire LF should be reconstructed from only a single coded image. To achieve this goal, we propose a new modulation scheme called factorized modulation that can approximate arbitrary 4-D modulation patterns in a factorized manner. Our method can be hardware-implemented by combining the architectures for coded aperture and pixel-wise coded exposure imaging. The modulation pattern is jointly optimized with a CNN-based reconstruction algorithm. Our method is validated through extensive evaluations against other modulation schemes. |