Paper ID | TEC-4.10 | ||
Paper Title | 360° SINGLE IMAGE SUPER RESOLUTION VIA DISTORTION-AWARE NETWORK AND DISTORTED PERSPECTIVE IMAGES | ||
Authors | Akito Nishiyama, University of Tokyo, Japan; Satoshi Ikehata, National Institute of Informatics, Japan; Kiyoharu Aizawa, University of Tokyo, Japan | ||
Session | TEC-4: Super-resolution | ||
Location | Area G | ||
Session Time: | Wednesday, 22 September, 14:30 - 16:00 | ||
Presentation Time: | Wednesday, 22 September, 14:30 - 16:00 | ||
Presentation | Poster | ||
Topic | Image and Video Processing: Interpolation, super-resolution, and mosaicing | ||
IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
Abstract | Effective 360° imaging requires a very high resolution because the field of view is extraordinarily high. Single-image super-resolution (SISR) applied to 360° imaging has the potential to solve the resolution/quality problem in this modality. In this paper, we exploit existing perspective SISR networks to address this problem by (1) introducing a distortion map as an additional input with the 360°-distortion-aware loss function, and (2) augmenting the training 360° images by distorting the perspective images. We also present a new 360° image dataset from YouTube for training. Our extensive experiments show that how each component contributes to the better transfer from the perspective domain to the 360° domain and merging all the ideas leads to the best performance in quantitative and qualitative ways for the 360° SISR task. |