2021 IEEE International Conference on Image Processing
19-22 September 2021 • Anchorage, Alaska, USA
Imaging Without Borders
| Paper ID | TEC-7.2 | ||
| Paper Title | A NOVEL ALL-IN-ONE GRID NETWORK FOR VIDEO FRAME INTERPOLATION | ||
| Authors | Fanyong Xue, Jie Li, Chentao Wu, Shanghai Jiao Tong University, China | ||
| Session | TEC-7: Interpolation, Enhancement, Inpainting | ||
| Location | Area G | ||
| Session Time: | Tuesday, 21 September, 08:00 - 09:30 | ||
| Presentation Time: | Tuesday, 21 September, 08:00 - 09:30 | ||
| Presentation | Poster | ||
| Topic | Image and Video Processing: Interpolation, super-resolution, and mosaicing | ||
| IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
| Abstract | Flow-based approaches for video frame interpolation typically consist of multiple networks that are responsible for feature extraction, optical flow estimation, and image synthesis, respectively. However, they are usually computationally expensive, and can hardly be employed in devices with limited computing resources. In this work, we propose an All-in-one Grid Frame Interpolation Network (AGFIN) to address this problem. AGFIN is a light-weight network with multiple rows and columns. In each row, we estimate the contextual features and optical flows, then the image synthesis module reconstructs the results from the warped frames and features. Each row serves as a coarser or finer auxiliary for the nearest row. In contrast to using multiple networks, our model integrates feature extraction, optical flow estimation, and image synthesis into a compact network. The experimental results show that our approach has better or comparable performance comparing to representative state-of-the-art approaches with less computational cost. | ||