Paper ID | COM-3.5 | ||
Paper Title | Attention-driven tile splitting method for improved efficiency of omnidirectional versatile video Coding | ||
Authors | Joao Carreira, Instituto de Telecomunicações, Portugal; Sergio Faria, Instituto de Telecomunicações / Polytechnic of Leiria, Portugal; Luis Tavora, Polytechnic of Leiria, Portugal; Antonio Navarro, Instituto de Telecomunicações / Universidade de Aveiro, Portugal; Pedro Assuncao, Instituto de Telecomunicações / Polytechnic of Leiria, Portugal | ||
Session | COM-3: Image and Video Communications | ||
Location | Area H | ||
Session Time: | Tuesday, 21 September, 13:30 - 15:00 | ||
Presentation Time: | Tuesday, 21 September, 13:30 - 15:00 | ||
Presentation | Poster | ||
Topic | Image and Video Communications: Lossy coding of images & video | ||
IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
Abstract | A common approach used in omnidirectional video coding is based on frame splitting into tiles, allowing partial delivery of only the subset of tiles that is necessary to render the user’s current viewing region, defined as a specific viewport or Field-of-View (FoV). Since tiles can be independently encoded, such mechanism provides a flexible solution for encoding planar representations with ultra-high definition (UHD), such as the Equirectangular Projection (ERP), using Versatile Video Coding (VVC). By only selecting and transmitting the coded data that is required to render the necessary FoV, rather than the full 360º, a great deal of bandwidth can be saved. While current solutions are based on splitting the omnidirectional video frames into tiles of equal size, this paper proposes a new approach based on adaptive tile size, driven by visual attention. Those regions where the visual attention is higher are partitioned in smaller tiles to obtain higher bit rate granularity, allowing to decode the most frequent FoVs with minimum out-of-FoV pixels and reduced bandwidth. Optimal tile boundaries are found by solving a lagrangian minimisation problem with a cost function that achieves the best tradeoff between the standard deviation and the average attention-weighted bit rate per tile. The experimental results show that an average of 7.17% and 17.73% of bit rate savings is obtained in comparison with conventional tilling methods for the commonly used FoVs of 90ºx90º and 45ºx45º, respectively. |