Alireza Zare
ABSTRACT
The recent Omnidirectional MediA Format (OMAF) standard specifies delivery of 360° video content. OMAF supports only equirectangular (ERP) and cubemap projections and their region-wise packing with a limitation on video decoding capability to the maximum resolution of 4K (e.g., 4096x2048). Streaming of 4K ERP content allows only a limited viewport resolution, which is lower than the resolution of many current head-mounted displays (HMDs). In order to take the full advantage of those HMDs, this work proposes a specific mixed-resolution packing of 6K (6144x3072) ERP content and its realization in tile-based streaming, while complying with the 4K-decoding constraint and the High Efficiency Video Coding (HEVC) standard. Experimental results indicate that, using Zonal-PSNR test methodology, the proposed layout decreases the streaming bitrate up to 32% in terms of BD-rate, when compared to mixed-quality viewport-adaptive streaming of 4K ERP as an alternative solution.
- Kammachi-Sreedhar K., Aminlou A., Hannuksela M. M., and Gabbouj M. 2016. Viewport-adaptive encoding and streaming of 360-degree video for virtual reality applications. In 2016 IEEE International Symposium on Multimedia (ISM), pp. 583--586.Google Scholar
- Lederer S. 2017. Today's and future challenges with new forms of content like 360°, AR, and VR. 2017. Invited talk in MPEG Workshop Global Media Technology Standards for an Immersive Age, Accessed Dec. 2017, from: http://mpeg.chiariglione.org/sites/default/files/events/06_Lederer.pdf.Google Scholar
- Zare A., Aminlou A., and Hannuksela M. M. 2017. Virtual reality content streaming: viewport-dependent and tile-based techniques. IEEE International Conference on Image Processing (ICIP).Google Scholar
- Sánchez Y., Skupin R., and Schierl T. 2015. Compressed domain video processing for tile based panoramic streaming using HEVC. Proc. of IEEE International Conference on Image Processing (ICIP), pp. 2244--2248.Google Scholar
- Zare A., Aminlou A., Hannuksela M. M., and Gabbouj M. 2016. HEVC-compliant tile-based streaming of panoramic video for virtual reality applications. In Proceedings of the 2016 ACM on Multimedia Conference, pp. 601--605. Google ScholarDigital Library
- Ghaznavi-Youvalari R. et al. 2017. Comparison of HEVC coding schemes for tile-based viewport-adaptive streaming of omnidirectional video. 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP), pp. 1--6. Luton, United Kingdom.Google Scholar
- Choi B., Wang Y., Hannuksela M. M., Lim Y., and Murtaza A. 2017. Text of ISO/IEC FDIS 23090-2 Omnidirectional Media Format, document: MPEG-M41922. Macau, China.Google Scholar
- Mason W. 2016. VR HMD Roundup: Technical Specs. Accessed Apr. 2016, from http://uploadvr.com/vr-hmd-specs/.Google Scholar
- Aminlou A., Kammachi-Sreedhar K., Zare A., and Hannuksela M. M. 2016. Testing methodology for viewport-dependent encoding and streaming. ITU-T Joint Video Exploration Team (JVET), document JVET-D0079. Chengdu.Google Scholar
- Podborski D., Thomas E., Hannuksela M. M., Oh S., Stockhammer T., and Pham S. 2017. Virtual Reality and DASH. International Broadcasting Convention (IBC).Google Scholar
- Information technology -- Dynamic adaptive streaming over HTTP (DASH) -- Part 1: Media presentation description and segment formats (ISO/IEC 23009-1:2014). 2017. Accessed Dec. 2017, from: https://www.iso.org/standard/65274.html.Google Scholar
- Auwera G. V. d., Coban M., and Mart H. 2016. Truncated Square Pyramid Projection (TSP) for 360 video. ITU-T Joint Video Exploration Team (JVET), document: JVET-D0071. Chengdu.Google Scholar
- Zare A., Aminlou A., and Hannuksela M. M. 2017. Requirements and proposed method for viewport-adaptive quality assessment. ITU-T Joint Video Exploration Team (JVET), document: JVET-E0107. Geneva.Google Scholar
- Yu M., Lakshman H., and Girod B. 2015. A Framework to Evaluate Omnidirectional Video Coding Schemes. 2015 IEEE International Symposium on Mixed and Augmented Reality, pp. 31--36. Fukuoka. Google ScholarDigital Library
- Singla A., Fremerey S., Raake A., List P., and Feiten B. 2017. Measurement of User Exploration Behavior for Omnidirectional (360°) Videos with a Head Mounted Display. ITU-T Joint Video Exploration Team (JVET), document: JVET-H0050. Macau, China, (Oct. 2017).Google Scholar
- Boyce J., Alshina E., Abbas A., and Ye Y. 2016. JVET common test conditions and evaluation procedures for 360° video. ITU-T Joint Video Exploration Team (JVET), document: JVET-D1030, (Oct. 2016).Google Scholar
- Bjøntegard G. 2001. Calculation of average PSNR differences between RD-curves, document: VCEG-M33. Austin.Google Scholar
Index Terms
- 6K Effective Resolution with 4K HEVC Decoding Capability for OMAF-compliant 360° Video Streaming
Recommendations
6K and 8K Effective Resolution with 4K HEVC Decoding Capability for 360 Video Streaming
Special Section on Cross-Media Analysis for Visual Question Answering, Special Section on Big Data, Machine Learning and AI Technologies for Art and Design and Special Section on MMSys/NOSSDAV 2018The recent Omnidirectional MediA Format (OMAF) standard, which specifies the delivery of 360° video content, supports only equirectangular projection (ERP) and cubemap projection and their region-wise packing with a limitation on video decoding ...
HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications
MM '16: Proceedings of the 24th ACM international conference on MultimediaDelivering wide-angle and high-resolution spherical panoramic video content entails a high streaming bitrate. This imposes challenges when panorama clips are consumed in virtual reality (VR) head-mounted displays (HMD). The reason is that the HMDs ...
Comparison of HEVC-based OMAF-compliant 6K effective packings for viewport-dependent 360-degree video streaming
PV '20: Proceedings of the 25th ACM Workshop on Packet VideoOmnidirectional MediA Format (OMAF), a recent standard for representation of 360° video content, supports only equirectangular projection (ERP) and cubemap projection (CMP) and their region-wise packing with a 4K decoding-capability constraint on the ...
Comments