Ashutosh Singla
Werner Robitza
ABSTRACT
In this paper, we perform subjective quality evaluation studies for HEVC/H.265-encoded omnidirectional videos at different bit-rates for two different resolutions (FHD and UHD) on an Oculus Rift. Results of these tests provide insight into appropriate coding and resolution settings for given bitrate constraints, for example in an HTTP-based streaming (HAS) context. Subjective quality judgements were collected on a 5-point Absolute Category Rating (ACR) scale. Further, we collected head motion data during viewing and rating. Working towards the technical goal of subjective evaluation for different resolutions and bit-rates, we address aspects of how to conduct respective viewing tests, involving information from head-rotation tracking (yaw and pitch) and motion-sickness questionnaires. Quality adaptation (in terms of resolution and bit-rate) of omnidirectional videos is an important feature of media streaming. Its effect on subjective quality evaluations of 360° video has not been investigated so far. To utilize network and processing resources efficiently, limitations in the resolution of current Head Mounted Displays (HMDs), with typically 2160 x 1200 pixels per view, may be exploited. The subjective test results provide indications for boundaries between resolution and quantization scaling. To discuss the merits of the applied subjective test method, we compare simulator sickness scores along with behavioral data.
- A. Abbas and B. Adsumilli. 2016. New GoPro Test Sequences for Virtual Reality Video Coding. 4th Meeting: Chengdu, China, 15-21 October.Google Scholar
- Stacy A. Balk, Mary Anne Bertola, and Vaughan W. Inman. 2013. Simulator sickness questionnaire: Twenty years later Proceedings of the Seventh International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design. 257--263.Google Scholar
- Ingo Bauermann, Matthias Mielke, and Eckehard Steinbach. 2006. H. 264 based coding of omnidirectional video. Computer Vision and Graphics. Springer, 209--215.Google Scholar
- M. Budagavi, J. Furton, G. Jin, A. Saxena, J. Wilkinson, and A. Dickerson. 2015. 360 degrees video coding using region adaptive smoothing 2015 IEEE International Conference on Image Processing (ICIP). 750--754.Google Scholar
- Marisa Carrasco. 2011. Visual attention: The past 25 years. Vision research, Vol. 51, 13 (2011), 1484--1525.Google Scholar
- Ulrich Engelke and Hans-Jürgen Zepernick. 2010. Framework for optimal region of interest-based quality assessment in wireless imaging. Journal of Electronic Imaging Vol. 19, 1 (2010), 011005--011005.Google ScholarCross Ref
- Peter J. Gianaros, Eric R. Muth, J. Toby Mordkoff, Max E. Levine, and Robert M. Stern. 2001. A questionnaire for the assessment of the multiple dimensions of motion sickness. Aviation, space, and environmental medicine, Vol. 72, 2 (2001), 115.Google Scholar
- Kelly S. Hale and Kay M. Stanney. 2014. Handbook of virtual environments: Design, implementation, and applications. CRC Press. Google ScholarDigital Library
- ITU-R. January 2012. Recommendation ITU-R BT.500-13: Methodology for the subjective assessment of the quality of television pictures. (. January 2012).Google Scholar
- ITU-T. April 2008. Recommendation ITU-T P.910: Subjective video quality assessment methods for multimedia applications. (April 2008).Google Scholar
- Robert S. Kennedy, Norman E. Lane, Kevin S. Berbaum, and Michael G. Lilienthal. 1993. Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. The International Journal of Aviation Psychology, Vol. 3, 3 (1993), 203--220.Google ScholarCross Ref
- S. Leorin, L. Lucchese, and R. G. Cutler. 2005. Quality Assessment of Panorama Video for Videoconferencing Applications 2005 IEEE 7th Workshop on Multimedia Signal Processing. 1--4.Google Scholar
- King-To Ng, Shing-Chow Chan, and Heung-Yeung Shum. 2005. Data compression and transmission aspects of panoramic videos. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 15, 1 (Jan. 2005), 82--95. 1049/ib.2014.0029 Google ScholarDigital Library
- Alexandre Ninassi, Olivier Le Meur, Patrick Le Callet, Dominique Barba, and Arnaud Tirel. 2006. Task impact on the visual attention in subjective image quality assessment. In Signal Processing Conference, 2006 14th European. IEEE, 1--5.Google Scholar
- Yashas Rai, Patrick Le Callet, and Philippe Guillotel. 2017. Which saliency weighting for omni directional image quality assessment? In Quality of Multimedia Experience (QoMEX), 2017 Ninth International Conference on. IEEE, 1--6.Google ScholarCross Ref
- Martin Rerabek, Evgeniy Upenik, and Touradj Ebrahimi. 2016. JPEG backward compatible coding of omnidirectional images. In SPIE Optical Engineering+Applications. International Society for Optics and Photonics, 99711O--99711O.Google Scholar
- A. Singla, S. Fremerey, W. Robitza, and A. Raake. 2017. Measuring and comparing QoE and simulator sickness of omnidirectional videos in different head mounted displays. In 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX). 1--6.Google Scholar
- Vincent Sitzmann, Ana Serrano, Amy Pavel, Maneesh Agrawala, Diego Gutierrez, and Gordon Wetzstein. 2016. Saliency in VR: How do people explore virtual environments? arXiv preprint arXiv:1612.04335 (2016).Google Scholar
- K. K. Sreedhar, A. Aminlou, M. M. Hannuksela, and M. Gabbouj. 2016. Viewport-Adaptive Encoding and Streaming of 360-Degree Video for Virtual Reality Applications. In 2016 IEEE International Symposium on Multimedia (ISM). 583--586.Google Scholar
- T.K. Tan, M. Mrak, R. Weerakkody, N. Ramzan, V. Baroncini, G.J. Sullivan, J.-R. Ohm, and K.D. McCann. 2014. HEVC subjective video quality test results. Institution of Engineering and Technology, United Kingdom. Location: Amsterdam, Netherlands Conference date: 11-15 Sept. 2014.Google Scholar
- I. Tosic and P. Frossard. 2009. Low bit-rate compression of omnidirectional images 2009 Picture Coding Symposium. 1--4. Google ScholarDigital Library
- Evgeniy Upenik, Martin Rerabek, and Touradj Ebrahimi. 2016. A Testbed for Subjective Evaluation of Omnidirectional Visual Content 32nd Picture Coding Symposium.Google Scholar
- M. Yu, H. Lakshman, and B. Girod. 2015. A Framework to Evaluate Omnidirectional Video Coding Schemes 2015 IEEE International Symposium on Mixed and Augmented Reality. 31--36. Google ScholarDigital Library
- Vladyslav Zakharchenko, Kwang Pyo Choi, and Jeong Hoon Park. 2016. Quality metric for spherical panoramic video. In SPIE Optical Engineering+Applications. International Society for Optics and Photonics, 99700C--99700C.Google Scholar
Index Terms
- Comparison of Subjective Quality Evaluation for HEVC Encoded Omnidirectional Videos at Different Bit-rates for UHD and FHD Resolution
Recommendations
Bandwidth Reduction of Omnidirectional Viewport-Dependent Video Streaming via Subjective Quality Assessment
AltMM '17: Proceedings of the 2nd International Workshop on Multimedia Alternate RealitiesOmnidirectional video is more and more widespread in consumer electronics and professional capture devices, as well over Internet via novel streaming services. Omnidirectional video requires a large streaming bandwidth. To date there is little knowledge ...
Subjective quality evaluation of tile-based streaming for omnidirectional videos
MMSys '19: Proceedings of the 10th ACM Multimedia Systems ConferenceIn viewport-adaptive streaming of omnidirectional video, only the field of view is streamed in high quality. While this has significant benefits over streaming the entire 360 sphere, no standard test method for perceived quality and simulator sickness ...
Subjective quality evaluation of compressed digital compound images
We build a new Compound Image Quality Assessment Database (CIQAD).Subjective test is conducted to get the MOS values of images in CIQAD.Five compression methods are compared with respect to the obtained MOS values.We study the applicability of existing ...
Comments