Yago Sanchez de la Fuente
ABSTRACT
Panoramic streaming is a particular way of video streaming where an arbitrary Region-of-Interest (RoI) of high-spatial resolution videos is transmitted, allowing users to navigate around the video and leading to an immersive experience. Tile based streaming has been proposed in the past and is drawing a lot of attention to provide a solution that scales well. In tile base streaming the video is divided into multiple tiles and a subset of tiles of interest is transmitted to the viewer. We propose a low-complexity compressed domain video processing technique, which uses H.265/SHVC and generates a single video bitstream from the selected tiles so that single hardware decoders can be used to decode the RoI video stream. Additionally, the proposed technique makes it possible to use Open GOP structures in the output layer without incurring in any interruption at switching events, which provides a better compression efficiency compared to closed GOP structures.
- ClassX, Stanford University. http://classx.stanford.edu/, Aug. 2015.Google Scholar
- R. van Brandenburg, O. Niamult, M. Prins, H. Stokking, "Spatial Segmentation For Immersive Media Delivery", 2011.Google Scholar
- Christian Weissig, Oliver Schreer, Peter Eisert, Peter Kauff, "The Ultimate Immersive Experience: Panoramic 3D Video Acquisition", Advances in Multimedia Modeling, Lecture Notes in Computer Science Volume 7131, 2012, pp 671--681. Google ScholarDigital Library
- http://www.oculus.com/rift/, Aug. 2015.Google Scholar
- A. Mavlankar, P. Agrawal, D. Pang, S. Halwa, N. Cheung, B. Girod "An interactive Region-of-Interest Video Streaming System for Online Lecture Viewing", Special Session on Advanced Interactive Multimedia Streaming, Proc. of 18th International Packet Video Workshop (PV), Hong Kong, Dec. 2010.Google Scholar
- ISO/IEC 23009--1:2014/Amd 2:2015, "Spatial relationship description, generalized URL parameters and other extensions"Google Scholar
- A. Mavlankar, P. Baccichet, D. Varodayan, and B. Girod, "Optimal Slice Size for Streaming Regions of High Resolution Video with Virtual Pan/Tilt/Zoom Functionality," Proc. of 15th European Signal Processing Conference (EUSIPCO), Poznan, Poland, Sept. 2007Google Scholar
- N. Quang , G. Ravindra, W.T. Ooi, "Adaptive Encoding of Zoomable Video Streams based on User Access Pattern", MMSys 2011, San Jose, Feb. 2011.Google Scholar
- Y. Sanchez, R. Skupin, and T. Schierl: "Compressed Domain Video Processing for Tile based Panoramic Streaming using HEVC", Proceedings of IEEE International Conference on Image Processing (ICIP), Quebec, Canada, September 2015.Google ScholarCross Ref
- ITU-T, Recommendation H.265 (04/15), Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services -- Coding of Moving Video, High Efficiency Video Coding.Google Scholar
- A. Fujibayashi, TK Tan (NTT DOCOMO), "Random access support for HEVC", JCTVC-D234, 4th JCT-VC Meeting, Daegu, January 2011.Google Scholar
- R. Skupin, Y. Sanchez, and T. Schierl: "Compressed Domain Video Compositing with HEVC", Picture Coding Symposium (PCS 2015), Cairns, Australia, May 31 - June 3, 2015.Google ScholarCross Ref
- Y. Sanchéz, R.Globisch, T. Schierl, and T. Wiegand: Low Complexity Cloud-video-Mixing Using HEVC, Proceedings of IEEE Consumer Communications and Networking Conference, Las Vegas, NV, USA, January 2014.Google ScholarCross Ref
Index Terms
- Compressed Domain Video Processing for Tile Based Panoramic Streaming using SHVC
Recommendations
HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications
MM '16: Proceedings of the 24th ACM international conference on MultimediaDelivering wide-angle and high-resolution spherical panoramic video content entails a high streaming bitrate. This imposes challenges when panorama clips are consumed in virtual reality (VR) head-mounted displays (HMD). The reason is that the HMDs ...
Video processing for panoramic streaming using HEVC and its scalable extensions
Panoramic streaming is a particular way of video streaming where an arbitrary Region-of-Interest (RoI) is transmitted from a high-spatial resolution video, i.e. a video covering a very "wide-angle" (much larger than the human field-of-view --- e.g. 360°)...
Low-Complexity Scalable Extension of the High-Efficiency Video Coding (SHVC) Encoding System
The scalable extension of the high-efficiency video coding (SHVC) system adopts a hierarchical quadtree-based coding unit (CU) that is suitable for various texture and motion properties of videos. Currently, the test model of SHVC identifies the optimal ...
Comments