Fanyi Duanmu
ABSTRACT
360 degree video compression and streaming is one of the key components of Virtual Reality (VR) applications. In 360 video streaming, a user may freely navigate through the captured 3D environment by changing her desired viewing direction. Only a small portion of the entire 360 degree video is watched at any time. Streaming the entire 360 degree raw video is therefore unnecessary and bandwidth-consuming. One the other hand, only streaming the video in the predicted user's view direction will introduce streaming discontinuity whenever the the prediction is wrong. In this work, a two-tier 360 video streaming framework with prioritized buffer control is proposed to effectively accommodate the dynamics in both network bandwidth and viewing direction. Through simulations driven by real network bandwidth and viewing direction traces, we demonstrate that the proposed framework can significantly outperform the conventional 360 video streaming solutions.
Supplemental Material
- 2014. OpenTrack: head tracking software. (2014). https://github.com/opentrack/opentrackGoogle Scholar
- 2015. Google Cardboard. (2015). https://vr.google.com/cardboardGoogle Scholar
- M. Budagavi, J. Furton, G. Jin, A. Saxena, J. Wilkinson, and A. Dickerson. 2015. 360 degrees video coding using region adaptive smoothing. In Proc. IEEE Int. Conf. Image Processing (ICIP). IEEE, 750--754. Google ScholarCross Ref
- G. Van der Auwera, Hendry M. Coban, and M. Karczewicz. 2016. Truncated Square Pyramid Projection (TSP) For 360 Video, JVET Doc. D0071.Google Scholar
- F. Duanmu, E. Kurdoglu, Y. Liu, and Y. Wang. 2017. View Direction and Bandwidth Adaptive 360 Degree Video Streaming using a Two-Tier System. In Proc. IEEE International Symposium on Circuits and Systems (ISCAS '17). IEEE, Baltimore, MD, USA.Google Scholar
- Eymen Kurdoglu, Yong Liu, Yao Wang, Yongfang Shi, ChenChen Gu, and Jing Lyu. 2016. Real-time Bandwidth Prediction and Rate Adaptation for Video Calls over Cellular Networks. In Proceedings of the 7th International Conference on Multimedia Systems (MMSys '16). ACM, New York, NY, USA. Google ScholarDigital Library
- Evgeny Kuzyakov. 2015. Under the hood: Building 360 video. (2015). https://code.facebook.com/posts/1638767863078802/under-the-hood-building-360-video/Google Scholar
- Evgeny Kuzyakov. 2016. Next-generation video encoding techniques for 360 video and VR. (2016). https://code.facebook.com/posts/1126354007399553/next-generation-video-encoding-techniques-for-360-video-and-vr/Google Scholar
- H.-C. Lin, C.-Y. Li, J.-L. Lin, S.-K. Chang, and C.-C. Ju. 2016. An efficient compact layout for octahedron format, JVET Doc. D0142.Google Scholar
- Feng Qian, Lusheng Ji, Bo Han, and Vijay Gopalakrishnan. 2016. Optimizing 360 Video Delivery over Cellular Networks. In Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges (ATC '16). ACM, New York, NY, USA, 1--6. Google ScholarDigital Library
- Iraj Sodagar. 2011. The mpeg-dash standard for multimedia streaming over the internet. IEEE Multimedia 18, 4 (2011), 62--67. Google ScholarDigital Library
- Guibin Tian and Yong Liu. 2012. Towards agile and smooth video adaptation in dynamic HTTP streaming. In Proceedings of the 8th international conference on Emerging networking experiments and technologies. ACM, 109--120. Google ScholarDigital Library
- Y.-K. Wang, Hendry, and M. Karczewicz. 2016. Tile based VR video encoding and decoding schemes, JCTVC Doc. X0077.Google Scholar
- C. Zhang, Y. Lu, J. Li, and Z. Wen. 2016. segmented sphere projection (SSP) for 360-degree video content, JVET Doc. D0030.Google Scholar
- Minhua Zhou. 2016. A study on compression efficiency of icosahedral projection, JVET Doc. D0023.Google Scholar
Index Terms
- Prioritized Buffer Control in Two-tier 360 Video Streaming
Recommendations
A Survey on 360° Video Streaming: Acquisition, Transmission, and Display
Head-mounted displays and 360° videos have become increasingly more popular, delivering a more immersive viewing experience to end users. Streaming 360° videos over the best-effort Internet, however, faces tremendous challenges, because of the high ...
Multi-path multi-tier 360-degree video streaming in 5G networks
MMSys '18: Proceedings of the 9th ACM Multimedia Systems Conference360° video streaming is a key component of the emerging Virtual Reality (VR) and Augmented Reality (AR) applications. In 360° video streaming, a user may freely navigate through the captured 360° video scene by changing her desired Field-of-View. High-...
Power Evaluation of 360 VR Video Streaming on Head Mounted Display Devices
NOSSDAV'17: Proceedings of the 27th Workshop on Network and Operating Systems Support for Digital Audio and VideoVirtual reality (VR) video streaming with 360-degree views has become a trending video application recently. While providing the users with immersive video viewing experiences, the 360 video streaming introduces significantly higher overhead than the ...
Comments