ABSTRACT
Bitrate adaptation is critical in ensuring good users’ quality-of-experience (QoE) in Internet video delivery system. Several efforts have argued that accurate throughput prediction can dramatically improve (1) initial bitrate selection for low startup delay and high initial resolution; (2) midstream bitrate adaptation for high QoE. However, prior ef- forts did not systematically quantify real-world throughput predictability or develop good prediction algorithms. To bridge this gap, this paper makes three key technical contributions: First, we analyze the throughput characteristics in a dataset with 20M+ sessions. We find: (a) Sessions sharing similar key features (e.g., ISP, region) present similar initial values and dynamical patterns; (b) There is a natural “stateful” dynamical behavior within a given session. Second, building on these insights, we develop CS2P, a better throughput prediction system. CS2P leverages data-driven approach to learn (a) clusters of similar sessions, (b) an initial throughput predictor, and (c) a Hidden-Markov-Model based midstream predictor modeling the stateful evolution of throughput. Third, we develop a prototype system and show by trace-driven simulation and real-world experiments that CS2P outperforms state-of-art by 40% and 50% median pre- diction error respectively for initial and midstream through- put and improves QoE by 14% over buffer-based adaptation algorithm.
Supplemental Material
- 1.Cisco Visual Networking Index. http://www.cisco.com/c/en/us/solutions/service-provider/visual-networking-index-vni/index.html.Google Scholar
- 2.DASH-264 JavaScript reference client landing page 1.4.0. http://dashif.org/reference/players/javascript/1.4.0/samples/dash-if-reference-player/index.html.Google Scholar
- 3.Dash.js. https://github.com/Dash-Industry-Forum/dash.js/wiki.Google Scholar
- 4.FCC Measuring Broadband America. http://www.fcc.gov/measuring-broadband-america.Google Scholar
- 5.Final Report on the Validation of Objective Models of Video Quality Assessment. http://videoclarity.com/PDF/COM-80E_final_report.pdf.Google Scholar
- 6.Hadamard Product. https://en.wikipedia.org/wiki/Hadamard_product_(matrices).Google Scholar
- 7.HSDPA. http://home.ifi.uio.no/paalh/dataset/hsdpa-tcp-logs/.Google Scholar
- 8.iQIYI. http://www.iqiyi.com.Google Scholar
- 9.MLab NDT. https://console.cloud.google.com/storage/browser/m-lab/ndt/.Google Scholar
- 10.Netflix. http://www.netflix.com.Google Scholar
- 11.Node.js. https://nodejs.org/en/.Google Scholar
- 12.Pathchar. http://www.caida.org/tools/utilities/others/pathchar/.Google Scholar
- 13.YouTube live encoder settings, bitrates and resolutions. https://support.google.com/youtube/answer/2853702?hl=en.Google Scholar
- 14.S. Akhshabi, L. Anantakrishnan, C. Dovrolis, and A. C. Begen. Server-Based Traffic Shaping for Stabilizing Oscillating Adaptive Streaming Players. In Proc.ACM NOSSDAV, 2013. Google ScholarDigital Library
- 15.A. Balachandran, V. Sekar, A. Akella, and S. Seshan. Analyzing the Potential Benefits of CDN Augmentation Strategies for Internet Video Workloads. In Proc.ACM IMC, 2013. Google ScholarDigital Library
- 16.A. Balachandran, V. Sekar, A. Akella, S. Seshan, I. Stoica, and H. Zhang. Developing a Predictive Model of Quality of Experience for Internet Video. In Proc.ACM SIGCOMM, 2013. Google ScholarDigital Library
- 17.H. Balakrishnan, M. Stemm, S. Seshan, and R. H. Katz. Analyzing Stability in Wide-area Network Performance. ACM SIGMETRICS Performance Evaluation Review, 25(1):2–12, 1997. Google ScholarDigital Library
- 18.C. M. Bishop. Pattern Recognition and Machine Learning. springer, 2006. Google ScholarDigital Library
- 19.F. Dabek, R. Cox, F. Kaashoek, and R. Morris. Vivaldi: A Decentralized Network Coordinate System. In Proc.ACM SIGCOMM, 2004. Google ScholarDigital Library
- 20.L. De Cicco, S. Mascolo, and V. Palmisano. Feedback Control for Adaptive Live Video Streaming. In Proc.ACM MMSys, 2011. Google ScholarDigital Library
- 21.M. Dischinger, M. Marcon, S. Guha, P. K. Gummadi, R. Mahajan, and S. Saroiu. Glasnost: Enabling End Users to Detect Traffic Differentiation. In Proc.USENIX NSDI, 2010. Google ScholarDigital Library
- 22.F. Dobrian, V. Sekar, A. Awan, I. Stoica, D. Joseph, A. Ganjam, J. Zhan, and H. Zhang. Understanding the Impact of Video Quality on User Engagement. In Proc.ACM SIGCOMM, 2011. Google ScholarDigital Library
- 23.A. Ganjam, F. Siddiqui, J. Zhan, X. Liu, I. Stoica, J. Jiang, V. Sekar, and H. Zhang. C3: Internet-Scale Control Plane for Video Quality Optimization. In Proc.USENIX NSDI, 2015. Google ScholarDigital Library
- 24.Q. He, C. Dovrolis, and M. Ammar. On the Predictability of Large Transfer TCP Throughput. In Proc.ACM SIGCOMM, 2005. Google ScholarDigital Library
- 25.N. Hu, L. Li, Z. M. Mao, P. Steenkiste, and J. Wang. A Measurement Study of Internet Bottlenecks. In Proc.IEEE INFOCOM, 2005.Google Scholar
- 26.N. Hu, L. E. Li, Z. M. Mao, P. Steenkiste, and J. Wang. Locating Internet Bottlenecks: Algorithms, Measurements, and Implications. In Proc.ACM SIGCOMM, 2004. Google ScholarDigital Library
- 27.T. Y. Huang, R. Johari, N. McKeown, M. Trunnell, and M. Watson. A Buffer-Based Approach to Rate Adaptation: Evidence from a Large Video Streaming Service. In Proc.ACM SIGCOMM, 2014. Google ScholarDigital Library
- 28.M. Jain and C. Dovrolis. End-to-end Estimation of the Available Bandwidth Variation Range. ACM SIGMETRICS Performance Evaluation Review, 33(1):265–276, 2005. Google ScholarDigital Library
- 29.J. Jiang, V. Sekar, H. Milner, D. Shepherd, I. Stoica, and H. Zhang. CFA: A Practical Prediction System for Video QoE Optimization. In Proc.USENIX NSDI, 2016. Google ScholarDigital Library
- 30.J. Jiang, V. Sekar, and H. Zhang. Improving Fairness, Efficiency, and Stability in HTTP-Based Adaptive Video Streaming with Festive. IEEE/ACM Transactions on Networking, 22(1):326–340, 2014. Google ScholarDigital Library
- 31.S. S. Krishnan and R. K. Sitaraman. Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-experimental Designs. In Proc.ACM IMC, 2012. Google ScholarDigital Library
- 32.Y. S. Lim, Y. C. Chen, E. M. Nahum, D. Towsley, and R. J. Gibbens. How Green is Multipath TCP for Mobile Devices? In Proc.ACM SIGCOMM AllThingsCellular, 2014. Google ScholarDigital Library
- 33.H. V. Madhyastha, T. Isdal, M. Piatek, C. Dixon, T. Anderson, A. Krishnamurthy, and A. Venkataramani. iPlane: An Information Plane for Distributed Services. In Proc.USENIX OSDI, 2006. Google ScholarDigital Library
- 34.M. Mirza, J. Sommers, P. Barford, and X. Zhu. A Machine Learning Approach to TCP Throughput Prediction. In Proc.ACM SIGMETRICS, 2007. Google ScholarDigital Library
- 35.K. Murphy and M. Dunham. PMTK: Probabilistic Modeling Toolkit. In Proc.NIPS, 2008.Google Scholar
- 36.A. Nikravesh, D. R. Choffnes, E. Katz-Bassett, Z. M. Mao, and M. Welsh. Mobile Network Performance from User Devices: A Longitudinal, Multidimensional Analysis. In Proc.PAM, 2014. Google ScholarDigital Library
- 37.B. A. A. Nunes, K. Veenstra, W. Ballenthin, S. Lukin, and K. Obraczka. A Machine Learning Framework for TCP Round-trip Time Estimation. EURASIP Journal on Wireless Communications and Networking, 2014(1):1–22, 2014.Google ScholarCross Ref
- 38.J. Padhye, V. Firoiu, D. Towsley, and J. Kurose. Modeling TCP Throughput: A Simple Model and its Empirical Validation. In Proc.ACM SIGCOMM, 1998. Google ScholarDigital Library
- 39.F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, and J. Vanderplas. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, 12:2825–2830, 2011. Google ScholarDigital Library
- 40.V. Ramasubramanian, D. Malkhi, F. Kuhn, M. Balakrishnan, A. Gupta, and A. Akella. On the Treeness of Internet Latency and Bandwidth. ACM SIGMETRICS Performance Evaluation Review, 37(1):61–72, 2009. Google ScholarDigital Library
- 41.G. Ridgeway. Generalized Boosted Models: A Guide to the GBM Package. Update, 1(1):1–12, 2007.Google Scholar
- 42.K. Salamatian and S. Vaton. Hidden Markov Modeling for Network Communication Channels. In Proc.ACM SIGMETRICS, 2001. Google ScholarDigital Library
- 43.S. Sundaresan, W. De Donato, N. Feamster, R. Teixeira, S. Crawford, and A. Pescape. Broadband Internet Performance: A View From the Gateway. In Proc.ACM SIGCOMM, 2011. Google ScholarDigital Library
- 44.S. Tao and R. Guerin. Application-specific Path Switching: a Case Study for Streaming Video. In Proc.ACM Multimedia, 2004. Google ScholarDigital Library
- 45.G. Tian and Y. Liu. Towards Agile and Smooth Video Adaptation in Dynamic HTTP Streaming. In Proc.ACM CoNEXT, 2012. Google ScholarDigital Library
- 46.W. Wei, B. Wang, and D. Towsley. Continuous-time Hidden Markov Models for Network Performance Evaluation. Performance Evaluation, 49(14):129–146, 2002. Google ScholarDigital Library
- 47.X. Yin, A. Jindal, V. Sekar, and B. Sinopoli. A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. In Proc.ACM SIGCOMM, 2015. Google ScholarDigital Library
- 48.X. Yin, V. Sekar, and B. Sinopoli. Toward a Principled Framework to Design Dynamic Adaptive Streaming Algorithms over HTTP. In Proc.ACM SIGCOMM HotNets, 2014. Google ScholarDigital Library
- 49.Y. Zhang, N. Duffield, V. Paxson, and S. Shenker. On the Constancy of Internet Path Properties. In Proc.ACM IMW, 2001. Google ScholarDigital Library
- 50.X. K. Zou, J. Erman, V. Gopalakrishnan, E. Halepovic, R. Jana, X. Jin, J. Rexford, and R. K. Sinha. Can Accurate Predictions Improve Video Streaming in Cellular Networks? In Proc.ACM HotMobile, 2015. Google ScholarDigital Library
Index Terms
- CS2P: Improving Video Bitrate Selection and Adaptation with Data-Driven Throughput Prediction
Recommendations
PRIOR: deep reinforced adaptive video streaming with attention-based throughput prediction
NOSSDAV '22: Proceedings of the 32nd Workshop on Network and Operating Systems Support for Digital Audio and VideoVideo service providers have deployed dynamic video bitrate adaptation services to fulfill user demands for higher video quality. However, fluctuations and instability of network conditions inhibit the performance promotion of adaptive bitrate (ABR) ...
Smooth DASH adaptation exploiting throughput prediction
MobiArch '16: Proceedings of the Workshop on Mobility in the Evolving Internet ArchitectureWe present and evaluate a procedure that exploits throughput prediction to select the DASH video quality sequence (sequence of representations) with the highest average bit rate and the fewest quality switches, while explicitly taking into account ...
Incorporating Prediction into Adaptive Streaming Algorithms: A QoE Perspective
NOSSDAV '18: Proceedings of the 28th ACM SIGMM Workshop on Network and Operating Systems Support for Digital Audio and VideoStreaming over the wireless channel is challenging due to rapid fluctuations in available throughput. Encouraged by recent advances in cellular throughput prediction based on radio link metrics, we examine the impact on Quality of Experience (QoE) when ...
Comments