skip to main content
10.1145/3127479.3129262acmconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
research-article

A machine learning approach to live migration modeling

Published:24 September 2017Publication History

ABSTRACT

Live migration is one of the key technologies to improve data center utilization, power efficiency, and maintenance. Various live migration algorithms have been proposed; each exhibiting distinct characteristics in terms of completion time, amount of data transferred, virtual machine (VM) downtime, and VM performance degradation. To make matters worse, not only the migration algorithm but also the applications running inside the migrated VM affect the different performance metrics. With service-level agreements and operational constraints in place, choosing the optimal live migration technique has so far been an open question. In this work, we propose an adaptive machine learning-based model that is able to predict with high accuracy the key characteristics of live migration in dependence of the migration algorithm and the workload running inside the VM. We discuss the important input parameters for accurately modeling the target metrics, and describe how to profile them with little overhead. Compared to existing work, we are not only able to model all commonly used migration algorithms but also predict important metrics that have not been considered so far such as the performance degradation of the VM. In a comparison with the state-of-the-art, we show that the proposed model outperforms existing work by a factor 2 to 5.

References

  1. Sherif Akoush, Ripduman Sohan, Andrew Rice, Andrew W. Moore, and Andy Hopper. 2010. Predicting the Performance of Virtual Machine Migration. In Proceedings of the 2010 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS '10). IEEE Computer Society, Washington, DC, USA, 37--46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Arwa Aldhalaan and Daniel A. Menascé. 2013. Analytic Performance Modeling and Optimization of Live VM Migration. In Proceedings of 10th European Workshop (EPEW '13). 28--42. Google ScholarGoogle ScholarCross RefCross Ref
  3. Amazon EC2 - Virtual Server Hosting 2017. https://aws.amazon.com/ec2/. (2017). Online; accessed August 2017.Google ScholarGoogle Scholar
  4. Fabrice Bellard. 2005. QEMU, a Fast and Portable Dynamic Translator. In Proceedings of the Annual Conference on USENIX Annual Technical Conference (ATEC '05). USENIX Association, Berkeley, CA, USA, 41--41. http://dl.acm.org/citation.cfm?id=1247360.1247401Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Christian Bienia, Sanjeev Kumar, Jaswinder Pal Singh, and Kai Li. 2008. The PARSEC Benchmark Suite: Characterization and Architectural Implications. In Proceedings of the 17th International Conference on Parallel Architectures and Compilation Techniques (PACT '08). ACM, New York, NY, USA, 72--81. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Stephen M. Blackburn, Robin Garner, Chris Hoffmann, Asjad M. Khang, Kathryn S. McKinley, Rotem Bentzur, Amer Diwan, Daniel Feinberg, Daniel Frampton, Samuel Z. Guyer, Martin Hirzel, Antony Hosking, Maria Jump, Han Lee, J. Eliot B. Moss, Aashish Phansalkar, Darko Stefanović, Thomas VanDrunen, Daniel von Dincklage, and Ben Wiedermann. 2006. The DaCapo Benchmarks: Java Benchmarking Development and Analysis. In Proceedings of the 21st Annual ACM SIGPLAN Conference on Object-oriented Programming Systems, Languages, and Applications (OOPSLA '06). ACM, New York, NY, USA, 169--190. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Leo Breiman. 1996. Bagging predictors. Machine Learning 24, 2 (1996), 123--140. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. A. Colin Cameron and Frank A.G. Windmeijer. 1997. An R-squared measure of goodness of fit for some common nonlinear regression models. Journal of Econometrics 77, 2 (1997), 329 -- 342. Google ScholarGoogle ScholarCross RefCross Ref
  9. Ron C. Chiang, Jinho Hwang, H. Howie Huang, and Timothy Wood. 2014. Matrix: Achieving Predictable Virtual Machine Performance in the Clouds. In 11th International Conference on Autonomic Computing (ICAC 14). USENIX Association, Philadelphia, PA, 45--56. https://www.usenix.org/conference/icac14/technical-sessions/presentation/chiangGoogle ScholarGoogle Scholar
  10. Christopher Clark, Keir Fraser, Steven Hand, Jacob Gorm Hansen, Eric Jul, Christian Limpach, Ian Pratt, and Andrew Warfield. 2005. Live Migration of Virtual Machines. In Proceedings of the 2nd Conference on Symposium on Networked Systems Design & Implementation - Volume 2 (NSDI'05). USENIX Association, Berkeley, CA, USA, 273--286. http://dl.acm.org/citation.cfm?id=1251203.1251223Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Christina Delimitrou and Christos Kozyrakis. 2013. QoS-Aware Scheduling in Heterogeneous Datacenters with Paragon. ACM Trans. Comput. Syst. 31, 4, Article 12 (Dec. 2013), 34 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Christina Delimitrou and Christos Kozyrakis. 2014. Quasar: Resource-efficient and QoS-aware Cluster Management. In Proceedings of the 19th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS '14). ACM, New York, NY, USA, 127--144. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Li Deng, Hai Jin, Huacai Chen, and Song Wu. 2013. Migration Cost Aware Mitigating Hot Nodes in the Cloud. In Proceedings of the 2013 International Conference on Cloud Computing and Big Data (CLOUDCOM-ASIA '13). IEEE Computer Society, Washington, DC, USA, 197--204. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Djellel Eddine Difallah, Andrew Pavlo, Carlo Curino, and Philippe Cudre-Mauroux. 2013. OLTP-Bench: An Extensible Testbed for Benchmarking Relational Databases. Proc. VLDB Endow. 7, 4 (Dec. 2013), 277--288. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Jim Gao and Ratnesh Jamidar. 2014. Machine learning applications for data center optimization. Google White Paper (2014).Google ScholarGoogle Scholar
  16. Google Compute Engine 2017. https://cloud.google.com/compute. (2017). Online; accessed August 2017.Google ScholarGoogle Scholar
  17. Google Compute Engine uses Live Migration technology to service infrastructure without application downtime 2017. https://goo.gl/Ui3HFd. (2017). Online; accessed August 2017.Google ScholarGoogle Scholar
  18. Fabien Hermenier, Xavier Lorca, Jean-Marc Menaud, Gilles Muller, and Julia Lawall. 2009. Entropy: A Consolidation Manager for Clusters. In Proceedings of the 2009 ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE '09). ACM, New York, NY, USA, 41--50. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Michael R. Hines and Kartik Gopalan. 2009. Post-copy Based Live Virtual Machine Migration Using Adaptive Pre-paging and Dynamic Self-ballooning. In Proceedings of the 2009 ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE '09). ACM, New York, NY, USA, 51--60. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Hai Jin, Li Deng, Song Wu, Xuanhua Shi, and Xiaodong Pan. 2009. Live virtual machine migration with adaptive, memory compression. In 2009 IEEE International Conference on Cluster Computing and Workshops. 1--10. Google ScholarGoogle ScholarCross RefCross Ref
  21. Changyeon Jo and Bernhard Egger. 2013. Optimizing Live Migration for Virtual Desktop Clouds. In IEEE 5th International Conference on Cloud Computing Technology and Science (CloudCom '13), Vol. 1. 104--111. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Changyeon Jo, Erik Gustafsson, Jeongseok Son, and Bernhard Egger. 2013. Efficient Live Migration of Virtual Machines Using Shared Storage. In Proceedings of the 9th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE '13). ACM, New York, NY, USA, 41--50. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Jonathan Koomey. 2011. Growth in data center electricity use 2005 to 2010. A report by Analytical Press, completed at the request of The New York Times 9 (2011).Google ScholarGoogle Scholar
  24. Sajib Kundu, Raju Rangaswami, Ajay Gulati, Ming Zhao, and Kaushik Dutta. 2012. Modeling Virtualized Applications Using Machine Learning Techniques. In Proceedings of the 8th ACM SIGPLAN/SIGOPS Conference on Virtual Execution Environments (VEE '12). ACM, New York, NY, USA, 3--14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Jianxin Li, Jieyu Zhao, Yi Li, Lei Cui, Bo Li, Lu Liu, and John Panneerselvam. 2014. iMIG: Toward an Adaptive Live Migration Method for KVM Virtual Machines. Comput. J. 58, 6 (2014), 1227. Google ScholarGoogle ScholarCross RefCross Ref
  26. Haikun Liu and Bingsheng He. 2015. VMbuddies: Coordinating Live Migration of Multi-Tier Applications in Cloud Environments. IEEE Transactions on Parallel and Distributed Systems 26, 4 (April 2015), 1192--1205. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Haikun Liu, Hai Jin, Cheng-Zhong Xu, and Xiaofei Liao. 2013. Performance and energy modeling for live migration of virtual machines. Cluster Computing 16, 2 (2013), 249--264. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Zhaobin Liu, Wenyu Qu, Weijiang Liu, and Keqiu Li. 2010. Xen Live Migration with Slowdown Scheduling Algorithm. In Proceedings of the 2010 International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT '10). IEEE Computer Society, Washington, DC, USA, 215--221. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Vijay Mann, Akanksha Gupta, Partha Dutta, Anilkumar Vishnoi, Parantapa Bhattacharya, Rishabh Poddar, and Aakash Iyer. 2012. Remedy: Network-Aware Steady State VM Management for Data Centers. Springer Berlin Heidelberg, Berlin, Heidelberg, 190--204. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Memcached - a distributed memory object caching system 2017. https://memcached.org/. (2017). Online; accessed August 2017.Google ScholarGoogle Scholar
  31. Microsoft Azure - Virtual Machines 2017. https://azure.microsoft.com/en-us/services/virtual-machines/. (2017). Online; accessed August 2017.Google ScholarGoogle Scholar
  32. M. Mishra, A. Das, P. Kulkarni, and A. Sahoo. 2012. Dynamic resource management using virtual machine migrations. IEEE Communications Magazine 50, 9 (September 2012), 34--40. Google ScholarGoogle ScholarCross RefCross Ref
  33. MPlayer - The Movie Player 2017. http://www.mplayerhq.hu/design7/news.html. (2017). Online; accessed August 2017.Google ScholarGoogle Scholar
  34. Senthil Nathan, Umesh Bellur, and Purushottam Kulkarni. 2015. Towards a Comprehensive Performance Model of Virtual Machine Live Migration. In Proceedings of the Sixth ACM Symposium on Cloud Computing (SoCC '15). ACM, New York, NY, USA, 288--301. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Senthil Nathan, Umesh Bellur, and Purushottam Kulkarni. 2016. On Selecting the Right Optimizations for Virtual Machine Migration. In Proceedings of the 12th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE '16). ACM, New York, NY, USA, 37--49. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Senthil Nathan, Purushottam Kulkarni, and Umesh Bellur. 2013. Resource Availability Based Performance Benchmarking of Virtual Machine Migrations. In Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering (ICPE '13). ACM, New York, NY, USA, 387--398. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Michael Nelson, Beng-Hong Lim, and Greg Hutchins. 2005. Fast Transparent Migration for Virtual Machines. In Proceedings of the Annual Conference on USENIX Annual Technical Conference (ATEC '05). USENIX Association, Berkeley, CA, USA, 25--25. http://dl.acm.org/citation.cfm?id=1247360.1247385Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Hiep Nguyen, Zhiming Shen, Xiaohui Gu, Sethuraman Subbiah, and John Wilkes. 2013. AGILE: Elastic Distributed Resource Scaling for Infrastructure-as-a-Service. In Proceedings of the 10th International Conference on Autonomic Computing (ICAC 13). USENIX, San Jose, CA, 69--82. https://www.usenix.org/conference/icac13/technical-sessions/presentation/nguyenGoogle ScholarGoogle Scholar
  39. Dejan Novaković, Nedeljko Vasić, Stanko Novaković, Dejan Kostić, and Ricardo Bianchini. 2013. DeepDive: Transparently Identifying and Managing Performance Interference in Virtualized Environments. In Proceedings of the 2013 USENIX Conference on Annual Technical Conference (USENIX ATC'13). USENIX Association, Berkeley, CA, USA, 219--230. http://dl.acm.org/citation.cfm?id=2535461.2535489Google ScholarGoogle Scholar
  40. Greg Schulz. 2009. The green and virtual data center. Auerbach Publications Boston.Google ScholarGoogle Scholar
  41. scikit-learn - Machine Learning in Python 2017. http://scikit-learn.org/stable/. (2017). Online; accessed August 2017.Google ScholarGoogle Scholar
  42. C. E. Shannon. 2001. A Mathematical Theory of Communication. SIGMOBILE Mob. Comput. Commun. Rev. 5, 1 (Jan. 2001), 3--55. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. SPECweb2009 2017. https://www.spec.org/web2009/. (2017). Online; accessed August 2017.Google ScholarGoogle Scholar
  44. Petter Svärd, Benoit Hudzia, Johan Tordsson, and Erik Elmroth. 2011. Evaluation of Delta Compression Techniques for Efficient Live Migration of Large Virtual Machines. In Proceedings of the 7th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE '11). ACM, New York, NY, USA, 111--120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Petter Svärd, Benoit Hudzia, Steve Walsh, Johan Tordsson, and Erik Elmroth. 2015. Principles and Performance Characteristics of Algorithms for Live VM Migration. SIGOPS Operating Systems Review - Special Issue on Repeatability and Sharing of Experimental Artifacts 49, 1 (Jan. 2015), 142--155. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. The Xen Project 2017. https://www.xenproject.org/. (2017). Online; accessed August 2017.Google ScholarGoogle Scholar
  47. Marvin M. Theimer, Keith A. Lantz, and David R. Cheriton. 1985. Preemptable Remote Execution Facilities for the V-system. In Proceedings of the Tenth ACM Symposium on Operating Systems Principles (SOSP '85). ACM, New York, NY, USA, 2--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. VMware Virtualization Solutions 2017. http://www.vmware.com/. (2017). Online; accessed August 2017.Google ScholarGoogle Scholar
  49. William Voorsluys, James Broberg, Srikumar Venugopal, and Rajkumar Buyya. 2009. Cost of Virtual Machine Live Migration in Clouds: A Performance Evaluation. In Proceedings of the 1st International Conference on Cloud Computing (CloudCom '09). Springer-Verlag, Berlin, Heidelberg, 254--265. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Yangyang Wu and Ming Zhao. 2011. Performance Modeling of Virtual Machine Live Migration. In Proceedings of the 2011 IEEE 4th International Conference on Cloud Computing (CLOUD '11). IEEE Computer Society, Washington, DC, USA, 492--499. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Fei Xu, Fangming Liu, Linghui Liu, Hai Jin, Bo Li, and Baochun Li. 2014. iAware: Making Live Migration of Virtual Machines Interference-Aware in the Cloud. IEEE Trans. Comput. 63, 12 (Dec 2014), 3012--3025. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Kejiang Ye, Zhaohui Wu, Chen Wang, Bing Bing Zhou, Weisheng Si, Xiaohong Jiang, and Albert Y Zomaya. 2015. Profiling-Based Workload Consolidation and Migration in Virtualized Data Centers. IEEE Transactions on Parallel and Distributed Systems 26, 3 (March 2015), 878--890. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Jiao Zhang, Fengyuan Ren, and Chuang Lin. 2014. Delay guaranteed live migration of Virtual Machines. In IEEE INFOCOM 2014 - IEEE Conference on Computer Communications. 574--582. Google ScholarGoogle ScholarCross RefCross Ref
  54. Jie Zheng, TS Ng, Kunwadee Sripanidkulchai, and Zhaolei Liu. 2013. Pacer: A Progress Management System for Live Virtual Machine Migration in Cloud Computing. IEEE Transactions on Network and Service Management 10, 4 (December 2013), 369--382. Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. A machine learning approach to live migration modeling

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          SoCC '17: Proceedings of the 2017 Symposium on Cloud Computing
          September 2017
          672 pages
          ISBN:9781450350280
          DOI:10.1145/3127479

          Copyright © 2017 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 24 September 2017

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          Overall Acceptance Rate169of722submissions,23%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader