skip to main content
10.1145/2670979.2671003acmconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
tutorial

Distributed Autonomous Virtual Resource Management in Datacenters Using Finite-Markov Decision Process

Authors Info & Claims
Published:03 November 2014Publication History

ABSTRACT

To provide robust infrastructure as a service (IaaS), clouds currently perform load balancing by migrating virtual machines (VMs) from heavily loaded physical machines (PMs) to lightly loaded PMs. Previous reactive load balancing algorithms migrate VMs upon the occurrence of load imbalance, while previous proactive load balancing algorithms predict PM overload to conduct VM migration. However, both methods cannot maintain long-term load balance and produce high overhead and delay due to migration VM selection and destination PM selection. To overcome these problems, in this paper, we propose a proactive Markov Decision Process (MDP)-based load balancing algorithm. We handle the challenges of allying MDP in virtual resource management in cloud datacenters, which allows a PM to proactively find an optimal action to transit to a lightly loaded state that will maintain for a longer period of time. We also apply the MDP to determine destination PMs to achieve long-term PM load balance state. Our algorithm reduces the numbers of Service Level Agreement (SLA) violations by long-term load balance maintenance, and also reduces the load balancing overhead (e.g., CPU time, energy) and delay by quickly identifying VMs and destination PMs to migrate. Our trace-driven experiments show that our algorithm outperforms both previous reactive and proactive load balancing algorithms in terms of SLA violation, load balancing efficiency and long-term load balance maintenance.

References

  1. Microsoft Azure. http://www.windowsazure.com.Google ScholarGoogle Scholar
  2. BEA System Inc. http://www.bea.com.Google ScholarGoogle Scholar
  3. Amazon. Amazon Web Service. http://aws.amazon.com/.Google ScholarGoogle Scholar
  4. E. Arzuaga and D. R. Kaeli. Quantifying load imbalance on virtualized enterprise servers. In Proc. of WOSP/SIPEW, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. R. Bellman. Dynamic Programming. Princeton University Press, 1957. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. A. Beloglazov and R. Buyya. Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. CCPE, 24(13):1397--1420, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. A. Beloglazov and R. Buyya. Managing overloaded hosts for dynamic consolidation of virtual machines in cloud data centers under quality of service constraints. TPDS, 24(7): 1366--1379, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. N. Bobroff, A. Kochut, and K. Beaty. Dynamic placement of virtual machines for managing sla violations. In Proc. of IM, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  9. R. N. Calheiros, R. Ranjan, A. Beloglazov, C. De Rose, and R. Buyya. Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. SPE, 41(1):23--50, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. A. Chandra, W. Gong, and P. J. Shenoy. Dynamic resource allocation for shared data centers using online measurements. In Proc. of SIGMETRICS, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. L. Chen, H. Shen, and S. Sapra. RIAL: Resource intensity aware load balancing in clouds. In Proc. of INFOCOM, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  12. Z. Gong, X. Gu, and J. Wilkes. PRESS: Predictive elastic resource scaling for cloud systems. In Proc. of CNSM, 2010.Google ScholarGoogle Scholar
  13. GoogleTraceWebsite. Google cluster data. https://code.google.com/p/googleclusterdata/.Google ScholarGoogle Scholar
  14. R. A. Howard. Dynamic Programming and Markov Processes. MIT Press, 1960.Google ScholarGoogle Scholar
  15. D. Kondo, B. Javadi, P. Malecot, F. Cappello, and D. P. Anderson. Cost-benefit analysis of cloud computing versus desktop grids. In Proc. of IPDPS, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. M. Lauri and E. Brad. Energy Efficiency for Information Technology: How to Reduce Power Consumption in Servers and Data Centers. Intel Press, 2009.Google ScholarGoogle Scholar
  17. A. Sallam and K. Li. A multi-objective virtual machine migration policy in cloud systems. The Computer Journal, 57(2):195--204, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  18. U. Sharma, P. J. Shenoy, S. Sahu, and A. Shaikh. A cost-aware elasticity provisioning system for the cloud. In Proc. of ICDCS, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Z. Shen, S. Subbiah, X. Gu, and J. Wilkes. CloudScale: Elastic resource scaling for multi-tenant cloud systems. In Proc. of SOCC, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. A. Singh, M. R. Korupolu, and D. Mohapatra. Server-storage virtualization: integration and load balancing in data centers. In Proc. of SC, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. M. Tarighi, S. A. Motamedi, and S. Sharifian. A new model for virtual machine migration in virtualized cluster server based on fuzzy decision making. CoRR, 1(1):40--51, 2010.Google ScholarGoogle Scholar
  22. T. Wood, P. J. Shenoy, A. Venkataramani, and M. S. Yousif. Black-box and gray-box strategies for virtual machine migration. In Proc. of NSDI, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. T. Wood, P. Shenoy, A. Venkataramani, and M. Yousif. Sandpiper: Black-box and gray-box resource management for virtual machines. Computer Networks, 53(17):2923--2938, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Distributed Autonomous Virtual Resource Management in Datacenters Using Finite-Markov Decision Process

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          SOCC '14: Proceedings of the ACM Symposium on Cloud Computing
          November 2014
          383 pages
          ISBN:9781450332521
          DOI:10.1145/2670979

          Copyright © 2014 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 3 November 2014

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • tutorial
          • Research
          • Refereed limited

          Acceptance Rates

          Overall Acceptance Rate169of722submissions,23%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader