Skip to main content
Top
Published in: Memetic Computing 4/2016

01-12-2016 | Regular Research Paper

WAYFINDER: parallel virtual machine reallocation through A* search

Authors: Eli M. Dow, Jeanna N. Matthews

Published in: Memetic Computing | Issue 4/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Modern virtual machine (VM) management software enables consolidation of VMs for power savings or load-balancing for performance. While existing literature provides various methods for computing a better load-balanced, or consolidated goal state, it fails to adequately suggest the best path from the system’s current state to the desired goal allocation. This paper discusses an approach to efficient path finding in VM placement problems for cloud computing environments of moderate scale with results indicating the solution is reasonable for managing hundreds of VMs. We present an overview of known approaches to dynamic VM placement and discuss their shortcomings with respect to dynamic reallocation. We then describe a novel design and implementation of a heuristic search algorithm to determine optimal sequential migration plans to transition from a given VM-to-host allocation to an arbitrary desired allocation state. We then elaborate nuances of A* application to this domain along with our simulation-based validation approach. Finally, this work demonstrates a novel and highly effective technique for exploiting migration parallelism in order to rapidly achieving VM reallocation convergence suitable for continual workload rebalancing in cloud data centers.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
To enforce co-location and anti-colocation policy, we opted to leverage the concept of VM contracts [18]. Our implementation of co-location and anti-colocation contracts were the addition of small XML stanzas to the existing VM XML definition files. Upon achieving some success with constructing optimal consolidation plans, we then set out to construct an algorithm for high performance live migration plan generation.
 
Literature
1.
go back to reference Campegiani P et al (2009) A general model for VMs resources allocation in multi-tier distributed systems. In: Fifth international conference on autonomic and autonomous systems, 2009. ICAS ’09, pp 162–167, 20–25 April 2009. doi:10.1109/ICAS.2009.49 Campegiani P et al (2009) A general model for VMs resources allocation in multi-tier distributed systems. In: Fifth international conference on autonomic and autonomous systems, 2009. ICAS ’09, pp 162–167, 20–25 April 2009. doi:10.​1109/​ICAS.​2009.​49
3.
go back to reference Dow EM (2016) Decomposed multi-objective bin-packing for virtual machine consolidation. PeerJ Comput Sci 2:e47CrossRef Dow EM (2016) Decomposed multi-objective bin-packing for virtual machine consolidation. PeerJ Comput Sci 2:e47CrossRef
4.
go back to reference Gu et al (2012) A new resource scheduling strategy based on genetic algorithm in cloud computing environment. J Comput 7:1 Gu et al (2012) A new resource scheduling strategy based on genetic algorithm in cloud computing environment. J Comput 7:1
5.
go back to reference Campegiani P (2009) A genetic algorithm to solve the virtual machines resources allocation problem in multi-tier distributed systems. In: Second international workshop on virtualization performance: analysis, characterization, and tools (VPACT 2009), Boston, Massachusetts Campegiani P (2009) A genetic algorithm to solve the virtual machines resources allocation problem in multi-tier distributed systems. In: Second international workshop on virtualization performance: analysis, characterization, and tools (VPACT 2009), Boston, Massachusetts
6.
go back to reference Lynar T et al (2009) Auction resource allocation mechanisms in grids of heterogeneous computers. WSEAS Trans Comput 8(10):1671–1680 Lynar T et al (2009) Auction resource allocation mechanisms in grids of heterogeneous computers. WSEAS Trans Comput 8(10):1671–1680
7.
go back to reference Lo S et al (2013) Design and analysis of schedules for virtual network migration. In: Proceedings of the 11th international IFIP conference on networking, IFIP Networking 2013 Lo S et al (2013) Design and analysis of schedules for virtual network migration. In: Proceedings of the 11th international IFIP conference on networking, IFIP Networking 2013
8.
go back to reference Boughzala B et al (2011) OpenFlow supporting interdomain virtual machine migration. In: Proceedings of eighth international conference on wireless and optical communications networks. doi:10.1109/WOCN.2011.5872945 Boughzala B et al (2011) OpenFlow supporting interdomain virtual machine migration. In: Proceedings of eighth international conference on wireless and optical communications networks. doi:10.​1109/​WOCN.​2011.​5872945
9.
go back to reference Dow EM et al (2009) A reference implementation architecture for deploying a highly-available networking infrastructure for cloud computing and virtual environments using OSPF. IBM Platform Test-z Systems library Dow EM et al (2009) A reference implementation architecture for deploying a highly-available networking infrastructure for cloud computing and virtual environments using OSPF. IBM Platform Test-z Systems library
10.
go back to reference Dow EM et al (2010) Validation of OSPF on IBM Linux on system z at scale. IBM Platform Test-z Systems library Dow EM et al (2010) Validation of OSPF on IBM Linux on system z at scale. IBM Platform Test-z Systems library
11.
go back to reference Hyser C, Mckee B, Gardner R, Watson BJ (2007) Autonomic virtual machine placement in the data center. HP Labs Technical Report HPL-2007-189, February 2007 Hyser C, Mckee B, Gardner R, Watson BJ (2007) Autonomic virtual machine placement in the data center. HP Labs Technical Report HPL-2007-189, February 2007
12.
go back to reference Gulati A et al (2012) VMWare distributed resource management: design, implementation, and lessons learned. VMware Tech J 1(1):45–64 Gulati A et al (2012) VMWare distributed resource management: design, implementation, and lessons learned. VMware Tech J 1(1):45–64
14.
go back to reference Tantawi AN (2012) A scalable algorithm for placement of virtual clusters in large data centers. In: 2012 IEEE 20th international symposium on modeling, analysis and simulation of computer and telecommunication systems, pp 3–10, 7–9 Aug 2012 Tantawi AN (2012) A scalable algorithm for placement of virtual clusters in large data centers. In: 2012 IEEE 20th international symposium on modeling, analysis and simulation of computer and telecommunication systems, pp 3–10, 7–9 Aug 2012
15.
go back to reference Hu W et al (2013) A quantitative study of virtual machine live migration. In: Proceedings of the 2013 ACM cloud and autonomic computing conference (CAC ’13) ACM, New York. doi:10.1145/2494621.2494622 Hu W et al (2013) A quantitative study of virtual machine live migration. In: Proceedings of the 2013 ACM cloud and autonomic computing conference (CAC ’13) ACM, New York. doi:10.​1145/​2494621.​2494622
16.
go back to reference Hart PE et al (1968) A formal basis for the heuristic determination of minimum cost paths. IEEE Trans Syst Sci Cybern SSC4 4(2):100–107 Hart PE et al (1968) A formal basis for the heuristic determination of minimum cost paths. IEEE Trans Syst Sci Cybern SSC4 4(2):100–107
17.
go back to reference Dow EM, Matthews N (2015) Virtual machine migration plan generation through A* search. In: Cloud networking (CloudNet), 2015 IEEE 4th international conference on cloud networking, pp 71–73, 5–7 Oct 2015. doi:10.1109/CloudNet.2015.7335283 Dow EM, Matthews N (2015) Virtual machine migration plan generation through A* search. In: Cloud networking (CloudNet), 2015 IEEE 4th international conference on cloud networking, pp 71–73, 5–7 Oct 2015. doi:10.​1109/​CloudNet.​2015.​7335283
18.
go back to reference Matthews et al (2009) Virtual machine contracts for datacenter and cloud computing environments. In: Proceedings of the first workshop on automated control for datacenters and clouds (ACDC09), June 2009 Matthews et al (2009) Virtual machine contracts for datacenter and cloud computing environments. In: Proceedings of the first workshop on automated control for datacenters and clouds (ACDC09), June 2009
19.
go back to reference Zhou et al (2002) Memory-bounded A* graph search. In: 15th International florida artificial intelligence research society conference, pp 203–209 Zhou et al (2002) Memory-bounded A* graph search. In: 15th International florida artificial intelligence research society conference, pp 203–209
20.
go back to reference Stuart Russell (1992) Efficient memory-bounded search methods. In: Bernd Neumann (ed) Proceedings of the 10th European conference on Artificial intelligence (ECAI ’92), pp 1–5, Wiley, New York, USA Stuart Russell (1992) Efficient memory-bounded search methods. In: Bernd Neumann (ed) Proceedings of the 10th European conference on Artificial intelligence (ECAI ’92), pp 1–5, Wiley, New York, USA
21.
go back to reference Salfner F et al (2012) Dependable estimation of downtime for virtual machine live migration. Int J Adv Syst Meas 5(1):70–88 Salfner F et al (2012) Dependable estimation of downtime for virtual machine live migration. Int J Adv Syst Meas 5(1):70–88
22.
go back to reference Isci C et al (2011) Improving server utilization using fast virtual machine migration. IBM J Res Dev 55(6):4:1–4:12 Isci C et al (2011) Improving server utilization using fast virtual machine migration. IBM J Res Dev 55(6):4:1–4:12
23.
go back to reference Song X et al (2013) Parallelizing live migration of virtual machines. In: Proceedings of the ACM SIGPLAN/SIGOPS international conference on virtual execution environment, pp 85–96 Song X et al (2013) Parallelizing live migration of virtual machines. In: Proceedings of the ACM SIGPLAN/SIGOPS international conference on virtual execution environment, pp 85–96
24.
go back to reference Wang H et al (2015) Virtual machine migration planning in software-defined networks. Proceedings of the IEEE conference INFOCOM, Apr/May 2015:487–495 Wang H et al (2015) Virtual machine migration planning in software-defined networks. Proceedings of the IEEE conference INFOCOM, Apr/May 2015:487–495
25.
go back to reference Bari MF et al (2014) CQNCR: optimal VM migration planning in cloud data centers. In: 2014 IFIP networking conference, IEEE, pp 1–9 Bari MF et al (2014) CQNCR: optimal VM migration planning in cloud data centers. In: 2014 IFIP networking conference, IEEE, pp 1–9
Metadata
Title
WAYFINDER: parallel virtual machine reallocation through A* search
Authors
Eli M. Dow
Jeanna N. Matthews
Publication date
01-12-2016
Publisher
Springer Berlin Heidelberg
Published in
Memetic Computing / Issue 4/2016
Print ISSN: 1865-9284
Electronic ISSN: 1865-9292
DOI
https://doi.org/10.1007/s12293-016-0205-2

Other articles of this Issue 4/2016

Memetic Computing 4/2016 Go to the issue

Premium Partner