Umesh Deshpande
ABSTRACT
This paper addresses the problem of simultaneously migrating a group of co-located and live virtual machines (VMs), i.e, VMs executing on the same physical machine. We refer to such a mass simultaneous migration of active VMs as "live gang migration". Cluster administrators may often need to perform live gang migration for load balancing, system maintenance, or power savings. Application performance requirements may dictate that the total migration time, network traffic overhead, and service downtime, be kept minimal when migrating multiple VMs. State-of-the-art live migration techniques optimize the migration of a single VM. In this paper, we optimize the simultaneous live migration of multiple co-located VMs. We present the design, implementation, and evaluation of a de-duplication based approach to perform concurrent live migration of co-located VMs. Our approach transmits memory content that is identical across VMs only once during migration to significantly reduce both the total migration time and network traffic. Using the QEMU/KVM platform, we detail a proof-of-concept prototype implementation of two types of de-duplication strategies (at page level and sub-page level) and a differential compression approach to exploit content similarity across VMs. Evaluations over Gigabit Ethernet with various types of VM workloads demonstrate that our prototype for live gang migration can achieve significant reductions in both network traffic and total migration time.
- Superfasthash www.azillionmonkeys.com/qed/hash.html.Google Scholar
- A. Arcangeli, I. Eidus, and C. Wright. Increasing memory density by using ksm. In Proc. of Linux Symposium, July 2009.Google Scholar
- F. Bellard. Qemu, a fast and portable dynamic translator. In Proc. of USENIX Annual Technical Conference, April 2005. Google ScholarDigital Library
- N. Bobroff, A. Kochut, and K. Beaty. Dynamic placement of virtual machines for managing sla violations. In Proc. of Integrated Network Management, page 119--128, May 2007.Google ScholarCross Ref
- C. Clark, K. Fraser, S. Hand, J.G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proc. of Network System Design and Implementation, May 2005. Google ScholarDigital Library
- Dbench. http://samba.org/ftp/tridge/dbench.Google Scholar
- D. Gupta, S. Lee, M. Vrable, S. Savage, A. C Snoeren, G. Varghese, G. M Voelker, and A. Vahdat. Difference engine: Harnessing memory redundancy in virtual machines. In Proc. of Operating Systems Design and Implementation, December 2010. Google ScholarDigital Library
- J.G. Hansen and E. Jul. Self-migration of operating systems. In Proc. of ACM SIGOPS European Workshop, September 2004. Google ScholarDigital Library
- M. Hines, U. Deshpande, and K. Gopalan. Post-copy live migration of virtual machines. SIGOPS Operating Syst. Review, 43(3):14--26, July 2009. Google ScholarDigital Library
- W. Huang, M. Koop, Q. Gao,, and D.K. Panda. Virtual machine aware communication libraries for high performance computing. In Proc. of SuperComputing, November 2007. Google ScholarDigital Library
- H. Jin, L. Deng, S. Wu, X. Shi, and X. Pan. Live virtual machine migration with adaptive, memory compression. In Proc. of Cluster Computing and Workshops, August 2009.Google ScholarCross Ref
- K. Kim, C. Kim, S-I. Jung, H Shin, and J-S. Kim. Inter-domain socket communications supporting high performance and full binary compatibility on xen. In Proc. of Virtual Execution Environments, March 2008. Google ScholarDigital Library
- A. Kivity, Y. Kamay, D. Laor, U. Lublin, and A. Liguori. Kvm: The linux virtual machine monitor. In Proc. of Linux Symposium, June 2007.Google Scholar
- J. MacDonald. Xdelta http://www.xdelta.org/.Google Scholar
- V. Makhija, B. Herndon, P. Smith, L. Roderick, E. Zamost, and J. Anderson. VMmark: A scalable benchmark for virtualized systems. Technical Report 2006-002, 2002.Google Scholar
- G. Milos, D.G. Murray, S. Hand, and M.A. Fetterman. Satori: Enlightened page sharing. In Proc. of USENIX Annual Technical Conference, June 2009. Google ScholarDigital Library
- MySQL. MySQL Cluster http://www.mysql.com/products/database/cluster.Google Scholar
- M. Nelson, B. H Lim, and G. Hutchins. Fast transparent migration for virtual machines. In Proc. of USENIX Annual Technical Conference, April 2005. Google ScholarDigital Library
- P. Riteau, C. Morin, and T. Priol. Shrinker: Efficient wide area live virtual machine migration using distributed content-based addressing. In http://hal.inria.fr/inria-00454727/en/, February 2009.Google Scholar
- C. P Sapuntzakis, R. Chandra, B. Pfaff, J. Chow, M. S Lam, and M. Rosenblum. Optimizing the migration of virtual computers. In Proc. of Operating Systems Design and Implementation, December 2002. Google ScholarDigital Library
- VMWare Distributed Resource Scheduler. http://www.vmware.com/products/vi/vc/drs.html.Google Scholar
- Sysbench. Sysbench benchmark http://sysbench.sourceforge.net/index.html.Google Scholar
- TCPDUMP. http://www.tcpdump.org.Google Scholar
- TPC-H Benchmark. http://www.tpc.org/tpch/.Google Scholar
- A. Verma, P. Ahuja, and A. Neogi. pMapper: power and migration cost aware application placement in virtualized systems. In International Conference on Middleware, December 2008. Google ScholarDigital Library
- C. A. Waldspurger. Memory resource management in VMware ESX server. In Proc. of Operating Systems Design and Implementation, December 2002. Google ScholarDigital Library
- J. Wang, K. L Wright, and K. Gopalan. XenLoop: a transparent high performance inter-vm network loopback. In Proc. of High performance distributed computing, June 2008. Google ScholarDigital Library
- T. Wood, K. Ramakrishnan, J. van der Merwe, and P. Shenoy. CloudNet: a platform for optimized WAN migration of virtual machines. University of Massachusetts Technical Report TR-2010, 2, 2010.Google Scholar
- T. Wood, P. Shenoy, A. Venkataramani, and M. Yousif. Sandpiper: Black-box and gray-box resource management for virtual machines. The International Journal of Computer and Telecommunications Networking, 53(17), December 2009. Google ScholarDigital Library
- X. Zhang, Z. Huo, J. Ma, and D. Meng. Exploiting data deduplication to accelerate live virtual machine migration. In Proc. of International Conference on Cluster Computing, September 2010. Google ScholarDigital Library
- X. Zhang, S. McIntosh, P. Rohatgi, and J. L. Griffin. Xensocket: a high-throughput interdomain transport for virtual machines. In Proc. of International Conference on Middleware, November 2007. Google ScholarDigital Library
Index Terms
- Live gang migration of virtual machines
Recommendations
Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning
VEE '09: Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environmentsWe present the design, implementation, and evaluation of post-copy based live migration for virtual machines (VMs) across a Gigabit LAN. Live migration is an indispensable feature in today's virtualization technologies. Post-copy migration defers the ...
Post-copy live migration of virtual machines
We present the design, implementation, and evaluation of post-copy based live migration for virtual machines (VMs) across a Gigabit LAN. Post-copy migration defers the transfer of a VM's memory contents until after its processor state has been sent to ...
Inter-rack live migration of multiple virtual machines
VTDC '12: Proceedings of the 6th international workshop on Virtualization Technologies in Distributed Computing DateWithin datacenters, often multiple virtual machines (VMs) need to be live migrated simultaneously for various reasons such as maintenance, power savings, and load balancing. Such mass simultaneous live migration of multiple VMs can trigger large data ...
Comments