Abstract
In this article, we present vGreen, a multitiered software system for energy-efficient virtual machine management in a clustered virtualized environment. The system leverages the use of novel hierarchical metrics that work across the different abstractions in a virtualized environment to capture power and performance characteristics of both the virtual and physical machines. These characteristics are then used to implement policies for scheduling and power management of virtual machines across the cluster. We show through real implementation of the system on a state-of-the-art testbed of server machines that vGreen improves both average performance and system-level energy savings by close to 40% across benchmarks with varying characteristics.
- Abdelsalam, H. S., Maly, K., Mukkamala, R., Zubair, M., and Kaminsky, D. 2009. Analysis of energy efficiency in clouds. In Future Computing, Service Computation, Cognitive, Adaptive, Content, Patterns, Computation World, 416--421. Google ScholarDigital Library
- Amazon. 2008. Amazon Elastic Compute Cloud (Amazon EC2). http://aws.amazon.com/ec2/.Google Scholar
- Ayoub, R., Sherifi, S., and Rosing, T. 2010. Gentlecool: Cooling aware proactive workload scheduling in multi-machine systems. In Proceedings of the IEEE Design, Automation Test in Europe (DATE’10). Google ScholarDigital Library
- Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., and Warfield, A. 2003. Xen and the art of virtualization. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP’03). ACM, New York, 164--177. Google ScholarDigital Library
- Bobroff, N., Kochut, A., and Beaty, K. 2007. Dynamic placement of virtual machines for managing sla violations. In Integrated Network Management. IEEE, 119--128.Google Scholar
- Chase, J. S., Anderson, D. C., Thakar, P. N., Vahdat, A. M., and Doyle, R.P. 2001. Managing energy and server resources in hosting centers. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP’01). ACM, New York, 103--116. Google ScholarDigital Library
- Clark, C., Fraser, K., Hand, S., Hansen, J. G., Jul, E., Limpach, C., Pratt, I., and Warfield, A. 2005. Live migration of virtual machines. In Proceedings of the 2nd Conference on Symposium on Networked Systems Design & Implementation (NSDI’’05). USENIX Association, 273--286. Google ScholarDigital Library
- Dhiman, G., Marchetti, G., and Rosing, T. 2009. vGreen: A system for energy efficient computing in virtualized environments. In Proceedings of the International Symposium on Lower Power Electronics and Design (ISLPED’09). ACM, New York. Google ScholarDigital Library
- Dhiman, G., Mihic, K., and Rosing, T. 2010. A system for online power prediction in virtualized environments using gaussian mixture models. In Proceedings of the 47th Design Automation Conference (DAC’10). ACM, New York, 807--812. Google ScholarDigital Library
- Dhiman, G., Pusukuri, K., and Rosing, T. S. 2008. Analysis of dynamic voltage scaling for system level energy management. In Proceedings of the Workshop on Power Aware Computing and Systems (HotPower’08). Google ScholarDigital Library
- Dhiman, G. and Rosing, T. S. 2007. Dynamic voltage frequency scaling for multi-tasking systems using online learning. In Proceedings of the International Symposium on Low Power Electronics and Design (ISLPED’07). ACM, New York, 207--212. Google ScholarDigital Library
- Fan, X., Weber, W.-D., and Barroso, L. A. 2007. Power provisioning for a warehouse-sized computer. In Proceedings of the 34th Annual International Symposium on Computer Architecture (ISCA’07). ACM, New York, 13--23. Google ScholarDigital Library
- Ge, R., Feng, X., Feng, W.-C., and Cameron, K. W. 2007. Cpu miser: A performance-directed, run-time system for power-aware clusters. In Proceedings of the International Conference on Parallel Processing (ICPP’07). IEEE Computer Society, 18. Google ScholarDigital Library
- Haletky, E. L. 2008. VMware ESX Server in the Enterprise: Planning and Securing Virtualization Servers. Prentice Hall. Google ScholarDigital Library
- Hermenier, F., Lorca, X., Menaud, J.-M., Muller, G., and Lawall, J. 2009. Entropy: a consolidation manager for clusters. In Proceedings of the ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE’09). ACM, New York, 41--50. Google ScholarDigital Library
- IPMI. 2004. Intelligent platform management interface v2.0 specification. http://www.intel.com/design/servers/impi.Google Scholar
- Isci, C., Contreras, G., and Martonosi, M. 2006. Live, runtime phase monitoring and prediction on real systems with application to dynamic power management. In Proceedings of the 39th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO’39). IEEE Computer Society, 359--370. Google ScholarDigital Library
- Kansal, A., Zhao, F., Liu, J., Kothari, N., and Bhattacharya, A. A. 2010. Virtual machine power metering and provisioning. In Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC’10). ACM, New York, 39--50. Google ScholarDigital Library
- Knauerhase, R. C., Brett, P., Hohlt, B., Li, T., and Hahn, S. 2008. Using os observations to improve performance in multicore systems. IEEE Micro 28, 3, 54--66. Google ScholarDigital Library
- Koller, R., Verma, A., and Neogi, A. 2010. Wattapp: An application aware power meter for shared data centers. In Proceeding of the 7th International Conference on Autonomic Computing (ICAC’10). ACM, New York, 31--40. Google ScholarDigital Library
- Liu, L., Wang, H., Liu, X., Jin, X., He, W. B., Wang, Q. B., and Chen, Y. 2009. Greencloud: a new architecture for green data center. In Proceedings of the 6th International Conference Industry Session on Autonomic Computing and Communications Industry Session (ICAC-INDST’09). ACM, New York, 29--38. Google ScholarDigital Library
- McNett, M., Gupta, D., Vahdat, A., and Voelker, G. M. 2007. Usher: An extensible framework for managing custers of virtual machines. In Proceedings of the 21st Conference on Large Installation System Administration Conference (LISA’07). USENIX Association, 1--15. Google ScholarDigital Library
- Meisner, D., Gold, B., and Thomas, W. 2009. Powernap: Eliminating server idle power. In Proceedings of the 14th International Conference on Architectural Support for Programming Languages and Operating Systems. Google ScholarDigital Library
- Merkel, A. and Bellosa, F. 2006. Balancing power consumption in multiprocessor systems. SIGOPS Oper. Syst. Rev. 40, 4, 403--414. Google ScholarDigital Library
- Merkel, A., Stoess, J., and Bellosa, F. 2010. Resource-conscious scheduling for energy efficiency on multicore processors. In Proceedings of the 5th European Conference on Computer Systems (EuroSys’10). ACM, New York, 153--166. Google ScholarDigital Library
- Moore, J., Chase, J., Ranganathan, P., and Sharma, R. 2005. Making scheduling “cool”: Temperature-aware workload placement in data centers. In Proceedings of the Annual Conference on USENIX Annual Technical Conference (ATEC’05). USENIX Association, 5--5. Google ScholarDigital Library
- Nathuji, R., England, P., Sharma, P., and Singh, A. 2009. Feedback driven qos-aware power budgeting for virtualized servers. In Proceedings of the 4th International Workshop on Feedback Control Implementation and Design in Computing Systems and Networks (FeBID’09).Google Scholar
- Nathuji, R., Kansal, A., and Ghaffarkhah, A. 2010. Q-clouds: Managing performance interference effects for qos-aware clouds. In Proceedings of the 5th European Conference on Computer Systems (EuroSys’10). ACM, New York, 237--250. Google ScholarDigital Library
- Nathuji, R. and Schwan, K. 2007. Virtualpower: Coordinated power management in virtualized enterprise systems. In Proceedings of 21st ACM SIGOPS Symposium on Operating Systems Principles (SOSP’07). ACM, New York, 265--278. Google ScholarDigital Library
- Nurmi, D., Wolski, R., Grzegorczyk, C., Obertelli, G., Soman, S., Youseff, L., and Zagorodnov, D. 2008. The eucalyptus open-source cloud-computing system. In Proceedings of Cloud Computing and Its Applications.Google Scholar
- OpenNebula. Opennebula homepage. http://dev.opennebula.org/Google Scholar
- Pakbaznia, E. and Pedram, M. 2009. Minimizing data center cooling and server power costs. In Proceedings of the International Symposium on Lower Power Electronics and Design (ISLPED’09). ACM, 145--150. Google ScholarDigital Library
- Raghavendra, R., Ranganathan, P., Talwar, V., Wang, Z., and Zhu, X. 2008. No “power” struggles: Coordinated multi-level power management for the data center. In Proceedings of the 13th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS’08). ACM, New York, 48--59. Google ScholarDigital Library
- Ranganathan, P., Leech, P., Irwin, D., and Chase, J. 2006. Ensemble-level power management for dense blade servers. In Proceedings of the 33rd Annual International Symposium on Computer Architecture (ISCA’06). IEEE Computer Society, 66--77. Google ScholarDigital Library
- Snavely, A. and Tullsen, D. M. 2000. Symbiotic jobscheduling for a simultaneous mutlithreading processor. SIGPLAN Not. 35, 11, 234--244. Google ScholarDigital Library
- Stoess, J., Lang, C., and Bellosa, F. 2007. Energy management for hypervisor-based virtual machines. In Proceedings of the USENIX Annual Technical Conference (ATC’07). USENIX Association, 1--14. Google ScholarDigital Library
- Verma, A., Ahuja, P., and Neogi, A. 2008. Power-Aware dynamic placement of hpc applications. In Proceedings of the 22nd Annual International Conference on supercomputing (ICS’08). ACM, New York, 175--184. Google ScholarDigital Library
- VMware. 2009. Vmware distributed resource scheduler. http://www.vmware.com/products/drs/Google Scholar
- Wang, L., von Laszewski, G., Tao, J., and Kunze, M. 2009. Grid virtualization engine: design, implementation and evaluation. IEEE Syst. J. 3, 4, 477--488.Google ScholarCross Ref
- Wang, R. and Kandasamy, N. 2009. A distributed control framework for performance management of virtualized computing environments: Some preliminary results. In Proceedings of the 1st Workshop on Automated Control for Datacenters and Clouds (ACDC’09). ACM, New York, 7--12. Google ScholarDigital Library
- Wood, T., Shenoy, P., and Arun. 2007. Black-Box and gray-box strategies for virtual machine migration. In Proceedings of the ACM Symposium on Networked Systems Design and Implementation (NSDI’07). 229--242. Google ScholarDigital Library
Index Terms
- vGreen: A System for Energy-Efficient Management of Virtual Machines
Recommendations
vGreen: a system for energy efficient computing in virtualized environments
ISLPED '09: Proceedings of the 2009 ACM/IEEE international symposium on Low power electronics and designIn this paper, we present vGreen, a multi-tiered software system for energy efficient computing in virtualized environments. It comprises of novel hierarchical metrics that capture power and performance characteristics of virtual and physical machines, ...
Urgent Virtual Machine Eviction with Enlightened Post-Copy
VEE '16Virtual machine (VM) migration demands distinct properties under resource oversubscription and workload surges. We present enlightened post-copy, a new mechanism for VMs under contention that evicts the target VM with fast execution transfer and short ...
Sandpiper: Black-box and gray-box resource management for virtual machines
Virtualization can provide significant benefits in data centers by enabling dynamic virtual machine resizing and migration to eliminate hotspots. We present Sandpiper, a system that automates the task of monitoring and detecting hotspots, determining a ...
Comments