Kien Le
Thu D. Nguyen
ABSTRACT
In this paper, we first study the impact of load placement policies on cooling and maximum data center temperatures in cloud service providers that operate multiple geographically distributed data centers. Based on this study, we then propose dynamic load distribution policies that consider all electricity-related costs as well as transient cooling effects. Our evaluation studies the ability of different cooling strategies to handle load spikes, compares the behaviors of our dynamic cost-aware policies to cost-unaware and static policies, and explores the effects of many parameter settings. Among other interesting results, we demonstrate that (1) our policies can provide large cost savings, (2) load migration enables savings in many scenarios, and (3) all electricity-related costs must be considered at the same time for higher and consistent cost savings.
- Energy Information Administration. Average Retail Price of Electricity to Ultimate Customers by End-Use Sector, by State. http://www.eia.doe.gov/cneaf/electricity/epm/table5_6_b.html.Google Scholar
- Amazon. High Performance Computing Using Amazon EC2. http://aws.amazon.com/ec2/hpc-applications.Google Scholar
- ANSYS. ANSYS FLUENT. http://www.ansys.com/Products/Simulation+Technology/Fluid+Dynamics/ANSYS+FLUENT.Google Scholar
- ASHRAE. Environmental Guidelines for Datacom Equipment, 2008. American Society of Heating, Refrigeration, and Air-Conditioning Engineers.Google Scholar
- L. A. Barroso and U. Hölzle. The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines. Synthesis Lectures on Computer Architecture, 4(1), 2009.Google Scholar
- R. Bradford et al. Live Wide-Area Migration of Virtual Machines Including Local Persistent State. In Proceedings of the 3rd International Conference on Virtual Execution Environments, 2007. Google ScholarDigital Library
- R. Buyya et al. Scheduling Parameter Sweep Applications on Global Grids: A Deadline and Budget Constrained Cost-Time Optimization Algorithm. Software Practice and Experience, 35(5), 2005. Google ScholarDigital Library
- J. Chase et al. Managing Energy and Server Resources in Hosting Centers. In Proceedings of the 8th Symposium on Operating Systems Principles, 2001. Google ScholarDigital Library
- G. Chen et al. Energy-Aware Server Provisioning and Load Dispatching for Connection-Intensive Internet Services. In Proceedings of the 5th Symposium on Networked Systems Design and Implementation, 2008. Google ScholarDigital Library
- Y. Chen et al. Managing Server Energy and Operational Costs in Hosting Centers. In Proceedings of the International Conference on Measurement and Modeling of Computer Systems, 2005. Google ScholarDigital Library
- J. Choi et al. Modeling and Managing Thermal Profiles of Rack-mounted Servers with ThermoStat. In Proceedings of the 13th International Symposium on High Performance Computer Architecture, 2007. Google ScholarDigital Library
- SARA Computing and Networking Services. High Performance Compute Cloud. http://www.sara.nl/index_eng.html.Google Scholar
- K. Coughlin et al. The Tariff Analysis Project: A Database and Analysis Platform for Electricity Tariffs, 2006. http://repositories.cdlib.org/lbnl/LBNL-55680.Google Scholar
- Dror Feitelson. Parallel Workloads Archive. http://www.cs.huji.ac.il/labs/parallel/workload/.Google Scholar
- Duke Energy. North Carolina Electric Rates. http://www.duke-energy.com/north-carolina.asp.Google Scholar
- E. N. Elnozahy, M. Kistler, and R. Rajamony. Energy Conservation Policies for Web Servers. In Proceedings of the 4th Symposium on Internet Technologies and Systems, 2003. Google ScholarDigital Library
- A. P. Ferreira, D. Mosse, and J. C. Oh. Thermal Faults Modeling using a RC model with an Application to Web Farms. In Proceedings of the 19th Euromicro Conference on Real-Time Systems, 2007. Google ScholarDigital Library
- S. K. Garg, R. Buyya, and HJ Siegel. Scheduling Parallel Applications on Utility Grids: Time and Cost Trade-off Management. In Proceedings of the 32nd Australasian Conference on Computer Science, 2009. Google ScholarDigital Library
- R. Ge, X. Feng, and K. W. Cameron. Performance-Constrained Distributed DVS Scheduling for Scientific Applications on Power-aware Clusters. In Proceedings of the 17th International Conference on High Performance Computing and Communications, 2005. Google ScholarDigital Library
- Georgia Power. Business Pricing - Georgia Power. http://www.georgiapower.com/.Google Scholar
- I. Goiri et al. Energy-aware Scheduling in Virtualized Datacenters. In Proceedings of the International Conference on Cluster Computing, 2010. Google ScholarDigital Library
- I. Goiri, J. Guitart, and J. Torres. Characterizing Cloud Federation for Enhancing Providers' Profit. In Proceedings of the 3rd International Conference on Cloud Computing, 2010. Google ScholarDigital Library
- S. Govindan, A. Sivasubramaniam, and B. Urgaonkar. Benefits and Limitations of Tapping into Stored Energy for Datacenters. In Proceedings of the International Symposium on Computer Architecture, 2011. Google ScholarDigital Library
- Eric Harney et al. The Efficacy of Live Virtual Machine Migrations Over the Internet. In Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing, 2007. Google ScholarDigital Library
- T. Heath et al. Energy Conservation in Heterogeneous Server Clusters. In Proceedings of the 10th Symposium on Principles and Practice of Parallel Programming, 2005. Google ScholarDigital Library
- T. Heath et al. Mercury and Freon: Temperature Emulation and Management for Server Systems. In Proceedings of the 12th International Conference on Architectural Support for Programming Languages and Operating Systems, 2006. Google ScholarDigital Library
- F. Hermenier et al. Entropy: A Consolidation Manager for Clusters. In Proceedings of the 5th International Conference on Virtual Execution Environments, 2009. Google ScholarDigital Library
- Data Center Knowledge. Google: Raise Your Data Center Temperature. http://www.datacenterknowledge.com/archives/2008/10/14/google-raise-your-data-center-temperature/.Google Scholar
- K. Kurowski et al. Dynamic Grid Scheduling with Job Migration and Rescheduling in the GridLab Resource Management System. Scientific Programming, 12(4), 2004. Google ScholarDigital Library
- K. Le et al. A Cost-Effective Distributed File Service with QoS Guarantees. In Proceedings of the International Middleware Conference, 2007. Google ScholarDigital Library
- K. Le et al. Cost- And Energy-Aware Load Distribution Across Data Centers. In Proceedings of the Workshop on Power Aware Computing and Systems, 2009.Google Scholar
- K. Le et al. Capping the Brown Energy Consumption of Internet Services at Low Cost. In Proceedings of the International Conference on Green Computing, 2010. Google ScholarDigital Library
- M. Y. Lim et al. Adaptive, Transparent Frequency and Voltage Scaling of Communication Phases in MPI Programs. In Proceedings of the 18th International Conference on High Performance Computing and Communications, 2006. Google ScholarDigital Library
- Z. Liu et al. Greening Geographical Load Balancing. In Proceedings of the International Conference on Measurement and Modeling of Computer Systems, 2011. Google ScholarDigital Library
- R. S. Montero, E. Huedo, and I. M. Llorente. Grid Resource Selection for Opportunistic Job Migration. Proceedings of Euro-Par International Conference on Parallel and Distributed Computing, 2004.Google Scholar
- J. Moore et al. Making Scheduling Cool: Temperature-Aware Workload Placement in Data Centers. In Proceedings of the Annual USENIX Technical Conference, 2005. Google ScholarDigital Library
- J. Moore et al. Weatherman: Automated, Online and Predictive Thermal Mapping and Management for Data Centers. In Proceedings of the International Conference on Autonomic Computing, 2006. Google ScholarDigital Library
- A. W. Mu'alem and D. G. Feitelson. Utilization, Predictability, Workloads, and User Runtime Estimates in Scheduling the IBM SP2 with Backfilling. IEEE Transactions on Parallel and Distributed Systems, 12, 2001. Google ScholarDigital Library
- T. Mukherjee et al. Software Architecture for Dynamic Thermal Management in Datacenters. In Proceedings of the 2nd International Conference on Communication Systems Software and Middleware, 2007.Google ScholarCross Ref
- NREL. Best Practices Guide for Energy-Efficient Data Center Design, 2010. National Renewable Energy Laboratory (NREL), U. S. Department of Energy.Google Scholar
- Department of Energy and Climate Change. Quarterly Energy Prices. http://stats.berr.gov.uk/uksa/energy/sa20090625b.htm.Google Scholar
- Pacific Gas and Electric. ELECTRIC SCHEDULES. http://www.pge.com/.Google Scholar
- E. Pinheiro et al. Dynamic Cluster Reconfiguration for Power and Performance. Compilers and Operating Systems for Low Power, 2003. Earlier version published in COLP'01, September 2001. Google ScholarDigital Library
- A. Qureshi et al. Cutting the Electric Bill for Internet-Scale Systems. In Proceedings of SIGCOMM, 2009. Google ScholarDigital Library
- L. Ramos and R. Bianchini. C-Oracle: Predictive Thermal Management for Data Centers. In Proceedings the 14th International Symposium on High Performance Computer Architecture, 2008.Google ScholarCross Ref
- B. Rountree et al. Adagio: Making DVS Practical for Complex HPC Applications. In Proceedings of the 23rd International Conference on Supercomputing, 2009. Google ScholarDigital Library
- E. Samadiani et al. Adaptable Robust Design of Multi-Scale Convective Systems Applied to Energy Efficient Data Centers. Numerical Heat Transfer, 57(2), 2010.Google Scholar
- R. Sharma et al. Balance of Power: Dynamic Thermal Management for Internet Data Centers. In Technical Report HPL-2003-5, HP Labs, 2003.Google Scholar
- D. Tsafrir, Y. Etsion, and D. Feitelson. Modeling User Runtime Estimates. In Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing. Springer-Verlag, 2005. Google ScholarDigital Library
- Weather Underground. Weather Underground. http://www.wunderground.com/.Google Scholar
- A. Weissel and F. Bellosa. Dynamic Thermal Management in Distributed Systems. In Proceedings of the 1st Workshop on Temperature-Aware Computer Systems, 2004.Google Scholar
- T. Wood et al. CloudNet: Dynamic Pooling of Cloud Resources by Live WAN Migration of Virtual Machines. In Proceedings of the 7th International Conference on Virtual Execution Environments, 2011. Google ScholarDigital Library
Index Terms
- Reducing electricity cost through virtual machine placement in high performance computing clouds
Recommendations
A Cost Model for IaaS Clouds Based on Virtual Machine Energy Consumption
Cloud Computing has revolutionized the software, platform and infrastructure provisioning. Infrastructure-as-a-Service (IaaS) providers offer on-demand and configurable Virtual Machine (VMs) to tenants of cloud computing services. A key consolidation ...
Thermo-Fluids Provisioning of a High Performance High Density Data Center
Consolidation and dense aggregation of slim compute, storage and networking hardware has resulted in high power density data centers. The high power density resulting from current and future generations of servers necessitates detailed thermo-fluids ...
Thermal placement for high-performance multichip modules
ICCD '95: Proceedings of the 1995 International Conference on Computer Design: VLSI in Computers and ProcessorsA placement scheme that considers both electrical performance requirements and thermal behavior for the high-performance multichip modules is described in this paper. Practical thermal models are used for placement of high-speed chips in multichip ...
Comments