Dushyanth Narayanan
Abstract
In enterprise data centers power usage is a problem impacting server density and the total cost of ownership. Storage uses a significant fraction of the power budget and there are no widely deployed power-saving solutions for enterprise storage systems. The traditional view is that enterprise workloads make spinning disks down ineffective because idle periods are too short. We analyzed block-level traces from 36 volumes in an enterprise data center for one week and concluded that significant idle periods exist, and that they can be further increased by modifying the read/write patterns using write off-loading. Write off-loading allows write requests on spun-down disks to be temporarily redirected to persistent storage elsewhere in the data center.
The key challenge is doing this transparently and efficiently at the block level, without sacrificing consistency or failure resilience. We describe our write off-loading design and implementation that achieves these goals. We evaluate it by replaying portions of our traces on a rack-based testbed. Results show that just spinning disks down when idle saves 28--36% of energy, and write off-loading further increases the savings to 45--60%.
- Anderson, T. E., Dahlin, M. D., Neefe, J. M., Patterson, D. A., Roselli, D. S., and Wang, R. Y. 1995. Serverless network file systems. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP). Copper Mountain, CO. Google Scholar
Digital Library
- Aranya, A., Wright, C. P., and Zadok, E. 2004. Tracefs: A file system to trace them all. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST), San Francisco, CA. Google ScholarDigital Library
- Baker, M., Asami, S., Deprit, E., Ousterhout, J., and Seltzer, M. 1992. Non-Volatile memory for fast, reliable file systems. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), Boston, MA. Google ScholarDigital Library
- Baker, M. G., Hartman, J. H., Kupfer, M. D., Shirriff, K. W., and Ousterhout, J. K. 1991. Measurements of a distributed file system. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP). Pacific Grove, CA. Google ScholarDigital Library
- Carrera, E. V., Pinheiro, E., and Bianchini, R. 2003. Conserving disk energy in network servers. In Proceedings of the ACM International Conference on Supercomputing (ICS), San Francisco, CA. Google ScholarDigital Library
- Chase, J. S., Anderson, D. C., Thakar, P. N., Vahdat, A. M., and Doyle, R. P. 2001. Managing energy and server resources in hosting centers. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP), Chateau Lake Louise, Banff, Canada. Google ScholarDigital Library
- Colarelli, D. and Grunwald, D. 2002. Massive arrays of idle disks for storage archives. In Proceedings of the ACM/IEEE Conference on Supercomputing (ICS) Baltimore, MD. Google ScholarDigital Library
- Dahlin, M., Wang, R., Anderson, T., and Patterson, D. 1994. Cooperative caching: Using remote client memory to improve file system performance. In Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI), Monterey, CA. Google ScholarDigital Library
- Douglis, F., Krishnan, P., and Marsh, B. 1994. Thwarting the power-hungry disk. In Proceedings of the USENIX Winter Technical Conference, San Francisco, CA. Google ScholarDigital Library
- Ellard, D., Ledlie, J., Malkani, P., and Seltzer, M. I. 2003. Passive NFS tracing of email and research workloads. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST). San Francisco, CA. Google ScholarDigital Library
- Ganesh, L., Weatherspoon, H., Balakrishnan, M., and Birman, K. 2007. Optimizing power consumption in large scale storage systems. In Proceedings of the Workshop on Hot Topics in Operating Systems (HotOS), San Diego, CA. Google ScholarDigital Library
- Gurumurthi, S., Sivasubramaniam, A., Kandemir, M., and Franke, H. 2003. DRPM: Dynamic speed control for power management in server class disks. In Proceedings of the International Symposium on Computer Architecture (ISCA), San Diego, CA. Google ScholarDigital Library
- Gurumurthi, S., Zhang, J., Sivasubramaniam, A., Kandemir, M., Franke, H., Vijaykrishnan, N., and Irwin, M. 2003. Interplay of energy and performance for disk arrays running transaction processing workloads. In Proceedings of the International Symposium on Performance Analysis of Systems and Software (ISPASS). Austin, TX. Google ScholarDigital Library
- Intel Corporation. 2006. Dual-Core Intel® Xeon® Processor 5100 Series Datasheet. Intel Corporation, Reference Number: 313355-002.Google Scholar
- Joukov, N., Wong, T., and Zadok, E. 2005. Accurate and efficient replaying of file system traces. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST), San Francisco, CA. Google ScholarDigital Library
- Li, D. and Wang, J. 2004. EERAID: Energy efficient redundant and inexpensive disk arrays. In Proceedings of the 11th ACM SIGOPS European Workshop (SIGOPS-EW), Leuven, Belgium. Google ScholarDigital Library
- Microsoft. 2002. Event tracing. http://msdn.microsoft.com/library/. Platform SDK: Performance Monitoring, Event Tracing.Google Scholar
- Nightingale, E. B. and Flinn, J. 2004. Energy-Efficiency and storage flexibility in the Blue file system. In Proceedings of the Symposium on Operating System Design and Implementation (OSDI), San Francisco, CA. Google ScholarDigital Library
- Pinheiro, E. and Bianchini, R. 2004. Energy conservation techniques for disk array-based servers. In Proceedings of the Annual International Conference on Supercomputing (ICS), Google ScholarDigital Library
- Pinheiro, E., Weber, W.-D., and Barroso, L. A. 2007. Failure trends in a large disk drive population. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST). San Jose, CA. Google ScholarDigital Library
- Rosenblum, M. and Ousterhout, J. 1991. The design and implementation of a log-structured file system. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP). Pacific Grove, CA. Google ScholarDigital Library
- Ruemmler, C. and Wilkes, J. 1993. UNIX disk access patterns. In Proceedings of the USENIX Winter Technical Conference, San Diego, CA.Google Scholar
- Samsung. 2007. NAND flash-based solid state disk product data sheet.Google Scholar
- SanDisk. 2007. SSD UATA 5000 1.8” data sheet. Document No. 80-11-00001.Google Scholar
- Schroeder, B. and Gibson, G. A. 2007. Disk failures in the real world: What does an MTTF of 1,000,000 hours mean to you? In Proceedings of the USENIX Conference on File and Storage Technologies (FAST), San Jose, CA. Google ScholarDigital Library
- Seagate Technology LLC. 2005. Cheetah 15K.4 SCSI Product Manual, Rev. D ed. Seagate Technology LLC, 920 Disc Drive, Scotts Valley, CA. Publication number: 100220456.Google Scholar
- Seltzer, M. I., Bostic, K., McKusick, M. K., and Staelin, C. 1993. An implementation of a log-structured file system for UNIX. In Proceedings of the USENIX Winter Conference, San Diego, CA. Google ScholarDigital Library
- Weddle, C., Oldham, M., Qian, J., Wang, A.-I. A., Reiher, P., and Kuenning, G. 2007. PARAID: The gear-shifting power-aware RAID. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST), San Jose, CA. Google ScholarDigital Library
- Yao, X. and Wang, J. 2006. Rimac: A novel redundancy-based hierarchical cache architecture for energy efficient, high performance storage systems. In Proceedings of the EuroSys Conference, Leuven, Belgium. Google ScholarDigital Library
- Zedlewski, J., Sobti, S., Garg, N., Zheng, F., Krishnamurthy, A., and Wang, R. 2003. Modeling hard-disk power consumption. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST), San Francisco, CA. Google ScholarDigital Library
- Zhu, N., Chen, J., and Chiueh, T. 2005. TBBT: Scalable and accurate trace replay for file server evaluation. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST), San Francisco, CA. Google ScholarDigital Library
- Zhu, Q., Chen, Z., Tan, L., Zhou, Y., Keeton, K., and Wilkes, J. 2005. Hibernator: Helping disk arrays sleep through the winter. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP), Brighton, United Kingdom. Google ScholarDigital Library
- Zhu, Q. and Zhou, Y. 2005. Power-aware storage cache management. IEEE Trans. Comput. 54, 5, 587--602. Google ScholarDigital Library
Index Terms
- Write off-loading: Practical power management for enterprise storage
Recommendations
Migrating server storage to SSDs: analysis of tradeoffs
EuroSys '09: Proceedings of the 4th ACM European conference on Computer systemsRecently, flash-based solid-state drives (SSDs) have become standard options for laptop and desktop storage, but their impact on enterprise server storage has not been studied. Provisioning server storage is challenging. It requires optimizing for the ...
A comprehensive study of energy efficiency and performance of flash-based SSD
Use of flash memory as a storage medium is becoming popular in diverse computing environments. However, because of differences in interface, flash memory requires a hard-disk-emulation layer, called FTL (flash translation layer). Although the FTL enables ...
Write off-loading: practical power management for enterprise storage
FAST'08: Proceedings of the 6th USENIX Conference on File and Storage TechnologiesIn enterprise data centers power usage is a problem impacting server density and the total cost of ownership. Storage uses a significant fraction of the power budget and there are no widely deployed power-saving solutions for enterprise storage systems. ...
Comments