skip to main content
research-article
Public Access

Classifying Data to Reduce Long-Term Data Movement in Shingled Write Disks

Published:24 February 2016Publication History
Skip Abstract Section

Abstract

Shingled magnetic recording (SMR) is a means of increasing the density of hard drives that brings a new set of challenges. Due to the nature of SMR disks, updating in place is not an option. Holes left by invalidated data can only be filled if the entire band is reclaimed, and a poor band compaction algorithm could result in spending a lot of time moving blocks over the lifetime of the device. We propose using write frequency to separate blocks to reduce data movement and develop a band compaction algorithm that implements this heuristic. We demonstrate how our algorithm results in improved data management, resulting in an up to 45% reduction in required data movements when compared to naive approaches to band management.

References

  1. Abutalib Aghayev and Peter Desnoyers. 2015. Skylight-A window on shingled disk operation. In Proceedings of the 13th USENIX Conference on File and Storage Technologies. 135--149. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Ahmed Amer, Darrell D. E. Long, Ethan L. Miller, J.-F. Paris, and S. J. Thomas Schwarz. 2010. Design issues for a shingled write disk system. In Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST’10). IEEE, Los Alamitos, CA, 1--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Medha Bhadkamkar, Jorge Guerra, Luis Useche, Sam Burnett, Jason Liptak, Raju Rangaswami, and Vagelis Hristidis. 2009. BORG: Block-reORGanization for self-optimizing storage systems. In Proceedings of the 7th USENIX Conference on File and Storage Technologies (FAST’09). Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Tevor Blackwell, Jeffrey Harris, and Margo Seltzer. 1995. Heuristic cleaning algorithms in log-structured file systems. In Proceedings of the Winter 1995 USENIX Technical Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Yuval Cassuto, Marco A. A. Sanvido, Cyril Guyot, David R. Hall, and Zvonimir Z. Bandic. 2010. Indirection systems for shingled-recording disk drives. In Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST’10). IEEE, Los Alamitos, CA, 1--14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Peter Desnoyers. 2013. What systems researchers need to know about NAND flash. In Proceedings of the 5th USENIX Workshop on Hot Topics in File and Storage Technologies (HotStorage’13). Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Peter Desnoyers. 2014. Analytic models of SSD write performance. ACM Transactions on Storage 10, 2, 8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. David Essary and Ahmed Amer. 2008. Predictive data grouping: Defining the bounds of energy and latency reduction through predictive data grouping and replication. ACM Transactions on Storage 4, 1, 2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. David Hall, John H. Marcos, and Jonathan D. Coker. 2012. Data handling algorithms for autonomous shingled magnetic recording HDDs. IEEE Transactions on Magnetics 48, 5, 1777--1781.Google ScholarGoogle ScholarCross RefCross Ref
  10. Weiping He and David H. C. Du. 2014. Novel address mappings for shingled write disks. In Proceedings of the 6th USENIX Conference on Hot Topics in Storage and File Systems. 5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Jen-Wei Hsieh, Tei-Wei Kuo, and Li-Pin Chang. 2006. Efficient identification of hot data for flash memory storage systems. ACM Transactions on Storage 2. 1, 22--240. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Chao Jin, Wei-Ya Xi, Zhi-Yong Ching, Feng Huo, and Chun-Teck Lim. 2014. HiSMRfs: A high performance file system for shingled storage array. In Proceedings of the 2014 30th Symposium on Mass Storage Systems and Technologies (MSST’14). IEEE, Los Alamitos, CA, 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  13. Damien Le Moal, Zvonimir Bandic, and Cyril Guyot. 2012. Shingled file system host-side management of shingled magnetic recording disks. In Proceedings of the 2012 IEEE International Conference on Consumer Electronics (ICCE’12). IEEE, Los Alamitos, CA, 425--426.Google ScholarGoogle ScholarCross RefCross Ref
  14. Chung-I. Lin, Dongchul Park, Weiping He, and David Du. 2012. H-SWD: Incorporating hot data identification into shingled write disks. In Proceedings of the 20th IEEE International Symposium on Modeling, Analysis, and Simulations of Computer and Telecommunication Systems (MASCOTS’12). 248--255. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Jeanna Neefe Matthews, Drew Roselli, Adam M. Costello, Randolph Y. Wang, and Thomas E. Anderson. 1997. Improving the performance of log-structured file systems with adaptive methods. In Proceedings of the 16th ACM Symposium on Operating Systems Principles (SOSP’97). 238--251. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Dushyanth Narayanan, Austin Donnelly, and Antony Rowstron. 2008. Write off-loading: Practical power management for enterprise storage. In Proceedings of the 6th USENIX Conference on File and Storage Technologies. 17. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Rekha Pitchumani, Andy Hospodor, Ahmed Amer, Yangwook Kang, Ethan L. Miller, and Darrell D. E. Long. 2012. Emulating a shingled write disk. In Proceedings of the 20th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS’12). Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Mendel Rosenblum and John K. Ousterhout. 1992. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems 10, 1, 26--52. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Margo Seltzer, Keith Bostic, M. Kirk McKusick, and Carl Staelin. 1993. An implementation of a log-structured file system for UNIX. In Proceedings of the Winter 1993 USENIX Technical Conference. 307--326. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Ji-Yong Shin, Mahesh Balakrishnan, Tudor Marian, and Hakim Weatherspoon. 2013. Gecko: Contention-oblivious disk arrays for cloud storage. In Proceedings of the 11th USENIX Conference on File and Storage Technologies. 285--298. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Jun Wang and Yiming Hu. 2001. PROFS-performance oriented data reorganization for log-structured file system on multi-zone disks. In Proceedings of the 9th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS’01). Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Jun Wang and Yiming Hu. 2002. WOLF—a novel reordering write buffer to boost the performance of log-structured file systems. In Proceedings of the 1st Conference on File and Storage Technologies (FAST’02). 47--60. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Wenguang Wang, Yanping Zhao, and Rick Bunt. 2004. HyLog: A high performance approach to managing disk layout. In Proceedings of the 3rd USENIX Conference on File and Storage Systems (FAST’04). 145--158. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Classifying Data to Reduce Long-Term Data Movement in Shingled Write Disks

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Storage
          ACM Transactions on Storage  Volume 12, Issue 1
          Special Issue on Massive Storage Systems and Technologies (MSST 2015)
          February 2016
          108 pages
          ISSN:1553-3077
          EISSN:1553-3093
          DOI:10.1145/2875132
          Issue’s Table of Contents

          Copyright © 2016 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 24 February 2016
          • Accepted: 1 November 2015
          • Received: 1 November 2014
          Published in tos Volume 12, Issue 1

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader