Abstract
Shingled magnetic recording (SMR) is a means of increasing the density of hard drives that brings a new set of challenges. Due to the nature of SMR disks, updating in place is not an option. Holes left by invalidated data can only be filled if the entire band is reclaimed, and a poor band compaction algorithm could result in spending a lot of time moving blocks over the lifetime of the device. We propose using write frequency to separate blocks to reduce data movement and develop a band compaction algorithm that implements this heuristic. We demonstrate how our algorithm results in improved data management, resulting in an up to 45% reduction in required data movements when compared to naive approaches to band management.
- Abutalib Aghayev and Peter Desnoyers. 2015. Skylight-A window on shingled disk operation. In Proceedings of the 13th USENIX Conference on File and Storage Technologies. 135--149. Google ScholarDigital Library
- Ahmed Amer, Darrell D. E. Long, Ethan L. Miller, J.-F. Paris, and S. J. Thomas Schwarz. 2010. Design issues for a shingled write disk system. In Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST’10). IEEE, Los Alamitos, CA, 1--12. Google ScholarDigital Library
- Medha Bhadkamkar, Jorge Guerra, Luis Useche, Sam Burnett, Jason Liptak, Raju Rangaswami, and Vagelis Hristidis. 2009. BORG: Block-reORGanization for self-optimizing storage systems. In Proceedings of the 7th USENIX Conference on File and Storage Technologies (FAST’09). Google ScholarDigital Library
- Tevor Blackwell, Jeffrey Harris, and Margo Seltzer. 1995. Heuristic cleaning algorithms in log-structured file systems. In Proceedings of the Winter 1995 USENIX Technical Conference. Google ScholarDigital Library
- Yuval Cassuto, Marco A. A. Sanvido, Cyril Guyot, David R. Hall, and Zvonimir Z. Bandic. 2010. Indirection systems for shingled-recording disk drives. In Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST’10). IEEE, Los Alamitos, CA, 1--14. Google ScholarDigital Library
- Peter Desnoyers. 2013. What systems researchers need to know about NAND flash. In Proceedings of the 5th USENIX Workshop on Hot Topics in File and Storage Technologies (HotStorage’13). Google ScholarDigital Library
- Peter Desnoyers. 2014. Analytic models of SSD write performance. ACM Transactions on Storage 10, 2, 8. Google ScholarDigital Library
- David Essary and Ahmed Amer. 2008. Predictive data grouping: Defining the bounds of energy and latency reduction through predictive data grouping and replication. ACM Transactions on Storage 4, 1, 2. Google ScholarDigital Library
- David Hall, John H. Marcos, and Jonathan D. Coker. 2012. Data handling algorithms for autonomous shingled magnetic recording HDDs. IEEE Transactions on Magnetics 48, 5, 1777--1781.Google ScholarCross Ref
- Weiping He and David H. C. Du. 2014. Novel address mappings for shingled write disks. In Proceedings of the 6th USENIX Conference on Hot Topics in Storage and File Systems. 5. Google ScholarDigital Library
- Jen-Wei Hsieh, Tei-Wei Kuo, and Li-Pin Chang. 2006. Efficient identification of hot data for flash memory storage systems. ACM Transactions on Storage 2. 1, 22--240. Google ScholarDigital Library
- Chao Jin, Wei-Ya Xi, Zhi-Yong Ching, Feng Huo, and Chun-Teck Lim. 2014. HiSMRfs: A high performance file system for shingled storage array. In Proceedings of the 2014 30th Symposium on Mass Storage Systems and Technologies (MSST’14). IEEE, Los Alamitos, CA, 1--6.Google ScholarCross Ref
- Damien Le Moal, Zvonimir Bandic, and Cyril Guyot. 2012. Shingled file system host-side management of shingled magnetic recording disks. In Proceedings of the 2012 IEEE International Conference on Consumer Electronics (ICCE’12). IEEE, Los Alamitos, CA, 425--426.Google ScholarCross Ref
- Chung-I. Lin, Dongchul Park, Weiping He, and David Du. 2012. H-SWD: Incorporating hot data identification into shingled write disks. In Proceedings of the 20th IEEE International Symposium on Modeling, Analysis, and Simulations of Computer and Telecommunication Systems (MASCOTS’12). 248--255. Google ScholarDigital Library
- Jeanna Neefe Matthews, Drew Roselli, Adam M. Costello, Randolph Y. Wang, and Thomas E. Anderson. 1997. Improving the performance of log-structured file systems with adaptive methods. In Proceedings of the 16th ACM Symposium on Operating Systems Principles (SOSP’97). 238--251. Google ScholarDigital Library
- Dushyanth Narayanan, Austin Donnelly, and Antony Rowstron. 2008. Write off-loading: Practical power management for enterprise storage. In Proceedings of the 6th USENIX Conference on File and Storage Technologies. 17. Google ScholarDigital Library
- Rekha Pitchumani, Andy Hospodor, Ahmed Amer, Yangwook Kang, Ethan L. Miller, and Darrell D. E. Long. 2012. Emulating a shingled write disk. In Proceedings of the 20th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS’12). Google ScholarDigital Library
- Mendel Rosenblum and John K. Ousterhout. 1992. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems 10, 1, 26--52. Google ScholarDigital Library
- Margo Seltzer, Keith Bostic, M. Kirk McKusick, and Carl Staelin. 1993. An implementation of a log-structured file system for UNIX. In Proceedings of the Winter 1993 USENIX Technical Conference. 307--326. Google ScholarDigital Library
- Ji-Yong Shin, Mahesh Balakrishnan, Tudor Marian, and Hakim Weatherspoon. 2013. Gecko: Contention-oblivious disk arrays for cloud storage. In Proceedings of the 11th USENIX Conference on File and Storage Technologies. 285--298. Google ScholarDigital Library
- Jun Wang and Yiming Hu. 2001. PROFS-performance oriented data reorganization for log-structured file system on multi-zone disks. In Proceedings of the 9th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS’01). Google ScholarDigital Library
- Jun Wang and Yiming Hu. 2002. WOLF—a novel reordering write buffer to boost the performance of log-structured file systems. In Proceedings of the 1st Conference on File and Storage Technologies (FAST’02). 47--60. Google ScholarDigital Library
- Wenguang Wang, Yanping Zhao, and Rick Bunt. 2004. HyLog: A high performance approach to managing disk layout. In Proceedings of the 3rd USENIX Conference on File and Storage Systems (FAST’04). 145--158. Google ScholarDigital Library
Index Terms
- Classifying Data to Reduce Long-Term Data Movement in Shingled Write Disks
Recommendations
Evolving Ext4 for shingled disks
FAST'17: Proceedings of the 15th Usenix Conference on File and Storage TechnologiesDrive-Managed SMR (Shingled Magnetic Recording) disks offer a plug-compatible higher-capacity replacement for conventional disks. For non-sequential workloads, these disks show bimodal behavior: After a short period of high throughput they enter a ...
Workload Impact on Shingled Write Disks: All-Writes Can Be Alright
MASCOTS '11: Proceedings of the 2011 IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication SystemsThe data density of magnetic disk has been growing at 30% to 50% per year. However, physical limitations will slow this growth unless creative recording techniques can be found. Shingled writing is a promising technique that trades off the inability to ...
A data management method for databases using hybrid storage systems
When applications require high I/O performance, solid-state drives (SSDs) are often preferable because they perform better than traditional hard-disk drives (HDDs). Therefore, database system response time can be improved by moving frequently used data ...
Comments