Sangwhan Moon
Skip Abstract Section
Abstract
Parity protection at the system level is typically employed to compose reliable storage systems. However, careful consideration is required when SSD-based systems employ parity protection. First, additional writes are required for parity updates. Second, parity consumes space on the device, which results in write amplification from less efficient garbage collection at higher space utilization.
This article analyzes the effectiveness of SSD-based RAID and discusses the potential benefits and drawbacks in terms of reliability. A Markov model is presented to estimate the lifetime of SSD-based RAID systems in different environments. In a small array, our results show that parity protection provides benefit only with considerably low space utilizations and low data access rates. However, in a large system, RAID improves data lifetime even when we take write amplification into account.
- Seungjae Baek, Seongjun Ahn, Jongmoo Choi, Donghee Lee, and Sam H. Noh. 2007. Uniformity improving page allocation for flash memory file systems. In Proceedings of the 7th ACM and IEEE International Conference on Embedded Software (EMSOFT’07). ACM, New York, NY, 154--163. DOI:http://dx.doi.org/10.1145/1289927.1289954 Google Scholar
Digital Library
- Mahesh Balakrishnan, Asim Kadav, Vijayan Prabhakaran, and Dahlia Malkhi. 2010. Differential RAID: Rethinking RAID for SSD reliability. ACM Transactions on Storage 6, 2, Article 4, 22 pages. DOI:http://dx.doi.org/10.1145/1807060.1807061 Google ScholarDigital Library
- Andrew Birrell, Michael Isard, Chuck Thacker, and Ted Wobber. 2007. A design for high-performance flash disks. SIGOPS Operation Systems Review 41, 2, 88--93. DOI:http://dx.doi.org/10.1145/1243418.1243429 Google ScholarDigital Library
- Simona Boboila and Peter Desnoyers. 2010. Write endurance in flash drives: Measurements and analysis. In Proceedings of the 8th USENIX Conference on File and Storage Technologies (FAST’10). USENIX Association, Berkeley, CA, 9--9. http://dl.acm.org/citation.cfm?id=1855511.1855520 Google ScholarDigital Library
- Yu Cai, Erich F. Haratsch, Onur Mutlu, and Ken Mai. 2012. Error patterns in MLC NAND flash memory: Measurement, characterization, and analysis. In Proceedings of the Conference on Design, Automation and Test in Europe (DATE’12). EDA Consortium, San Jose, CA, 521--526. http://dl.acm.org/citation.cfm?id=2492708.2492838 Google ScholarDigital Library
- Li-Pin Chang. 2007. On efficient wear leveling for large-scale flash-memory storage systems. In Proceedings of the 2007 ACM Symposium on Applied Computing (SAC’07). ACM, New York, NY, 1126--1130. DOI:http://dx.doi.org/10.1145/1244002.1244248 Google ScholarDigital Library
- Bainan Chen, Xinmiao Zhang, and Zhongfeng Wang. 2008. Error correction for multi-level NAND flash memory using Reed-Solomon codes. In IEEE Workshop on Signal Processing Systems, 2008 (SiPS’08). 94--99. DOI:http://dx.doi.org/10.1109/SIPS.2008.4671744Google ScholarCross Ref
- Feng Chen, Tian Luo, and Xiaodong Zhang. 2011. CAFTL: A content-aware flash translation layer enhancing the lifespan of flash memory based solid state drives. In Proceedings of the 9th USENIX Conference on File and Storage Technologies (FAST’11). USENIX Association, Berkeley, CA, 6--6. http://dl.acm.org/citation.cfm?id=1960475.1960481 Google ScholarDigital Library
- E. de la Iglesia. 2012. Abstracting the flash translation layer for enterprise-ready MLC. Presentation at Flash Memory Summit, Santa Clara, CA.Google Scholar
- Peter Desnoyers. 2012. Analytic modeling of SSD write performance. In Proceedings of the 5th Annual International Systems and Storage Conference (SYSTOR’12). ACM, New York, NY, Article 12, 10 pages. DOI:http://dx.doi.org/10.1145/2367589.2367603 Google ScholarDigital Library
- Fujitsu. 2014. Fujitsu PRIMERGY servers solution-specific evaluation of SSD write endurance {white paper}. Retrieved April 1, 2016 from http://globalsp.ts.fujitsu.com/dmsp/Publications/public/wp-solution-specific-evaluation-of-ssd-write-endurance-ww-en.pdf.Google Scholar
- Eran Gal and Sivan Toledo. 2005. Algorithms and data structures for flash memories. ACM Computing Surveys 37, 2, 138--163. DOI:http://dx.doi.org/10.1145/1089733.1089735 Google ScholarDigital Library
- J. Gathman, A. McPadden, and G. Tressler. 2013. The need for standardization in the enterprise SSD product segment. Presentation in Flash Memory Summit, Santa Clara, CA.Google Scholar
- Kevin Greenan, Darrell D. E. Long, Ethan L. Miller, Thomas Schwarz, and Avani Wildani. 2009. Building flexible, fault-tolerant flash-based storage systems. In Proceedings of the 5th Workshop on Hot Topics in System Dependability (HotDep’09).Google Scholar
- S. Gregori, A. Cabrini, O. Khouri, and G. Torelli. 2003. On-chip error correcting techniques for new-generation flash memories. Proceedings of the IEEE 91, 4, 602--616. DOI:http://dx.doi.org/10.1109/JPROC.2003.811709Google ScholarCross Ref
- E. Grochowski. 2012. Future technology challenges for NAND flash and HDD products. Presentation at Flash Memory Summit, Santa Clara, CA.Google Scholar
- L. M. Grupp, A. M. Caulfield, J. Coburn, S. Swanson, E. Yaakobi, P. H. Siegel, and J. K. Wolf. 2009. Characterizing flash memory: Anomalies, observations, and applications. In 42nd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO’09). 24--33. Google ScholarDigital Library
- Laura M. Grupp, John D. Davis, and Steven Swanson. 2012. The bleak future of NAND flash memory. In Proceedings of the 10th USENIX Conference on File and Storage Technologies (FAST’12). USENIX Association, Berkeley, CA, 2--2. http://dl.acm.org/citation.cfm?id=2208461.2208463 Google ScholarDigital Library
- Aayush Gupta, Raghav Pisolkar, Bhuvan Urgaonkar, and Anand Sivasubramaniam. 2011. Leveraging value locality in optimizing NAND flash-based SSDs. In Proceedings of the 9th USENIX Conference on File and Storage Technologies (FAST’11). USENIX Association, Berkeley, CA, 7--7. http://dl.acm.org/citation.cfm?id=1960475.1960482 Google ScholarDigital Library
- HGST. 2016. Ultrastar™ SSD800MH {Datasheet}. https://www.hgst.com/sites/default/files/resources/US_SSD800MH_ds.pdf.Google Scholar
- HP. 2016. HP enterprise solid state drive {Datasheet}. Retrieved April 1, 2016 from http://h20195.www2.hp.com/v2/GetPDF.aspx%2F4AA4-7186ENW.pdf.Google Scholar
- Xiao-Yu Hu, Evangelos Eleftheriou, Robert Haas, Ilias Iliadis, and Roman Pletka. 2009. Write amplification analysis in flash-based solid state drives. In Proceedings of SYSTOR 2009: The Israeli Experimental Systems Conference (SYSTOR’09). ACM, New York, NY, Article 10, 9 pages. DOI:http://dx.doi.org/10.1145/1534530.1534544 Google ScholarDigital Library
- A. Jagmohan, M. Franceschini, and L. Lastras. 2010. Write amplification reduction in NAND flash through multi-write coding. In IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST’10). 1--6. DOI:http://dx.doi.org/10.1109/MSST.2010.5496985 Google ScholarDigital Library
- Nikolaus Jeremic, Gero Mühl, Anselm Busse, and Jan Richling. 2011. The pitfalls of deploying solid-state drive RAIDs. In Proceedings of the 4th Annual International Conference on Systems and Storage (SYSTOR’11). ACM, New York, NY, Article 14, 13 pages. DOI:http://dx.doi.org/10.1145/1987816.1987835 Google ScholarDigital Library
- Han-Joon Kim and Sang-Goo Lee. 2002. An effective flash memory manager for reliable flash memory space management. IEICE Transactions on Information and Systems 85, 6, 950--964.Google Scholar
- Hyojun Kim and Seongjun Ahn. 2008. BPLRU: A buffer management scheme for improving random writes in flash storage. In Proceedings of the 6th USENIX Conference on File and Storage Technologies (FAST’08). USENIX Association, Berkeley, CA, Article 16, 14 pages. http://dl.acm.org/citation.cfm?id=1364813.1364829 Google ScholarDigital Library
- Youngjae Kim, S. Oral, G. M. Shipman, Junghee Lee, D. A. Dillow, and Feiyi Wang. 2011. Harmonia: A globally coordinated garbage collector for arrays of solid-state drives. In IEEE 27th Symposium on Mass Storage Systems and Technologies (MSST’11). 1--12. DOI:http://dx.doi.org/10.1109/MSST.2011.5937224 Google ScholarDigital Library
- Jongmin Lee, Sunghoon Kim, Hunki Kwon, Choulseung Hyun, Seongjun Ahn, Jongmoo Choi, Donghee Lee, and Sam H. Noh. 2007. Block recycling schemes and their cost-based optimization in NAND flash memory based storage system. In Proceedings of the 7th ACM/IEEE International Conference on Embedded Software (EMSOFT’07). ACM, New York, NY, 174--182. DOI:http://dx.doi.org/10.1145/1289927.1289956 Google ScholarDigital Library
- Bo Mao, Hong Jiang, Dan Feng, Suzhen Wu, Jianxi Chen, Lingfang Zeng, and Lei Tian. 2010. HPDA: A hybrid parity-based disk array for enhanced performance and reliability. In IEEE International Symposium on Parallel Distributed Processing (IPDPS’10). 1--12. DOI:http://dx.doi.org/10.1109/IPDPS.2010.5470361Google ScholarCross Ref
- N. Mielke, T. Marquart, Ning Wu, J. Kessenich, H. Belgal, Eric Schares, F. Trivedi, E. Goodness, and L. R. Nevill. 2008. Bit error rate in NAND flash memories. In Reliability Physics Symposium, 2008 (IRPS’08). IEEE International. 9--19. DOI:http://dx.doi.org/10.1109/RELPHY.2008.4558857Google ScholarCross Ref
- Sangwhan Moon and A. L. N. Reddy. 2012. Write amplification due to ECC on flash memory or leave those bit errors alone. In IEEE 28th Symposium on Mass Storage Systems and Technologies (MSST’12). 1--6. DOI:http://dx.doi.org/10.1109/MSST.2012.6232375Google ScholarCross Ref
- Sangwhan Moon and A. L. Narasimha Reddy. 2013. Don’t let RAID raid the lifetime of your SSD array. In Proceedings of the 5th USENIX Conference on Hot Topics in Storage and File Systems (HotStorage’13). USENIX Association, Berkeley, CA, 7--7. http://dl.acm.org/citation.cfm?id=2534861.2534868 Google ScholarDigital Library
- Yongseok Oh, Jongmoo Choi, Donghee Lee, and Sam H. Noh. 2012. Caching less for better performance: Balancing cache size and update cost of flash memory cache in hybrid storage systems. In Proceedings of the 10th USENIX Conference on File and Storage Technologies (FAST’12). USENIX Association, Berkeley, CA, 25--25. http://dl.acm.org/citation.cfm?id=2208461.2208486 Google ScholarDigital Library
- John Ousterhout and Fred Douglis. 1989. Beating the I/O bottleneck: A case for log-structured file systems. SIGOPS Operating Systems Review 23, 1, 11--28. DOI:http://dx.doi.org/10.1145/65762.65765 Google ScholarDigital Library
- David A. Patterson, Garth Gibson, and Randy H. Katz. 1988. A case for redundant arrays of inexpensive disks (RAID). In Proceedings of the 1988 ACM SIGMOD International Conference on Management of Data (SIGMOD’88). ACM, New York, NY, 109--116. DOI:http://dx.doi.org/10.1145/50202.50214 Google ScholarDigital Library
- J. S. Plank. 2005. Erasure Codes for Storage Applications. Tutorial Slides, presented at FAST-2005: 4th Usenix Conference on File and Storage Technologies. Retrieved April 1, 2016 from http://www.cs.utk.edu/∼plank/plank/papers/FAST-2005.html. (2005).Google Scholar
- Mendel Rosenblum and John K. Ousterhout. 1992. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems 10, 1, 26--52. DOI:http://dx.doi.org/10.1145/146941.146943 Google ScholarDigital Library
- A. M. Saleh, J. J. Serrano, and J. H. Patel. 1990. Reliability of scrubbing recovery-techniques for memory systems. IEEE Transactions on Reliability 39, 1, 114--122. DOI:http://dx.doi.org/10.1109/24.52622Google ScholarCross Ref
- Mohit Saxena, Michael M. Swift, and Yiying Zhang. 2012. FlashTier: A lightweight, consistent and durable storage cache. In Proceedings of the 7th ACM European Conference on Computer Systems (EuroSys’12). ACM, New York, NY, 267--280. DOI:http://dx.doi.org/10.1145/2168836.2168863 Google ScholarDigital Library
- Mohit Saxena, Yiying Zhang, Michael M. Swift, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau. 2013. Getting real: Lessons in transitioning research simulations into hardware systems. Presented as Part of the 11th USENIX Conference on File and Storage Technologies (FAST’13). USENIX, San Jose, CA, 215--228. https://www.usenix.org/conference/fast13/technical-sessions/presentation/saxena. Google ScholarDigital Library
- Thomas J. E. Schwarz, Qin Xin, Ethan L. Miller, Darrell D. E. Long, Andy Hospodor, and Spencer Ng. 2004. Disk scrubbing in large archival storage systems. In Proceedings of the IEEE Computer Society’s 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems (MASCOTS’04). IEEE Computer Society, Washington, DC, 409--418. http://dl.acm.org/citation.cfm?id=1032659.1034226 Google ScholarDigital Library
- SanDisk. 2013. WP004-The why and how of SSD over provisioning {White paper}. https://www.sandisk.com/content/dam/sandisk-main/en_us/assets/resources/enterprise/white-papers/WP004_OverProvisioning_WhyHow_FINAL.pdf.Google Scholar
- SMART Storage Systems. 2013. Guardian™technology platform {white paper}. Number WP003. Retrieved April 1, 2016 from http://www.smartstoragesys.com/pdfs/WP003_Guardian_Technology.pdf.Google Scholar
- Gokul Soundararajan, Vijayan Prabhakaran, Mahesh Balakrishnan, and Ted Wobber. 2010. Extending SSD lifetimes with disk-based write caches. In Proceedings of the 8th USENIX Conference on File and Storage Technologies (FAST’10). USENIX Association, Berkeley, CA, 8--8. http://dl.acm.org/citation.cfm?id=1855511.1855519 Google ScholarDigital Library
- Spec Inc. 2011. Engineering MLC flash-based SSDs to reduce total cost of ownership in enterprise SSD deployments. Presentation at Flash Memory Summit, Santa Clara, CA.Google Scholar
- S. Stead. 2012. It takes guts to be great. Presentation at Flash Memory Summit, Santa Clara, CA.Google Scholar
- Fei Sun, Ken Rose, and Tong Zhang. 2006. On the use of strong BCH codes for improving multilevel NAND flash memory storage capacity. In IEEE Workshop on Signal Processing Systems (SiPS): Design and Implementation.Google Scholar
- Hairong Sun, Pete Grayson, and Bob Wood. 2011. Quantifying reliability of solid-state storage from multiple aspects. In Proceedings of the 7th IEEE International Workshop on Storage and Network Architecture and Parallel I/O (SNAPI’11).Google Scholar
- K. Thomas. 2012. Solid state drives no better than others, survey says. (2012). Retrieved April 1, 2016 from http://www.pcworld.com/article/213442.Google Scholar
- Qin Xin, E. L. Miller, T. Schwarz, D. D. E. Long, S. A. Brandt, and W. Litwin. 2003. Reliability mechanisms for very large storage systems. In Proceedings of the 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies 2003 (MSST’03). 146--156. DOI:http://dx.doi.org/10.1109/MASS.2003.1194851 Google ScholarDigital Library
- E. Yaakobi, L. Grupp, P. H. Siegel, S. Swanson, and J. K. Wolf. 2012. Characterization and error-correcting codes for TLC flash memories. In International Conference on Computing, Networking and Communications (ICNC’12). 486--491. DOI:http://dx.doi.org/10.1109/ICCNC.2012.6167470Google Scholar
- E. Yaakobi, Jing Ma, L. Grupp, P. H. Siegel, S. Swanson, and J. K. Wolf. 2010. Error characterization and coding schemes for flash memories. In IEEE GLOBECOM Workshops (GC Wkshps’10). 1856--1860. DOI:http://dx.doi.org/10.1109/GLOCOMW.2010.5700263Google Scholar
- Yiying Zhang, Leo Prasath Arulraj, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau. 2012. De-indirection for flash-based SSDs with nameless writes. In Proceedings of the 10th USENIX Conference on File and Storage Technologies (FAST’12). USENIX Association, Berkeley, CA, 1--1. http://dl.acm.org/citation.cfm?id=2208461.2208462 Google ScholarDigital Library
Index Terms
- Does RAID Improve Lifetime of SSD Arrays?
Recommendations
Optimizing RAID/SSD controllers with lifetime extension for flash-based SSD array
LCTES '18Flash-based SSD RAID arrays are increasingly being deployed in data centers. Compared with HDD arrays, SSD arrays drastically enhance storage density and I/O performance, and reduce power and rack space. Nevertheless, SSDs suffer aging issues. Though ...
An empirical study of redundant array of independent solid-state drives (RAIS)
Solid-state drives (SSD) are popular storage media devices alongside magnetic hard disk drives (HDD). SSD flash chips are packaged in HDD form factors and SSDs are compatible with regular HDD device drivers and I/O buses. This compatibility allows easy ...
Optimizing RAID/SSD controllers with lifetime extension for flash-based SSD array
LCTES 2018: Proceedings of the 19th ACM SIGPLAN/SIGBED International Conference on Languages, Compilers, and Tools for Embedded SystemsFlash-based SSD RAID arrays are increasingly being deployed in data centers. Compared with HDD arrays, SSD arrays drastically enhance storage density and I/O performance, and reduce power and rack space. Nevertheless, SSDs suffer aging issues. Though ...
Comments