skip to main content
research-article

NVRAM-aware logging in transaction systems

Published:01 December 2014Publication History
Skip Abstract Section

Abstract

Emerging byte-addressable, non-volatile memory technologies (NVRAM) like phase-change memory can increase the capacity of future memory systems by orders of magnitude. Compared to systems that rely on disk storage, NVRAM-based systems promise significant improvements in performance for key applications like online transaction processing (OLTP). Unfortunately, NVRAM systems suffer from two drawbacks: their asymmetric read-write performance and the notable higher cost of the new memory technologies compared to disk. This paper investigates the cost-effective use of NVRAM in transaction systems. It shows that using NVRAM only for the logging subsystem (NV-Logging) provides much higher transactions per dollar than simply replacing all disk storage with NVRAM. Specifically, for NV-Logging, we show that the software overheads associated with centralized log buffers cause performance bottlenecks and limit scaling. The per-transaction logging methods described in the paper help avoid these overheads, enabling concurrent logging for multiple transactions. Experimental results with a faithful emulation of future NVRAM-based servers using the TPCC, TATP, and TPCB benchmarks show that NV-Logging improves throughput by 1.42 - 2.72x over the costlier option of replacing all disk storage with NVRAM. Results also show that NV-Logging performs 1.21 - 6.71x better than when logs are placed into the PMFS NVRAM-optimized file system. Compared to state-of-the-art distributed logging, NV-Logging delivers 20.4% throughput improvements.

References

  1. In-memory Databases. http://en.wikipedia.org/wiki/In-memory_database.Google ScholarGoogle Scholar
  2. Micron Technology, Inc. http://us.micron.com/products-support/phase-change-memory.Google ScholarGoogle Scholar
  3. Newegg. http://www.newegg.com/.Google ScholarGoogle Scholar
  4. perf. https://perf.wiki.kernel.org.Google ScholarGoogle Scholar
  5. Shore-MT. https://sites.google.com/site/shoremt/.Google ScholarGoogle Scholar
  6. Anon et al. A measure of transaction processing power. In Datamation, 1985. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. S. Chen. Flashlogging: Exploiting flash devices for synchronous logging performance. In SIGMOD'09, Providence, Rhode Island, USA, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. J. Coburn, T. Bunker, M. Schwarz, R. Gupta, and S. Swanson. From aries to mars: Transaction support for next-generation, solid-state drives. In SOSP'13, Famington, Pennsylvania, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. J. Coburn, A. M. Caulfield, A. Akel, L. M. Grupp, R. K. Gupta, R. Jhala, and S. Swanson. Nv-heaps: Making persistent objects fast and safe with next-generation, non-volatile memories. In ASPLOS'11, Newport Beach, California, USA, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. J. Condit, E. B. Nightingale, C. Frost, E. Ipek, D. Burger, B. Lee, and D. Coetzee. Better i/o through byte-addressable, persistent memory. In SOSP'09, Big Sky, Montana, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. D. J. Dewitt, R. H. Katz, F. Olken, L. D. Shapiro, M. R. Stonebraker, and D. A. Wood. Implementation techniques for main memory database systems. In SIGMOD'84, New York, NY, USA, 1984. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. S. R. Dulloor, S. K. Kumar, A. K. Keshavamurthy, P. Lantz, D. Subbareddy, R. Sankaran, and J. Jackson. System software for persistent memory. In EuroSys'14, Amsterdam, The Netherlands, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. R. Fang, H.-I. Hsiao, C. Mohan, and Y. Wang. High performance database logging using storage class memory. In ICDE'11, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. G. Graefe, M. Lillibridge, H. Kuno, J. Tucek, and A. Veitch. Controlled lock violation. In SIGMOD'13, New York, USA, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. R. Johnson, I. Pandis, and A. Ailamaki. Improving oltp scalability using speculative lock inheritance. In VLDB'09, Lyon, France, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. R. Johnson, I. Pandis, N. Hardavellas, A. Ailamaki, and B. Falsafi. Shore-mt: A scalable storage manager for the multicore era. In EDBT'09, Saint Petersburg, Russia, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. R. Johnson, I. Pandis, R. Stoica, and M. Athanassoulis. Aether: A scalable approach to logging. In VLDB'10, Singapore, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. P. Kieun. Database Technology for Large Scale Data. http://www.cubrid.org/blog/dev-platform/database-technology-for-large-scale-data/.Google ScholarGoogle Scholar
  19. H. Kim, S. Seshadri, C. L. Dickey, and L. Chiu. Evaluating phase change memory for enterprise storage systems: A study of caching and tiering approaches. In FAST'14, Santa Clara, CA, USA, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. R. Lawrence. Early hash join: A configurable algorithm for the efficient and early production of join results. In VLDB'05, Trondheim, Norway, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. S.-W. Lee, B. Moon, C. Park, J.-M. Kim, and S.-W. Kim. A case for flash memory ssd in enterprise database applications. In SIGMOD'08, Vancouver, BC, Canada, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. M. F. Mokbel, M. Lu, and W. G. Aref. Hash-merge join: A non-blocking join algorithm for producing fast and early join results. In ICDE'04, Boston, USA, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. D. Narayanan and O. Hodson. Whole-system persistence. In ASPLOS'12, London, UK, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. D. Ongaro, S. M. Rumble, R. Stutsman, J. Ousterhout, and M. Rosenblum. Fast crash recovery in ramcloud. In SOSP'11, Cascais, Portugal, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. S. Pelley, T. F. Wenisch, B. T. Gold, and B. Bridge. Storage management in the nvram era. In VLDB'14, Hangzhou, China, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. M. K. Qureshi, V. Srinivasan, and J. A. Rivers. Scalable high performance main memory system using phase-change memory technology. In ISCA'09, Austin, Texas, USA, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. A. Rafii and D. DuBois. Performance tradeoffs of group commit logging. In CMG Conference, 1989.Google ScholarGoogle Scholar
  28. H. Volos, A. J. Tack, and M. M. Swift. Mnemosyne: Lightweight persistent memory. In ASPLOS'11, Newport Beach, California, USA, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. T. Wang and R. Johnson. Scalable logging through emerging non-volatile memory. In VLDB'14, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Wikipedia. ARIES. http://en.wikipedia.org/wiki/Algorithms_for_Recovery_and_Isolation_Exploiting_Semantics.Google ScholarGoogle Scholar
  31. J. H. Yoon, H. C. Hunter, and G. A. Tressler. Flash and dram si scaling challenges, emerging non-volatile memory technology enablement-implications to enterprise storage and server compute systems. In Flash Memory Summit, 2013.Google ScholarGoogle Scholar
  32. J. Zhao, S. Li, D. H. Yoon, Y. Xie, and N. P. Jouppi. Kiln: Closing the performance gap between systems with and without persistent support. In MICRO-46, Davis, CA, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. NVRAM-aware logging in transaction systems
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image Proceedings of the VLDB Endowment
            Proceedings of the VLDB Endowment  Volume 8, Issue 4
            December 2014
            132 pages

            Publisher

            VLDB Endowment

            Publication History

            • Published: 1 December 2014
            Published in pvldb Volume 8, Issue 4

            Qualifiers

            • research-article

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader