Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Datenbank-Spektrum
Published in: Datenbank-Spektrum 3/2018

05-10-2018 | Schwerpunktbeitrag

Data Management on Non-Volatile Memory: A Perspective

Authors: Philipp Götze, Alexander van Renen, Lucas Lersch, Viktor Leis, Ismail Oukid

Published in: Datenbank-Spektrum | Issue 3/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The large performance gap between main memory and secondary storage accounts for many design decisions of traditional database systems. With the upcoming availability of Non-Volatile Memory (NVM), which has latencies in the same order of magnitude as DRAM, is byte-addressable and persistent, a completely new type of technology is added to the memory stack. This changes some basic assumptions such as slow storage, block granular access, and that sequential accesses are much faster than random accesses. New ideas are therefore needed to efficiently leverage NVM. Although several new approaches can be found in the literature, the exact role of NVM is not yet clear. In this paper, we survey recent work in this area and classify the existing approaches. We focus on two key challenges: (1) integration of NVM into the memory hierarchy and (2) the design of NVM-aware data structures. We contrast the different approaches, highlight their advantages and limitations, and make recommendations.
previous article Efficient and Scalable k‑Means on GPUs
next article Cooking DBMS Operations using Granular Primitives

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now
Show more products
Footnotes
1
Also known as Persistent Memory (PM), Non-Volatile Random Access Memory (NVRAM), or Storage Class Memory (SCM).
 
Literature
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
Agrawal R, Jagadish HV (1989) Recovery algorithms for database machines with nonvolatile main memory. IWDM ’89, pp 269–285
11.
Andrei M, Lemke C et al (2017) SAP HANA adoption of non-volatile memory. Proceedings VLDB Endowment 10(12):1754–1765CrossRef
12.
Appuswamy R, Borovica R et al (2017) The five minute rule thirty years later and its impact on the storage hierarchy. ADMS @ VLDB ’17.
13.
Arulraj J, Pavlo A (2017) How to build a non-volatile memory database management system. SIGMOD ’17, pp 1753–1758
14.
Arulraj J, Pavlo A, Dulloor S (2015) Let’s talk about storage & recovery methods for non-volatile memory database systems. SIGMOD ’15, pp 707–722
15.
Arulraj J, Perron M, Pavlo A (2016) Write-behind logging. Proceedings VLDB Endowment 10(4):337–348CrossRef
16.
Arulraj J, Levandoski JJ et al (2018) BzTree: a high-performance latch-free range index for non-volatile memory. Proceedings VLDB Endowment 11(5):553–565
17.
Bayer R, McCreight EM (1972) Organization and maintenance of large ordered indices. Acta Inform 1:173–189CrossRef
18.
Bhandari K, Chakrabarti DR, Boehm H (2016) Makalu: fast recoverable allocation of non-volatile memory, pp 677–694
19.
Chatzistergiou A, Cintra M, Viglas SD (2015) REWIND: recovery write-ahead system for in-memory non-volatile data-structures. Proceedings VLDB Endowment 8(5):497–508CrossRef
20.
Chen S, Jin Q (2015) Persistent B+-trees in non- volatile main memory. Proceedings VLDB Endowment 8(7):786–797CrossRef
21.
Chua L (1971) Memristor – the missing circuit element. IEEE Trans Circuit Theory 18(5):507–519CrossRef
22.
23.
Condit J, Nightingale EB et al (2009) Better I/O through byte-addressable, persistent memory. ACM, SOSP ’09, pp 133–146
24.
DeBrabant J, Pavlo A et al (2013) Anti-caching: a new approach to database management system architecture. Proceedings VLDB Endowment 6(14):1942–1953CrossRef
25.
DeBrabant J, Arulraj J et al (2014) A prolegomenon on OLTP database systems for non-volatile memory. ADMS @ VLDB ’14, pp 57–63
26.
Dulloor SR, Kumar S et al (2014) System software for persistent memory. ACM, EuroSys ’14, pp 15:1–15:15
27.
Eisenman A, Gardner D et al (2018) Reducing DRAM footprint with NVM in Facebook. ACM, EuroSys ’18, pp 42:1–42:13
28.
Götze P, Baumann S, Sattler KU (2018) An NVM-aware storage layout for analytical workloads. HardBD & Active @ ICDE ’18.
29.
Govoreanu B, Kar G et al (2011) 10×10nm2 Hf/HfOx crossbar resistive RAM with excellent performance, reliability and low-energy operation. IEEE, IEDM, pp 31.36.31–31.36.34
30.
Graefe G, Guy W, Sauer C (2016) Instant recovery with write-ahead logging: page repair, system restart, media restore, and system failover, 2nd edn. Synthesis lectures on data management. Morgan & Claypool, San Rafael
31.
Gray J, Putzolu GR (1987) The 5 minute rule for trading memory for disk accesses and the 10 byte rule for trading memory for CPU time. SIGMOD ’87, pp 395–398
32.
Harizopoulos S, Abadi DJ et al (2008) OLTP through the looking glass, and what we found there. SIGMOD ’08, pp 981–992
33.
Hosomi M, Yamagishi H et al (2005) A novel nonvolatile memory with spin torque transfer magnetization switching: spin-RAM. IEEE, IEDM, pp 459–462
34.
Hu J, Xue CJ et al (2011) Towards energy efficient hybrid on-chip scratch pad memory with non-volatile memory. IEEE, DATE, pp 1–6
35.
Huang J, Schwan K, Qureshi MK (2014) NVRAM- aware logging in transaction systems. Proceedings VLDB Endowment 8(4):389–400CrossRef
36.
Kimura H (2015) FOEDUS: OLTP engine for a thousand cores and NVRAM. In: SIGMOD, pp 691–706
37.
38.
Lee BC, Zhou P et al (2010) Phase-change technology and the future of main memory. IEEE Micro 30(1):131–141CrossRef
39.
Lee SK, Lim KH et al (2017) WORT: write optimal radix tree for persistent memory storage systems. FAST ’17, pp 257–270
40.
Leis V, Kemper A, Neumann T (2013) The adaptive radix tree: aRTful indexing for main-memory databases. ICDE ’13, pp 38–49
41.
Leis V, Haubenschild M et al (2018) Leanstore: in-memory data management beyond main memory. ICDE ’18.
42.
Lersch L, Oukid I et al (2017) Rethinking DRAM caching for LSMs in an NVRAM environment. ADBIS ’17, pp 326–340
43.
44.
Liu Q, Varman P (2017) Ouroboros wear-leveling: a two-level hierarchical wear-leveling model for NVRAM. MSST ’17.
45.
Mittal S, Vetter JS (2016) A survey of software techniques for using non-volatile memories for storage and main memory systems. IEEE Trans Parallel Distrib Syst 27(5):1537–1550CrossRef
46.
Mohan C, Haderle DJ et al (1992) ARIES: a transaction recovery method supporting fine-granularity locking and partial rollbacks using write-ahead logging. ACM Trans Database Syst 17(1):94–162CrossRef
47.
Moraru I, Andersen DG et al (2013) Consistent, durable, and safe memory management for byte-addressable non volatile main memory, pp 1:1–1:17
48.
Ou J, Shu J, Lu Y (2016) A high performance file system for non-volatile main memory. EuroSys ’16, ACM, pp 12:1–12:16
49.
Oukid I, Lehner W (2017) Data structure engineering for byte-addressable non-volatile memory. ACM, SIGMOD ’17, pp 1759–1764
50.
Oukid I, Booss D et al (2014) SOFORT: a hybrid SCM-DRAM storage engine for fast data recovery. DaMoN ’14, pp 8:1–8:7
51.
Oukid I, Lehner W et al (2015) Instant recovery for main memory databases. CIDR ’15.
52.
Oukid I, Lasperas J et al (2016) FPTree: a hybrid SCM- DRAM persistent and concurrent B‑tree for storage class memory. SIGMOD ’16, pp 371–386
53.
Oukid I, Booss D et al (2017) Memory management techniques for large-scale persistent-main-memory systems. Proceedings VLDB Endowment 10(11):1166–1177CrossRef
54.
Oukid I, Kettler R, Willhalm T (2017) Storage class memory and databases: opportunities and challenges. it Inf Technol 59(3):109–115
55.
O’Neil P, Cheng E et al (1996) The log-structured merge-tree (LSM-tree). Acta Inform 33(4):351–385CrossRef
56.
Pavlo A, Angulo G et al (2017) Self-driving database management systems. CIDR ’17.
57.
Qureshi MK, Karidis J et al (2009) Enhancing lifetime and security of PCM-based main memory with start-gap wear leveling. ACM, MICRO 42, pp 14–23
58.
van Renen A, Leis V et al (2018) Managing non-volatile memory in database systems. SIGMOD ’18, pp 1541–1555
59.
Schwalb D, Berning T et al (2015) nvm_malloc: memory allocation for NVRAM. ADMS @ VLDB ’15, pp 61–72
60.
Strukov DB, Snider GS et al (2008) The missing memristor found. Nature 453(7191):80–83CrossRef
61.
Venkataraman S, Tolia N et al (2011) Consistent and durable data structures for non-volatile byte- addressable memory. FAST ’11, pp 61–75
62.
Viglas SD (2015) Data management in non-volatile memory. SIGMOD ’15, pp 1707–1711
63.
Wang T, Johnson R (2014) Scalable logging through emerging non-volatile memory. Proceedings VLDB Endowment 7(10):865–876CrossRef
64.
Wang T, Levandoski J, Larson PA (2017) Easy lock-free indexing in non-volatile memory. Technical report, Microsoft research
65.
Wu X, Reddy A (2011) SCMFS: a file system for storage class memory. ACM, SC ’11, pp 39:1–39:11
66.
Xia F, Jiang D et al (2017) HiKV: a hybrid index key-value store for DRAM-NVM memory systems. USENIX ATC ’17, pp 349–362
67.
Xu J, Swanson S (2016) NOVA: a log-structured file system for hybrid volatile/non-volatile main memories. FAST ’16, pp 323–338
68.
Yang J, Wei Q et al (2015) NV-tree: reducing consistency cost for NVM-based single level systems. FAST ’15, pp 167–181
Metadata
Title
Data Management on Non-Volatile Memory: A Perspective
Authors
Philipp Götze
Alexander van Renen
Lucas Lersch
Viktor Leis
Ismail Oukid
Publication date
05-10-2018
Publisher
Springer Berlin Heidelberg
Published in
Datenbank-Spektrum / Issue 3/2018
Print ISSN: 1618-2162
Electronic ISSN: 1610-1995
DOI
https://doi.org/10.1007/s13222-018-0301-1

Other articles of this Issue 3/2018

Datenbank-Spektrum 3/2018 Go to the issue

Schwerpunktbeitrag

Integration of FPGAs in Database Management Systems: Challenges and Opportunities

Schwerpunktbeitrag

Cooking DBMS Operations using Granular Primitives

Kurz erklärt

Scalable Data Management on Modern Networks

Community

News

Datenbankgruppen vorgestellt

Datenbanken und Information Retrieval an der Universität Bamberg

Dissertationen

Dissertationen

Premium Partner

    Image Credits