Skip to main content
Top
Published in: Datenbank-Spektrum 2/2018

04-06-2018 | Kurz erklärt

On the Diversity of Memory and Storage Technologies

Authors: Ismail Oukid, Lucas Lersch

Published in: Datenbank-Spektrum | Issue 2/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The last decade has seen tremendous developments in memory and storage technologies, starting with Flash Memory and continuing with the upcoming Storage-Class Memories. Combined with an explosion of data processing, data analytics, and machine learning, this led to a segmentation of the memory and storage market. Consequently, the traditional storage hierarchy, as we know it today, might be replaced by a multitude of storage hierarchies, with potentially different depths, each tailored for specific workloads. In this context, we explore in this “Kurz Erklärt” the state of memory technologies and reflect on their future use with a focus on data management systems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Show more products
Footnotes
1
Intel has discontinued its Xeon Phi series, albeit some of its concepts have converged with the Xeon Scalable series.
 
2
SCM is also referred to as Persistent Memory, Non-Volatile RAM (NVRAM), or simply Non-Volatile Memory.
 
3
Intel and Micron did not disclose so far the technology that 3D XPoint is based on, albeit it has been speculated that it is based on Phase-Change Memory [8].
 
Literature
1.
go back to reference Appuswamy R, Borovica R, Graefe G, Ailamaki A (2017) The five minute rule thirty years later and its impact on the storage hierarchy. Proceedings of the 7th International Workshop on Accelerating Analytics and Data Management Systems Using Modern Processor and Storage Architectures. Appuswamy R, Borovica R, Graefe G, Ailamaki A (2017) The five minute rule thirty years later and its impact on the storage hierarchy. Proceedings of the 7th International Workshop on Accelerating Analytics and Data Management Systems Using Modern Processor and Storage Architectures.
2.
go back to reference Arulraj J, Perron M, Pavlo A (2016) Write-behind logging. Proceedings VLDB Endowment 10(4):337–348CrossRef Arulraj J, Perron M, Pavlo A (2016) Write-behind logging. Proceedings VLDB Endowment 10(4):337–348CrossRef
4.
go back to reference Bjørling M, González J, Bonnet P (2017) LightNVM: the Linux open-channel SSD subsystem. 15th USENIX Conference on File and Storage Technologies (FAST), USENIX Association, pp 359–374 Bjørling M, González J, Bonnet P (2017) LightNVM: the Linux open-channel SSD subsystem. 15th USENIX Conference on File and Storage Technologies (FAST), USENIX Association, pp 359–374
5.
go back to reference Boroumand A, Ghose S, Kim Y, Ausavarungnirun R, Shiu E, Thakur R, Kim D, Kuusela A, Knies A, Ranganathan P et al (2018) Google workloads for consumer devices: mitigating data movement bottlenecks. Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems, ACM, pp 316–331 Boroumand A, Ghose S, Kim Y, Ausavarungnirun R, Shiu E, Thakur R, Kim D, Kuusela A, Knies A, Ranganathan P et al (2018) Google workloads for consumer devices: mitigating data movement bottlenecks. Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems, ACM, pp 316–331
6.
go back to reference Chen S, Jin Q (2015) Persistent B+-trees in non-volatile main memory. Proceedings VLDB Endowment 8(7):786–797CrossRef Chen S, Jin Q (2015) Persistent B+-trees in non-volatile main memory. Proceedings VLDB Endowment 8(7):786–797CrossRef
7.
go back to reference Chen S, Gibbons PB, Nath S (2011) Rethinking database algorithms for phase change memory. Fifth Biennial Conference on Innovative Data Systems Research (CIDR), pp 21–31 Chen S, Gibbons PB, Nath S (2011) Rethinking database algorithms for phase change memory. Fifth Biennial Conference on Innovative Data Systems Research (CIDR), pp 21–31
9.
go back to reference Dayarathna M, Wen Y, Fan R (2016) Data center energy consumption modeling: a survey. IEEE Commun Surv Tutor 18(1):732–794CrossRef Dayarathna M, Wen Y, Fan R (2016) Data center energy consumption modeling: a survey. IEEE Commun Surv Tutor 18(1):732–794CrossRef
10.
go back to reference Dong X, Wu X, Sun G, Xie Y, Li H, Chen Y (2008) Circuit and microarchitecture evaluation of 3D stacking magnetic RAM (MRAM) as a universal memory replacement. 45th ACM/IEEE Design Automation Conference., IEEE, pp 554–559 Dong X, Wu X, Sun G, Xie Y, Li H, Chen Y (2008) Circuit and microarchitecture evaluation of 3D stacking magnetic RAM (MRAM) as a universal memory replacement. 45th ACM/IEEE Design Automation Conference., IEEE, pp 554–559
11.
go back to reference Fang R, Hsiao HI, He B, Mohan C, Wang Y (2011) High performance database logging using storage class memory. IEEE 27th International Conference on Data Engineering (ICDE). IEEE, Hannover, pp 1221–1231 Fang R, Hsiao HI, He B, Mohan C, Wang Y (2011) High performance database logging using storage class memory. IEEE 27th International Conference on Data Engineering (ICDE). IEEE, Hannover, pp 1221–1231
13.
go back to reference Govoreanu B, Kar G, Chen Y, Paraschiv V, Kubicek S, Fantini A, Radu I, Goux L, Clima S, Degraeve R et al (2011) 10x10nm 2 Hf/HfO x crossbar resistive RAM with excellent performance, reliability and low-energy operation. IEEE International Electron Devices Meeting (IEDM). IEEE, Washington, pp 31–36 Govoreanu B, Kar G, Chen Y, Paraschiv V, Kubicek S, Fantini A, Radu I, Goux L, Clima S, Degraeve R et al (2011) 10x10nm 2 Hf/HfO x crossbar resistive RAM with excellent performance, reliability and low-energy operation. IEEE International Electron Devices Meeting (IEDM). IEEE, Washington, pp 31–36
14.
go back to reference Hardock S, Petrov I, Gottstein R, Buchmann A (2013) NoFTL: database systems on FTL-less flash storage. Proceedings VLDB Endowment 6(12):1278–1281CrossRef Hardock S, Petrov I, Gottstein R, Buchmann A (2013) NoFTL: database systems on FTL-less flash storage. Proceedings VLDB Endowment 6(12):1278–1281CrossRef
15.
go back to reference Hardock S, Petrov I, Gottstein R, Buchmann A (2017) From in-place updates to in-place appends: revisiting out-of-place updates on flash. Proceedings of the 2017 ACM International Conference on Management of Data (SIGMOD). ACM, Chicago, pp 1571–1586 Hardock S, Petrov I, Gottstein R, Buchmann A (2017) From in-place updates to in-place appends: revisiting out-of-place updates on flash. Proceedings of the 2017 ACM International Conference on Management of Data (SIGMOD). ACM, Chicago, pp 1571–1586
16.
go back to reference Huang J, Schwan K, Qureshi MK (2014) NVRAM-aware logging in transaction systems. Proceedings VLDB Endowment 8(4):389–400CrossRef Huang J, Schwan K, Qureshi MK (2014) NVRAM-aware logging in transaction systems. Proceedings VLDB Endowment 8(4):389–400CrossRef
22.
go back to reference Kimura H (2015) FOEDUS: OLTP engine for a thousand cores and NVRAM. Proceedings of the 2015 ACM International Conference on Management of Data (SIGMOD). Melbourne, ACM, pp 691–706 Kimura H (2015) FOEDUS: OLTP engine for a thousand cores and NVRAM. Proceedings of the 2015 ACM International Conference on Management of Data (SIGMOD). Melbourne, ACM, pp 691–706
24.
go back to reference Klimovic A, Litz H, Kozyrakis C (2017) Reflex: remote flash ≈ local flash. Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). ACM, Xi’an, pp 345–359 Klimovic A, Litz H, Kozyrakis C (2017) Reflex: remote flash ≈ local flash. Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). ACM, Xi’an, pp 345–359
26.
go back to reference Lantz P, Rao DS, Kumar S, Sankaran R, Jackson J (2014) Yat: a validation framework for persistent memory software. USENIX Annual Technical Conference, pp 433–438 Lantz P, Rao DS, Kumar S, Sankaran R, Jackson J (2014) Yat: a validation framework for persistent memory software. USENIX Annual Technical Conference, pp 433–438
28.
go back to reference Lee SK, Lim KH, Song H, Nam B, Noh SH (2017) Wort: write optimal radix tree for persistent memory storage systems. 15th USENIX Conference on File and Storage Technologies (FAST). USENIX Association, Santa Clara, pp 257–270 Lee SK, Lim KH, Song H, Nam B, Noh SH (2017) Wort: write optimal radix tree for persistent memory storage systems. 15th USENIX Conference on File and Storage Technologies (FAST). USENIX Association, Santa Clara, pp 257–270
29.
go back to reference Lehner W (2017) The data center under your desk: how disruptive is modern hardware for DB system design? Proceedings VLDB Endowment 10(12):2018–2019CrossRef Lehner W (2017) The data center under your desk: how disruptive is modern hardware for DB system design? Proceedings VLDB Endowment 10(12):2018–2019CrossRef
30.
go back to reference Lehner W, Ungethüm A, Habich D (2018) Diversity of processing units. Datenbank Spektrum 18(1):57–62CrossRef Lehner W, Ungethüm A, Habich D (2018) Diversity of processing units. Datenbank Spektrum 18(1):57–62CrossRef
31.
go back to reference Lersch L, Oukid I, Schreter I, Lehner W (2017) Rethinking DRAM caching for LSMs in an NVRAM environment. 21th European Conference on Advances in Databases and Information Systems (ADBIS). Springer, NicosiaCrossRef Lersch L, Oukid I, Schreter I, Lehner W (2017) Rethinking DRAM caching for LSMs in an NVRAM environment. 21th European Conference on Advances in Databases and Information Systems (ADBIS). Springer, NicosiaCrossRef
32.
go back to reference Levandoski JJ, Lomet DB, Sengupta S (2013) The Bw-tree: a B-tree for new hardware platforms. IEEE 29th International Conference on Data Engineering (ICDE). IEEE, Brisbane, pp 302–313 Levandoski JJ, Lomet DB, Sengupta S (2013) The Bw-tree: a B-tree for new hardware platforms. IEEE 29th International Conference on Data Engineering (ICDE). IEEE, Brisbane, pp 302–313
33.
go back to reference Li Y, He B, Yang RJ, Luo Q, Yi K (2010) Tree indexing on solid state drives. Proceedings VLDB Endowment 3(1-2):1195–1206CrossRef Li Y, He B, Yang RJ, Luo Q, Yi K (2010) Tree indexing on solid state drives. Proceedings VLDB Endowment 3(1-2):1195–1206CrossRef
37.
go back to reference Mittal S, Vetter JS (2016) A survey of software techniques for using non-volatile memories for storage and main memory systems. IEEE Trans Parallel Distrib Syst 27(5):1537–1550CrossRef Mittal S, Vetter JS (2016) A survey of software techniques for using non-volatile memories for storage and main memory systems. IEEE Trans Parallel Distrib Syst 27(5):1537–1550CrossRef
38.
go back to reference Mutlu O (2013) Memory scaling: a systems architecture perspective. Fifth IEEE International Memory Workshop (IMW). IEEE, Monterey, pp 21–25 Mutlu O (2013) Memory scaling: a systems architecture perspective. Fifth IEEE International Memory Workshop (IMW). IEEE, Monterey, pp 21–25
39.
go back to reference Nanavati M et al (2016) Non-volatile storage: implications of the datacenter’s shifting center. Commun Acm 50(1):58–63 Nanavati M et al (2016) Non-volatile storage: implications of the datacenter’s shifting center. Commun Acm 50(1):58–63
41.
go back to reference Oukid I, Lehner W, Kissinger T, Willhalm T, Bumbulis P (2015) Instant recovery for main-memory databases. Seventh Biennial Conference on Innovative Data Systems Research (CIDR). Oukid I, Lehner W, Kissinger T, Willhalm T, Bumbulis P (2015) Instant recovery for main-memory databases. Seventh Biennial Conference on Innovative Data Systems Research (CIDR).
42.
go back to reference Oukid I, Booss D, Lespinasse A, Lehner W (2016) On testing persistent-memory-based software. Proceedings of the 12th International Workshop on Data Management on New Hardware. ACM, San Francisco, p 5 Oukid I, Booss D, Lespinasse A, Lehner W (2016) On testing persistent-memory-based software. Proceedings of the 12th International Workshop on Data Management on New Hardware. ACM, San Francisco, p 5
43.
go back to reference Oukid I, Lasperas J, Nica A, Willhalm T, Lehner W (2016) FPtree: a hybrid SCM-DRAM persistent and concurrent B‑tree for storage class memory. Proceedings of the 2016 ACM International Conference on Management of Data (SIGMOD). ACM, San Francisco, pp 371–386 Oukid I, Lasperas J, Nica A, Willhalm T, Lehner W (2016) FPtree: a hybrid SCM-DRAM persistent and concurrent B‑tree for storage class memory. Proceedings of the 2016 ACM International Conference on Management of Data (SIGMOD). ACM, San Francisco, pp 371–386
44.
go back to reference Oukid I, Booss D, Lespinasse A, Lehner W, Willhalm T, Gomes G (2017) Memory management techniques for large-scale persistent-main-memory systems. Proceedings VLDB Endowment 10(11):1166–1177CrossRef Oukid I, Booss D, Lespinasse A, Lehner W, Willhalm T, Gomes G (2017) Memory management techniques for large-scale persistent-main-memory systems. Proceedings VLDB Endowment 10(11):1166–1177CrossRef
45.
go back to reference van Renen A, Leis V, Kemper A, Neumann T, Hashida T, Oe K et al (2018) Managing non-volatile memory in database systems. Proceedings of the 2018 ACM International Conference on Management of Data (SIGMOD). ACM, Houston. (to appear)CrossRef van Renen A, Leis V, Kemper A, Neumann T, Hashida T, Oe K et al (2018) Managing non-volatile memory in database systems. Proceedings of the 2018 ACM International Conference on Management of Data (SIGMOD). ACM, Houston. (to appear)CrossRef
48.
go back to reference Schroeder B, Lagisetty R, Merchant A (2016) Flash reliability in production: the expected and the unexpected. 14th USENIX FAST. Schroeder B, Lagisetty R, Merchant A (2016) Flash reliability in production: the expected and the unexpected. 14th USENIX FAST.
51.
go back to reference Viglas SD (2014) Write-limited sorts and joins for persistent memory. Proceedings VLDB Endowment 7(5):413–424CrossRef Viglas SD (2014) Write-limited sorts and joins for persistent memory. Proceedings VLDB Endowment 7(5):413–424CrossRef
52.
go back to reference Wang T, Johnson R (2014) Scalable logging through emerging non-volatile memory. Proceedings VLDB Endowment 7(10):865–876CrossRef Wang T, Johnson R (2014) Scalable logging through emerging non-volatile memory. Proceedings VLDB Endowment 7(10):865–876CrossRef
53.
go back to reference Yang J, Wei Q, Wang C, Chen C, Yong K, He B (2015) NV-tree: a consistent and workload-adaptive tree structure for non-volatile memory. IEEE Trans Comput 65(7):2169–2183MathSciNetCrossRefMATH Yang J, Wei Q, Wang C, Chen C, Yong K, He B (2015) NV-tree: a consistent and workload-adaptive tree structure for non-volatile memory. IEEE Trans Comput 65(7):2169–2183MathSciNetCrossRefMATH
Metadata
Title
On the Diversity of Memory and Storage Technologies
Authors
Ismail Oukid
Lucas Lersch
Publication date
04-06-2018
Publisher
Springer Berlin Heidelberg
Published in
Datenbank-Spektrum / Issue 2/2018
Print ISSN: 1618-2162
Electronic ISSN: 1610-1995
DOI
https://doi.org/10.1007/s13222-018-0287-8

Other articles of this Issue 2/2018

Datenbank-Spektrum 2/2018 Go to the issue

Dissertationen

Dissertationen

Editorial

Editorial

Community

News

Premium Partner