Skip to main content
Erschienen in: Cluster Computing 1/2018

22.05.2017

Harmonized memory system for object-based cloud storage

verfasst von: Su-Kyung Yoon, Young-Sun Youn, Min-Ho Son, Shin-Dug Kim

Erschienen in: Cluster Computing | Ausgabe 1/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A new storage system that integrates non-volatile with conventional memory, a harmonized memory system (HMS) for object-based cloud storage, is proposed. The system overcomes IO bottlenecks when managing large amounts of metadata and transaction logs and is composed of five modules. The first, the harmonized memory supervisor, is a translation layer for accessing the harmonized array module. It manages address translation, address mapping by page linking, and wear leveling. The second, the harmonized array module, is divided into dynamic and static areas composed of DRAM, and PCM together with NAND flash memory, respectively. The harmonized memory migration engine and data pattern predictor, which anticipates future data flow, are designed to maximize the effectiveness of the PCM array area. The harmonized logging conductor processes the log between the PCM array and NAND flash areas. Experimental results show the total execution time and energy consumption of HMS is 5.77 faster and 4.27 times lower, respectively, than the conventional DRAM-HDD model for object-based storage workloads.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chekam, T.T., Ennan, Z., Zhenhua, L., Yong, C., Kui, R.: On the synchronization bottleneck of openstack swift-like cloud storage systems. In: IEEE International Conference on Computer Communications, San Francisco, CA 10–15 April 2016, p. 9. IEEE Xplore (2016) Chekam, T.T., Ennan, Z., Zhenhua, L., Yong, C., Kui, R.: On the synchronization bottleneck of openstack swift-like cloud storage systems. In: IEEE International Conference on Computer Communications, San Francisco, CA 10–15 April 2016, p. 9. IEEE Xplore (2016)
2.
Zurück zum Zitat Gilbert, S., Lynch, N.: Brewer’s conjecture and the feasibility of consistent, available, partition-tolerant web services. ACM SIGACT News 33(2), 51–59 (2002)CrossRef Gilbert, S., Lynch, N.: Brewer’s conjecture and the feasibility of consistent, available, partition-tolerant web services. ACM SIGACT News 33(2), 51–59 (2002)CrossRef
3.
Zurück zum Zitat Arnold, J.: OpenStack Swift: Using, Administering, and Developing for Swift Object Storage. O’Reilly Media, Inc., New York (2014) Arnold, J.: OpenStack Swift: Using, Administering, and Developing for Swift Object Storage. O’Reilly Media, Inc., New York (2014)
4.
Zurück zum Zitat McDougall, R., Filebench: Application level file system benchmark (2014) McDougall, R., Filebench: Application level file system benchmark (2014)
5.
Zurück zum Zitat Chen, C., Yang, J., et al.: Fine-Grained Metadata Journaling on NVM. Santa Clara university, Santa Clara (2016)CrossRef Chen, C., Yang, J., et al.: Fine-Grained Metadata Journaling on NVM. Santa Clara university, Santa Clara (2016)CrossRef
6.
Zurück zum Zitat Pelley, S., Wenisch, T.F., Gold, B.T., Bridge, B.: Storage management in the nvram era. PVLDB 7(2), 121–132 (2013) Pelley, S., Wenisch, T.F., Gold, B.T., Bridge, B.: Storage management in the nvram era. PVLDB 7(2), 121–132 (2013)
7.
Zurück zum Zitat Kryder, M.H., Kim, C.S.: After hard drives-what comes next? IEEE Trans. Magn. 45(10), 3406–3413 (2009)CrossRef Kryder, M.H., Kim, C.S.: After hard drives-what comes next? IEEE Trans. Magn. 45(10), 3406–3413 (2009)CrossRef
8.
Zurück zum Zitat Fang, R., Hsiao, H.I., He, B., Mohan, C., Wang, Y.: High performance database logging using storage class memory. In: IEEE 27th International Conference on Data Engineering (ICDE), 2011, pp. 1221–1231. IEEE (2011, April) Fang, R., Hsiao, H.I., He, B., Mohan, C., Wang, Y.: High performance database logging using storage class memory. In: IEEE 27th International Conference on Data Engineering (ICDE), 2011, pp. 1221–1231. IEEE (2011, April)
9.
Zurück zum Zitat DeBrabant, J., Arulraj, J., Pavlo, A., Stonebraker, M., Zdonik, S., Dulloor, S.: A prolegomenon on OLTP database systems for non-volatile memory.ADMS@ VLDB (2014) DeBrabant, J., Arulraj, J., Pavlo, A., Stonebraker, M., Zdonik, S., Dulloor, S.: A prolegomenon on OLTP database systems for non-volatile memory.ADMS@ VLDB (2014)
10.
Zurück zum Zitat Huang, J., Schwan, K., Qureshi, M.K.: NVRAM-aware logging in transaction systems. Proc. VLDB Endow. 8(4), 389–400 (2014)CrossRef Huang, J., Schwan, K., Qureshi, M.K.: NVRAM-aware logging in transaction systems. Proc. VLDB Endow. 8(4), 389–400 (2014)CrossRef
11.
Zurück zum Zitat Lee, D.H., Yoon, S.K., Kim, J.G., Weems, C.C., Kim, S.D.: A new memory-disk integrated system with HW optimizer. ACM Trans. Archit. Code Optim. 12(2), 11 (2015)CrossRef Lee, D.H., Yoon, S.K., Kim, J.G., Weems, C.C., Kim, S.D.: A new memory-disk integrated system with HW optimizer. ACM Trans. Archit. Code Optim. 12(2), 11 (2015)CrossRef
12.
Zurück zum Zitat Yoon, S.K., et al.: Optimized memory-disk integrated system with DRAM and nonvolatile memory. IEEE Trans. Comput. Syst. 2(2), 83–93 (2016)MathSciNet Yoon, S.K., et al.: Optimized memory-disk integrated system with DRAM and nonvolatile memory. IEEE Trans. Comput. Syst. 2(2), 83–93 (2016)MathSciNet
13.
Zurück zum Zitat Zheng, Q., Chen, H., Wang, Y., Zhang, J., Duan, J.: COSBench: cloud object storage benchmark. In: Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering, pp. 199–210. ACM (2013, April) Zheng, Q., Chen, H., Wang, Y., Zhang, J., Duan, J.: COSBench: cloud object storage benchmark. In: Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering, pp. 199–210. ACM (2013, April)
14.
Zurück zum Zitat Bellard, F.: QEMU, a Fast and portable dynamic translator. In: USENIX Annual Technical Conference, FREENIX Track, pp. 41–46. (2005, April) Bellard, F.: QEMU, a Fast and portable dynamic translator. In: USENIX Annual Technical Conference, FREENIX Track, pp. 41–46. (2005, April)
15.
Zurück zum Zitat DeBrabant, J., Pavlo, A., Tu, S., Stonebraker, M., Zdonik, S.: Anti-caching: a new approach to database management system architecture. Proc. VLDB Endow. 6(14), 1942–1953 (2013)CrossRef DeBrabant, J., Pavlo, A., Tu, S., Stonebraker, M., Zdonik, S.: Anti-caching: a new approach to database management system architecture. Proc. VLDB Endow. 6(14), 1942–1953 (2013)CrossRef
16.
Zurück zum Zitat Chen, S., Gibbons, P.B., Nath, S.: Rethinking database algorithms for phase change memory. In: CIDR, pp. 21–31. (2011, January) Chen, S., Gibbons, P.B., Nath, S.: Rethinking database algorithms for phase change memory. In: CIDR, pp. 21–31. (2011, January)
17.
Zurück zum Zitat Chen, S., Gibbons, P.B., Mowry, T.C., Valentin, G.: Fractal prefetching B+-trees: optimizing both cache and disk performance. In: SIGMOD (2002) Chen, S., Gibbons, P.B., Mowry, T.C., Valentin, G.: Fractal prefetching B+-trees: optimizing both cache and disk performance. In: SIGMOD (2002)
18.
Zurück zum Zitat Kannan, S. et al.: pVM—Persistent Virtual Memory for Efficient Capacity Scaling and Object Storage. EuroSys (2016) Kannan, S. et al.: pVM—Persistent Virtual Memory for Efficient Capacity Scaling and Object Storage. EuroSys (2016)
19.
Zurück zum Zitat Takatsu, F., et al.: Design of object storage using openNVM for high-performance distributed file system. J. Inf. Process. 24(5), 824–833 (2016) Takatsu, F., et al.: Design of object storage using openNVM for high-performance distributed file system. J. Inf. Process. 24(5), 824–833 (2016)
20.
Zurück zum Zitat Aye, K.N., Chandra, R.: A platform for big data analytics on distributed scale-out storage system. Int. J. Big Data Intell. 2(2), 127–141 (2015)CrossRef Aye, K.N., Chandra, R.: A platform for big data analytics on distributed scale-out storage system. Int. J. Big Data Intell. 2(2), 127–141 (2015)CrossRef
21.
Zurück zum Zitat Parankar, R., Dulluri, S.: Automated validation of structured large databases: an illustration of material code bulk validation. Int. J. Big Data Intell. 3(1), 38–50 (2016)CrossRef Parankar, R., Dulluri, S.: Automated validation of structured large databases: an illustration of material code bulk validation. Int. J. Big Data Intell. 3(1), 38–50 (2016)CrossRef
22.
Zurück zum Zitat Airman, A. et al.: Scalable object storage with resource reservations and dynamic load balancing. In: IEEE International Conference on Networking, Architecture and Storage (NAS) (2016) Airman, A. et al.: Scalable object storage with resource reservations and dynamic load balancing. In: IEEE International Conference on Networking, Architecture and Storage (NAS) (2016)
23.
Zurück zum Zitat Brunelle, A.D.: Block I/O layer tracing: blktrace. HP, Gelato-Cupertino, CA, USA (2006) Brunelle, A.D.: Block I/O layer tracing: blktrace. HP, Gelato-Cupertino, CA, USA (2006)
24.
Zurück zum Zitat Zhang, N., Kant, C.: Building cost-effective storage clouds. In: IEEE International Conference on Cloud Engineering (IC2E). IEEE (2014) Zhang, N., Kant, C.: Building cost-effective storage clouds. In: IEEE International Conference on Cloud Engineering (IC2E). IEEE (2014)
25.
Zurück zum Zitat Kapadia, A., Rajana, K., Varma, S.: OpenStack Object Storage (Swift) Essentials. Packt Publishing Ltd, New York (2015) Kapadia, A., Rajana, K., Varma, S.: OpenStack Object Storage (Swift) Essentials. Packt Publishing Ltd, New York (2015)
Metadaten
Titel
Harmonized memory system for object-based cloud storage
verfasst von
Su-Kyung Yoon
Young-Sun Youn
Min-Ho Son
Shin-Dug Kim
Publikationsdatum
22.05.2017
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 1/2018
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-017-0904-6

Weitere Artikel der Ausgabe 1/2018

Cluster Computing 1/2018 Zur Ausgabe