Skip to main content

2015 | OriginalPaper | Buchkapitel

Implementation of Multidimensional Databases in Column-Oriented NoSQL Systems

verfasst von : Max Chevalier, Mohammed El Malki, Arlind Kopliku, Olivier Teste, Ronan Tournier

Erschienen in: Advances in Databases and Information Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

NoSQL (Not Only SQL) systems are becoming popular due to known advantages such as horizontal scalability and elasticity. In this paper, we study the implementation of multidimensional data warehouses based on column-oriented NoSQL systems. To do this, we define a set of mapping rules that transform a conceptual multidimensional data model into a logical column-oriented model. We consider three ways (three sub-models) to structure conceptual multidimensional data model into a column-oriented model. Then, we show an implementation of the proposed rules. Finally, we focus, through experiment, on data loading, model-to-model conversion and OLAP cuboid computation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Conceptual level data models describe data in a generic way regardless the information technologies used, while logical level models use a specific technique for implementing the conceptual level.
 
2
CSV, Comma separated values files.
 
3
“Reasonable time” for a Big Data environment running on commodity hardware (without an optical fiber network between nodes, i.e. the recommended 10,000 GB/s).
 
Literatur
1.
Zurück zum Zitat Bosworth, A., Gray, J., Layman, A., Pirahesh, H.: Data cube: a relational aggregation operator generalizing group-by, cross-tab, and sub-totals. Technical Report MSR-TR-95-22, Microsoft Research February 1995 Bosworth, A., Gray, J., Layman, A., Pirahesh, H.: Data cube: a relational aggregation operator generalizing group-by, cross-tab, and sub-totals. Technical Report MSR-TR-95-22, Microsoft Research February 1995
2.
Zurück zum Zitat Chang, F., Dean, J., Ghemawat, S., Hsieh, W.C., Wallach, D.A., Burrows, M., Chandra, T., Fikes, A., Gruber, R.E.: Bigtable: a distributed storage system for structured data. ACM Trans. Comput. Syst. 26(2), 4:1–4:26 (2008)CrossRef Chang, F., Dean, J., Ghemawat, S., Hsieh, W.C., Wallach, D.A., Burrows, M., Chandra, T., Fikes, A., Gruber, R.E.: Bigtable: a distributed storage system for structured data. ACM Trans. Comput. Syst. 26(2), 4:1–4:26 (2008)CrossRef
3.
Zurück zum Zitat Chaudhuri, S., Dayal, U.: An overview of data warehousing and olap technology. SIGMOD Rec. 26, 65–74 (1997)CrossRef Chaudhuri, S., Dayal, U.: An overview of data warehousing and olap technology. SIGMOD Rec. 26, 65–74 (1997)CrossRef
4.
Zurück zum Zitat Chevalier, M., El Malki, M., Kopliku, A., Teste, O., Tournier, R.: Implementing multidimensional data warehouses into NoSQL. In: 17th International Conference on Enterprise Information Systems, vol. DISI Chevalier, M., El Malki, M., Kopliku, A., Teste, O., Tournier, R.: Implementing multidimensional data warehouses into NoSQL. In: 17th International Conference on Enterprise Information Systems, vol. DISI
5.
Zurück zum Zitat Chevalier, M., El Malki, M., Kopliku, A., Teste, O., Tournier, R.: Benchmark for OLAP on NoSQL technologies, comparing NoSQL multidimensional data warehousing solutions. In: 9th International Conference on Research Challenges in Information Science (RCIS), IEEE Chevalier, M., El Malki, M., Kopliku, A., Teste, O., Tournier, R.: Benchmark for OLAP on NoSQL technologies, comparing NoSQL multidimensional data warehousing solutions. In: 9th International Conference on Research Challenges in Information Science (RCIS), IEEE
7.
Zurück zum Zitat Cuzzocrea, A., Bellatreche, L., Song, I.Y.: Data warehousing and olap over bigdata: current challenges and future research directions. In: Proceedings of the Sixteenth International Workshop on Data Warehousing and OLAP, pp. 67–70. DOLAP 2013, ACM, New York, NY, USA (2013) Cuzzocrea, A., Bellatreche, L., Song, I.Y.: Data warehousing and olap over bigdata: current challenges and future research directions. In: Proceedings of the Sixteenth International Workshop on Data Warehousing and OLAP, pp. 67–70. DOLAP 2013, ACM, New York, NY, USA (2013)
8.
Zurück zum Zitat Cuzzocrea, A., Song, I.Y., Davis, K.C.: Analytics over large-scale multidimensionaldata: the big data revolution! In: Proceedings of the ACM 14th International Workshop on Data Warehousing and OLAP, pp. 101–104. DOLAP 2011, ACM, New York, NY, USA (2011) Cuzzocrea, A., Song, I.Y., Davis, K.C.: Analytics over large-scale multidimensionaldata: the big data revolution! In: Proceedings of the ACM 14th International Workshop on Data Warehousing and OLAP, pp. 101–104. DOLAP 2011, ACM, New York, NY, USA (2011)
9.
Zurück zum Zitat Dehdouh, K., Boussaid, O., Bentayeb, F.: Columnar NoSQL star schema benchmark. In: Ait Ameur, Y., Bellatreche, L., Papadopoulos, G.A. (eds.) MEDI 2014. LNCS, vol. 8748, pp. 281–288. Springer, Heidelberg (2014) Dehdouh, K., Boussaid, O., Bentayeb, F.: Columnar NoSQL star schema benchmark. In: Ait Ameur, Y., Bellatreche, L., Papadopoulos, G.A. (eds.) MEDI 2014. LNCS, vol. 8748, pp. 281–288. Springer, Heidelberg (2014)
10.
Zurück zum Zitat Golfarelli, M., Maio, D., Rizzi, S.: The dimensional fact model: a conceptual modelfor data warehouses. Int. J. Coop. Inf. Syst. 7, 215–247 (1998)CrossRef Golfarelli, M., Maio, D., Rizzi, S.: The dimensional fact model: a conceptual modelfor data warehouses. Int. J. Coop. Inf. Syst. 7, 215–247 (1998)CrossRef
11.
Zurück zum Zitat Harter, T., Borthakur, D., Dong, S., Aiyer, A.S., Tang, L., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H.: Analysis of hdfs under hbase: a facebook messages casestudy. In: FAST, pp. 199–212 (2014) Harter, T., Borthakur, D., Dong, S., Aiyer, A.S., Tang, L., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H.: Analysis of hdfs under hbase: a facebook messages casestudy. In: FAST, pp. 199–212 (2014)
12.
Zurück zum Zitat Kimball, R., Ross, M.: The Data Warehouse Toolkit: The Definitive Guide to Dimensional Modeling. John Wiley & Sons, Inc. (2013) Kimball, R., Ross, M.: The Data Warehouse Toolkit: The Definitive Guide to Dimensional Modeling. John Wiley & Sons, Inc. (2013)
13.
Zurück zum Zitat Lakshman, A., Malik, P.: Cassandra: a decentralized structured storage system. SIGOPS Oper. Syst. Rev. 44(2), 35–40 (2010)CrossRef Lakshman, A., Malik, P.: Cassandra: a decentralized structured storage system. SIGOPS Oper. Syst. Rev. 44(2), 35–40 (2010)CrossRef
14.
Zurück zum Zitat Li, C.: Transforming relational database into hbase: a case study. In: International Conference on Software Engineering and Service Sciences (ICSESS), IEEE, pp. 683–687 (2010) Li, C.: Transforming relational database into hbase: a case study. In: International Conference on Software Engineering and Service Sciences (ICSESS), IEEE, pp. 683–687 (2010)
15.
Zurück zum Zitat O’Neil, P., O’Neil, E., Chen, X., Revilak, S.: The star schema benchmark and augmented fact table indexing. In: Nambiar, R., Poess, M. (eds.) TPCTC 2009. LNCS, vol. 5895, pp. 237–252. Springer, Heidelberg (2009) O’Neil, P., O’Neil, E., Chen, X., Revilak, S.: The star schema benchmark and augmented fact table indexing. In: Nambiar, R., Poess, M. (eds.) TPCTC 2009. LNCS, vol. 5895, pp. 237–252. Springer, Heidelberg (2009)
16.
Zurück zum Zitat Ravat, F., Teste, O., Tournier, R., Zuruh, G.: Algebraic and graphic languages for OLAP manipulations. IJDWM 4(1), 17–46 (2008) Ravat, F., Teste, O., Tournier, R., Zuruh, G.: Algebraic and graphic languages for OLAP manipulations. IJDWM 4(1), 17–46 (2008)
17.
Zurück zum Zitat Stonebraker, M.: New opportunities for new sql. Commun. ACM 55(11), 10–11 (2012)CrossRef Stonebraker, M.: New opportunities for new sql. Commun. ACM 55(11), 10–11 (2012)CrossRef
18.
Zurück zum Zitat Vajk, T., Feher, P., Fekete, K., Charaf, H.: Denormalizing data into schema-free databases. In: 4th International Conference on Cognitive Infocommunications (CogInfoCom), IEEE, pp. 747–752 (2013) Vajk, T., Feher, P., Fekete, K., Charaf, H.: Denormalizing data into schema-free databases. In: 4th International Conference on Cognitive Infocommunications (CogInfoCom), IEEE, pp. 747–752 (2013)
19.
Zurück zum Zitat Zhao, H., Ye, X.: A Practice of TPC-DS multidimensional implementation on NoSQL database systems. In: Nambiar, R., Poess, M. (eds.) TPCTC 2013. LNCS, vol. 8391, pp. 93–108. Springer, Heidelberg (2014)CrossRef Zhao, H., Ye, X.: A Practice of TPC-DS multidimensional implementation on NoSQL database systems. In: Nambiar, R., Poess, M. (eds.) TPCTC 2013. LNCS, vol. 8391, pp. 93–108. Springer, Heidelberg (2014)CrossRef
Metadaten
Titel
Implementation of Multidimensional Databases in Column-Oriented NoSQL Systems
verfasst von
Max Chevalier
Mohammed El Malki
Arlind Kopliku
Olivier Teste
Ronan Tournier
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-23135-8_6

Premium Partner