Skip to main content
Top

2015 | OriginalPaper | Chapter

Implementation of Multidimensional Databases in Column-Oriented NoSQL Systems

Authors : Max Chevalier, Mohammed El Malki, Arlind Kopliku, Olivier Teste, Ronan Tournier

Published in: Advances in Databases and Information Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

NoSQL (Not Only SQL) systems are becoming popular due to known advantages such as horizontal scalability and elasticity. In this paper, we study the implementation of multidimensional data warehouses based on column-oriented NoSQL systems. To do this, we define a set of mapping rules that transform a conceptual multidimensional data model into a logical column-oriented model. We consider three ways (three sub-models) to structure conceptual multidimensional data model into a column-oriented model. Then, we show an implementation of the proposed rules. Finally, we focus, through experiment, on data loading, model-to-model conversion and OLAP cuboid computation.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Conceptual level data models describe data in a generic way regardless the information technologies used, while logical level models use a specific technique for implementing the conceptual level.
 
2
CSV, Comma separated values files.
 
3
“Reasonable time” for a Big Data environment running on commodity hardware (without an optical fiber network between nodes, i.e. the recommended 10,000 GB/s).
 
Literature
1.
go back to reference Bosworth, A., Gray, J., Layman, A., Pirahesh, H.: Data cube: a relational aggregation operator generalizing group-by, cross-tab, and sub-totals. Technical Report MSR-TR-95-22, Microsoft Research February 1995 Bosworth, A., Gray, J., Layman, A., Pirahesh, H.: Data cube: a relational aggregation operator generalizing group-by, cross-tab, and sub-totals. Technical Report MSR-TR-95-22, Microsoft Research February 1995
2.
go back to reference Chang, F., Dean, J., Ghemawat, S., Hsieh, W.C., Wallach, D.A., Burrows, M., Chandra, T., Fikes, A., Gruber, R.E.: Bigtable: a distributed storage system for structured data. ACM Trans. Comput. Syst. 26(2), 4:1–4:26 (2008)CrossRef Chang, F., Dean, J., Ghemawat, S., Hsieh, W.C., Wallach, D.A., Burrows, M., Chandra, T., Fikes, A., Gruber, R.E.: Bigtable: a distributed storage system for structured data. ACM Trans. Comput. Syst. 26(2), 4:1–4:26 (2008)CrossRef
3.
go back to reference Chaudhuri, S., Dayal, U.: An overview of data warehousing and olap technology. SIGMOD Rec. 26, 65–74 (1997)CrossRef Chaudhuri, S., Dayal, U.: An overview of data warehousing and olap technology. SIGMOD Rec. 26, 65–74 (1997)CrossRef
4.
go back to reference Chevalier, M., El Malki, M., Kopliku, A., Teste, O., Tournier, R.: Implementing multidimensional data warehouses into NoSQL. In: 17th International Conference on Enterprise Information Systems, vol. DISI Chevalier, M., El Malki, M., Kopliku, A., Teste, O., Tournier, R.: Implementing multidimensional data warehouses into NoSQL. In: 17th International Conference on Enterprise Information Systems, vol. DISI
5.
go back to reference Chevalier, M., El Malki, M., Kopliku, A., Teste, O., Tournier, R.: Benchmark for OLAP on NoSQL technologies, comparing NoSQL multidimensional data warehousing solutions. In: 9th International Conference on Research Challenges in Information Science (RCIS), IEEE Chevalier, M., El Malki, M., Kopliku, A., Teste, O., Tournier, R.: Benchmark for OLAP on NoSQL technologies, comparing NoSQL multidimensional data warehousing solutions. In: 9th International Conference on Research Challenges in Information Science (RCIS), IEEE
7.
go back to reference Cuzzocrea, A., Bellatreche, L., Song, I.Y.: Data warehousing and olap over bigdata: current challenges and future research directions. In: Proceedings of the Sixteenth International Workshop on Data Warehousing and OLAP, pp. 67–70. DOLAP 2013, ACM, New York, NY, USA (2013) Cuzzocrea, A., Bellatreche, L., Song, I.Y.: Data warehousing and olap over bigdata: current challenges and future research directions. In: Proceedings of the Sixteenth International Workshop on Data Warehousing and OLAP, pp. 67–70. DOLAP 2013, ACM, New York, NY, USA (2013)
8.
go back to reference Cuzzocrea, A., Song, I.Y., Davis, K.C.: Analytics over large-scale multidimensionaldata: the big data revolution! In: Proceedings of the ACM 14th International Workshop on Data Warehousing and OLAP, pp. 101–104. DOLAP 2011, ACM, New York, NY, USA (2011) Cuzzocrea, A., Song, I.Y., Davis, K.C.: Analytics over large-scale multidimensionaldata: the big data revolution! In: Proceedings of the ACM 14th International Workshop on Data Warehousing and OLAP, pp. 101–104. DOLAP 2011, ACM, New York, NY, USA (2011)
9.
go back to reference Dehdouh, K., Boussaid, O., Bentayeb, F.: Columnar NoSQL star schema benchmark. In: Ait Ameur, Y., Bellatreche, L., Papadopoulos, G.A. (eds.) MEDI 2014. LNCS, vol. 8748, pp. 281–288. Springer, Heidelberg (2014) Dehdouh, K., Boussaid, O., Bentayeb, F.: Columnar NoSQL star schema benchmark. In: Ait Ameur, Y., Bellatreche, L., Papadopoulos, G.A. (eds.) MEDI 2014. LNCS, vol. 8748, pp. 281–288. Springer, Heidelberg (2014)
10.
go back to reference Golfarelli, M., Maio, D., Rizzi, S.: The dimensional fact model: a conceptual modelfor data warehouses. Int. J. Coop. Inf. Syst. 7, 215–247 (1998)CrossRef Golfarelli, M., Maio, D., Rizzi, S.: The dimensional fact model: a conceptual modelfor data warehouses. Int. J. Coop. Inf. Syst. 7, 215–247 (1998)CrossRef
11.
go back to reference Harter, T., Borthakur, D., Dong, S., Aiyer, A.S., Tang, L., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H.: Analysis of hdfs under hbase: a facebook messages casestudy. In: FAST, pp. 199–212 (2014) Harter, T., Borthakur, D., Dong, S., Aiyer, A.S., Tang, L., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H.: Analysis of hdfs under hbase: a facebook messages casestudy. In: FAST, pp. 199–212 (2014)
12.
go back to reference Kimball, R., Ross, M.: The Data Warehouse Toolkit: The Definitive Guide to Dimensional Modeling. John Wiley & Sons, Inc. (2013) Kimball, R., Ross, M.: The Data Warehouse Toolkit: The Definitive Guide to Dimensional Modeling. John Wiley & Sons, Inc. (2013)
13.
go back to reference Lakshman, A., Malik, P.: Cassandra: a decentralized structured storage system. SIGOPS Oper. Syst. Rev. 44(2), 35–40 (2010)CrossRef Lakshman, A., Malik, P.: Cassandra: a decentralized structured storage system. SIGOPS Oper. Syst. Rev. 44(2), 35–40 (2010)CrossRef
14.
go back to reference Li, C.: Transforming relational database into hbase: a case study. In: International Conference on Software Engineering and Service Sciences (ICSESS), IEEE, pp. 683–687 (2010) Li, C.: Transforming relational database into hbase: a case study. In: International Conference on Software Engineering and Service Sciences (ICSESS), IEEE, pp. 683–687 (2010)
15.
go back to reference O’Neil, P., O’Neil, E., Chen, X., Revilak, S.: The star schema benchmark and augmented fact table indexing. In: Nambiar, R., Poess, M. (eds.) TPCTC 2009. LNCS, vol. 5895, pp. 237–252. Springer, Heidelberg (2009) O’Neil, P., O’Neil, E., Chen, X., Revilak, S.: The star schema benchmark and augmented fact table indexing. In: Nambiar, R., Poess, M. (eds.) TPCTC 2009. LNCS, vol. 5895, pp. 237–252. Springer, Heidelberg (2009)
16.
go back to reference Ravat, F., Teste, O., Tournier, R., Zuruh, G.: Algebraic and graphic languages for OLAP manipulations. IJDWM 4(1), 17–46 (2008) Ravat, F., Teste, O., Tournier, R., Zuruh, G.: Algebraic and graphic languages for OLAP manipulations. IJDWM 4(1), 17–46 (2008)
17.
go back to reference Stonebraker, M.: New opportunities for new sql. Commun. ACM 55(11), 10–11 (2012)CrossRef Stonebraker, M.: New opportunities for new sql. Commun. ACM 55(11), 10–11 (2012)CrossRef
18.
go back to reference Vajk, T., Feher, P., Fekete, K., Charaf, H.: Denormalizing data into schema-free databases. In: 4th International Conference on Cognitive Infocommunications (CogInfoCom), IEEE, pp. 747–752 (2013) Vajk, T., Feher, P., Fekete, K., Charaf, H.: Denormalizing data into schema-free databases. In: 4th International Conference on Cognitive Infocommunications (CogInfoCom), IEEE, pp. 747–752 (2013)
19.
go back to reference Zhao, H., Ye, X.: A Practice of TPC-DS multidimensional implementation on NoSQL database systems. In: Nambiar, R., Poess, M. (eds.) TPCTC 2013. LNCS, vol. 8391, pp. 93–108. Springer, Heidelberg (2014)CrossRef Zhao, H., Ye, X.: A Practice of TPC-DS multidimensional implementation on NoSQL database systems. In: Nambiar, R., Poess, M. (eds.) TPCTC 2013. LNCS, vol. 8391, pp. 93–108. Springer, Heidelberg (2014)CrossRef
Metadata
Title
Implementation of Multidimensional Databases in Column-Oriented NoSQL Systems
Authors
Max Chevalier
Mohammed El Malki
Arlind Kopliku
Olivier Teste
Ronan Tournier
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-23135-8_6

Premium Partner