Skip to main content

2020 | OriginalPaper | Buchkapitel

Graph-Based Denormalization for Migrating Big Data from SQL Database to NoSQL Database

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this big data era, the data storing methods are vary based upon the data type and the technologies upgradation. Due to the increase of voluminous data, the traditional Relational Database Management Systems (RDBMS) are immature to handle the unstructured data. To overcome this issue, NoSQL databases are used to store and process the unstructured data. The big data migration from SQL to NoSQL database is more complex. The SQL databases are well-normalized database. Denormalization plays a major role in retrieving the data more efficiently. This work is carried on migrating the big data from SQL to NoSQL database using the Graph-based Denormalization method. The proposed method is more efficient for big data migration and post-migration process.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Sanders, G.L., Shin, S.K.: Denormalization effects on performance of RDBMS. In: Proceedings of the HICSS Conference, January 2001 Sanders, G.L., Shin, S.K.: Denormalization effects on performance of RDBMS. In: Proceedings of the HICSS Conference, January 2001
2.
Zurück zum Zitat Shin, S.K., Sanders, G.L.: Denormalization strategies for data retrieval from data warehouses. Decis. Support Syst. 42(1), 267–282 (2006)CrossRef Shin, S.K., Sanders, G.L.: Denormalization strategies for data retrieval from data warehouses. Decis. Support Syst. 42(1), 267–282 (2006)CrossRef
3.
Zurück zum Zitat Wei, Z., Dejun, J., Pierre, G., Chi, C.-H., van Steen, M.: Service-oriented data denormalization for scalable web applications. In: Proceedings of the International World-Wide Web Conference, April 2008 Wei, Z., Dejun, J., Pierre, G., Chi, C.-H., van Steen, M.: Service-oriented data denormalization for scalable web applications. In: Proceedings of the International World-Wide Web Conference, April 2008
4.
Zurück zum Zitat Lombardo, S., Di Nitto, E., Ardagna, D.: Issues in handling complex data structures with NoSQL databases. In: Proceedings of the 14th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), pp. 443–448, September 2012 Lombardo, S., Di Nitto, E., Ardagna, D.: Issues in handling complex data structures with NoSQL databases. In: Proceedings of the 14th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), pp. 443–448, September 2012
5.
Zurück zum Zitat Li, Y., Manoharan, S.: A performance comparison of SQL and NoSQL databases. In: Proceedings of IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM), pp. 15–19, August 2013 Li, Y., Manoharan, S.: A performance comparison of SQL and NoSQL databases. In: Proceedings of IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM), pp. 15–19, August 2013
6.
Zurück zum Zitat Boicea, A., Radulescu, F., Agapin, L.I.: MongoDB vs Oracle – database comparison. In: Proceedings of The 3rd International Conference on Emerging Intelligent Data and Web Technologies (EIDWT), pp. 330–335, September 2012 Boicea, A., Radulescu, F., Agapin, L.I.: MongoDB vs Oracle – database comparison. In: Proceedings of The 3rd International Conference on Emerging Intelligent Data and Web Technologies (EIDWT), pp. 330–335, September 2012
7.
Zurück zum Zitat Grolinger, K., Hayes, M., Higashino, W.A., L’Heureux, A., Allison, D.S., Capretz, M.A.M.: Challenges for MapReduce in big data. In: Proceedings of IEEE World Congress on Services (SERVICES), pp. 182–189, June 2014 Grolinger, K., Hayes, M., Higashino, W.A., L’Heureux, A., Allison, D.S., Capretz, M.A.M.: Challenges for MapReduce in big data. In: Proceedings of IEEE World Congress on Services (SERVICES), pp. 182–189, June 2014
8.
Zurück zum Zitat Naheman, W., Wei, J.: Review of NoSQL databases and performance testing on HBase. In: Proceedings of International Conference on Mechatronic Sciences, Electric Engineering and Computer (MEC), pp. 2304–2309, December 2013 Naheman, W., Wei, J.: Review of NoSQL databases and performance testing on HBase. In: Proceedings of International Conference on Mechatronic Sciences, Electric Engineering and Computer (MEC), pp. 2304–2309, December 2013
9.
Zurück zum Zitat Scavuzzo, M., Di Nitto, E., Ceri, S.: Interoperable data migration between NoSQL columnar databases. In: Proceedings of IEEE 18th International Enterprise Distributed Object Computing Conference Workshops and Demonstrations (EDOCW), pp. 154–162, September 2014 Scavuzzo, M., Di Nitto, E., Ceri, S.: Interoperable data migration between NoSQL columnar databases. In: Proceedings of IEEE 18th International Enterprise Distributed Object Computing Conference Workshops and Demonstrations (EDOCW), pp. 154–162, September 2014
10.
Zurück zum Zitat Hsu, J.-C., Hsu, C.-H., Chen, S.-C., Chung, Y.-C.: Correlation aware technique for SQL to NoSQL transformation. In: Proceedings of the 7th International Conference on Ubi-Media Computing and Workshops (UMEDIA), pp. 43–46, July 2014 Hsu, J.-C., Hsu, C.-H., Chen, S.-C., Chung, Y.-C.: Correlation aware technique for SQL to NoSQL transformation. In: Proceedings of the 7th International Conference on Ubi-Media Computing and Workshops (UMEDIA), pp. 43–46, July 2014
11.
Zurück zum Zitat Zhao, G., Li, L., Li, Z., Lin, Q.: Multiple nested schema of HBase for migration from SQL. In: Proceedings of 9th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC), pp. 338–343, November 2014 Zhao, G., Li, L., Li, Z., Lin, Q.: Multiple nested schema of HBase for migration from SQL. In: Proceedings of 9th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC), pp. 338–343, November 2014
12.
Zurück zum Zitat Zhao, G., Lin, Q., Li, L., Li, Z.: Schema conversion model of SQL database to NoSQL. In: Proceedings of 9th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC), pp. 355–362, November 2014 Zhao, G., Lin, Q., Li, L., Li, Z.: Schema conversion model of SQL database to NoSQL. In: Proceedings of 9th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC), pp. 355–362, November 2014
13.
Zurück zum Zitat Sellami, R., Bhiri, S., Defude, B.: ODBAPI: a unified REST API for relational and NoSQL data stores. In: Proceedings of IEEE International Congress on Big Data (BigData Congress), pp. 653–660, June 2014 Sellami, R., Bhiri, S., Defude, B.: ODBAPI: a unified REST API for relational and NoSQL data stores. In: Proceedings of IEEE International Congress on Big Data (BigData Congress), pp. 653–660, June 2014
14.
Zurück zum Zitat Li, X., Ma, Z., Chen, H.: QODM: a query-oriented data modeling approach for NoSQL databases. In: Proceedings of IEEE Workshop on Advanced Research and Technology in Industry Applications (WARTIA), pp. 338–345, September 2014 Li, X., Ma, Z., Chen, H.: QODM: a query-oriented data modeling approach for NoSQL databases. In: Proceedings of IEEE Workshop on Advanced Research and Technology in Industry Applications (WARTIA), pp. 338–345, September 2014
15.
Zurück zum Zitat Gadkari, A., Nikam, V.B., Meshram, B.B.: Implementing joins over HBase on cloud platform. In: Proceedings of IEEE International Conference on Computer and Information Technology (CIT), pp. 547–554, September 2014 Gadkari, A., Nikam, V.B., Meshram, B.B.: Implementing joins over HBase on cloud platform. In: Proceedings of IEEE International Conference on Computer and Information Technology (CIT), pp. 547–554, September 2014
16.
Zurück zum Zitat Wei, Z., Pierre, G., Chi, C.-H.: Scalable join queries in cloud data stores. In: Proceedings of the 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), pp. 547–555 May 2012 Wei, Z., Pierre, G., Chi, C.-H.: Scalable join queries in cloud data stores. In: Proceedings of the 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), pp. 547–555 May 2012
17.
Zurück zum Zitat Lawrence, R.: Integration and virtualization of relational SQL and NoSQL systems including MySQL and MongoDB. In: Proceedings of International Conference on Computational Science and Computational Intelligence (CSCI), pp. 285–290, March 2014 Lawrence, R.: Integration and virtualization of relational SQL and NoSQL systems including MySQL and MongoDB. In: Proceedings of International Conference on Computational Science and Computational Intelligence (CSCI), pp. 285–290, March 2014
18.
Zurück zum Zitat Van Hieu, D., Smanchat, S., Meesad, P.: MapReduce join strategies for key-value storage. In: Proceedings of the 11th International Joint Conference on Computer Science and Software Engineering (JCSSE), pp. 164–169, May 2014 Van Hieu, D., Smanchat, S., Meesad, P.: MapReduce join strategies for key-value storage. In: Proceedings of the 11th International Joint Conference on Computer Science and Software Engineering (JCSSE), pp. 164–169, May 2014
Metadaten
Titel
Graph-Based Denormalization for Migrating Big Data from SQL Database to NoSQL Database
verfasst von
V. Rathika
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-28364-3_56