Skip to main content
Top

2018 | OriginalPaper | Chapter

Design of Effective Indexing Technique in Hadoop-Based Database

Authors : Jae-Sung Shim, Young-Hwan Jang, Yong-Wan Ju, Seok-Cheon Park

Published in: Advances in Computer Science and Ubiquitous Computing

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The recent rapid increase in the amount of data to be processed has led to the increased use of dispersed parallel processing of large-scale data analysis using open-source Hadoop’s MapReduce framework. The large-data processing method proposed by Google and Hadoop which implemented this are representative dispersed parallel processing methods, and the data are dispersedly saved on the HDFS(Hadoop Distributed File System). Such HDFS uses its own indexing technique when it comes to searching specific values from the saved files. Techniques that use conventional index, however, leads to problems like reduced search performance by not considering update and saving index in the disc. Therefore, the paper proposes effective DB indexing technique on Hadoop-based database.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ryu, H.-S., Choi, H.-S., Son, J.-H., Chung, Y.-D.: An Implementation of a BST index on a relational data warehouse system based on hadoop cloud. In: Proceeding of Korea Information Science Society, pp. 10–12 (2012) Ryu, H.-S., Choi, H.-S., Son, J.-H., Chung, Y.-D.: An Implementation of a BST index on a relational data warehouse system based on hadoop cloud. In: Proceeding of Korea Information Science Society, pp. 10–12 (2012)
2.
go back to reference Lee, H.-J., Kim, T.-H.: A MapReduce-based kNN join query processing algorithm for analyzing large-scale data. J. Korea Inf. Sci. Soc. 42, 504–511 (2015) Lee, H.-J., Kim, T.-H.: A MapReduce-based kNN join query processing algorithm for analyzing large-scale data. J. Korea Inf. Sci. Soc. 42, 504–511 (2015)
3.
go back to reference Kim, D.-M., Choi, J.-W., Woo, C.-W.: A design and development of big data indexing and search system using lucene. J. Internet Comput. Serv. 15, 107–115 (2014)CrossRef Kim, D.-M., Choi, J.-W., Woo, C.-W.: A design and development of big data indexing and search system using lucene. J. Internet Comput. Serv. 15, 107–115 (2014)CrossRef
4.
go back to reference Park, J.-H., Bok, K.-S., Yoo, J.-S.: Big data parallel processing technology trend. Commun. Korean Inst. Inf. Sci. Eng. 32, 18–26 (2014) Park, J.-H., Bok, K.-S., Yoo, J.-S.: Big data parallel processing technology trend. Commun. Korean Inst. Inf. Sci. Eng. 32, 18–26 (2014)
5.
go back to reference Park, H.-J., Gwon, Y.-H., An, Y.-M.: Big data and big data refinement technology. Korean Soc. Comput. Inf. Rev. 21, 1–8 (2013) Park, H.-J., Gwon, Y.-H., An, Y.-M.: Big data and big data refinement technology. Korean Soc. Comput. Inf. Rev. 21, 1–8 (2013)
6.
go back to reference Oh, H.-J., Yun, B.-H., Choi, N.-H., Yoo, C.-J., Kim, Y.: Visualization for preferred locations and moving patterns according to user groups based on contents analysis in social big data. J. Korean Inst. Inf. Technol. 12, 195–203 (2014) Oh, H.-J., Yun, B.-H., Choi, N.-H., Yoo, C.-J., Kim, Y.: Visualization for preferred locations and moving patterns according to user groups based on contents analysis in social big data. J. Korean Inst. Inf. Technol. 12, 195–203 (2014)
7.
go back to reference Kim, C.-S.: Hadoop based spatial bigdata index creation and processing. In: Proceeding of Korea Information Science Society, pp. 87–89 (2016) Kim, C.-S.: Hadoop based spatial bigdata index creation and processing. In: Proceeding of Korea Information Science Society, pp. 87–89 (2016)
Metadata
Title
Design of Effective Indexing Technique in Hadoop-Based Database
Authors
Jae-Sung Shim
Young-Hwan Jang
Yong-Wan Ju
Seok-Cheon Park
Copyright Year
2018
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-7605-3_15