Skip to main content
Erschienen in: The Journal of Supercomputing 5/2016

01.05.2016

Distributed RDF store for efficient searching billions of triples based on Hadoop

verfasst von: Jung-Ho Um, Seungwoo Lee, Tae-Hong Kim, Chang-Hoo Jeong, Sa-Kwang Song, Hanmin Jung

Erschienen in: The Journal of Supercomputing | Ausgabe 5/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

As the development of IT and scientific technology, very large amounts of knowledge data are continuously being created and the big data era can be said to have arrived. Therefore, RDF store inserting and inquiring into knowledge bases has to be scaled up in order to deal with such large sources of data. To this end, we propose a scalable distributed RDF store based on a distributed database that uses bulk-loading for billions of triples to store data and to respond to user queries quickly. In order to achieve this purpose, we introduce a bulk-loading algorithm using the MapReduce framework and the SPARQL query processing engine to connect to a large distributed database. Experimental results show that the proposed bulk-loading algorithm achieves 67.893K triples per second to load approximately 33 billion triples. Therefore, the experiment proves proposed RDF store can manage billions of triples scale data.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ko M, Choi W (2013) A distributional inference for cross-lingual undefined entities linking. J Converg 4(2):23–28 Ko M, Choi W (2013) A distributional inference for cross-lingual undefined entities linking. J Converg 4(2):23–28
2.
Zurück zum Zitat Augusto JC, Callaghan V, Cook D, Kameas A, Satoh I (2013) Intelligent environments: a manifesto. Hum Cent Comput Inform Sci 3(12):1–18 Augusto JC, Callaghan V, Cook D, Kameas A, Satoh I (2013) Intelligent environments: a manifesto. Hum Cent Comput Inform Sci 3(12):1–18
3.
Zurück zum Zitat Onte MB, Marcial DE (2013) Developing a web-based knowledge product outsourcing system at a university. J Inform Process Syst 9(4):548–566CrossRef Onte MB, Marcial DE (2013) Developing a web-based knowledge product outsourcing system at a university. J Inform Process Syst 9(4):548–566CrossRef
4.
Zurück zum Zitat Kim J, Lee S, Jeong D and Jung H (2012) Semantic data model and service for supporting intelligent legislation establishment. The 2nd joint international semantic technology conference Kim J, Lee S, Jeong D and Jung H (2012) Semantic data model and service for supporting intelligent legislation establishment. The 2nd joint international semantic technology conference
6.
Zurück zum Zitat Khadilkar V, Kantarcioglu M, Thuraisingham B, Castagna P (2012) Jena-HBase: a distributed, scalable and efficient RDF triple store. ISWC Khadilkar V, Kantarcioglu M, Thuraisingham B, Castagna P (2012) Jena-HBase: a distributed, scalable and efficient RDF triple store. ISWC
7.
Zurück zum Zitat Papailiou N, Konstantinou L, Tsoumakos D, Korizirs N (2012) H2RDF: adaptive query processing on RDF data in the cloud. WWW Papailiou N, Konstantinou L, Tsoumakos D, Korizirs N (2012) H2RDF: adaptive query processing on RDF data in the cloud. WWW
10.
Zurück zum Zitat Dean J, Ghemawat S (2004) MapReduce: simplified data processing on large clusters. OSDI, 2004, pp 137–150 Dean J, Ghemawat S (2004) MapReduce: simplified data processing on large clusters. OSDI, 2004, pp 137–150
12.
Zurück zum Zitat Chang F, Dean J, Ghemawat S, Hsieh WC, Wallach Deborah A, Burrows M, Chandra T, Fikes A, Gruber RE (2006) Bigtable: a distributed storage system for structured data. OSDI Chang F, Dean J, Ghemawat S, Hsieh WC, Wallach Deborah A, Burrows M, Chandra T, Fikes A, Gruber RE (2006) Bigtable: a distributed storage system for structured data. OSDI
13.
Zurück zum Zitat DeCandia G, Hastorun D, Jampani M, Kakulapati G, Lakshman A, Pilchin A, Sivasubramanian S, Vosshall P, Vogels W (2007) Dynamo: amazon’s highly available key-value store. SOSP DeCandia G, Hastorun D, Jampani M, Kakulapati G, Lakshman A, Pilchin A, Sivasubramanian S, Vosshall P, Vogels W (2007) Dynamo: amazon’s highly available key-value store. SOSP
14.
Zurück zum Zitat Stoica I, Morris R, Karger D, Frans Kaashoek M, Balakrishnan H (2001) Chord: a scalable peer-to-peer lookup service for internet applications. SIGCOMM Stoica I, Morris R, Karger D, Frans Kaashoek M, Balakrishnan H (2001) Chord: a scalable peer-to-peer lookup service for internet applications. SIGCOMM
15.
Zurück zum Zitat Cooper BF, Silberstein A, Tam E, Ramakrishnan R, Sears R (2010) Benchmarking cloud serving systems with YCSB. The 1st ACM symposium on cloud computing, pp 143–154 Cooper BF, Silberstein A, Tam E, Ramakrishnan R, Sears R (2010) Benchmarking cloud serving systems with YCSB. The 1st ACM symposium on cloud computing, pp 143–154
17.
Zurück zum Zitat Bizer C, Schultz A (2009) The Berlin SPARQL benchmark. Int J Semant Web Inform Syst 5(2):1–24CrossRef Bizer C, Schultz A (2009) The Berlin SPARQL benchmark. Int J Semant Web Inform Syst 5(2):1–24CrossRef
18.
Zurück zum Zitat Ladwig G, Harth A (2011) CumulusRDF: linked data management on nested key-value stores. ISWC Ladwig G, Harth A (2011) CumulusRDF: linked data management on nested key-value stores. ISWC
22.
Zurück zum Zitat Cao B, Yin J, Zhang Q, Ye Y (2010) A MapReduce-based architecture for rule matching in production system. CloudCom Cao B, Yin J, Zhang Q, Ye Y (2010) A MapReduce-based architecture for rule matching in production system. CloudCom
Metadaten
Titel
Distributed RDF store for efficient searching billions of triples based on Hadoop
verfasst von
Jung-Ho Um
Seungwoo Lee
Tae-Hong Kim
Chang-Hoo Jeong
Sa-Kwang Song
Hanmin Jung
Publikationsdatum
01.05.2016
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 5/2016
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-016-1670-6

Weitere Artikel der Ausgabe 5/2016

The Journal of Supercomputing 5/2016 Zur Ausgabe