Skip to main content
Top

2017 | OriginalPaper | Chapter

GeoWave: Utilizing Distributed Key-Value Stores for Multidimensional Data

Authors : Michael A. Whitby, Rich Fecher, Chris Bennight

Published in: Advances in Spatial and Temporal Databases

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

To date, it has been difficult for modern geospatial software projects to take advantage of the benefits provided by distributed computing frameworks due to the implicit challenges of spatial and spatiotemporal data. Chief among these issues is preserving locality between multidimensional objects and the single dimensional sort order imposed by key-value stores. We will use the open source framework GeoWave to harness the scalability of various distributed frameworks and integrate them with geospatial queries, analytics, and map rendering. GeoWave performs dimensionality reduction by utilizing space–filling curves to convert n-dimensional data into a single dimension. This ensures that values close in multidimensional space are highly contiguous in the single dimensional keys of the datastore. By using various forms of geospatial data, we show that preserving locality in this way reduces the time needed to query, analyze, and render large amounts of data by multiple orders of magnitude.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
6.
go back to reference Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Google Inc. (2004) Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Google Inc. (2004)
7.
go back to reference Eldawy, A., Mohamed, M.: The ecosystem of SpatialHadoop. SIGSPATIAL Spec. 6(3), 3–10 (2015)CrossRef Eldawy, A., Mohamed, M.: The ecosystem of SpatialHadoop. SIGSPATIAL Spec. 6(3), 3–10 (2015)CrossRef
9.
go back to reference Hamilton, C.H., Rau-Chaplin, A.: Compact Hilbert indices: space-filling curves for domains with unequal side lengths. Inf. Process. Lett. 105, 155–163 (2008)MathSciNetCrossRefMATH Hamilton, C.H., Rau-Chaplin, A.: Compact Hilbert indices: space-filling curves for domains with unequal side lengths. Inf. Process. Lett. 105, 155–163 (2008)MathSciNetCrossRefMATH
10.
go back to reference Haverkort, H., Walderveen, F.: Locality and bounding-box quality of two-dimensional space-filling curves. Comput. Geom. 43, 131–147 (2010)MathSciNetCrossRefMATH Haverkort, H., Walderveen, F.: Locality and bounding-box quality of two-dimensional space-filling curves. Comput. Geom. 43, 131–147 (2010)MathSciNetCrossRefMATH
11.
go back to reference Indyk, P., Motwani, R., Raghavan, P., Vempala, S.: Locality-preserving hashing in multidimensional spaces, p. 618. ACM (1997) Indyk, P., Motwani, R., Raghavan, P., Vempala, S.: Locality-preserving hashing in multidimensional spaces, p. 618. ACM (1997)
12.
go back to reference Kim, H., Kang, S., Lee, S., Min, J.: The efficient algorithms for constructing enhanced quadtrees using MapReduce. IEICE Trans. Inf. Syst. 99(4), 918–926 (2016)CrossRef Kim, H., Kang, S., Lee, S., Min, J.: The efficient algorithms for constructing enhanced quadtrees using MapReduce. IEICE Trans. Inf. Syst. 99(4), 918–926 (2016)CrossRef
13.
go back to reference Nishimura, S., Das, S., Agrawal, D.: MD-HBase: a scalable multi-dimensional data infrastructure for location aware. In: IEEE MDM 2011, vol. 1 (2011) Nishimura, S., Das, S., Agrawal, D.: MD-HBase: a scalable multi-dimensional data infrastructure for location aware. In: IEEE MDM 2011, vol. 1 (2011)
14.
go back to reference Paiva, J., Ruivo,, P., Romano, P., Rodrigues, L.: AUTOPLACER: scalable self-tuning data placement in distributed key-value stores. ACM Trans. Auton. Adapt. Syst. 9(4) (2014). Article No. 19 Paiva, J., Ruivo,, P., Romano, P., Rodrigues, L.: AUTOPLACER: scalable self-tuning data placement in distributed key-value stores. ACM Trans. Auton. Adapt. Syst. 9(4) (2014). Article No. 19
Metadata
Title
GeoWave: Utilizing Distributed Key-Value Stores for Multidimensional Data
Authors
Michael A. Whitby
Rich Fecher
Chris Bennight
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-64367-0_6

Premium Partner