Skip to main content
Top
Published in: Cluster Computing 3/2019

28-02-2018

An extra spatial hierarchical schema in key-value store

Authors: Kun Zheng, Kang Zheng, Falin Fang, Miao Zhang, Qi Li, Yanghui Wang, Wenyu Zhao

Published in: Cluster Computing | Special Issue 3/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The rapid growth of positioning technologies has resulted in an explosion of spatial data, and how to manage and retrieve such data has become a challenge. To solve this problem, many researchers pay attention to build spatial index in key-value store. Nevertheless, this will generate questions regarding the spatial index update and management. Furthermore, the efficiency of spatial query operations would decrease because it will generate much more request on network. Besides some scholars adopt space filling curve to carry out spatial query with primary key index, however it can bring out the questions of “Edge-Case Problem” and “Z-Order Problem” which is caused by space filling curve. To solve these questions, scholars resort to spatial index again. Nevertheless, we deem that the questions can be resolved without building spatial index. So this paper advocates an extra spatial hierarchical schema inspired by geohash, and design spatial query method based on primary keys index. Finally, to test the query accuracy and efficiency of the spatial hierarchical schema, we adopt Z-ordering, Hilbert, Row and Gray into the process of primary key encoding and conduct range query and k-NN queries in HBase. Experiment evaluation shows that the efficiency of the spatial queries good based on this schema even without the help of a spatial index.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Le, H.V., Takasu, A.: An efficient distributed index for geospatial databases, pp. 28–42. Springer International Publishing, Basel (2015) Le, H.V., Takasu, A.: An efficient distributed index for geospatial databases, pp. 28–42. Springer International Publishing, Basel (2015)
2.
go back to reference Li, F., et al.: R-Store: a scalable distributed system for supporting real-time analytics. In: Proceeding of the IEEE International Conference on Data Engineering (2014) Li, F., et al.: R-Store: a scalable distributed system for supporting real-time analytics. In: Proceeding of the IEEE International Conference on Data Engineering (2014)
3.
go back to reference Zhou, X., et al.: ABR-Tree: an efficient distributed multidimensional indexing approach for massive data. In: Proceeding of the ICA3PP International Workshops and Symposiums on Algorithms and Architectures for Parallel Processing (2015)CrossRef Zhou, X., et al.: ABR-Tree: an efficient distributed multidimensional indexing approach for massive data. In: Proceeding of the ICA3PP International Workshops and Symposiums on Algorithms and Architectures for Parallel Processing (2015)CrossRef
4.
go back to reference Han, J., et al.: Survey on NoSQL database. In: Proceeding of the International Conference on Pervasive Computing and Applications (2011) Han, J., et al.: Survey on NoSQL database. In: Proceeding of the International Conference on Pervasive Computing and Applications (2011)
7.
go back to reference Zhong, Y., et al.: Towards parallel spatial query processing for big spatial data. In: Proceeding of the Parallel and Distributed Processing Symposium Workshops & Phd Forum (2012) Zhong, Y., et al.: Towards parallel spatial query processing for big spatial data. In: Proceeding of the Parallel and Distributed Processing Symposium Workshops & Phd Forum (2012)
8.
go back to reference Chen, X.Y., et al.: Efficient historical query in HBase for spatio-temporal decision support. Int. J. Comput. Commun. Control 11(5), 613–630 (2016)CrossRef Chen, X.Y., et al.: Efficient historical query in HBase for spatio-temporal decision support. Int. J. Comput. Commun. Control 11(5), 613–630 (2016)CrossRef
9.
go back to reference Han, D., E. Stroulia: HGrid: a data model for large geospatial data sets in HBase. In: Proceeding of the IEEE Sixth International Conference on Cloud Computing (2013) Han, D., E. Stroulia: HGrid: a data model for large geospatial data sets in HBase. In: Proceeding of the IEEE Sixth International Conference on Cloud Computing (2013)
10.
go back to reference Zhang, N., et al.: HBaseSpatial: a scalable spatial data storage based on HBase. In: Proceeding of the IEEE International Conference on Trust, Security and Privacy in Computing and Communications (2014) Zhang, N., et al.: HBaseSpatial: a scalable spatial data storage based on HBase. In: Proceeding of the IEEE International Conference on Trust, Security and Privacy in Computing and Communications (2014)
11.
go back to reference Aji, A., et al.: Hadoop-GIS: a high performance spatial data warehousing system over MapReduce. Proc. Vldb Endow. 6(11), 1009–1020 (2013)CrossRef Aji, A., et al.: Hadoop-GIS: a high performance spatial data warehousing system over MapReduce. Proc. Vldb Endow. 6(11), 1009–1020 (2013)CrossRef
12.
go back to reference Zhang, X., et al.: An efficient multi-dimensional index for cloud data management. In: Proceeding of the International CIKM Workshop on Cloud Data Management, Clouddb 2009, Hong Kong, China, November (2009) Zhang, X., et al.: An efficient multi-dimensional index for cloud data management. In: Proceeding of the International CIKM Workshop on Cloud Data Management, Clouddb 2009, Hong Kong, China, November (2009)
13.
go back to reference Lee, K., et al.: Efficient spatial query processing for big data. In: Proceeding of the ACM Sigspatial International Conference (2014) Lee, K., et al.: Efficient spatial query processing for big data. In: Proceeding of the ACM Sigspatial International Conference (2014)
14.
go back to reference Nishimura, S., et al.: MD-HBase: design and implementation of an elastic data infrastructure for cloud-scale location services. Distrib Parallel Databases 31(2SI), 289–319 (2013)CrossRef Nishimura, S., et al.: MD-HBase: design and implementation of an elastic data infrastructure for cloud-scale location services. Distrib Parallel Databases 31(2SI), 289–319 (2013)CrossRef
15.
go back to reference Hong, V.L., Distributed Moving Objects Database Based on Key–Value Stores. 2016 Hong, V.L., Distributed Moving Objects Database Based on Key–Value Stores. 2016
17.
go back to reference Papadopoulos, A., Katsaros, D.: A-Tree: distributed indexing of multidimensional data for cloud computing environments. In: Proceeding of the IEEE Third International Conference on Cloud Computing Technology and Science (2011) Papadopoulos, A., Katsaros, D.: A-Tree: distributed indexing of multidimensional data for cloud computing environments. In: Proceeding of the IEEE Third International Conference on Cloud Computing Technology and Science (2011)
18.
go back to reference Zhang, Y., et al. A Large-scale Online Search System of High-Dimensional Vectors Based on Key-Value Store. In: Proceeding of the Eighth International Conference on Semantics, Knowledge and Grids (2012) Zhang, Y., et al. A Large-scale Online Search System of High-Dimensional Vectors Based on Key-Value Store. In: Proceeding of the Eighth International Conference on Semantics, Knowledge and Grids (2012)
20.
go back to reference Fox, A., Eichelberger, C., Hughes, J., Lyon, S.: Spatio-temporal indexing in non-relational distributed databases. In: Proceedings of IEEE International Conference on Big Data, pp. 291–299, Santa Clara Marriott, CA, USA (2013) Fox, A., Eichelberger, C., Hughes,  J., Lyon, S.: Spatio-temporal indexing in non-relational distributed databases. In: Proceedings of IEEE International Conference on Big Data, pp. 291–299, Santa Clara Marriott, CA, USA (2013)
21.
go back to reference Hughes, J.N., et al.: A survey of techniques and open-source tools for processing streams of spatio-temporal events. In: Proceedings of the 7th ACM Sigspatial International Workshop on Geostreaming (IWGS), pp. 39–42 (2016) Hughes, J.N., et al.: A survey of techniques and open-source tools for processing streams of spatio-temporal events. In: Proceedings of the 7th ACM Sigspatial International Workshop on Geostreaming (IWGS), pp. 39–42 (2016)
22.
go back to reference Zheng, K., Gu, D., Fang, F., et al.: Data storage optimization strategy in distributed column-oriented database by considering spatial adjacency. Clust. Comput. 12, 1–12 (2017) Zheng, K., Gu, D., Fang, F., et al.: Data storage optimization strategy in distributed column-oriented database by considering spatial adjacency. Clust. Comput. 12, 1–12 (2017)
24.
go back to reference Abel, D.J., Mark, D.M.: A comparative analysis of some two-dimensional orderings. Int. J. Geogr. Inf. Sci. 4(1), 21–31 (1990)CrossRef Abel, D.J., Mark, D.M.: A comparative analysis of some two-dimensional orderings. Int. J. Geogr. Inf. Sci. 4(1), 21–31 (1990)CrossRef
Metadata
Title
An extra spatial hierarchical schema in key-value store
Authors
Kun Zheng
Kang Zheng
Falin Fang
Miao Zhang
Qi Li
Yanghui Wang
Wenyu Zhao
Publication date
28-02-2018
Publisher
Springer US
Published in
Cluster Computing / Issue Special Issue 3/2019
Print ISSN: 1386-7857
Electronic ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-018-2270-4

Other articles of this Special Issue 3/2019

Cluster Computing 3/2019 Go to the issue

Premium Partner