Skip to main content
Erschienen in: Cluster Computing 3/2017

17.07.2017

A basis of spatial big data analysis with map-matching system

verfasst von: Wonhee Cho, Eunmi Choi

Erschienen in: Cluster Computing | Ausgabe 3/2017

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The data collection of vehicle trajectories becomes the basis of big data analysis and prediction for a variety of purposes, such as vehicle navigation and movement analysis. A digital tachograph (DTG) is pre-installed on most commercial vehicles in South Korea and is highly valuable for analyzing eco-driving metrics such as safe driving and fuel consumption estimates. In order to properly analyze a large amount of GPS location information, it is necessary to find the exact match of the location data in space to the link in the digital road network data. We previously discovered the road information of the GPS coordinates using the commonly utilized map-matching technique. However, such a navigation map-matching technique requires a lot of supplementary corrections in order to rapidly and accurately navigate a large amount of data. In this study, we applied enhanced map-matching logics with Geohash as spatial index, long link vertex division, speed filtering, azimuth filtering, and map-matching weight logics. Also, we established and implemented a distributed analysis environment for the big data map-matching with HBase (a Hadoop-based NoSQL DB). This paper shows a spatial analysis system using the map-matching logics on the Hadoop MapReduce mechanism, which improved its performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Quddus, M.A., Ochieng, W.Y., Noland, R.B.: Current map-matching algorithms for transport applications: state-of-the art and future research directions. Transp. Res. Part C 15(5), 312–328 (2007)CrossRef Quddus, M.A., Ochieng, W.Y., Noland, R.B.: Current map-matching algorithms for transport applications: state-of-the art and future research directions. Transp. Res. Part C 15(5), 312–328 (2007)CrossRef
3.
Zurück zum Zitat Cortés, R., Marin, O., Bonnaire, X., Arantes, L., & Sens, P.: A scalable architecture for spatio-temporal range queries over big location data. In: 14th IEEE International Symposium on Network Computing and Applications-IEEE NCA’15, 2015 Cortés, R., Marin, O., Bonnaire, X., Arantes, L., & Sens, P.: A scalable architecture for spatio-temporal range queries over big location data. In: 14th IEEE International Symposium on Network Computing and Applications-IEEE NCA’15, 2015
4.
Zurück zum Zitat Lee, K., Ganti, R. K., Srivatsa, M., & Liu, L.: Efficient spatial query processing for big data. In Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 469–472. ACM, (2014) Lee, K., Ganti, R. K., Srivatsa, M., & Liu, L.: Efficient spatial query processing for big data. In Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 469–472. ACM, (2014)
5.
Zurück zum Zitat Whitman, R.T., Park, M.B., Ambrose, S.M., & Hoel, E.G.: Spatial indexing and analytics on Hadoop. In: Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 73–82, ACM, (2014) Whitman, R.T., Park, M.B., Ambrose, S.M., & Hoel, E.G.: Spatial indexing and analytics on Hadoop. In: Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 73–82, ACM, (2014)
6.
Zurück zum Zitat Han, D., & Stroulia, E.: HGrid: a data model for large ceospatial data sets in HBase. In Cloud Computing (CLOUD), 2013 IEEE Sixth International Conference on, pp. 910–917. IEEE (2013) Han, D., & Stroulia, E.: HGrid: a data model for large ceospatial data sets in HBase. In Cloud Computing (CLOUD), 2013 IEEE Sixth International Conference on, pp. 910–917. IEEE (2013)
7.
Zurück zum Zitat White, C.E., Bernstein, D., Kornhauser, A.L.: Some map matching algorithms for personal navigation assistants. Transport. Res. Part C 8(1), 91–108 (2000)CrossRef White, C.E., Bernstein, D., Kornhauser, A.L.: Some map matching algorithms for personal navigation assistants. Transport. Res. Part C 8(1), 91–108 (2000)CrossRef
8.
Zurück zum Zitat Pereira, F.C., Costa, H., Pereira, N.M.: An off-line map-matching algorithm for incomplete map databases. Eur. Transp. Res. Rev. 1(3), 107–124 (2009)MathSciNetCrossRef Pereira, F.C., Costa, H., Pereira, N.M.: An off-line map-matching algorithm for incomplete map databases. Eur. Transp. Res. Rev. 1(3), 107–124 (2009)MathSciNetCrossRef
9.
Zurück zum Zitat Brakatsoulas, S., Pfoser, D., Salas, R., & Wenk, C.: On map-matching vehicle tracking data. In Proceedings of the 31st international conference on Very large data bases, pp. 853–864, VLDB Endowment (2005) Brakatsoulas, S., Pfoser, D., Salas, R., & Wenk, C.: On map-matching vehicle tracking data. In Proceedings of the 31st international conference on Very large data bases, pp. 853–864, VLDB Endowment (2005)
10.
Zurück zum Zitat Szwed, P., & Pekala, K.: An incremental map-matching algorithm based on hidden markov model. In International Conference on Artificial Intelligence and Soft Computing, pp. 579–590, Springer, (2014) Szwed, P., & Pekala, K.: An incremental map-matching algorithm based on hidden markov model. In International Conference on Artificial Intelligence and Soft Computing, pp. 579–590, Springer, (2014)
11.
Zurück zum Zitat Koller, H., Widhalm, P., Dragaschnig, M., & Graser, A.: Fast hidden Markov model map-matching for sparse and noisy trajectories. In Intelligent Transportation Systems (ITSC), 2015 IEEE 18th International Conference on IEEE, pp. 2557–2561 (2015) Koller, H., Widhalm, P., Dragaschnig, M., & Graser, A.: Fast hidden Markov model map-matching for sparse and noisy trajectories. In Intelligent Transportation Systems (ITSC), 2015 IEEE 18th International Conference on IEEE, pp. 2557–2561 (2015)
12.
Zurück zum Zitat Wu, D., Zhu, T., Lv, W., & Gao, X.: A heuristic map-matching algorithm by using vector-based recognition. In Computing in the Global Information Technology, 2007. ICCGI 2007. International Multi-Conference on IEEE, pp. 18–18 (2007) Wu, D., Zhu, T., Lv, W., & Gao, X.: A heuristic map-matching algorithm by using vector-based recognition. In Computing in the Global Information Technology, 2007. ICCGI 2007. International Multi-Conference on IEEE, pp. 18–18 (2007)
13.
Zurück zum Zitat Chen, B.Y., Yuan, H., Li, Q., Lam, W.H., Shaw, S.L., Yan, K.: Map-matching algorithm for large-scale low-frequency floating car data. Int. J. Geogr. Inf. Sci. 28(1), 22–38 (2014)CrossRef Chen, B.Y., Yuan, H., Li, Q., Lam, W.H., Shaw, S.L., Yan, K.: Map-matching algorithm for large-scale low-frequency floating car data. Int. J. Geogr. Inf. Sci. 28(1), 22–38 (2014)CrossRef
14.
Zurück zum Zitat Tiwari, V.S., Arya, A., & Chaturvedi, S.: Framework for horizontal scaling of map matching: using map-reduce. In Information Technology (ICIT), 2014 International Conference on IEEE, pp. 30–34, (2014) Tiwari, V.S., Arya, A., & Chaturvedi, S.: Framework for horizontal scaling of map matching: using map-reduce. In Information Technology (ICIT), 2014 International Conference on IEEE, pp. 30–34, (2014)
15.
Zurück zum Zitat Huang, J., Qie, J., Liu, C., Li, S., Weng, J., Lv, W.: Cloud computing-based map-matching for transportation data center. Electron. Commer. Res. Applications 14(6), 431–443 (2015)CrossRef Huang, J., Qie, J., Liu, C., Li, S., Weng, J., Lv, W.: Cloud computing-based map-matching for transportation data center. Electron. Commer. Res. Applications 14(6), 431–443 (2015)CrossRef
16.
Zurück zum Zitat Huang, J., Liu, C., & Qie, J.: Developing map matching algorithm for transportation data center. In P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC), 2014 Ninth International Conference on IEEE, pp. 167–170 (2014) Huang, J., Liu, C., & Qie, J.: Developing map matching algorithm for transportation data center. In P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC), 2014 Ninth International Conference on IEEE, pp. 167–170 (2014)
17.
Zurück zum Zitat Huang, J., Qiao, S., Yu, H., Qie, J., & Liu, C.: Parallel map matching on massive vehicle gps data using mapreduce. In High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing (HPCC_EUC), 2013 IEEE 10th International Conference on IEEE, pp. 1498–1503 (2013) Huang, J., Qiao, S., Yu, H., Qie, J., & Liu, C.: Parallel map matching on massive vehicle gps data using mapreduce. In High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing (HPCC_EUC), 2013 IEEE 10th International Conference on IEEE, pp. 1498–1503 (2013)
18.
Zurück zum Zitat Almeida, A.M., Lima, M.I., Macedo, J.A., & Machado, J.C.: DMM A distributed map-matching algorithm using the mapreduce paradigm. In Intelligent Transportation Systems (ITSC), 2016 IEEE 19th International Conference on IEEE, pp. 1706–1711 (2016) Almeida, A.M., Lima, M.I., Macedo, J.A., & Machado, J.C.: DMM A distributed map-matching algorithm using the mapreduce paradigm. In Intelligent Transportation Systems (ITSC), 2016 IEEE 19th International Conference on IEEE, pp. 1706–1711 (2016)
19.
Zurück zum Zitat Tiwari, V.S., Arya, A., & Chaturvedi, S.: Framework for horizontal scaling of map matching: using map-reduce. In Information Technology (ICIT), 2014 International Conference on IEEE, pp. 30–34, (2014) Tiwari, V.S., Arya, A., & Chaturvedi, S.: Framework for horizontal scaling of map matching: using map-reduce. In Information Technology (ICIT), 2014 International Conference on IEEE, pp. 30–34, (2014)
20.
Zurück zum Zitat Mattheis, S., Al-Zahid, K.K., Engelmann, B., Hildisch, A., Holder, S., Lazarevych, O., & Zinck, R. (2014). Putting the car on the map: a scalable map matching system for the Open Source Community. In GI-Jahrestagung, pp. 2109–2119 Mattheis, S., Al-Zahid, K.K., Engelmann, B., Hildisch, A., Holder, S., Lazarevych, O., & Zinck, R. (2014). Putting the car on the map: a scalable map matching system for the Open Source Community. In GI-Jahrestagung, pp. 2109–2119
21.
Zurück zum Zitat Zhang, N., Zheng, G., Chen, H., Chen, J., & Chen, X.: HBaseSpatial: a scalable spatial data storage based on HBase. In Trust, Security and Privacy in Computing and Communications (TrustCom), 2014 IEEE 13th International Conference on IEEE, pp. 644–651 (2014) Zhang, N., Zheng, G., Chen, H., Chen, J., & Chen, X.: HBaseSpatial: a scalable spatial data storage based on HBase. In Trust, Security and Privacy in Computing and Communications (TrustCom), 2014 IEEE 13th International Conference on IEEE, pp. 644–651 (2014)
22.
Zurück zum Zitat George, L.: HBase: The Definitive Guide. O’Reilly Media, Inc, Sebastopol (2011) George, L.: HBase: The Definitive Guide. O’Reilly Media, Inc, Sebastopol (2011)
23.
Zurück zum Zitat Le Hong Van, B., & Takasu, A.: An efficient distributed index for geospatial databases. In Database and expert systems applications: 26th International Conference, DEXA 2015, Valencia, Spain, September 1–4, 2015, Proceedings, Vol. 9261, p. 28. Springer (2015) Le Hong Van, B., & Takasu, A.: An efficient distributed index for geospatial databases. In Database and expert systems applications: 26th International Conference, DEXA 2015, Valencia, Spain, September 1–4, 2015, Proceedings, Vol. 9261, p. 28. Springer (2015)
24.
Zurück zum Zitat Rodríguez-Mazahua, L., Rodríguez-Enríquez, C.A., Sánchez-Cervantes, J.L., Cervantes, J., García-Alcaraz, J.L., & Alor-Hernández, G.: A general perspective of big data: applications, tools, challenges and trends. J. Supercomput. 1–41 (2015) Rodríguez-Mazahua, L., Rodríguez-Enríquez, C.A., Sánchez-Cervantes, J.L., Cervantes, J., García-Alcaraz, J.L., & Alor-Hernández, G.: A general perspective of big data: applications, tools, challenges and trends. J. Supercomput. 1–41 (2015)
25.
Zurück zum Zitat Park, S.H., Kim, S.M., & Ha, Y.G.: Highway traffic accident prediction using VDS big data analysis. J. Supercomput. 1–17 (2016) Park, S.H., Kim, S.M., & Ha, Y.G.: Highway traffic accident prediction using VDS big data analysis. J. Supercomput. 1–17 (2016)
26.
Zurück zum Zitat Eldawy, A.: Spatialhadoop towards flexible and scalable spatial processing using mapreduce. In Proceedings of the 2014 SIGMOD PhD symposium, pp. 46–50, ACM, (2014) Eldawy, A.: Spatialhadoop towards flexible and scalable spatial processing using mapreduce. In Proceedings of the 2014 SIGMOD PhD symposium, pp. 46–50, ACM, (2014)
27.
Zurück zum Zitat Aji, A., Wang, F., Vo, H., Lee, R., Liu, Q., Zhang, X., Saltz, J.: Hadoop GIS: a high performance spatial data warehousing system over mapreduce. Proc. VLDB Endow. 6(11), 1009–1020 (2013)CrossRef Aji, A., Wang, F., Vo, H., Lee, R., Liu, Q., Zhang, X., Saltz, J.: Hadoop GIS: a high performance spatial data warehousing system over mapreduce. Proc. VLDB Endow. 6(11), 1009–1020 (2013)CrossRef
31.
Zurück zum Zitat Dimiduk, N., Khurana, A., Ryan, M.H., Stack, M.: HBase in Action. Manning, Shelter Island (2013) Dimiduk, N., Khurana, A., Ryan, M.H., Stack, M.: HBase in Action. Manning, Shelter Island (2013)
32.
Zurück zum Zitat Cho, H.G., Yang, P.W., Yoo, K.H., Nam, K.W.: A mapreduce based algorithm for spatial aggregation of microblog data in spatial social analytics. J. KIISE 42(6), 781–790 (2015)CrossRef Cho, H.G., Yang, P.W., Yoo, K.H., Nam, K.W.: A mapreduce based algorithm for spatial aggregation of microblog data in spatial social analytics. J. KIISE 42(6), 781–790 (2015)CrossRef
33.
Zurück zum Zitat Chung, Y., Yoon, H., Choi, K.: Classification of map-matching techniques and a development. J. Korean Soc. Geo-Spatial Inf. Syst. 8(1), 73–84 (2000) Chung, Y., Yoon, H., Choi, K.: Classification of map-matching techniques and a development. J. Korean Soc. Geo-Spatial Inf. Syst. 8(1), 73–84 (2000)
34.
Zurück zum Zitat Espinosa, A., Hernandez, P., Moure, J.C., Protasio, J., Ripoll, A.: Analysis and improvement of map-reduce data distribution in read mapping applications. J. Supercomput. 62(3), 1305–1317 (2012)CrossRef Espinosa, A., Hernandez, P., Moure, J.C., Protasio, J., Ripoll, A.: Analysis and improvement of map-reduce data distribution in read mapping applications. J. Supercomput. 62(3), 1305–1317 (2012)CrossRef
35.
Zurück zum Zitat Chawathe, S.S.: Segment-based map matching. In: Intelligent Vehicles Symposium, 2007 IEEE, pp. 1190–1197 (2007) Chawathe, S.S.: Segment-based map matching. In: Intelligent Vehicles Symposium, 2007 IEEE, pp. 1190–1197 (2007)
Metadaten
Titel
A basis of spatial big data analysis with map-matching system
verfasst von
Wonhee Cho
Eunmi Choi
Publikationsdatum
17.07.2017
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 3/2017
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-017-1014-1

Weitere Artikel der Ausgabe 3/2017

Cluster Computing 3/2017 Zur Ausgabe