Skip to main content
Top
Published in: GeoInformatica 3/2023

03-09-2022

GeoImageNet: a multi-source natural feature benchmark dataset for GeoAI and supervised machine learning

Authors: Wenwen Li, Sizhe Wang, Samantha T. Arundel, Chia-Yu Hsu

Published in: GeoInformatica | Issue 3/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The field of GeoAI or Geospatial Artificial Intelligence has undergone rapid development since 2017. It has been widely applied to address environmental and social science problems, from understanding climate change to tracking the spread of infectious disease. A foundational task in advancing GeoAI research is the creation of open, benchmark datasets to train and evaluate the performance of GeoAI models. While a number of datasets have been published, very few have centered on the natural terrain and its landforms. To bridge this gulf, this paper introduces a first-of-its-kind benchmark dataset, GeoImageNet, which supports natural feature detection in a supervised machine-learning paradigm. A distinctive feature of this dataset is the fusion of multi-source data, including both remote sensing imagery and DEM in depicting spatial objects of interest. This multi-source dataset allows a GeoAI model to extract rich spatio-contextual information to gain stronger confidence in high-precision object detection and recognition. The image dataset is tested with a multi-source GeoAI extension against two well-known object detection models, Faster-RCNN and RetinaNet. The results demonstrate the robustness of the dataset in aiding GeoAI models to achieve convergence and the superiority of multi-source data in yielding much higher prediction accuracy than the commonly used single data source.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Li K, Wan G, Cheng G, Meng L, Han J (2020) Object detection in optical remote sensing images: A survey and a new benchmark. ISPRS J Photogramm Remote Sens 159:296–307CrossRef Li K, Wan G, Cheng G, Meng L, Han J (2020) Object detection in optical remote sensing images: A survey and a new benchmark. ISPRS J Photogramm Remote Sens 159:296–307CrossRef
2.
go back to reference Li W, Batty M, Goodchild MF (2020) Real-time GIS for smart cities. Int J Geogr Inf Sci 34(2):311–324CrossRef Li W, Batty M, Goodchild MF (2020) Real-time GIS for smart cities. Int J Geogr Inf Sci 34(2):311–324CrossRef
3.
go back to reference Li W, Arundel ST (2022) GeoAI and the future of spatial analytics. New thinking in GIScience. Springer, Singapore, pp 151–158CrossRef Li W, Arundel ST (2022) GeoAI and the future of spatial analytics. New thinking in GIScience. Springer, Singapore, pp 151–158CrossRef
4.
go back to reference Gahegan M (2020) Fourth paradigm GIScience? Prospects for automated discovery and explanation from data. Int J Geogr Inf Sci 34(1):1–21CrossRef Gahegan M (2020) Fourth paradigm GIScience? Prospects for automated discovery and explanation from data. Int J Geogr Inf Sci 34(1):1–21CrossRef
5.
go back to reference Li W (2020) GeoAI: Where machine learning and big data converge in GIScience. J Spat Inf Sci 2020(20):71–77 Li W (2020) GeoAI: Where machine learning and big data converge in GIScience. J Spat Inf Sci 2020(20):71–77
6.
go back to reference Zhang C, Sargent I, Pan X, Li H, Gardiner A, Hare J, Atkinson PM (2019) Joint Deep Learning for land cover and land use classification. Remote Sens Environ 221:173–187CrossRef Zhang C, Sargent I, Pan X, Li H, Gardiner A, Hare J, Atkinson PM (2019) Joint Deep Learning for land cover and land use classification. Remote Sens Environ 221:173–187CrossRef
7.
go back to reference Demertzis K, Iliadis L, Pimenidis E (2021) Geo-AI to aid disaster response by memory-augmented deep reservoir computing. Integr Comput Aided Eng 28(4):383–398CrossRef Demertzis K, Iliadis L, Pimenidis E (2021) Geo-AI to aid disaster response by memory-augmented deep reservoir computing. Integr Comput Aided Eng 28(4):383–398CrossRef
8.
go back to reference Li W, Zhou B, Hsu CY, Li Y, Ren F (2017) Recognizing terrain features on terrestrial surface using a deep learning model: An example with crater detection. In: Proceedings of the 1st Workshop on Artificial Intelligence and Deep Learning for Geographic Knowledge Discovery, pp 33–36 Li W, Zhou B, Hsu CY, Li Y, Ren F (2017) Recognizing terrain features on terrestrial surface using a deep learning model: An example with crater detection. In: Proceedings of the 1st Workshop on Artificial Intelligence and Deep Learning for Geographic Knowledge Discovery, pp 33–36
9.
go back to reference Zhao B, Feng J, Wu X, Yan S (2017) A survey on deep learning-based fine-grained object classification and semantic segmentation. Int J Autom Comput 14(2):119–135CrossRef Zhao B, Feng J, Wu X, Yan S (2017) A survey on deep learning-based fine-grained object classification and semantic segmentation. Int J Autom Comput 14(2):119–135CrossRef
11.
go back to reference Li W, Hsu CY (2020) Automated terrain feature identification from remote sensing imagery: A deep learning approach. Int J Geogr Inf Sci 34(4):637–660CrossRef Li W, Hsu CY (2020) Automated terrain feature identification from remote sensing imagery: A deep learning approach. Int J Geogr Inf Sci 34(4):637–660CrossRef
12.
go back to reference Hsu CY, Li W (2021) Learning from counting: Leveraging temporal classification for weakly supervised object localization and detection. arXiv preprint arXiv:2103.04009 Hsu CY, Li W (2021) Learning from counting: Leveraging temporal classification for weakly supervised object localization and detection. arXiv preprint arXiv:2103.04009
13.
go back to reference Yang Y, Newsam S (2010) Bag -of-visual-words and spatial extensions for land-use classification. In: Proc ACM SIGSPATIAL Int Conf Adv Geogr Inform Syst, pp 270–279 Yang Y, Newsam S (2010) Bag -of-visual-words and spatial extensions for land-use classification. In: Proc ACM SIGSPATIAL Int Conf Adv Geogr Inform Syst, pp 270–279
14.
go back to reference Sheng G, Yang W, Xu T, Sun H (2012) High-resolution satellite scene classification using a sparse coding based multiple feature combination. Int J Remote Sens 33(8):2395–2412CrossRef Sheng G, Yang W, Xu T, Sun H (2012) High-resolution satellite scene classification using a sparse coding based multiple feature combination. Int J Remote Sens 33(8):2395–2412CrossRef
15.
go back to reference Cheng G, Han J, Lu X (2017) Remote sensing image scene classification: Benchmark and state of the art. Proc IEEE 105(10):1865–1883CrossRef Cheng G, Han J, Lu X (2017) Remote sensing image scene classification: Benchmark and state of the art. Proc IEEE 105(10):1865–1883CrossRef
16.
go back to reference Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, …, Fei-Fei L (2015) Imagenet large scale visual recognition challenge. Int J Comput Vision 115(3):211–252 Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, …, Fei-Fei L (2015) Imagenet large scale visual recognition challenge. Int J Comput Vision 115(3):211–252
17.
go back to reference Everingham M, Van Gool L, Williams CK, Winn J, Zisserman A (2010) The pascal visual object classes (voc) challenge. Int J Comput Vision 88(2):303–338CrossRef Everingham M, Van Gool L, Williams CK, Winn J, Zisserman A (2010) The pascal visual object classes (voc) challenge. Int J Comput Vision 88(2):303–338CrossRef
18.
go back to reference Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D, ..., Zitnick CL (2014) Microsoft coco: Common objects in context. In: European conference on computer vision. Springer, Cham, pp 740–755 Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D, ..., Zitnick CL (2014) Microsoft coco: Common objects in context. In: European conference on computer vision. Springer, Cham, pp 740–755
19.
go back to reference Razakarivony S, Jurie F (2015) Vehicle detection in aerial imagery: A small target detection benchmark. J Vis Commun Image Represent 34:187–203CrossRef Razakarivony S, Jurie F (2015) Vehicle detection in aerial imagery: A small target detection benchmark. J Vis Commun Image Represent 34:187–203CrossRef
20.
go back to reference Liu K, Mattyus G (2015) Fast multiclass vehicle detection on aerial images. IEEE Geosci Remote Sens Lett 12(9):1938–1942CrossRef Liu K, Mattyus G (2015) Fast multiclass vehicle detection on aerial images. IEEE Geosci Remote Sens Lett 12(9):1938–1942CrossRef
21.
go back to reference Xia GS, Bai X, Ding J, Zhu Z, Belongie S, Luo J, Datcu M, Pelillo M, Zhang L (2018) DOTA: A large-scale dataset for object detection in aerial images. In: Proc IEEE Int Conf Comput Vision Pattern Recognit, pp 3974–3983 Xia GS, Bai X, Ding J, Zhu Z, Belongie S, Luo J, Datcu M, Pelillo M, Zhang L (2018) DOTA: A large-scale dataset for object detection in aerial images. In: Proc IEEE Int Conf Comput Vision Pattern Recognit, pp 3974–3983
22.
go back to reference Arundel ST, Li W, Wang S (2020) GeoNat v1. 0: A dataset for natural feature mapping with artificial intelligence and supervised learning. Transactions in GIS 24(3):556–572 Arundel ST, Li W, Wang S (2020) GeoNat v1. 0: A dataset for natural feature mapping with artificial intelligence and supervised learning. Transactions in GIS 24(3):556–572
23.
go back to reference Goodchild MF, Guo H, Annoni A, Bian L, De Bie K, Campbell F, …, Woodgate P (2012) Next-generation digital earth. Proc Natl Acad Sci 109(28):11088–11094 Goodchild MF, Guo H, Annoni A, Bian L, De Bie K, Campbell F, …, Woodgate P (2012) Next-generation digital earth. Proc Natl Acad Sci 109(28):11088–11094
24.
go back to reference Li W, Li L, Goodchild MF, Anselin L (2013) A geospatial cyberinfrastructure for urban economic analysis and spatial decision-making. ISPRS Int J Geo Inf 2(2):413–431CrossRef Li W, Li L, Goodchild MF, Anselin L (2013) A geospatial cyberinfrastructure for urban economic analysis and spatial decision-making. ISPRS Int J Geo Inf 2(2):413–431CrossRef
25.
go back to reference Tobler WR (1970) A computer movie simulating urban growth in the Detroit region. Econ Geogr 46(sup1):234–240CrossRef Tobler WR (1970) A computer movie simulating urban growth in the Detroit region. Econ Geogr 46(sup1):234–240CrossRef
27.
go back to reference Azulay A, Weiss Y (2019) Why do deep convolutional networks generalize so poorly to small image transformations? J Mach Learn Res 20:1–25MathSciNetMATH Azulay A, Weiss Y (2019) Why do deep convolutional networks generalize so poorly to small image transformations? J Mach Learn Res 20:1–25MathSciNetMATH
28.
go back to reference Goodchild MF, Li W (2021) Replication across space and time must be weak in the social and environmental sciences. Proc Natl Acad Sci 118(35):e2015759118CrossRef Goodchild MF, Li W (2021) Replication across space and time must be weak in the social and environmental sciences. Proc Natl Acad Sci 118(35):e2015759118CrossRef
29.
go back to reference Hsu CY, Li W, Wang S (2021) Knowledge-driven GeoAI: integrating spatial knowledge into multi-scale deep learning for Mars Crater detection. Remote Sens 13(11):2116CrossRef Hsu CY, Li W, Wang S (2021) Knowledge-driven GeoAI: integrating spatial knowledge into multi-scale deep learning for Mars Crater detection. Remote Sens 13(11):2116CrossRef
30.
go back to reference Wang S, Li W (2021) GeoAI in terrain analysis: enabling multi-source deep learning and data fusion for natural feature detection. Comput Environ Urban Syst 90:101715CrossRef Wang S, Li W (2021) GeoAI in terrain analysis: enabling multi-source deep learning and data fusion for natural feature detection. Comput Environ Urban Syst 90:101715CrossRef
31.
go back to reference Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: Towards real-time object detection with region proposal networks. In: Advances in neural information processing systems, pp 91–99 Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: Towards real-time object detection with region proposal networks. In: Advances in neural information processing systems, pp 91–99
32.
go back to reference Lin TY, Goyal P, Girshick R, He K, Dollár P (2017) Focal loss for dense object detection. In: Proceedings of the IEEE international conference on computer vision, pp 2980–2988 Lin TY, Goyal P, Girshick R, He K, Dollár P (2017) Focal loss for dense object detection. In: Proceedings of the IEEE international conference on computer vision, pp 2980–2988
33.
go back to reference Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: Unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788 Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: Unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788
34.
go back to reference Hu Y, Gao S, Lunga D, Li W, Newsam S, Bhaduri B (2019) GeoAI at ACM SIGSPATIAL: progress, challenges, and future directions. SIGSPATIAL Special 11(2):5–15CrossRef Hu Y, Gao S, Lunga D, Li W, Newsam S, Bhaduri B (2019) GeoAI at ACM SIGSPATIAL: progress, challenges, and future directions. SIGSPATIAL Special 11(2):5–15CrossRef
35.
go back to reference Wang M, Deng W (2018) Deep visual domain adaptation: A survey. Neurocomputing 312:135–153CrossRef Wang M, Deng W (2018) Deep visual domain adaptation: A survey. Neurocomputing 312:135–153CrossRef
37.
go back to reference Tong K, Wu Y, Zhou F (2020) Recent advances in small object detection based on deep learning: A review. Image Vis Comput 97:103910CrossRef Tong K, Wu Y, Zhou F (2020) Recent advances in small object detection based on deep learning: A review. Image Vis Comput 97:103910CrossRef
Metadata
Title
GeoImageNet: a multi-source natural feature benchmark dataset for GeoAI and supervised machine learning
Authors
Wenwen Li
Sizhe Wang
Samantha T. Arundel
Chia-Yu Hsu
Publication date
03-09-2022
Publisher
Springer US
Published in
GeoInformatica / Issue 3/2023
Print ISSN: 1384-6175
Electronic ISSN: 1573-7624
DOI
https://doi.org/10.1007/s10707-022-00476-z

Other articles of this Issue 3/2023

GeoInformatica 3/2023 Go to the issue