Skip to main content
Erschienen in: Journal of Computer and Systems Sciences International 5/2020

01.09.2020 | ARTIFICIAL INTELLIGENCE

Deep Neural Networks for Determining the Parameters of Buildings from Single-Shot Satellite Imagery

verfasst von: A. N. Trekin, V. Yu. Ignatiev, P. Ya. Yakubovskii

Erschienen in: Journal of Computer and Systems Sciences International | Ausgabe 5/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The height of a building is a basic characteristic needed for analytical services. It can be used to evaluate the population and functional zoning of a region. The analysis of the height structure of urban territories can be useful for understanding the population dynamics. In this paper, a novel method for determining a building’s height from a single-shot Earth remote sensing oblique image is proposed. The height is evaluated by a simulation algorithm that uses the masks of shadows and the visible parts of the walls. The image is segmented using convolutional neural networks that makes it possible to extract the masks of roofs, shadows, and building walls. The segmentation models are integrated into a completely automatic system for mapping buildings and evaluating their heights. The test dataset containing a labeled set of various buildings is described. The proposed method is tested on this dataset, and it demonstrates the mean absolute error of less than 4 meters.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat R. B. Irvin and D. M. McKeown, “Methods for exploiting the relationship between buildings and their shadows in aerial imagery,” IEEE Trans. Syst. Man Cybern. 19, 1564–1575 (1989).CrossRef R. B. Irvin and D. M. McKeown, “Methods for exploiting the relationship between buildings and their shadows in aerial imagery,” IEEE Trans. Syst. Man Cybern. 19, 1564–1575 (1989).CrossRef
2.
Zurück zum Zitat A. Ahmad and L. Rabiu, “Generation of three dimensional model of building using photogrammetric technique,” in Proceedings of the IEEE 7th International Colloquium on Signal Processing and its Applications, Penang, Malaysia (IEEE, 2011), pp. 225–231. https://doi.org/10.1109/cspa.2011.5759877 A. Ahmad and L. Rabiu, “Generation of three dimensional model of building using photogrammetric technique,” in Proceedings of the IEEE 7th International Colloquium on Signal Processing and its Applications, Penang, Malaysia (IEEE, 2011), pp. 225–231. https://​doi.​org/​10.​1109/​cspa.​2011.​5759877
8.
Zurück zum Zitat L. Mou and X. X. Zhu, “IM2HEIGHT: Height estimation from single monocular imagery via fully residual convolutional-deconvolutional network,” arXiv: 1802.10249. L. Mou and X. X. Zhu, “IM2HEIGHT: Height estimation from single monocular imagery via fully residual convolutional-deconvolutional network,” arXiv: 1802.10249.
9.
Zurück zum Zitat G. G. Sebryakov, V. N. Soshnikov, I. S. Kikin, and A. A. Ishutin, “Algorithm for automatic recognition of ground objects in optoelectric images, based on evaluation of feature covariance matrices built for image gradient functions,” Vestn. Komp’yut. Inform. Tekhnol. 109 (7), 14–19 (2013). G. G. Sebryakov, V. N. Soshnikov, I. S. Kikin, and A. A. Ishutin, “Algorithm for automatic recognition of ground objects in optoelectric images, based on evaluation of feature covariance matrices built for image gradient functions,” Vestn. Komp’yut. Inform. Tekhnol. 109 (7), 14–19 (2013).
10.
Zurück zum Zitat Yu. V. Vizil’ter and S. Yu. Zheltov, “The use of projective morphologies for object detection and identification in images,” J. Comput. Syst. Sci. Int. 48, 282 (2009).MathSciNetCrossRef Yu. V. Vizil’ter and S. Yu. Zheltov, “The use of projective morphologies for object detection and identification in images,” J. Comput. Syst. Sci. Int. 48, 282 (2009).MathSciNetCrossRef
12.
Zurück zum Zitat V. Ignatiev, A. Trekin, V. Lobachev, et al., “Targeted change detection in remote sensing images,” in Proceedings of the SPIE 11th International Conference on Machine Vision ICMV 2018, Germany, Munich, 2018, Proc. SPIE 11041 (2019). https://doi.org/10.1117/12.2523141 V. Ignatiev, A. Trekin, V. Lobachev, et al., “Targeted change detection in remote sensing images,” in Proceedings of the SPIE 11th International Conference on Machine Vision ICMV 2018, Germany, Munich, 2018, Proc. SPIE 11041 (2019). https://​doi.​org/​10.​1117/​12.​2523141
13.
Zurück zum Zitat E. A. Van, D. Lindenbaum, and T. M. Bacastow, “Spacenet: A remote sensing dataset and challenge series,” arXiv:1807.01232. E. A. Van, D. Lindenbaum, and T. M. Bacastow, “Spacenet: A remote sensing dataset and challenge series,” arXiv:1807.01232.
14.
Zurück zum Zitat Kaggle Inc., DSTL Satellite Imagery Feature Detection Challenge. www.kaggle.com/c/dstl-satellite-imagery-feature-detection/. Kaggle Inc., DSTL Satellite Imagery Feature Detection Challenge. www.kaggle.com/c/dstl-satellite-imagery-feature-detection/.
15.
Zurück zum Zitat F. Rottensteiner, G. Sohn, M. Gerke, et al., ISPRS Semantic Labeling Contest. http://www2.isprs.org/commissions/comm3/wg4/semantic-labeling.html. F. Rottensteiner, G. Sohn, M. Gerke, et al., ISPRS Semantic Labeling Contest. http://www2.isprs.org/commissions/comm3/wg4/semantic-labeling.html.
16.
Zurück zum Zitat E. Maggiori, Y. Tarabalka, G. Charpiat, et al., “Can semantic labeling methods generalize to any city? The inria aerial image labeling benchmark,” in Proceedings of the IEEE International Geoscience and Remote Sensing Symposium IGARSS, Fort Worth, Texas,2017 (IEEE, 2017), pp. 3226–3229. https://doi.org/10.1007/978-3-319-24574-4 E. Maggiori, Y. Tarabalka, G. Charpiat, et al., “Can semantic labeling methods generalize to any city? The inria aerial image labeling benchmark,” in Proceedings of the IEEE International Geoscience and Remote Sensing Symposium IGARSS, Fort Worth, Texas,2017 (IEEE, 2017), pp. 3226–3229. https://​doi.​org/​10.​1007/​978-3-319-24574-4
17.
Zurück zum Zitat OpenStreetMap Contributors, Planet Dump. https://planet.osm.org. https://planet.openstreetmap.org/. OpenStreetMap Contributors, Planet Dump. https://​planet.​osm.​org.​ https://planet.openstreetmap.org/.
18.
Zurück zum Zitat State Corporation – Housing and Utilities Reform Support Fund, Open Data. Housing Reform. www.reformagkh.ru/opendata. State Corporation – Housing and Utilities Reform Support Fund, Open Data. Housing Reform. www.reformagkh.ru/opendata.
19.
Zurück zum Zitat Aeronetlab, Skoltech Open Dataset for Building Height Estimation. https://github.com/aeronetlab/open-datasets. Aeronetlab, Skoltech Open Dataset for Building Height Estimation. https://​github.​com/​aeronetlab/​open-datasets.​
21.
Zurück zum Zitat O. Ronneberger, Ph. Fischer, and Th. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in Proceedings of the 2015 International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany (Springer, 2015), pp. 234–241. https://doi.org/10.1007/978-3-319-24574-4_28 O. Ronneberger, Ph. Fischer, and Th. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in Proceedings of the 2015 International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany (Springer, 2015), pp. 234–241. https://​doi.​org/​10.​1007/​978-3-319-24574-4_​28
22.
Zurück zum Zitat G. Huang, Z. Liu, and M. van der Maaten, “Densely connected convolutional networks,” in Proceedings of the 2017 IEEE International Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA (IEEE, 2017), pp. 4700–4708. https://doi.org/10.1109/cvpr.2017.243 G. Huang, Z. Liu, and M. van der Maaten, “Densely connected convolutional networks,” in Proceedings of the 2017 IEEE International Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA (IEEE, 2017), pp. 4700–4708. https://​doi.​org/​10.​1109/​cvpr.​2017.​243
23.
Zurück zum Zitat C. Szegedy, V. Vanhoucke, and S. Ioffe, “Rethinking the inception architecture for computer vision,” in Proceedings of the 2016 International Conference on Computer Vision and Pattern Recognition, Las Vegas, NV (IEEE, 2016), pp. 2818–2826. https://doi.org/10.1109/cvpr.2016.308 C. Szegedy, V. Vanhoucke, and S. Ioffe, “Rethinking the inception architecture for computer vision,” in Proceedings of the 2016 International Conference on Computer Vision and Pattern Recognition, Las Vegas, NV (IEEE, 2016), pp. 2818–2826. https://​doi.​org/​10.​1109/​cvpr.​2016.​308
24.
Zurück zum Zitat C. Szegedy, S. Ioffe, and V. Vanhoucke, “Inception-V4, inception-resnet and the impact of residual connections on learning,” in Proceedings of the 2017 AAAI International Conference on Artificial Intelligence, San Francisco, CA (AAAI Press, 2017), pp. 2818–2826. https://doi.org/10.1109/cvpr.2016.308 C. Szegedy, S. Ioffe, and V. Vanhoucke, “Inception-V4, inception-resnet and the impact of residual connections on learning,” in Proceedings of the 2017 AAAI International Conference on Artificial Intelligence, San Francisco, CA (AAAI Press, 2017), pp. 2818–2826. https://​doi.​org/​10.​1109/​cvpr.​2016.​308
25.
Zurück zum Zitat K. He, X. Zhang, Sh. Ren, et al., “Deep residual learning for image recognition,” in Proceedings of the 2016 International Conference on Computer Vision and Pattern Recognition, Las Vegas, NV (IEEE, 2016), pp. 770–778. https://doi.org/10.1109/cvpr.2016.90 K. He, X. Zhang, Sh. Ren, et al., “Deep residual learning for image recognition,” in Proceedings of the 2016 International Conference on Computer Vision and Pattern Recognition, Las Vegas, NV (IEEE, 2016), pp. 770–778. https://​doi.​org/​10.​1109/​cvpr.​2016.​90
26.
27.
Zurück zum Zitat V. Iglovikov and A. Shvets, “Ternausnet: U-net with VGG11 encoder pre-trained on imagenet for image segmentation,” arXiv:1801.05746. V. Iglovikov and A. Shvets, “Ternausnet: U-net with VGG11 encoder pre-trained on imagenet for image segmentation,” arXiv:1801.05746.
29.
Zurück zum Zitat N. Weir, D. Lindenbaum, and A. Bastidas, “SpaceNet MVOI: A multi-view overhead imagery dataset,” arXiv:1903.12239. N. Weir, D. Lindenbaum, and A. Bastidas, “SpaceNet MVOI: A multi-view overhead imagery dataset,” arXiv:1903.12239.
30.
Zurück zum Zitat F. Chollet, Keras. https://keras.io. F. Chollet, Keras. https://​keras.​io.​
31.
Zurück zum Zitat D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv:1412.6980. D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv:1412.6980.
Metadaten
Titel
Deep Neural Networks for Determining the Parameters of Buildings from Single-Shot Satellite Imagery
verfasst von
A. N. Trekin
V. Yu. Ignatiev
P. Ya. Yakubovskii
Publikationsdatum
01.09.2020
Verlag
Pleiades Publishing
Erschienen in
Journal of Computer and Systems Sciences International / Ausgabe 5/2020
Print ISSN: 1064-2307
Elektronische ISSN: 1555-6530
DOI
https://doi.org/10.1134/S106423072005007X

Weitere Artikel der Ausgabe 5/2020

Journal of Computer and Systems Sciences International 5/2020 Zur Ausgabe