Skip to main content
Erschienen in: Journal of Computer and Systems Sciences International 3/2023

01.10.2023 | ARTIFICIAL INTELLIGENCE

Retrieving Structural Information on Anthropogenic Objects from Single Aerospace Images

verfasst von: N. V. Antipova, O. G. Gvozdev, V. A. Kozub, A. B. Murynin, A. A. Richter

Erschienen in: Journal of Computer and Systems Sciences International | Ausgabe 3/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A method for the three-dimensional reconstruction of buildings from a single aerospace image, which consists of two stages—the extraction of semantic information and the restoration of the geometry—is described. The topology of artificial neural networks by the semantic segmentation of building components and reference objects is considered. In the second stage, some mathematical transformations are presented: by calculating the photometric parameters of an image based on metadata or reference objects, by converting spatial coordinates into axial and flat image coordinates, etc. Two examples are shown for calculating photometric parameters and a three-dimensional building model from a single satellite image and an aerial photograph.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat F. Biljecki, J. Stoter, H. Ledoux, S. Zlatanova, and A. Cöltekin, “Applications of 3D city models: State of the art review,” ISPRS Int. J. Geo-Inf. 4 (4), 2842–2889 (2015).CrossRef F. Biljecki, J. Stoter, H. Ledoux, S. Zlatanova, and A. Cöltekin, “Applications of 3D city models: State of the art review,” ISPRS Int. J. Geo-Inf. 4 (4), 2842–2889 (2015).CrossRef
2.
Zurück zum Zitat L. Tang, L. Li, S. Ying, and Y. Lei, “A full level-of-detail specification for 3D building models combining indoor and outdoor scenes,” ISPRS Int. J. Geo-Inf. 7 (11), 419 (2018).CrossRef L. Tang, L. Li, S. Ying, and Y. Lei, “A full level-of-detail specification for 3D building models combining indoor and outdoor scenes,” ISPRS Int. J. Geo-Inf. 7 (11), 419 (2018).CrossRef
3.
Zurück zum Zitat D. Yu, S. Ji, J. Liu, and S. Wei, “Automatic 3D building reconstruction from multi-view aerial images with deep learning,” ISPRS J. Photogramm. Remote Sens. 171, 155–170 (2021).CrossRef D. Yu, S. Ji, J. Liu, and S. Wei, “Automatic 3D building reconstruction from multi-view aerial images with deep learning,” ISPRS J. Photogramm. Remote Sens. 171, 155–170 (2021).CrossRef
4.
Zurück zum Zitat M. J. Leotta, C. Long, B. Jacquet, M. Zins, D. Lipsa, J. Shan, B. Xu, Z. Li, X. Zhang, S. F. Chang, et al., “Urban semantic 3D reconstruction from multiview satellite imagery,” in IEEE/CVF Conf. on Computer Vision and Pattern Recognition Workshops (CVPRW), California (2019), pp. 1451–1460. M. J. Leotta, C. Long, B. Jacquet, M. Zins, D. Lipsa, J. Shan, B. Xu, Z. Li, X. Zhang, S. F. Chang, et al., “Urban semantic 3D reconstruction from multiview satellite imagery,” in IEEE/CVF Conf. on Computer Vision and Pattern Recognition Workshops (CVPRW), California (2019), pp. 1451–1460.
5.
Zurück zum Zitat Y. Anzhu, G. Wenyue, L. Bing, C. Xin, W. Xin, C. Xuefeng, and J. Bingchuan, “Attention aware cost volume pyramid based multi-view stereo network for 3D reconstruction,” ISPRS J. Photogramm. Remote Sens. 175, 448–460 (2021).CrossRef Y. Anzhu, G. Wenyue, L. Bing, C. Xin, W. Xin, C. Xuefeng, and J. Bingchuan, “Attention aware cost volume pyramid based multi-view stereo network for 3D reconstruction,” ISPRS J. Photogramm. Remote Sens. 175, 448–460 (2021).CrossRef
6.
Zurück zum Zitat C. Yi, Y. Zhang, Q. Wu, Y. Xu, O. Remil, M. Wei, and J. Wang, “Urban building reconstruction from raw LiDAR point data,” Comput.-Aided Des. 93, 1–14 (2017).CrossRef C. Yi, Y. Zhang, Q. Wu, Y. Xu, O. Remil, M. Wei, and J. Wang, “Urban building reconstruction from raw LiDAR point data,” Comput.-Aided Des. 93, 1–14 (2017).CrossRef
7.
Zurück zum Zitat Reconstructing 3D Buildings from Aerial LiDAR with Deep Learning. 2020. https://developers.arcgis.com/python/samples/building-reconstruction-using-mask-rcnn/. Reconstructing 3D Buildings from Aerial LiDAR with Deep Learning. 2020. https://​developers.​arcgis.​com/​python/​samples/​building-reconstruction-using-mask-rcnn/​.​
8.
Zurück zum Zitat R. Wang, J. Peethambaran, and D. Chen, “LiDAR point clouds to 3-D urban models: A review,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 11 (2), 606–627 (2018).CrossRef R. Wang, J. Peethambaran, and D. Chen, “LiDAR point clouds to 3-D urban models: A review,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 11 (2), 606–627 (2018).CrossRef
9.
Zurück zum Zitat K. Karantzalos and N. Paragios, “Automatic model-based building detection from single panchromatic high resolution images,” Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. 37 (3Ba), 127–132 (2008). K. Karantzalos and N. Paragios, “Automatic model-based building detection from single panchromatic high resolution images,” Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. 37 (3Ba), 127–132 (2008).
10.
Zurück zum Zitat K. Wang and J. M. Frahm, “Single view parametric building reconstruction from satellite imagery,” in International Conf. on 3D Vision (3DV) (Qingdao, 2017), pp. 603–611. K. Wang and J. M. Frahm, “Single view parametric building reconstruction from satellite imagery,” in International Conf. on 3D Vision (3DV) (Qingdao, 2017), pp. 603–611.
11.
Zurück zum Zitat F. Alidoost, H. Arefi, and M. Hahn, “Y-shaped convolutional neural network for 3D roof elements extraction to reconstruct building models from a single aerial image,” ISPRS Ann. Photogramm., Remote Sens. Spatial Inf. Sci. 2, 321–328 (2020). F. Alidoost, H. Arefi, and M. Hahn, “Y-shaped convolutional neural network for 3D roof elements extraction to reconstruct building models from a single aerial image,” ISPRS Ann. Photogramm., Remote Sens. Spatial Inf. Sci. 2, 321–328 (2020).
12.
Zurück zum Zitat F. Biljecki and H. E. Pang, “3D building reconstruction from single street view images using deep learning,” Int. J. Appl. Earth Obs. Geoinf. 112, 102859 (2022). F. Biljecki and H. E. Pang, “3D building reconstruction from single street view images using deep learning,” Int. J. Appl. Earth Obs. Geoinf. 112, 102859 (2022).
13.
Zurück zum Zitat O. G. Gvozdev, V. A. Kozub, A. A. Richter, A. B. Murynin, and N. V. Kosheleva, “Constructing 3D models of rigid objects from satellite images with high spatial resolution using convolutional neural networks,” Izv., Atmos. Ocean. Phys. 56 (12), 1664–1677 (2020).CrossRef O. G. Gvozdev, V. A. Kozub, A. A. Richter, A. B. Murynin, and N. V. Kosheleva, “Constructing 3D models of rigid objects from satellite images with high spatial resolution using convolutional neural networks,” Izv., Atmos. Ocean. Phys. 56 (12), 1664–1677 (2020).CrossRef
14.
Zurück zum Zitat M. Kazaryan, A. Richter, O. Gvozdev, A. Murynin, V. Kozub, D. Pukhovsky, M. Shakhramanyan, and E. Semenishchev, “Reconstruction of 3-D models of infrastructure objects from satellite images based on typed elements,” in Proc. SPIE-Int. Soc. Opt. Eng. 12269, Conf. Remote Sensing Technologies and Applications in Urban Environments VII, 122690 (Edinburgh, 2022). M. Kazaryan, A. Richter, O. Gvozdev, A. Murynin, V. Kozub, D. Pukhovsky, M. Shakhramanyan, and E. Semenishchev, “Reconstruction of 3-D models of infrastructure objects from satellite images based on typed elements,” in Proc. SPIE-Int. Soc. Opt. Eng. 12269, Conf. Remote Sensing Technologies and Applications in Urban Environments VII, 122690 (Edinburgh, 2022).
15.
Zurück zum Zitat A. B. Murynin and A. A. Richter, “Features of methods and algorithms for the reconstruction of the three-dimensional shape of rigid objects according to panoramic survey data,” Mash. Obuchenie Anal. Dannykh 4 (4), 235–247 (2018). A. B. Murynin and A. A. Richter, “Features of methods and algorithms for the reconstruction of the three-dimensional shape of rigid objects according to panoramic survey data,” Mash. Obuchenie Anal. Dannykh 4 (4), 235–247 (2018).
16.
Zurück zum Zitat O. Ronneberger, P. Fischer, and T. Brox, “U-Net: Convolutional networks for biomedical image segmentation,” in Medical Image Computing and Computer-Assisted Intervention (MICCAI, 2015) (Springer, 2015), pp. 234–241. O. Ronneberger, P. Fischer, and T. Brox, “U-Net: Convolutional networks for biomedical image segmentation,” in Medical Image Computing and Computer-Assisted Intervention (MICCAI, 2015) (Springer, 2015), pp. 234–241.
17.
Zurück zum Zitat I. M. Nabil and R. Sohel, “MultiResUNet: Rethinking the U-Net architecture for multimodal biomedical image segmentation,” Neuron Networks 121, 74–87 (2020).CrossRef I. M. Nabil and R. Sohel, “MultiResUNet: Rethinking the U-Net architecture for multimodal biomedical image segmentation,” Neuron Networks 121, 74–87 (2020).CrossRef
18.
Zurück zum Zitat O. G. Gvozdev, K. A. Kasinskaya, A. B. Murynin, and A. A. Richter, “Gathering data on anthropogenic littering of the Earth’s surface from satellite imagery data,” in Abstracts of Presentations of the Second International Conference “Situation, Language, and Speech: Models and Applications” (Moscow–Rome, 2019), pp. 50–51 [in Russian]. O. G. Gvozdev, K. A. Kasinskaya, A. B. Murynin, and A. A. Richter, “Gathering data on anthropogenic littering of the Earth’s surface from satellite imagery data,” in Abstracts of Presentations of the Second International Conference “Situation, Language, and Speech: Models and Applications” (Moscow–Rome, 2019), pp. 50–51 [in Russian].
19.
Zurück zum Zitat O. G. Gvozdev, A. B. Murynin, and A. A. Richter, “A set of applied solutions for building and learning artificial neural networks for the semantic segmentation of aerospace images of an arbitrary channel–spectral structure in shortage of learning data,” in Proceedings of the 19th All-Russian Conference with International Participation: Mathematical Methods of Pattern Recognition (MMPR-2019) (RAN, 2019), pp. 344–348 [in Russian]. O. G. Gvozdev, A. B. Murynin, and A. A. Richter, “A set of applied solutions for building and learning artificial neural networks for the semantic segmentation of aerospace images of an arbitrary channel–spectral structure in shortage of learning data,” in Proceedings of the 19th All-Russian Conference with International Participation: Mathematical Methods of Pattern Recognition (MMPR-2019) (RAN, 2019), pp. 344–348 [in Russian].
20.
Zurück zum Zitat O. Gvozdev, N. Kosheleva, A. Murynin, and A. Richter, “3D-modeling infrastructure facilities using deep learning based on high resolution satellite images,” in 20th Int. Multidisciplinary Scientific GeoConf. (SGEM, Albena, 2020), pp. 149–156. O. Gvozdev, N. Kosheleva, A. Murynin, and A. Richter, “3D-modeling infrastructure facilities using deep learning based on high resolution satellite images,” in 20th Int. Multidisciplinary Scientific GeoConf. (SGEM, Albena, 2020), pp. 149–156.
21.
Zurück zum Zitat O. G. Gvozdev, V. A. Kozub, N. V. Kosheleva, A. B. Murynin, and A. A. Richter, “Neural network method for constructing three-dimensional models of rigid objects from satellite images,” Mekhatron., Avtom., Upr. 22 (1), 48–55 (2021). O. G. Gvozdev, V. A. Kozub, N. V. Kosheleva, A. B. Murynin, and A. A. Richter, “Neural network method for constructing three-dimensional models of rigid objects from satellite images,” Mekhatron., Avtom., Upr. 22 (1), 48–55 (2021).
22.
Zurück zum Zitat A. A. Richter, O. G. Gvozdev, A. B. Murynin, V. A. Kozub, and N. V. Kosheleva, “Restoration of geometric models of railway infrastructure objects from satellite images based on artificial neural networks,” in Proceedings of the 18th All-Russian Open Conference “Modern Problems of Remote Sensing of the Earth from Space (Moscow, 2020), p. 41 [in Russian]. A. A. Richter, O. G. Gvozdev, A. B. Murynin, V. A. Kozub, and N. V. Kosheleva, “Restoration of geometric models of railway infrastructure objects from satellite images based on artificial neural networks,” in Proceedings of the 18th All-Russian Open Conference “Modern Problems of Remote Sensing of the Earth from Space (Moscow, 2020), p. 41 [in Russian].
23.
Zurück zum Zitat O. G. Gvozdev, V. A. Kozub, N. V. Kosheleva, A. B. Murynin, and A. A. Richter, “Constructing 3D models of rigid objects from satellite images with spatial resolution using convolutional neural networks,” Izv., Atmos. Ocean. Phys. 56 (12), 1664–1677 (2020).CrossRef O. G. Gvozdev, V. A. Kozub, N. V. Kosheleva, A. B. Murynin, and A. A. Richter, “Constructing 3D models of rigid objects from satellite images with spatial resolution using convolutional neural networks,” Izv., Atmos. Ocean. Phys. 56 (12), 1664–1677 (2020).CrossRef
Metadaten
Titel
Retrieving Structural Information on Anthropogenic Objects from Single Aerospace Images
verfasst von
N. V. Antipova
O. G. Gvozdev
V. A. Kozub
A. B. Murynin
A. A. Richter
Publikationsdatum
01.10.2023
Verlag
Pleiades Publishing
Erschienen in
Journal of Computer and Systems Sciences International / Ausgabe 3/2023
Print ISSN: 1064-2307
Elektronische ISSN: 1555-6530
DOI
https://doi.org/10.1134/S1064230723030012

Weitere Artikel der Ausgabe 3/2023

Journal of Computer and Systems Sciences International 3/2023 Zur Ausgabe

Premium Partner