Skip to main content
Erschienen in: Neural Processing Letters 1/2020

08.06.2020

A Novel Technique for Segmentation of High Resolution Remote Sensing Images Based on Neural Networks

Erschienen in: Neural Processing Letters | Ausgabe 1/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Remote sensing images have become one of the most important imaging resources recently. Thus, it is important to develop high-performance techniques to process and manipulate these images. On the other hand, image processing techniques are enhanced spatially based on neural networks. Deep learning is one of the most important techniques in use for computer vision tasks and has been deployed successfully to solve many tasks. But when dealing with remote sensing images, the deep learning method faces two main problems: the underfitting problem, because of the small amount of learning data and the unbalanced receptive field problem, because of the structural stereotype of the remote sensing images. In this paper, we propose to use a complex-valued neural network to segment high-resolution remote sensing images. The proposed network can deal with the problems of remote sensing images by using an ensemble of Complex-Valued Auto-Encoder. Based on an adaptive clustering technique, this network can be used to solve the multi-label segmentation problem of remote sensing images. The proposed method achieves state-of-the-art performance when evaluated on the ISPRS 2D dataset.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Xin P, Jian Z (2018) High-resolution remote sensing image classification method based on convolutional neural network and restricted conditional random field. Remote Sens 10:920 Xin P, Jian Z (2018) High-resolution remote sensing image classification method based on convolutional neural network and restricted conditional random field. Remote Sens 10:920
2.
Zurück zum Zitat Lu X, Yuan Y, Zheng X (2017) Joint dictionary learning for multispectral change detection. IEEE Trans Cybern 2:884–897 Lu X, Yuan Y, Zheng X (2017) Joint dictionary learning for multispectral change detection. IEEE Trans Cybern 2:884–897
3.
Zurück zum Zitat Voulodimos A, Doulamis N, Doulamis A (2018) Deep learning for computer vision: a brief review. Comput Intell Neurosci 2018:1–13 Voulodimos A, Doulamis N, Doulamis A (2018) Deep learning for computer vision: a brief review. Comput Intell Neurosci 2018:1–13
4.
Zurück zum Zitat Wang P, Di J (2018) Deep learning-based object classification through multimode fiber via a CNN-architecture SpeckleNet. Appl Opt 57:8258–8263 Wang P, Di J (2018) Deep learning-based object classification through multimode fiber via a CNN-architecture SpeckleNet. Appl Opt 57:8258–8263
5.
Zurück zum Zitat Afif M, Ayachi R, Said Y, Pissaloux E, Atri M (2018) Indoor image recognition and classification via deep convolutional neural network. In: ICSETIT, pp 364–371 Afif M, Ayachi R, Said Y, Pissaloux E, Atri M (2018) Indoor image recognition and classification via deep convolutional neural network. In: ICSETIT, pp 364–371
6.
Zurück zum Zitat Ayachi R, Said Y, Atri M (2019) To perform road signs recognition for autonomous vehicles using cascaded deep learning pipeline. Artif Intell Adv 1:1–10 Ayachi R, Said Y, Atri M (2019) To perform road signs recognition for autonomous vehicles using cascaded deep learning pipeline. Artif Intell Adv 1:1–10
7.
Zurück zum Zitat Zhao Z, Zheng P, Xu S, Wu X (2019) Object detection with deep learning: a review. IEEE Trans Neural Netw Learn Syst 30(11):3212–3232 Zhao Z, Zheng P, Xu S, Wu X (2019) Object detection with deep learning: a review. IEEE Trans Neural Netw Learn Syst 30(11):3212–3232
8.
Zurück zum Zitat Ayachi R, Afif M, Said Y, Atri M (2019) Traffic signs detection for real-world application of an advanced driving assisting system using deep learning. Neural Process Lett 51:1–15 Ayachi R, Afif M, Said Y, Atri M (2019) Traffic signs detection for real-world application of an advanced driving assisting system using deep learning. Neural Process Lett 51:1–15
9.
Zurück zum Zitat Hong C, Yu J, Zhang J, Jin X, Lee K (2018) Multimodal face-pose estimation with multitask manifold deep learning. IEEE Trans Ind Inform 15:3952–3961 Hong C, Yu J, Zhang J, Jin X, Lee K (2018) Multimodal face-pose estimation with multitask manifold deep learning. IEEE Trans Ind Inform 15:3952–3961
10.
Zurück zum Zitat Yu J, Tan M, Zhang H, Tao D, Rui Y (2019) Hierarchical deep click feature prediction for fine-grained image recognition. IEEE Trans Pattern Anal Mach Intell Yu J, Tan M, Zhang H, Tao D, Rui Y (2019) Hierarchical deep click feature prediction for fine-grained image recognition. IEEE Trans Pattern Anal Mach Intell
11.
Zurück zum Zitat Clough J, Oksuz I, Byrne N, Schnabel J, King A (2019) Explicit topological priors for deep-learning based image segmentation using persistent homology. In: ICIPMI, pp 16–28 Clough J, Oksuz I, Byrne N, Schnabel J, King A (2019) Explicit topological priors for deep-learning based image segmentation using persistent homology. In: ICIPMI, pp 16–28
12.
Zurück zum Zitat Yu J, Tao D, Wang M, Rui Y (2014) Learning to rank using user clicks and visual features for image retrieval. IEEE Trans Cybern 45:767–779 Yu J, Tao D, Wang M, Rui Y (2014) Learning to rank using user clicks and visual features for image retrieval. IEEE Trans Cybern 45:767–779
13.
Zurück zum Zitat Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Proceedings of the IEEE conference on vision and pattern recognition (CVPR), San Diego, CA, USA, pp 886–893 Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Proceedings of the IEEE conference on vision and pattern recognition (CVPR), San Diego, CA, USA, pp 886–893
14.
Zurück zum Zitat Cheung W, Hamarneh G (2007) N-sift: N-dimensional scale invariant feature transform for matching medical images. In: 2007 4th IEEE international symposium on biomedical imaging: from nano to macro, IEEE, pp 720–723 Cheung W, Hamarneh G (2007) N-sift: N-dimensional scale invariant feature transform for matching medical images. In: 2007 4th IEEE international symposium on biomedical imaging: from nano to macro, IEEE, pp 720–723
15.
Zurück zum Zitat Biadgie Y, Sohn L (2014) Feature detector using adaptive accelerated segment test. In: 2014 international conference on information science & applications (ICISA), IEEE, pp 1–4 Biadgie Y, Sohn L (2014) Feature detector using adaptive accelerated segment test. In: 2014 international conference on information science & applications (ICISA), IEEE, pp 1–4
16.
Zurück zum Zitat Karimi F, Sultana S, Babakan A, Suthaharan S (2019) An enhanced support vector machine model for urban expansion prediction. Comput Environ Urban Syst 75:61–75 Karimi F, Sultana S, Babakan A, Suthaharan S (2019) An enhanced support vector machine model for urban expansion prediction. Comput Environ Urban Syst 75:61–75
17.
Zurück zum Zitat Xu J, Lange L (2019) Power k-means clustering. In: ICML, pp 6921–6931 Xu J, Lange L (2019) Power k-means clustering. In: ICML, pp 6921–6931
18.
Zurück zum Zitat O’Brien R, Ishwaran H (2019) A random forests quantile classifier for class imbalanced data. Pattern Recognit 90:232–249 O’Brien R, Ishwaran H (2019) A random forests quantile classifier for class imbalanced data. Pattern Recognit 90:232–249
19.
Zurück zum Zitat Hirose A (2003) Complex-valued neural networks: theories and applications, vol 5. World Scientific, SingaporeMATH Hirose A (2003) Complex-valued neural networks: theories and applications, vol 5. World Scientific, SingaporeMATH
20.
Zurück zum Zitat Socher R, Huval B, Bath B, Manning C, Ng A (2012) Convolutional-recursive deep learning for 3d object classification. In: Advances in neural information processing systems, pp 656–664 Socher R, Huval B, Bath B, Manning C, Ng A (2012) Convolutional-recursive deep learning for 3d object classification. In: Advances in neural information processing systems, pp 656–664
21.
Zurück zum Zitat Farabet C, Couprie C, Najman L, LeCun Y (2012) Learning hierarchical features for scene labeling. IEEE Trans Pattern Anal Mach Intell 35(8):1915–1929 Farabet C, Couprie C, Najman L, LeCun Y (2012) Learning hierarchical features for scene labeling. IEEE Trans Pattern Anal Mach Intell 35(8):1915–1929
22.
Zurück zum Zitat Pinheiro P, Collobert R (2014) Recurrent convolutional neural networks for scene labeling. In: 31st international conference on machine learning (ICML), No. CONF. 2014 Pinheiro P, Collobert R (2014) Recurrent convolutional neural networks for scene labeling. In: 31st international conference on machine learning (ICML), No. CONF. 2014
23.
Zurück zum Zitat Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440 Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440
24.
Zurück zum Zitat Noh H, Hong S, Han B (2015) Learning deconvolution network for semantic segmentation. In: Proceedings of the IEEE international conference on computer vision, pp 1520–1528 Noh H, Hong S, Han B (2015) Learning deconvolution network for semantic segmentation. In: Proceedings of the IEEE international conference on computer vision, pp 1520–1528
25.
Zurück zum Zitat Zeiler M, Fergus R (2014) Visualizing and understanding convolutional networks. In: European conference on computer vision, pp 818–833 Zeiler M, Fergus R (2014) Visualizing and understanding convolutional networks. In: European conference on computer vision, pp 818–833
26.
Zurück zum Zitat Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495 Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495
27.
Zurück zum Zitat Pinheiro P, Lin T, Collobert R, Dollár P (2016) Learning to refine object segments. In: European conference on computer vision, pp 75–91 Pinheiro P, Lin T, Collobert R, Dollár P (2016) Learning to refine object segments. In: European conference on computer vision, pp 75–91
28.
Zurück zum Zitat Chen L, Papandreou G, Kokkinos I, Murphy K, Yuille A (2014) Semantic image segmentation with deep convolutional nets and fully connected crfs. arXiv preprint arXiv:1412.7062 Chen L, Papandreou G, Kokkinos I, Murphy K, Yuille A (2014) Semantic image segmentation with deep convolutional nets and fully connected crfs. arXiv preprint arXiv:​1412.​7062
29.
Zurück zum Zitat Krähenbühl P, Koltun V (2011) Efficient inference in fully connected crfs with gaussian edge potentials. Adv Neural Inf Process Syst 24:109–117 Krähenbühl P, Koltun V (2011) Efficient inference in fully connected crfs with gaussian edge potentials. Adv Neural Inf Process Syst 24:109–117
30.
Zurück zum Zitat Chen L, Papandreou G, Kokkinos I, Murphy K, Yuille A (2017) Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848 Chen L, Papandreou G, Kokkinos I, Murphy K, Yuille A (2017) Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848
31.
Zurück zum Zitat Yu J, Yao J, Zhang J, Yu Z, Tao D (2019) Single pixel reconstruction for one-stage instance segmentation. arXiv preprint arXiv:1904.07426 Yu J, Yao J, Zhang J, Yu Z, Tao D (2019) Single pixel reconstruction for one-stage instance segmentation. arXiv preprint arXiv:​1904.​07426
32.
Zurück zum Zitat Yu J, Zhu C, Zhang J, Huang Q, Tao D (2019) Spatial pyramid-enhanced NetVLAD with weighted triplet loss for place recognition. IEEE Trans Neural Netw Learn Syst 31(2):661–674 Yu J, Zhu C, Zhang J, Huang Q, Tao D (2019) Spatial pyramid-enhanced NetVLAD with weighted triplet loss for place recognition. IEEE Trans Neural Netw Learn Syst 31(2):661–674
33.
Zurück zum Zitat Zhang J, Yu J, Tao D (2018) Local deep-feature alignment for unsupervised dimension reduction. IEEE Trans Image Process 27:2420–2432MathSciNetMATH Zhang J, Yu J, Tao D (2018) Local deep-feature alignment for unsupervised dimension reduction. IEEE Trans Image Process 27:2420–2432MathSciNetMATH
34.
Zurück zum Zitat Hong C, Yu J, Wan J, Tao D, Wang M (2015) Multimodal deep autoencoder for human pose recovery. IEEE Trans Image Process 24:5659–5670MathSciNetMATH Hong C, Yu J, Wan J, Tao D, Wang M (2015) Multimodal deep autoencoder for human pose recovery. IEEE Trans Image Process 24:5659–5670MathSciNetMATH
35.
Zurück zum Zitat Hirose A (1994) Complex-valued neural networks, vol 400. Springer, BerlinMATH Hirose A (1994) Complex-valued neural networks, vol 400. Springer, BerlinMATH
36.
Zurück zum Zitat Chen S, McLaughlin S, Mulgrew B (1994) Complex-valued radial basic function network, part I: network architecture and learning algorithms. Signal Process 35(1):19–31MATH Chen S, McLaughlin S, Mulgrew B (1994) Complex-valued radial basic function network, part I: network architecture and learning algorithms. Signal Process 35(1):19–31MATH
37.
Zurück zum Zitat Savitha R, Suresh S, Sundararajan N (2009) A fully complex-valued radial basis function network and its learning algorithm. Int J Neural Syst 19:253–267 Savitha R, Suresh S, Sundararajan N (2009) A fully complex-valued radial basis function network and its learning algorithm. Int J Neural Syst 19:253–267
38.
Zurück zum Zitat Wu J, Wang K, Shang Z, Xu J, Ding D, Li X, Yang G (2019) Oval shape constraint based optic disc and cup segmentation in fundus photographs. In: Proceedings of british machine vision conference (BMVC), Cardiff, UK, pp 1–11 Wu J, Wang K, Shang Z, Xu J, Ding D, Li X, Yang G (2019) Oval shape constraint based optic disc and cup segmentation in fundus photographs. In: Proceedings of british machine vision conference (BMVC), Cardiff, UK, pp 1–11
39.
Zurück zum Zitat Chen L, Papandreou G, Schroff F, Adam H (2017) Rethinking atrous convolution for semantic image segmentation. arXiv preprint arXiv:1706.05587 Chen L, Papandreou G, Schroff F, Adam H (2017) Rethinking atrous convolution for semantic image segmentation. arXiv preprint arXiv:​1706.​05587
40.
Zurück zum Zitat Chen L, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European conference on computer vision (ECCV), pp 801–818 Chen L, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European conference on computer vision (ECCV), pp 801–818
41.
Zurück zum Zitat Cheng W, Yang W, Wang M, Wang G, Chen J (2019) Context aggregation network for semantic labeling in aerial images. Remote Sens 11:1158 Cheng W, Yang W, Wang M, Wang G, Chen J (2019) Context aggregation network for semantic labeling in aerial images. Remote Sens 11:1158
Metadaten
Titel
A Novel Technique for Segmentation of High Resolution Remote Sensing Images Based on Neural Networks
Publikationsdatum
08.06.2020
Erschienen in
Neural Processing Letters / Ausgabe 1/2020
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-020-10280-1

Weitere Artikel der Ausgabe 1/2020

Neural Processing Letters 1/2020 Zur Ausgabe

Neuer Inhalt