Skip to main content
Erschienen in: Soft Computing 12/2016

21.09.2014 | Focus

Difference representation learning using stacked restricted Boltzmann machines for change detection in SAR images

verfasst von: Jia Liu, Maoguo Gong, Jiaojiao Zhao, Hao Li, Licheng Jiao

Erschienen in: Soft Computing | Ausgabe 12/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we establish a deep neural network using stacked Restricted Boltzmann Machines (RBMs) to analyze the difference images and detect changes between multitemporal synthetic aperture radar (SAR) images. Given the two multitemporal images, a difference image which shows difference degrees between corresponding pixels is generated. Then, RBMs are stacked to form a deep hierarchical neural network to learn to analyze the difference image and recognize the changed pixels and unchanged pixels. The learning process includes unsupervised layer-wise feature learning and supervised fine-tuning of network parameters. Unsupervised learning aims to learn the representation of the difference image. Supervised fine-tuning aims to learn to classify the changed and unchanged pixels. The network can learn from datasets that have few labeled data. The labeled data can be selected from the results obtained by other methods because there is no prior information in image change detection. The system learns to detect the changes instead of recognizing the changes by fixed equations as in traditional change detection algorithms. We test the network with real synthetic aperture radar datasets and the labeled samples are extracted from the results obtained, respectively, by several methods, including a thresholding method, a level set method and two clustering methods. The results achieved by the trained network outperform that of other methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Alain G, Bengio Y, Rifai S (2012) Regularized auto-encoders estimate local statistics. arXiv preprint arXiv:1211.4246. Accessed 19 Aug 2014 Alain G, Bengio Y, Rifai S (2012) Regularized auto-encoders estimate local statistics. arXiv preprint arXiv:​1211.​4246. Accessed 19 Aug 2014
Zurück zum Zitat Arel I, Rose DC, Karnowski TP (2010) Deep machine learning—a new frontier in artificial intelligence research [research frontier]. IEEE Comput Intell Mag 5(4):13–18CrossRef Arel I, Rose DC, Karnowski TP (2010) Deep machine learning—a new frontier in artificial intelligence research [research frontier]. IEEE Comput Intell Mag 5(4):13–18CrossRef
Zurück zum Zitat Bazi Y, Melgani F, Al-Sharari HD (2010) Unsupervised change detection in multispectral remotely sensed imagery with level set methods. IEEE Trans Geosci Remote Sens 48(8):3178–3187CrossRef Bazi Y, Melgani F, Al-Sharari HD (2010) Unsupervised change detection in multispectral remotely sensed imagery with level set methods. IEEE Trans Geosci Remote Sens 48(8):3178–3187CrossRef
Zurück zum Zitat Bengio Y, Courville A, Vincent P (2013) Representation learning: a review and new perspectives. IEEE Trans Pattern Anal Mach Intell 35(8):1798–1828CrossRef Bengio Y, Courville A, Vincent P (2013) Representation learning: a review and new perspectives. IEEE Trans Pattern Anal Mach Intell 35(8):1798–1828CrossRef
Zurück zum Zitat Bengio Y, Courville AC, Bergstra JS (2011) Unsupervised models of images by spike-and-slab RBMs. In: Proceedings of the 28th International Conference on Machine Learning (ICML), pp 1145–1152 Bengio Y, Courville AC, Bergstra JS (2011) Unsupervised models of images by spike-and-slab RBMs. In: Proceedings of the 28th International Conference on Machine Learning (ICML), pp 1145–1152
Zurück zum Zitat Bordes A, Glorot X, Weston J, Bengio Y (2012) Joint learning of words and meaning representations for open-text semantic parsing. In: International Conference on Artificial Intelligence and Statistics, pp 127–135 Bordes A, Glorot X, Weston J, Bengio Y (2012) Joint learning of words and meaning representations for open-text semantic parsing. In: International Conference on Artificial Intelligence and Statistics, pp 127–135
Zurück zum Zitat Bovolo F, Bruzzone L (2005) A detail-preserving scale-driven approach to change detection in multitemporal SAR images. IEEE Trans Geosci Remote Sens 43(12):2963–2972CrossRef Bovolo F, Bruzzone L (2005) A detail-preserving scale-driven approach to change detection in multitemporal SAR images. IEEE Trans Geosci Remote Sens 43(12):2963–2972CrossRef
Zurück zum Zitat Bruzzone L, Prieto DF (2002) An adaptive semiparametric and context-based approach to unsupervised change detection in multitemporal remote-sensing images. IEEE Trans Image Process 11(4):452–466 Bruzzone L, Prieto DF (2002) An adaptive semiparametric and context-based approach to unsupervised change detection in multitemporal remote-sensing images. IEEE Trans Image Process 11(4):452–466
Zurück zum Zitat Bujor F, Trouvé E, Valet L, Nicolas JM, Rudant JP (2004) Application of log-cumulants to the detection of spatiotemporal discontinuities in multitemporal SAR images. IEEE Trans Geosci Remote Sens 42(10):2073–2084CrossRef Bujor F, Trouvé E, Valet L, Nicolas JM, Rudant JP (2004) Application of log-cumulants to the detection of spatiotemporal discontinuities in multitemporal SAR images. IEEE Trans Geosci Remote Sens 42(10):2073–2084CrossRef
Zurück zum Zitat Carneiro G, Nascimento J (2013) Combining multiple dynamic models and deep learning architectures for tracking the left ventricle endocardium in ultrasound data. IEEE Trans Pattern Anal Mach Intell 35(11):2592–2607CrossRef Carneiro G, Nascimento J (2013) Combining multiple dynamic models and deep learning architectures for tracking the left ventricle endocardium in ultrasound data. IEEE Trans Pattern Anal Mach Intell 35(11):2592–2607CrossRef
Zurück zum Zitat Chatelain F, Tourneret JY, Inglada J (2008) Change detection in multisensor SAR images using bivariate Gamma distributions. IEEE Trans Image Process 17(3):249–258CrossRefMathSciNet Chatelain F, Tourneret JY, Inglada J (2008) Change detection in multisensor SAR images using bivariate Gamma distributions. IEEE Trans Image Process 17(3):249–258CrossRefMathSciNet
Zurück zum Zitat Chen B, Polatkan G, Sapiro G, Blei D, Dunson D, Carin L (2013) Deep learning with hierarchical convolutional factor analysis. IEEE Trans Pattern Anal Mach Intell 35(8):1887–1901CrossRef Chen B, Polatkan G, Sapiro G, Blei D, Dunson D, Carin L (2013) Deep learning with hierarchical convolutional factor analysis. IEEE Trans Pattern Anal Mach Intell 35(8):1887–1901CrossRef
Zurück zum Zitat Ciresan D, Meier U, Masci J, Schmidhuber J (2011) A committee of neural networks for traffic sign classification. In: The 2011 International Joint Conference on Neural Networks (IJCNN), pp 1918–1921. IEEE Ciresan D, Meier U, Masci J, Schmidhuber J (2011) A committee of neural networks for traffic sign classification. In: The 2011 International Joint Conference on Neural Networks (IJCNN), pp 1918–1921. IEEE
Zurück zum Zitat Ciresan D, Meier U, Schmidhuber J (2012) Multi-column deep neural networks for image classification. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 3642–3649. IEEE Ciresan D, Meier U, Schmidhuber J (2012) Multi-column deep neural networks for image classification. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 3642–3649. IEEE
Zurück zum Zitat Cireşan DC, Meier U, Gambardella LM, Schmidhuber J (2010) Deep, big, simple neural nets for handwritten digit recognition. Neural comput 22(12):3207–3220CrossRef Cireşan DC, Meier U, Gambardella LM, Schmidhuber J (2010) Deep, big, simple neural nets for handwritten digit recognition. Neural comput 22(12):3207–3220CrossRef
Zurück zum Zitat Farabet C, Couprie C, Najman L, LeCun Y (2013) Learning hierarchical features for scene labeling. IEEE Trans Pattern Anal Mach Intell 35(8):1915–1929CrossRef Farabet C, Couprie C, Najman L, LeCun Y (2013) Learning hierarchical features for scene labeling. IEEE Trans Pattern Anal Mach Intell 35(8):1915–1929CrossRef
Zurück zum Zitat Gong M, Su L, Jia M, Chen W (2013) Fuzzy clustering with modified MRF energy function for change detection in synthetic aperture radar images. IEEE Trans, Fuzzy Syst Gong M, Su L, Jia M, Chen W (2013) Fuzzy clustering with modified MRF energy function for change detection in synthetic aperture radar images. IEEE Trans, Fuzzy Syst
Zurück zum Zitat Gong M, Zhou Z, Ma J (2012) Change detection in synthetic aperture radar images based on image fusion and fuzzy clustering. IEEE Trans Image Process 21(4):2141–2151CrossRefMathSciNet Gong M, Zhou Z, Ma J (2012) Change detection in synthetic aperture radar images based on image fusion and fuzzy clustering. IEEE Trans Image Process 21(4):2141–2151CrossRefMathSciNet
Zurück zum Zitat Goodfellow I, Courville A, Bengio Y (2012) Large-scale feature learning with spike-and-slab sparse coding. arXiv preprint arXiv:1206.6407. Accessed 27 June 2012 Goodfellow I, Courville A, Bengio Y (2012) Large-scale feature learning with spike-and-slab sparse coding. arXiv preprint arXiv:​1206.​6407. Accessed 27 June 2012
Zurück zum Zitat Goodfellow I, Courville A, Bengio Y (2013) Scaling up spike-and-slab models for unsupervised feature learning. IEEE Trans Pattern Anal Mach Intell 35(8):1902–1914CrossRef Goodfellow I, Courville A, Bengio Y (2013) Scaling up spike-and-slab models for unsupervised feature learning. IEEE Trans Pattern Anal Mach Intell 35(8):1902–1914CrossRef
Zurück zum Zitat Graves A, Liwicki M, Fernández S, Bertolami R, Bunke H, Schmidhuber J (2009) A novel connectionist system for unconstrained handwriting recognition. IEEE Trans Pattern Anal Mach Intell 31(5):855–868CrossRef Graves A, Liwicki M, Fernández S, Bertolami R, Bunke H, Schmidhuber J (2009) A novel connectionist system for unconstrained handwriting recognition. IEEE Trans Pattern Anal Mach Intell 31(5):855–868CrossRef
Zurück zum Zitat Hinton GE (2010) A practical guide to training restricted Boltzmann machines. Momentum 9(1):926 Hinton GE (2010) A practical guide to training restricted Boltzmann machines. Momentum 9(1):926
Zurück zum Zitat Hutchinson B, Deng L, Yu D (2013) Tensor deep stacking networks. IEEE Trans Pattern Anal Mach Intell 35(8):1944–1957CrossRef Hutchinson B, Deng L, Yu D (2013) Tensor deep stacking networks. IEEE Trans Pattern Anal Mach Intell 35(8):1944–1957CrossRef
Zurück zum Zitat Inglada J, Mercier G (2007) A new statistical similarity measure for change detection in multitemporal SAR images and its extension to multiscale change analysis. IEEE Trans Geosci Remote Sens 45(5):1432–1445CrossRef Inglada J, Mercier G (2007) A new statistical similarity measure for change detection in multitemporal SAR images and its extension to multiscale change analysis. IEEE Trans Geosci Remote Sens 45(5):1432–1445CrossRef
Zurück zum Zitat Ji S, Xu W, Yang M, Yu K (2013) 3D convolutional neural networks for human action recognition. IEEE Trans Pattern Anal Mach Intell 35(1):221–231CrossRef Ji S, Xu W, Yang M, Yu K (2013) 3D convolutional neural networks for human action recognition. IEEE Trans Pattern Anal Mach Intell 35(1):221–231CrossRef
Zurück zum Zitat Krinidis S, Chatzis V (2010) A robust fuzzy local information c-means clustering algorithm. IEEE Trans Image Process 19(5):1328–1337CrossRefMathSciNet Krinidis S, Chatzis V (2010) A robust fuzzy local information c-means clustering algorithm. IEEE Trans Image Process 19(5):1328–1337CrossRefMathSciNet
Zurück zum Zitat Krizhevsky A, Sutskever I, Hinton G (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1106–1114 Krizhevsky A, Sutskever I, Hinton G (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1106–1114
Zurück zum Zitat Le QV, Ranzato M, Monga R, Devin M, Chen K, Corrado GS, Dean J, Ng AY (2011) Building high-level features using large scale unsupervised learning. arXiv preprint arXiv:1112.6209. Accessed 12 July 2012 Le QV, Ranzato M, Monga R, Devin M, Chen K, Corrado GS, Dean J, Ng AY (2011) Building high-level features using large scale unsupervised learning. arXiv preprint arXiv:​1112.​6209. Accessed 12 July 2012
Zurück zum Zitat LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef
Zurück zum Zitat Marchesi S, Bovolo F, Bruzzone L (2010) A context-sensitive technique robust to registration noise for change detection in VHR multispectral images. IEEE Trans Image Process 19(7):1877–1889CrossRefMathSciNet Marchesi S, Bovolo F, Bruzzone L (2010) A context-sensitive technique robust to registration noise for change detection in VHR multispectral images. IEEE Trans Image Process 19(7):1877–1889CrossRefMathSciNet
Zurück zum Zitat Moser G, Serpico SB (2006) Generalized minimum-error thresholding for unsupervised change detection from SAR amplitude imagery. IEEE Trans Image Process 44(10):2972–2982MathSciNet Moser G, Serpico SB (2006) Generalized minimum-error thresholding for unsupervised change detection from SAR amplitude imagery. IEEE Trans Image Process 44(10):2972–2982MathSciNet
Zurück zum Zitat Nielsen AA (2007) The regularized iteratively reweighted MAD method for change detection in multi-and hyperspectral data. IEEE Trans Image Process 16(2):463–478CrossRefMathSciNet Nielsen AA (2007) The regularized iteratively reweighted MAD method for change detection in multi-and hyperspectral data. IEEE Trans Image Process 16(2):463–478CrossRefMathSciNet
Zurück zum Zitat Pajares G (2006) A hopfield neural network for image change detection. IEEE Trans Neural Netw 17(5):1250 Pajares G (2006) A hopfield neural network for image change detection. IEEE Trans Neural Netw 17(5):1250
Zurück zum Zitat Radke RJ, Andra S, Al-Kofahi O, Roysam B (2005) Image change detection algorithms: a systematic survey. IEEE Trans Image Process 14(3):294–307CrossRefMathSciNet Radke RJ, Andra S, Al-Kofahi O, Roysam B (2005) Image change detection algorithms: a systematic survey. IEEE Trans Image Process 14(3):294–307CrossRefMathSciNet
Zurück zum Zitat Ranzato M, Mnih V, Susskind J, Hinton G (2013) Modeling natural images using gated MRFs. IEEE Trans Pattern Anal Mach Intell 35(9):2206–2222CrossRef Ranzato M, Mnih V, Susskind J, Hinton G (2013) Modeling natural images using gated MRFs. IEEE Trans Pattern Anal Mach Intell 35(9):2206–2222CrossRef
Zurück zum Zitat Robin A, Moisan L, Hegarat-Mascle L et al (2010) An a-contrario approach for subpixel change detection in satellite imagery. IEEE Trans Pattern Anal Mach Intell 32(11):1977–1993CrossRef Robin A, Moisan L, Hegarat-Mascle L et al (2010) An a-contrario approach for subpixel change detection in satellite imagery. IEEE Trans Pattern Anal Mach Intell 32(11):1977–1993CrossRef
Zurück zum Zitat Rosenfield GH, Fitzpatricklins K (1986) A coefficient of agreement as a measure of thematic classification accuracy. Photogramm Eng Remote Sens 52(2):223–227 Rosenfield GH, Fitzpatricklins K (1986) A coefficient of agreement as a measure of thematic classification accuracy. Photogramm Eng Remote Sens 52(2):223–227
Zurück zum Zitat Salakhutdinov R, Tenenbaum J, Torralba A (2013) Learning with hierarchical-deep models. IEEE Trans Pattern Anal Mach Intell 35(8):1958–1971CrossRef Salakhutdinov R, Tenenbaum J, Torralba A (2013) Learning with hierarchical-deep models. IEEE Trans Pattern Anal Mach Intell 35(8):1958–1971CrossRef
Zurück zum Zitat Sezgin M, Sankur B (2004) Survey over image thresholding techniques and quantitative performance evaluation. J Electron Imag 13(1):146–165CrossRef Sezgin M, Sankur B (2004) Survey over image thresholding techniques and quantitative performance evaluation. J Electron Imag 13(1):146–165CrossRef
Zurück zum Zitat Shi L, Zhang L, Zhao L, Yang J, Li P, Zhang L (2013) The potential of linear discriminative laplacian eigenmaps dimensionality reduction in polarimetric sar classification for agricultural areas. ISPRS J Photogramm Remote Sens 86:124–135CrossRef Shi L, Zhang L, Zhao L, Yang J, Li P, Zhang L (2013) The potential of linear discriminative laplacian eigenmaps dimensionality reduction in polarimetric sar classification for agricultural areas. ISPRS J Photogramm Remote Sens 86:124–135CrossRef
Zurück zum Zitat Shin HC, Orton M, Collins D, Doran S, Leach M (2013) Stacked autoencoders for unsupervised feature learning and multiple organ detection in a pilot study using 4D patient data. IEEE Trans Pattern Anal Mach Intell 35(8):1930–1943CrossRef Shin HC, Orton M, Collins D, Doran S, Leach M (2013) Stacked autoencoders for unsupervised feature learning and multiple organ detection in a pilot study using 4D patient data. IEEE Trans Pattern Anal Mach Intell 35(8):1930–1943CrossRef
Zurück zum Zitat Socher R, Pennington J, Huang EH, Ng AY, Manning CD (2011) Semi-supervised recursive autoencoders for predicting sentiment distributions. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp 151–161. Association for Computational Linguistics. Socher R, Pennington J, Huang EH, Ng AY, Manning CD (2011) Semi-supervised recursive autoencoders for predicting sentiment distributions. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp 151–161. Association for Computational Linguistics.
Zurück zum Zitat Tang K, Lin M, Minku FL, Yao X (2009) Selective negative correlation learning approach to incremental learning. Neurocomputing 72:2796–2805CrossRef Tang K, Lin M, Minku FL, Yao X (2009) Selective negative correlation learning approach to incremental learning. Neurocomputing 72:2796–2805CrossRef
Zurück zum Zitat Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol PA (2010) Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 9999:3371–3408MATHMathSciNet Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol PA (2010) Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 9999:3371–3408MATHMathSciNet
Metadaten
Titel
Difference representation learning using stacked restricted Boltzmann machines for change detection in SAR images
verfasst von
Jia Liu
Maoguo Gong
Jiaojiao Zhao
Hao Li
Licheng Jiao
Publikationsdatum
21.09.2014
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 12/2016
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-014-1460-0

Weitere Artikel der Ausgabe 12/2016

Soft Computing 12/2016 Zur Ausgabe