Skip to main content
Top

2021 | OriginalPaper | Chapter

5. Integrating Spectral-Spatial Information for Deep Learning Based HSI Classification

Authors : Linmi Tao, Atif Mughees

Published in: Deep Learning for Hyperspectral Image Analysis and Classification

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter presents a detailed analysis and development of Deep Learning (DL) based techniques for hyperspectral image classification. This is the third phase in our developed framework as shown in Fig. 5.1. The complete explanation of each stage is illustrated in Chap. 1, Fig. 1.​3. In this phase, three different DL based algorithms are developed for HSI classification.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Rajan S, Ghosh J, Crawford MM (2008) An active learning approach to hyperspectral data classification. IEEE Trans Geosci Remote Sens 46(4):1231–1242CrossRef Rajan S, Ghosh J, Crawford MM (2008) An active learning approach to hyperspectral data classification. IEEE Trans Geosci Remote Sens 46(4):1231–1242CrossRef
2.
go back to reference Chen Y, Jiang H, Li C, Jia X, Ghamisi P (2016) Deep feature extraction and classification of hyperspectral images based on convolutional neural networks. IEEE Trans Geosci Remote Sens 54(10):6232–6251CrossRef Chen Y, Jiang H, Li C, Jia X, Ghamisi P (2016) Deep feature extraction and classification of hyperspectral images based on convolutional neural networks. IEEE Trans Geosci Remote Sens 54(10):6232–6251CrossRef
3.
go back to reference Yuen PW, Richardson M (2010) An introduction to hyperspectral imaging and its application for security, surveillance and target acquisition. Imaging Sci J 58(5):241–253CrossRef Yuen PW, Richardson M (2010) An introduction to hyperspectral imaging and its application for security, surveillance and target acquisition. Imaging Sci J 58(5):241–253CrossRef
4.
go back to reference Lacar F, Lewis M, Grierson I (2001) Use of hyperspectral imagery for mapping grape varieties in the Barossa Valley, South Australia. In: IEEE 2001 international geoscience and remote sensing symposium, 2001. IGARSS’01, vol 6. IEEE, pp 2875–2877 Lacar F, Lewis M, Grierson I (2001) Use of hyperspectral imagery for mapping grape varieties in the Barossa Valley, South Australia. In: IEEE 2001 international geoscience and remote sensing symposium, 2001. IGARSS’01, vol 6. IEEE, pp 2875–2877
5.
go back to reference Van Der Meer F (2004) Analysis of spectral absorption features in hyperspectral imagery. Int J Appl Earth Obs Geoinf 5(1):55–68CrossRef Van Der Meer F (2004) Analysis of spectral absorption features in hyperspectral imagery. Int J Appl Earth Obs Geoinf 5(1):55–68CrossRef
6.
go back to reference Hege EK, O’Connell D, Johnson W, Basty S, Dereniak EL (2004) Hyperspectral imaging for astronomy and space surveillance. In: Optical science and technology, SPIE’s 48th annual meeting. International Society for Optics and Photonics, pp 380–391 Hege EK, O’Connell D, Johnson W, Basty S, Dereniak EL (2004) Hyperspectral imaging for astronomy and space surveillance. In: Optical science and technology, SPIE’s 48th annual meeting. International Society for Optics and Photonics, pp 380–391
7.
go back to reference Malthus TJ, Mumby PJ (2003) Remote sensing of the coastal zone: an overview and priorities for future research Malthus TJ, Mumby PJ (2003) Remote sensing of the coastal zone: an overview and priorities for future research
8.
go back to reference Bioucas-Dias JM, Plaza A, Camps-Valls G, Scheunders P, Nasrabadi N, Chanussot J (2013) Hyperspectral remote sensing data analysis and future challenges. IEEE Geosci Remote Sens Mag 1(2):6–36CrossRef Bioucas-Dias JM, Plaza A, Camps-Valls G, Scheunders P, Nasrabadi N, Chanussot J (2013) Hyperspectral remote sensing data analysis and future challenges. IEEE Geosci Remote Sens Mag 1(2):6–36CrossRef
9.
go back to reference Hughes G (1968) On the mean accuracy of statistical pattern recognizers. IEEE Trans Inf Theory 14(1):55–63CrossRef Hughes G (1968) On the mean accuracy of statistical pattern recognizers. IEEE Trans Inf Theory 14(1):55–63CrossRef
10.
go back to reference Landgrebe D (2002) Hyperspectral image data analysis. IEEE Signal Process Mag 19(1):17–28CrossRef Landgrebe D (2002) Hyperspectral image data analysis. IEEE Signal Process Mag 19(1):17–28CrossRef
11.
go back to reference Kang X, Li S, Benediktsson JA (2014) Spectral–spatial hyperspectral image classification with edge-preserving filtering. IEEE Trans Geosci Remote Sens 52(5):2666–2677CrossRef Kang X, Li S, Benediktsson JA (2014) Spectral–spatial hyperspectral image classification with edge-preserving filtering. IEEE Trans Geosci Remote Sens 52(5):2666–2677CrossRef
12.
go back to reference Pal M, Foody GM (2010) Feature selection for classification of hyperspectral data by SVM. IEEE Trans Geosci Remote Sens 48(5):2297–2307CrossRef Pal M, Foody GM (2010) Feature selection for classification of hyperspectral data by SVM. IEEE Trans Geosci Remote Sens 48(5):2297–2307CrossRef
13.
go back to reference Plaza A, Plaza J, Martin G (2009) Incorporation of spatial constraints into spectral mixture analysis of remotely sensed hyperspectral data. In: 2009 IEEE international workshop on machine learning for signal processing, 2009. MLSP 2009. IEEE, pp 1–6 Plaza A, Plaza J, Martin G (2009) Incorporation of spatial constraints into spectral mixture analysis of remotely sensed hyperspectral data. In: 2009 IEEE international workshop on machine learning for signal processing, 2009. MLSP 2009. IEEE, pp 1–6
14.
go back to reference Qian Y, Ye M (2013) Hyperspectral imagery restoration using nonlocal spectral-spatial structured sparse representation with noise estimation. IEEE J Sel Top Appl Earth Obs Remote Sens 6(2):499–515CrossRef Qian Y, Ye M (2013) Hyperspectral imagery restoration using nonlocal spectral-spatial structured sparse representation with noise estimation. IEEE J Sel Top Appl Earth Obs Remote Sens 6(2):499–515CrossRef
15.
go back to reference Li J, Marpu PR, Plaza A, Bioucas-Dias JM, Benediktsson JA (2013) Generalized composite kernel framework for hyperspectral image classification. IEEE Trans Geosci Remote Sens 51(9):4816–4829CrossRef Li J, Marpu PR, Plaza A, Bioucas-Dias JM, Benediktsson JA (2013) Generalized composite kernel framework for hyperspectral image classification. IEEE Trans Geosci Remote Sens 51(9):4816–4829CrossRef
16.
go back to reference Zhou Y, Peng J, Chen CP (2015) Extreme learning machine with composite kernels for hyperspectral image classification. IEEE J Sel Top Appl Earth Obs Remote Sens 8(6):2351–2360CrossRef Zhou Y, Peng J, Chen CP (2015) Extreme learning machine with composite kernels for hyperspectral image classification. IEEE J Sel Top Appl Earth Obs Remote Sens 8(6):2351–2360CrossRef
17.
go back to reference Zhang Y, Prasad S (2015) Locality preserving composite kernel feature extraction for multi-source geospatial image analysis. IEEE J Sel Top Appl Earth Obs Remote Sens 8(3):1385–1392 Zhang Y, Prasad S (2015) Locality preserving composite kernel feature extraction for multi-source geospatial image analysis. IEEE J Sel Top Appl Earth Obs Remote Sens 8(3):1385–1392
18.
go back to reference Zhang Q, Tian Y, Yang Y, Pan C (2015) Automatic spatial–spectral feature selection for hyperspectral image via discriminative sparse multimodal learning. IEEE Trans Geosci Remote Sens 53(1):261–279CrossRef Zhang Q, Tian Y, Yang Y, Pan C (2015) Automatic spatial–spectral feature selection for hyperspectral image via discriminative sparse multimodal learning. IEEE Trans Geosci Remote Sens 53(1):261–279CrossRef
19.
go back to reference Ghamisi P, Benediktsson JA, Sveinsson JR (2014) Automatic spectral–spatial classification framework based on attribute profiles and supervised feature extraction. IEEE Trans Geosci Remote Sens 52(9):5771–5782CrossRef Ghamisi P, Benediktsson JA, Sveinsson JR (2014) Automatic spectral–spatial classification framework based on attribute profiles and supervised feature extraction. IEEE Trans Geosci Remote Sens 52(9):5771–5782CrossRef
20.
go back to reference Ghamisi P, Benediktsson JA, Cavallaro G, Plaza A (2014) Automatic framework for spectral–spatial classification based on supervised feature extraction and morphological attribute profiles. IEEE J Sel Top Appl Earth Obs Remote Sens 7(6):2147–2160CrossRef Ghamisi P, Benediktsson JA, Cavallaro G, Plaza A (2014) Automatic framework for spectral–spatial classification based on supervised feature extraction and morphological attribute profiles. IEEE J Sel Top Appl Earth Obs Remote Sens 7(6):2147–2160CrossRef
21.
go back to reference Li J, Zhang H, Zhang L (2014) Supervised segmentation of very high resolution images by the use of extended morphological attribute profiles and a sparse transform. IEEE Geosci Remote Sens Lett 11(8):1409–1413CrossRef Li J, Zhang H, Zhang L (2014) Supervised segmentation of very high resolution images by the use of extended morphological attribute profiles and a sparse transform. IEEE Geosci Remote Sens Lett 11(8):1409–1413CrossRef
22.
go back to reference Song B, Li J, Dalla Mura M, Li P, Plaza A, Bioucas-Dias JM, Benediktsson JA, Chanussot J (2014) Remotely sensed image classification using sparse representations of morphological attribute profiles. IEEE Trans Geosci Remote Sens 52(8):5122–5136 Song B, Li J, Dalla Mura M, Li P, Plaza A, Bioucas-Dias JM, Benediktsson JA, Chanussot J (2014) Remotely sensed image classification using sparse representations of morphological attribute profiles. IEEE Trans Geosci Remote Sens 52(8):5122–5136
23.
go back to reference Fauvel M, Benediktsson JA, Chanussot J, Sveinsson JR (2008) Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles. IEEE Trans Geosci Remote Sens 46(11):3804–3814CrossRef Fauvel M, Benediktsson JA, Chanussot J, Sveinsson JR (2008) Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles. IEEE Trans Geosci Remote Sens 46(11):3804–3814CrossRef
24.
go back to reference Wang G, Hoiem D, Forsyth D (2012) Learning image similarity from Flickr groups using fast kernel machines. IEEE Trans Pattern Anal Mach Intell 34(11):2177–2188CrossRef Wang G, Hoiem D, Forsyth D (2012) Learning image similarity from Flickr groups using fast kernel machines. IEEE Trans Pattern Anal Mach Intell 34(11):2177–2188CrossRef
25.
go back to reference Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507MathSciNetCrossRef Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507MathSciNetCrossRef
26.
go back to reference Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105 Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105
27.
go back to reference Yu D, Deng L, Wang S (2009) Learning in the deep-structured conditional random fields. In: Proceedings of the NIPS workshop, pp 1–8 Yu D, Deng L, Wang S (2009) Learning in the deep-structured conditional random fields. In: Proceedings of the NIPS workshop, pp 1–8
28.
go back to reference Mohamed AR, Dahl G, Hinton G (2009) Deep belief networks for phone recognition. In: NIPS workshop on deep learning for speech recognition and related applications, vol 1, p 39 Mohamed AR, Dahl G, Hinton G (2009) Deep belief networks for phone recognition. In: NIPS workshop on deep learning for speech recognition and related applications, vol 1, p 39
29.
go back to reference Chen Y, Lin Z, Zhao X, Wang G, Gu Y (2014) Deep learning-based classification of hyperspectral data. IEEE J Sel Top Appl Earth Obs Remote Sens 7(6):2094–2107CrossRef Chen Y, Lin Z, Zhao X, Wang G, Gu Y (2014) Deep learning-based classification of hyperspectral data. IEEE J Sel Top Appl Earth Obs Remote Sens 7(6):2094–2107CrossRef
30.
go back to reference Gómez-Chova L, Tuia D, Moser G, Camps-Valls G (2015) Multimodal classification of remote sensing images: a review and future directions. Proc IEEE 103(9):1560–1584CrossRef Gómez-Chova L, Tuia D, Moser G, Camps-Valls G (2015) Multimodal classification of remote sensing images: a review and future directions. Proc IEEE 103(9):1560–1584CrossRef
31.
go back to reference Tao C, Pan H, Li Y, Zou Z (2015) Unsupervised spectral–spatial feature learning with stacked sparse autoencoder for hyperspectral imagery classification. IEEE Geosci Remote Sens Lett 12(12):2438–2442CrossRef Tao C, Pan H, Li Y, Zou Z (2015) Unsupervised spectral–spatial feature learning with stacked sparse autoencoder for hyperspectral imagery classification. IEEE Geosci Remote Sens Lett 12(12):2438–2442CrossRef
32.
go back to reference Chen Y, Zhao X, Jia X (2015) Spectral–spatial classification of hyperspectral data based on deep belief network. IEEE J Sel Top Appl Earth Obs Remote Sens 8(6):2381–2392CrossRef Chen Y, Zhao X, Jia X (2015) Spectral–spatial classification of hyperspectral data based on deep belief network. IEEE J Sel Top Appl Earth Obs Remote Sens 8(6):2381–2392CrossRef
33.
go back to reference Mughees A, Chen X, Tao L (2016) Unsupervised hyperspectral image segmentation: merging spectral and spatial information in boundary adjustment. In: 2016 55th annual conference of the society of instrument and control engineers of Japan (SICE). IEEE, pp 1466–1471 Mughees A, Chen X, Tao L (2016) Unsupervised hyperspectral image segmentation: merging spectral and spatial information in boundary adjustment. In: 2016 55th annual conference of the society of instrument and control engineers of Japan (SICE). IEEE, pp 1466–1471
34.
go back to reference Mughees A, Chen X, Du R, Tao L (2016) Ab3c: adaptive boundary-based band-categorization of hyperspectral images. J Appl Remote Sens 10(4):046009 Mughees A, Chen X, Du R, Tao L (2016) Ab3c: adaptive boundary-based band-categorization of hyperspectral images. J Appl Remote Sens 10(4):046009
35.
go back to reference Li W, Du Q (2014) Gabor-filtering-based nearest regularized subspace for hyperspectral image classification. IEEE J Sel Top Appl Earth Obs Remote Sens 7(4):1012–1022CrossRef Li W, Du Q (2014) Gabor-filtering-based nearest regularized subspace for hyperspectral image classification. IEEE J Sel Top Appl Earth Obs Remote Sens 7(4):1012–1022CrossRef
36.
go back to reference Tan K, Li E, Du Q, Du P (2014) Hyperspectral image classification using band selection and morphological profiles. IEEE J Sel Top Appl Earth Obs Remote Sens 7(1):40–48CrossRef Tan K, Li E, Du Q, Du P (2014) Hyperspectral image classification using band selection and morphological profiles. IEEE J Sel Top Appl Earth Obs Remote Sens 7(1):40–48CrossRef
37.
go back to reference Li J, Bioucas-Dias JM, Plaza A (2011) Hyperspectral image segmentation using a new Bayesian approach with active learning. IEEE Trans Geosci Remote Sens 49(10):3947–3960CrossRef Li J, Bioucas-Dias JM, Plaza A (2011) Hyperspectral image segmentation using a new Bayesian approach with active learning. IEEE Trans Geosci Remote Sens 49(10):3947–3960CrossRef
38.
go back to reference Chen Y, Nasrabadi NM, Tran TD (2013) Hyperspectral image classification via kernel sparse representation. IEEE Trans Geosci Remote Sens 51(1):217–231CrossRef Chen Y, Nasrabadi NM, Tran TD (2013) Hyperspectral image classification via kernel sparse representation. IEEE Trans Geosci Remote Sens 51(1):217–231CrossRef
39.
go back to reference Li J, Bioucas-Dias JM, Plaza A (2013) Spectral–spatial classification of hyperspectral data using loopy belief propagation and active learning. IEEE Trans Geosci Remote Sens 51(2):844–856CrossRef Li J, Bioucas-Dias JM, Plaza A (2013) Spectral–spatial classification of hyperspectral data using loopy belief propagation and active learning. IEEE Trans Geosci Remote Sens 51(2):844–856CrossRef
40.
go back to reference Hu W, Huang Y, Wei L, Zhang F, Li H (2015) Deep convolutional neural networks for hyperspectral image classification. J Sens 2015 Hu W, Huang Y, Wei L, Zhang F, Li H (2015) Deep convolutional neural networks for hyperspectral image classification. J Sens 2015
41.
go back to reference Melgani F, Bruzzone L (2004) Classification of hyperspectral remote sensing images with support vector machines. IEEE Trans Geosci Remote Sens 42(8):1778–1790CrossRef Melgani F, Bruzzone L (2004) Classification of hyperspectral remote sensing images with support vector machines. IEEE Trans Geosci Remote Sens 42(8):1778–1790CrossRef
42.
go back to reference Ji R, Gao Y, Hong R, Liu Q, Tao D, Li X (2014) Spectral-spatial constraint hyperspectral image classification. IEEE Trans Geosci Remote Sens 52(3):1811–1824CrossRef Ji R, Gao Y, Hong R, Liu Q, Tao D, Li X (2014) Spectral-spatial constraint hyperspectral image classification. IEEE Trans Geosci Remote Sens 52(3):1811–1824CrossRef
43.
go back to reference Hinton GE (2002) Training products of experts by minimizing contrastive divergence. Neural Comput 14(8):1771–1800CrossRef Hinton GE (2002) Training products of experts by minimizing contrastive divergence. Neural Comput 14(8):1771–1800CrossRef
44.
go back to reference Chan T-H, Jia K, Gao S, Lu J, Zeng Z, Ma Y (2015) PCANet: a simple deep learning baseline for image classification? IEEE Trans Image Process 24(12):5017–5032MathSciNetCrossRef Chan T-H, Jia K, Gao S, Lu J, Zeng Z, Ma Y (2015) PCANet: a simple deep learning baseline for image classification? IEEE Trans Image Process 24(12):5017–5032MathSciNetCrossRef
45.
go back to reference Benediktsson JA, Ghamisi P (2015) Spectral-spatial classification of hyperspectral remote sensing images. Artech House, Boston Benediktsson JA, Ghamisi P (2015) Spectral-spatial classification of hyperspectral remote sensing images. Artech House, Boston
46.
go back to reference Mou L, Ghamisi P, Zhu XX (2017) Deep recurrent neural networks for hyperspectral image classification. IEEE Trans Geosci Remote Sens Mou L, Ghamisi P, Zhu XX (2017) Deep recurrent neural networks for hyperspectral image classification. IEEE Trans Geosci Remote Sens
Metadata
Title
Integrating Spectral-Spatial Information for Deep Learning Based HSI Classification
Authors
Linmi Tao
Atif Mughees
Copyright Year
2021
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-33-4420-4_5

Premium Partner