Skip to main content
Top
Published in: GeoInformatica 1/2023

24-07-2021

Unified active and semi-supervised learning for hyperspectral image classification

Authors: Zengmao Wang, Bo Du

Published in: GeoInformatica | Issue 1/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The large-scale labeled data is very crucial to train a classification model with strong generalization ability. However, the collection of large-scale labeled data is very expensive, especially in the remote sensing fields. The available of labeled data is very limited for the hyperspectal image classification. To address such a challenge, active learning and semi-supervised learning are two popular techniques in machine learning community. In this paper, we integrate active learning and semi-supervised learning into a framework by improving the quality of pseudo-labels for hyperspectral remote sensing images. In the proposed method, the collaboration of the spatial features and spectral features are adopted to improve the ability of classifier. Specifically, we train two classifiers with spatial feature and spectral feature respectively based on the labeled data. Then the prediction probabilities of the two classifiers are combined for strong prediction. With active learning technique, we can select a batch of the most informative samples and obtain a new labeled dataset. Two classifiers based on the new labeled dataset can be obtained. With these two classifiers, another prediction results by combining their predictions can be obtained. To guarantee the quality of the pseudo-labels, the samples that are predicted with the same labels before and after active learning are assigned with pseudo-labels. The samples that can not be assigned with high confident samples are regarded as the candidate pool for active learning. The final predictions are obtained by the classification models trained on the pseudo-labeled samples and the labeled samples with both the spatial features and spectral features. The experiments on two popular hyperspectral images show that the proposed method outperforms the state-of-the-art and baseline methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Benediktsson J, Palmason J, Sveinsson J (2005) Classification of hyperspectral data from urban areas based on extended morphological profiles. IEEE Trans Geosci Remote Sens 43(3):480–491CrossRef Benediktsson J, Palmason J, Sveinsson J (2005) Classification of hyperspectral data from urban areas based on extended morphological profiles. IEEE Trans Geosci Remote Sens 43(3):480–491CrossRef
2.
go back to reference Chen L, Shang S, Yang C, Li J (2020) Spatial keyword search: a survey. GeoInformatica 24(1):85–106CrossRef Chen L, Shang S, Yang C, Li J (2020) Spatial keyword search: a survey. GeoInformatica 24(1):85–106CrossRef
3.
go back to reference Cui B, Cui J, Lu Y, Guo N, Gong M (2020) A sparse representation-based sample pseudo-labeling method for hyperspectral image classification. Remote Sens 12(4):664CrossRef Cui B, Cui J, Lu Y, Guo N, Gong M (2020) A sparse representation-based sample pseudo-labeling method for hyperspectral image classification. Remote Sens 12(4):664CrossRef
4.
go back to reference Demir B, Persello C, Bruzzone L (2011) Batch-mode active-learning methods for the interactive classification of remote sensing images. IEEE Trans Geosci Remote Sens 49(3):1014–1031CrossRef Demir B, Persello C, Bruzzone L (2011) Batch-mode active-learning methods for the interactive classification of remote sensing images. IEEE Trans Geosci Remote Sens 49(3):1014–1031CrossRef
5.
go back to reference Fang B, Li Y, Zhang H, Chan JCW (2020) Collaborative learning of lightweight convolutional neural network and deep clustering for hyperspectral image semi-supervised classification with limited training samples. ISPRS J Photogramm Remote Sens 161:164–178CrossRef Fang B, Li Y, Zhang H, Chan JCW (2020) Collaborative learning of lightweight convolutional neural network and deep clustering for hyperspectral image semi-supervised classification with limited training samples. ISPRS J Photogramm Remote Sens 161:164–178CrossRef
6.
go back to reference Fauvel M, Chanussot J, Benediktsson JA, Sveinsson JR (2007) Spectral and spatial classification of hyperspectral data using svms and morphological profiles. In: 2007 IEEE International geoscience and remote sensing symposium, pp 4834–4837 Fauvel M, Chanussot J, Benediktsson JA, Sveinsson JR (2007) Spectral and spatial classification of hyperspectral data using svms and morphological profiles. In: 2007 IEEE International geoscience and remote sensing symposium, pp 4834–4837
7.
go back to reference Gao M, Zhang Z, Yu G, Arık SÖ, Davis LS, Pfister T (2020) Consistency-based semi-supervised active learning: Towards minimizing labeling cost. In: Vedaldi A, Bischof H, Brox T, Frahm JM (eds) Computer Vision – ECCV 2020, pp 510–526 Gao M, Zhang Z, Yu G, Arık SÖ, Davis LS, Pfister T (2020) Consistency-based semi-supervised active learning: Towards minimizing labeling cost. In: Vedaldi A, Bischof H, Brox T, Frahm JM (eds) Computer Vision – ECCV 2020, pp 510–526
8.
go back to reference Han P, Shang S, Sun A, Zhao P, Zheng K, Kalnis P (2019) Auc-mf: point of interest recommendation with auc maximization. In: 2019 IEEE 35th international conference on data engineering (ICDE), pp 1558–1561 Han P, Shang S, Sun A, Zhao P, Zheng K, Kalnis P (2019) Auc-mf: point of interest recommendation with auc maximization. In: 2019 IEEE 35th international conference on data engineering (ICDE), pp 1558–1561
9.
go back to reference He Z, Xia K, Li T, Zu B, Yin Z, Zhang J (2021) A constrained graph-based semi-supervised algorithm combined with particle cooperation and competition for hyperspectral image classification. Remote Sens 13 (2):193CrossRef He Z, Xia K, Li T, Zu B, Yin Z, Zhang J (2021) A constrained graph-based semi-supervised algorithm combined with particle cooperation and competition for hyperspectral image classification. Remote Sens 13 (2):193CrossRef
10.
go back to reference Hong D, Wu X, Ghamisi P, Chanussot J, Yokoya N, Zhu XX (2020) Invariant attribute profiles: A spatial-frequency joint feature extractor for hyperspectral image classification. IEEE Trans Geosci Remote Sens 58(6):3791–3808CrossRef Hong D, Wu X, Ghamisi P, Chanussot J, Yokoya N, Zhu XX (2020) Invariant attribute profiles: A spatial-frequency joint feature extractor for hyperspectral image classification. IEEE Trans Geosci Remote Sens 58(6):3791–3808CrossRef
11.
go back to reference Hu J, Hong D, Zhu XX (2019) Mima: Mapper-induced manifold alignment for semi-supervised fusion of optical image and polarimetric sar data. IEEE Trans Geosci Remote Sens 57(11):9025–9040CrossRef Hu J, Hong D, Zhu XX (2019) Mima: Mapper-induced manifold alignment for semi-supervised fusion of optical image and polarimetric sar data. IEEE Trans Geosci Remote Sens 57(11):9025–9040CrossRef
12.
go back to reference Huo L, Tang P (2014) A batch-mode active learning algorithm using region-partitioning diversity for svm classifier. IEEE J Sel Top Appl Earth Obs Remote Sens 7(4):1036–1046CrossRef Huo L, Tang P (2014) A batch-mode active learning algorithm using region-partitioning diversity for svm classifier. IEEE J Sel Top Appl Earth Obs Remote Sens 7(4):1036–1046CrossRef
13.
go back to reference Imani M, Ghassemian H (2020) An overview on spectral and spatial information fusion for hyperspectral image classification: Current trends and challenges. Information Fusion 59:59–83CrossRef Imani M, Ghassemian H (2020) An overview on spectral and spatial information fusion for hyperspectral image classification: Current trends and challenges. Information Fusion 59:59–83CrossRef
14.
go back to reference Jamshidpour N, Safari A, Homayouni S (2020) A ga-based multi-view, multi-learner active learning framework for hyperspectral image classification. Remote Sens 12(2):297CrossRef Jamshidpour N, Safari A, Homayouni S (2020) A ga-based multi-view, multi-learner active learning framework for hyperspectral image classification. Remote Sens 12(2):297CrossRef
15.
go back to reference Liu C, Li J, He L (2018) Superpixel-based semisupervised active learning for hyperspectral image classification. IEEE J Sel Top Appl Earth Obs Remote Sens 12(1):357–370 Liu C, Li J, He L (2018) Superpixel-based semisupervised active learning for hyperspectral image classification. IEEE J Sel Top Appl Earth Obs Remote Sens 12(1):357–370
16.
go back to reference Lv J, Zhang H, Yang M, Yang W (2020) A novel spectral–spatial based adaptive minimum spanning forest for hyperspectral image classification. GeoInformatica 24:827–848CrossRef Lv J, Zhang H, Yang M, Yang W (2020) A novel spectral–spatial based adaptive minimum spanning forest for hyperspectral image classification. GeoInformatica 24:827–848CrossRef
17.
go back to reference Ma KY, Chang CI (2021) Iterative training sampling coupled with active learning for semisupervised spectral-spatial hyperspectral image classification. IEEE Trans Geoscience Remote Sens Ma KY, Chang CI (2021) Iterative training sampling coupled with active learning for semisupervised spectral-spatial hyperspectral image classification. IEEE Trans Geoscience Remote Sens
18.
go back to reference Patra S, Bruzzone L (2014) A novel som-svm-based active learning technique for remote sensing image classification. IEEE Trans Geosci Remote Sens 52 (11):6899–6910CrossRef Patra S, Bruzzone L (2014) A novel som-svm-based active learning technique for remote sensing image classification. IEEE Trans Geosci Remote Sens 52 (11):6899–6910CrossRef
19.
go back to reference Platt J, et al. (1999) Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Advances in Large Margin Classifiers 10(3):61–74 Platt J, et al. (1999) Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Advances in Large Margin Classifiers 10(3):61–74
20.
go back to reference Shang S, Chen L, Wei Z, Jensen CS, Zheng K, Kalnis P (2018) Parallel trajectory similarity joins in spatial networks. The VLDB Journal 27(3):395–420CrossRef Shang S, Chen L, Wei Z, Jensen CS, Zheng K, Kalnis P (2018) Parallel trajectory similarity joins in spatial networks. The VLDB Journal 27(3):395–420CrossRef
21.
go back to reference Shang S, Shen J, Wen JR, Kalnis P. (2020) Deep understanding of big geospatial data for self-driving cars Shang S, Shen J, Wen JR, Kalnis P. (2020) Deep understanding of big geospatial data for self-driving cars
22.
go back to reference Tuia D, Ratle F, Pacifici F, Kanevski MF, Emery WJ (2009) Active learning methods for remote sensing image classification. IEEE Trans Geosci Remote Sens 47(7):2218–2232CrossRef Tuia D, Ratle F, Pacifici F, Kanevski MF, Emery WJ (2009) Active learning methods for remote sensing image classification. IEEE Trans Geosci Remote Sens 47(7):2218–2232CrossRef
23.
go back to reference Tuia D, Volpi M, Copa L, Kanevski M, Munoz-Mari J (2011) A survey of active learning algorithms for supervised remote sensing image classification. IEEE J Sel Top Signal Process 5(3):606–617CrossRef Tuia D, Volpi M, Copa L, Kanevski M, Munoz-Mari J (2011) A survey of active learning algorithms for supervised remote sensing image classification. IEEE J Sel Top Signal Process 5(3):606–617CrossRef
24.
go back to reference Tuia D, Volpi M, Copa L, Kanevski M, Munoz-Mari J (2011) A survey of active learning algorithms for supervised remote sensing image classification. IEEE J Sel Top Signal Process 5(3):606–617CrossRef Tuia D, Volpi M, Copa L, Kanevski M, Munoz-Mari J (2011) A survey of active learning algorithms for supervised remote sensing image classification. IEEE J Sel Top Signal Process 5(3):606–617CrossRef
26.
go back to reference Wan L, Tang K, Li M, Zhong Y, Qin AK (2015) Collaborative active and semisupervised learning for hyperspectral remote sensing image classification. IEEE Trans Geosci Remote Sens 53(5):2384–2396CrossRef Wan L, Tang K, Li M, Zhong Y, Qin AK (2015) Collaborative active and semisupervised learning for hyperspectral remote sensing image classification. IEEE Trans Geosci Remote Sens 53(5):2384–2396CrossRef
27.
go back to reference Wang Z, Du B, Guo Y (2020) Domain adaptation with neural embedding matching. IEEE Trans Neural Netw Learn Sys 31(7):2387–2397MathSciNetCrossRef Wang Z, Du B, Guo Y (2020) Domain adaptation with neural embedding matching. IEEE Trans Neural Netw Learn Sys 31(7):2387–2397MathSciNetCrossRef
28.
go back to reference Wang Z, Du B, Shi Q, Tu W (2019) Domain adaptation with discriminative distribution and manifold embedding for hyperspectral image classification. IEEE Geosci Remote Sens Lett 16(7):1155–1159CrossRef Wang Z, Du B, Shi Q, Tu W (2019) Domain adaptation with discriminative distribution and manifold embedding for hyperspectral image classification. IEEE Geosci Remote Sens Lett 16(7):1155–1159CrossRef
29.
go back to reference Wang Z, Du B, Zhang L, Zhang L, Jia X (2017) A novel semisupervised active-learning algorithm for hyperspectral image classification. IEEE Trans Geosci Remote Sens 55(6):3071–3083CrossRef Wang Z, Du B, Zhang L, Zhang L, Jia X (2017) A novel semisupervised active-learning algorithm for hyperspectral image classification. IEEE Trans Geosci Remote Sens 55(6):3071–3083CrossRef
30.
go back to reference Wu H, Prasad S (2017) Semi-supervised deep learning using pseudo labels for hyperspectral image classification. IEEE Trans Image Process 27 (3):1259–1270MathSciNetCrossRefMATH Wu H, Prasad S (2017) Semi-supervised deep learning using pseudo labels for hyperspectral image classification. IEEE Trans Image Process 27 (3):1259–1270MathSciNetCrossRefMATH
31.
go back to reference Zhang Y, Cao G, Li X, Wang B, Fu P (2019) Active semi-supervised random forest for hyperspectral image classification. Remote Sensing 11(24) Zhang Y, Cao G, Li X, Wang B, Fu P (2019) Active semi-supervised random forest for hyperspectral image classification. Remote Sensing 11(24)
32.
go back to reference Zhao Y, Shang S, Wang Y, Zheng B, Nguyen QVH, Zheng K (2018) Rest: A reference-based framework for spatio-temporal trajectory compression. In: Proceedings of the 24th ACM SIGKDD International conference on knowledge discovery & data mining, pp 2797–2806 Zhao Y, Shang S, Wang Y, Zheng B, Nguyen QVH, Zheng K (2018) Rest: A reference-based framework for spatio-temporal trajectory compression. In: Proceedings of the 24th ACM SIGKDD International conference on knowledge discovery & data mining, pp 2797–2806
33.
go back to reference Zhou X, Prasad S (2017) Active and semisupervised learning with morphological component analysis for hyperspectral image classification. IEEE Geosci Remote Sens Lett 14(8):1348–1352CrossRef Zhou X, Prasad S (2017) Active and semisupervised learning with morphological component analysis for hyperspectral image classification. IEEE Geosci Remote Sens Lett 14(8):1348–1352CrossRef
34.
go back to reference Zhou X, Prasad S (2017) Active and semisupervised learning with morphological component analysis for hyperspectral image classification. IEEE Geosci Remote Sens Lett 14(8):1348–1352CrossRef Zhou X, Prasad S (2017) Active and semisupervised learning with morphological component analysis for hyperspectral image classification. IEEE Geosci Remote Sens Lett 14(8):1348–1352CrossRef
35.
go back to reference Zhu R, Dornaika F, Ruichek Y (2020) Semi-supervised elastic manifold embedding with deep learning architecture. Pattern Recogn 107:107425CrossRef Zhu R, Dornaika F, Ruichek Y (2020) Semi-supervised elastic manifold embedding with deep learning architecture. Pattern Recogn 107:107425CrossRef
Metadata
Title
Unified active and semi-supervised learning for hyperspectral image classification
Authors
Zengmao Wang
Bo Du
Publication date
24-07-2021
Publisher
Springer US
Published in
GeoInformatica / Issue 1/2023
Print ISSN: 1384-6175
Electronic ISSN: 1573-7624
DOI
https://doi.org/10.1007/s10707-021-00443-0

Other articles of this Issue 1/2023

GeoInformatica 1/2023 Go to the issue