Skip to main content
Erschienen in: Neural Computing and Applications 11/2020

31.01.2019 | Original Article

MCK-ELM: multiple composite kernel extreme learning machine for hyperspectral images

verfasst von: Ugur Ergul, Gokhan Bilgin

Erschienen in: Neural Computing and Applications | Ausgabe 11/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multiple kernel (MK) learning (MKL) methods have a significant impact on improving the classification performance. Besides that, composite kernel (CK) methods have high capability on the analysis of hyperspectral images due to making use of the contextual information. In this work, it is aimed to aggregate both CKs and MKs autonomously without the need of kernel coefficient adjustment manually. Convex combination of predefined kernel functions is implemented by using multiple kernel extreme learning machine. Thus, complex optimization processes of standard MKL are disposed of and the facility of multi-class classification is profited. Different types of kernel functions are placed into MKs in order to realize hybrid kernel scenario. The proposed methodology is performed over Pavia University, Indian Pines, and Salinas hyperspectral scenes that have ground-truth information. Multiple composite kernels are constructed using Gaussian, polynomial, and logarithmic kernel functions with various parameters, and then the obtained results are presented comparatively along with the state-of-the-art standard machine learning, MKL, and CK methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hughes G (1968) On the mean accuracy of statistical pattern recognizers. IEEE Trans Inf Theory 14(1):55–63CrossRef Hughes G (1968) On the mean accuracy of statistical pattern recognizers. IEEE Trans Inf Theory 14(1):55–63CrossRef
2.
Zurück zum Zitat Bolton J, Gader P (2011) Application of multiple-instance learning for hyperspectral image analysis. IEEE Geosci Remote Sens Lett 8(5):889–893CrossRef Bolton J, Gader P (2011) Application of multiple-instance learning for hyperspectral image analysis. IEEE Geosci Remote Sens Lett 8(5):889–893CrossRef
3.
Zurück zum Zitat Camps-Valls G, Tuia D, Bruzzone L, Benediktsson JA (2014) Advances in hyperspectral image classification: earth monitoring with statistical learning methods. IEEE Signal Process Mag 31(1):45–54CrossRef Camps-Valls G, Tuia D, Bruzzone L, Benediktsson JA (2014) Advances in hyperspectral image classification: earth monitoring with statistical learning methods. IEEE Signal Process Mag 31(1):45–54CrossRef
4.
Zurück zum Zitat Camps-Valls G, Gómez-Chova L, Calpe-Maravilla J, Martín-Guerrero JD, Soria-Olivas E, Alonso-Chordá L, Moreno J (2004) Robust support vector method for hyperspectral data classification and knowledge discovery. IEEE Trans Geosci Remote Sens 42(7):1530–1542CrossRef Camps-Valls G, Gómez-Chova L, Calpe-Maravilla J, Martín-Guerrero JD, Soria-Olivas E, Alonso-Chordá L, Moreno J (2004) Robust support vector method for hyperspectral data classification and knowledge discovery. IEEE Trans Geosci Remote Sens 42(7):1530–1542CrossRef
5.
Zurück zum Zitat Han M, Liu B (2015) Ensemble of extreme learning machine for remote sensing image classification. Neurocomputing 149:65–70CrossRef Han M, Liu B (2015) Ensemble of extreme learning machine for remote sensing image classification. Neurocomputing 149:65–70CrossRef
6.
Zurück zum Zitat Mountrakis G, Im J, Ogole C (2011) Support vector machines in remote sensing: a review. ISPRS J Photogramm Remote Sens 66(3):247–259CrossRef Mountrakis G, Im J, Ogole C (2011) Support vector machines in remote sensing: a review. ISPRS J Photogramm Remote Sens 66(3):247–259CrossRef
7.
Zurück zum Zitat Pal M, Maxwell AE, Warner TA (2013) Kernel-based extreme learning machine for remote-sensing image classification. Remote Sens Lett 4(9):853–862CrossRef Pal M, Maxwell AE, Warner TA (2013) Kernel-based extreme learning machine for remote-sensing image classification. Remote Sens Lett 4(9):853–862CrossRef
8.
Zurück zum Zitat Chen C, Li W, Su H, Liu K (2014) Spectral–spatial classification of hyperspectral image based on kernel extreme learning machine. Remote Sens 6(6):5795–5814CrossRef Chen C, Li W, Su H, Liu K (2014) Spectral–spatial classification of hyperspectral image based on kernel extreme learning machine. Remote Sens 6(6):5795–5814CrossRef
9.
Zurück zum Zitat Camps-Valls G, Bruzzone L (2005) Kernel-based methods for hyperspectral image classification. IEEE Trans Geosci Remote Sens 43(6):1351–1362CrossRef Camps-Valls G, Bruzzone L (2005) Kernel-based methods for hyperspectral image classification. IEEE Trans Geosci Remote Sens 43(6):1351–1362CrossRef
10.
Zurück zum Zitat Pao YH, Takefuji Y (1992) Functional-link net computing: theory, system architecture, and functionalities. Computer 25(5):76–79CrossRef Pao YH, Takefuji Y (1992) Functional-link net computing: theory, system architecture, and functionalities. Computer 25(5):76–79CrossRef
11.
Zurück zum Zitat Igelnik B, Pao YH (1995) Stochastic choice of basis functions in adaptive function approximation and the functional-link net. IEEE Trans Neural Netw 6(6):1320–1329CrossRef Igelnik B, Pao YH (1995) Stochastic choice of basis functions in adaptive function approximation and the functional-link net. IEEE Trans Neural Netw 6(6):1320–1329CrossRef
12.
Zurück zum Zitat Li M, Wang D (2017) Insights into randomized algorithms for neural networks: practical issues and common pitfalls. Inf Sci 382:170–178CrossRef Li M, Wang D (2017) Insights into randomized algorithms for neural networks: practical issues and common pitfalls. Inf Sci 382:170–178CrossRef
13.
Zurück zum Zitat Wang D, Li M (2017) Stochastic configuration networks: fundamentals and algorithms. IEEE Trans Cybern 47(10):3466–3479CrossRef Wang D, Li M (2017) Stochastic configuration networks: fundamentals and algorithms. IEEE Trans Cybern 47(10):3466–3479CrossRef
14.
Zurück zum Zitat Schmidt WF, Kraaijveld MA, Duin RP (1992) Feedforward neural networks with random weights. In: Proceedings of 11th IAPR international conference on pattern recognition, vol. II. Conference B: pattern recognition methodology and systems. IEEE, pp 1–4 Schmidt WF, Kraaijveld MA, Duin RP (1992) Feedforward neural networks with random weights. In: Proceedings of 11th IAPR international conference on pattern recognition, vol. II. Conference B: pattern recognition methodology and systems. IEEE, pp 1–4
15.
Zurück zum Zitat Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501CrossRef Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501CrossRef
16.
Zurück zum Zitat Gönen M, Alpaydın E (2011) Multiple kernel learning algorithms. J Mach Learn Res 12(Jul):2211–2268MathSciNetMATH Gönen M, Alpaydın E (2011) Multiple kernel learning algorithms. J Mach Learn Res 12(Jul):2211–2268MathSciNetMATH
17.
Zurück zum Zitat Bach FR, Lanckriet GR, Jordan MI (2004) Multiple kernel learning, conic duality, and the smo algorithm. In: Proceedings of the 21st international conference on machine learning, ICML’04. ACM, p 6 Bach FR, Lanckriet GR, Jordan MI (2004) Multiple kernel learning, conic duality, and the smo algorithm. In: Proceedings of the 21st international conference on machine learning, ICML’04. ACM, p 6
18.
Zurück zum Zitat Gu Y, Chanussot J, Jia X, Benediktsson JA (2017) Multiple kernel learning for hyperspectral image classification: a review. IEEE Trans Geosci Remote Sens 55(11):6547–6565CrossRef Gu Y, Chanussot J, Jia X, Benediktsson JA (2017) Multiple kernel learning for hyperspectral image classification: a review. IEEE Trans Geosci Remote Sens 55(11):6547–6565CrossRef
19.
Zurück zum Zitat Wang Q, Gu Y, Tuia D (2016) Discriminative multiple kernel learning for hyperspectral image classification. IEEE Trans Geosci Remote Sens 54(7):3912–3927CrossRef Wang Q, Gu Y, Tuia D (2016) Discriminative multiple kernel learning for hyperspectral image classification. IEEE Trans Geosci Remote Sens 54(7):3912–3927CrossRef
20.
Zurück zum Zitat Liu X, Wang L, Huang GB, Zhang J, Yin J (2015) Multiple kernel extreme learning machine. Neurocomputing 149:253–264CrossRef Liu X, Wang L, Huang GB, Zhang J, Yin J (2015) Multiple kernel extreme learning machine. Neurocomputing 149:253–264CrossRef
21.
Zurück zum Zitat Li X, Mao W, Jiang W (2016) Multiple-kernel-learning-based extreme learning machine for classification design. Neural Comput Appl 27(1):175–184CrossRef Li X, Mao W, Jiang W (2016) Multiple-kernel-learning-based extreme learning machine for classification design. Neural Comput Appl 27(1):175–184CrossRef
22.
Zurück zum Zitat Camps-Valls G, Gomez-Chova L, Muñoz-Marí J, Vila-Francés J, Calpe-Maravilla J (2006) Composite kernels for hyperspectral image classification. IEEE Geosci Remote Sens Lett 3(1):93–97CrossRef Camps-Valls G, Gomez-Chova L, Muñoz-Marí J, Vila-Francés J, Calpe-Maravilla J (2006) Composite kernels for hyperspectral image classification. IEEE Geosci Remote Sens Lett 3(1):93–97CrossRef
23.
Zurück zum Zitat Zhou Y, Peng J, Chen CP (2015) Extreme learning machine with composite kernels for hyperspectral image classification. IEEE J Sel Top Appl Earth Obs Remote Sens 8(6):2351–2360CrossRef Zhou Y, Peng J, Chen CP (2015) Extreme learning machine with composite kernels for hyperspectral image classification. IEEE J Sel Top Appl Earth Obs Remote Sens 8(6):2351–2360CrossRef
24.
Zurück zum Zitat Ergul U, Bilgin G (2017) Hyperspectral image classification with hybrid kernel extreme learning machine. In: IEEE 25th signal processing and communications applications conference, SIU’17. IEEE, pp 1–4 Ergul U, Bilgin G (2017) Hyperspectral image classification with hybrid kernel extreme learning machine. In: IEEE 25th signal processing and communications applications conference, SIU’17. IEEE, pp 1–4
25.
Zurück zum Zitat Serre D (2000) Matrices: theory and applications, 2002. In: Graduate texts in mathematics Serre D (2000) Matrices: theory and applications, 2002. In: Graduate texts in mathematics
26.
Zurück zum Zitat Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH
27.
Zurück zum Zitat Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, CambridgeCrossRef Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, CambridgeCrossRef
28.
Zurück zum Zitat Huang GB, Zhou H, Ding X, Zhang R (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern Part B (Cybern) 42(2):513–529CrossRef Huang GB, Zhou H, Ding X, Zhang R (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern Part B (Cybern) 42(2):513–529CrossRef
29.
Zurück zum Zitat Rakotomamonjy A, Bach FR, Canu S, Grandvalet Y (2008) Simplemkl. J Mach Learn Res 9(Nov):2491–2521MathSciNetMATH Rakotomamonjy A, Bach FR, Canu S, Grandvalet Y (2008) Simplemkl. J Mach Learn Res 9(Nov):2491–2521MathSciNetMATH
30.
Zurück zum Zitat Xu X, Tsang IW, Xu D (2013) Soft margin multiple kernel learning. IEEE Trans Neural Netw Learn Syst 24(5):749–761CrossRef Xu X, Tsang IW, Xu D (2013) Soft margin multiple kernel learning. IEEE Trans Neural Netw Learn Syst 24(5):749–761CrossRef
31.
Zurück zum Zitat Kloft M, Brefeld U, Sonnenburg S, Zien A (2011) Lp-norm multiple kernel learning. J Mach Learn Res 12(Mar):953–997MathSciNetMATH Kloft M, Brefeld U, Sonnenburg S, Zien A (2011) Lp-norm multiple kernel learning. J Mach Learn Res 12(Mar):953–997MathSciNetMATH
32.
Zurück zum Zitat Xia H, Hoi SC (2013) Mkboost: a framework of multiple kernel boosting. IEEE Trans Knowl Data Eng 25(7):1574–1586CrossRef Xia H, Hoi SC (2013) Mkboost: a framework of multiple kernel boosting. IEEE Trans Knowl Data Eng 25(7):1574–1586CrossRef
33.
Zurück zum Zitat Boughorbel S, Tarel JP, Boujemaa N (2005) Conditionally positive definite kernels for svm based image recognition. In: IEEE international conference on multimedia and expo, ICME’05. IEEE, pp 113–116 Boughorbel S, Tarel JP, Boujemaa N (2005) Conditionally positive definite kernels for svm based image recognition. In: IEEE international conference on multimedia and expo, ICME’05. IEEE, pp 113–116
34.
Zurück zum Zitat Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20(1):37–46CrossRef Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20(1):37–46CrossRef
35.
Zurück zum Zitat Viera AJ, Garrett JM et al (2005) Understanding interobserver agreement: the kappa statistic. Fam Med 37(5):360–363 Viera AJ, Garrett JM et al (2005) Understanding interobserver agreement: the kappa statistic. Fam Med 37(5):360–363
36.
Zurück zum Zitat Foody GM (2004) Thematic map comparison. Photogramm Eng Remote Sens 70(5):627–633CrossRef Foody GM (2004) Thematic map comparison. Photogramm Eng Remote Sens 70(5):627–633CrossRef
Metadaten
Titel
MCK-ELM: multiple composite kernel extreme learning machine for hyperspectral images
verfasst von
Ugur Ergul
Gokhan Bilgin
Publikationsdatum
31.01.2019
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 11/2020
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-019-04044-9

Weitere Artikel der Ausgabe 11/2020

Neural Computing and Applications 11/2020 Zur Ausgabe

Premium Partner