Skip to main content
Top

2013 | OriginalPaper | Chapter

77. Efficient Mixed-Norm Multiple Kernel Learning

Authors : Yan Wei, Han-shu Qin, Shao-hua Zeng

Published in: Proceedings of the International Conference on Information Engineering and Applications (IEA) 2012

Publisher: Springer London

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multiple kernels learning (MKL) is a hot topic in the current kernel machine learning field which aims at find a convexity linear combination of based kernels. Current MKL methods encourage spare kernel coefficients combination, unfortunately, when features encode orthogonal data, spareness tends to select only a few kernels, and may discards useful information which lead to poor generalization performance. In this paper, we presented an efficient multiple kernels learning method based on mix-norm in which sparseness and nonsparseness can be compromised using a mixing regularization. Both SVM and MKL could be regarded as special cases of EMNMKL. Then, we developed a rapid gradient descent algorithm to deal with the problem. Simulation experiment results show that the EMNMKL rapidly converges and the average testing accuracy demonstrates that EMNMKL algorithm clearly outperforms SVM and MKL.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Wang H-Q, Sun F-C, Cai Y-N, Chen N, Ding L-G (2010) On multiple kernel learning methods. Acta Automatica Sinica 36(8):1037–1050MathSciNetCrossRef Wang H-Q, Sun F-C, Cai Y-N, Chen N, Ding L-G (2010) On multiple kernel learning methods. Acta Automatica Sinica 36(8):1037–1050MathSciNetCrossRef
2.
go back to reference G¨onen M, Alpaydın E (2011) Multiple kernel learning algorithms. J Mach Learn Res 12:2211–2268 G¨onen M, Alpaydın E (2011) Multiple kernel learning algorithms. J Mach Learn Res 12:2211–2268
3.
go back to reference Rakotomamonjy A, Bach FR, Canu S, Grandvalet Y (2008) SimpleMKL. J Mach Learn Res 9:2491–2521 Rakotomamonjy A, Bach FR, Canu S, Grandvalet Y (2008) SimpleMKL. J Mach Learn Res 9:2491–2521
4.
go back to reference Tuia D, Camps-Valls G, Matasci G, Kanevski M (2010) Learning relevant image features with multiple-kernel classification. IEEE Geosci Remote Sens Soc 48(10):3780–3791CrossRef Tuia D, Camps-Valls G, Matasci G, Kanevski M (2010) Learning relevant image features with multiple-kernel classification. IEEE Geosci Remote Sens Soc 48(10):3780–3791CrossRef
5.
go back to reference Zhang X, Hu L, Wang ZS (2010) Multiple kernel support vector regression for economic forecasting, vol 36. In: International conference on management science and engineering, 17st. Melbourne, Australia, pp 129–134 Zhang X, Hu L, Wang ZS (2010) Multiple kernel support vector regression for economic forecasting, vol 36. In: International conference on management science and engineering, 17st. Melbourne, Australia, pp 129–134
6.
go back to reference Yeh CY, Huang CW, Lee SJ (2011) A multiple-kernel support vector regression approach for stock market price forecasting. Expert Syst Appl 38:2177–2186CrossRef Yeh CY, Huang CW, Lee SJ (2011) A multiple-kernel support vector regression approach for stock market price forecasting. Expert Syst Appl 38:2177–2186CrossRef
7.
go back to reference Wang HQ, Cai YN, Sun FC, Zhao ZT (2011) Adaptive sequence learning and applications for multi-scale kernel method. Pattern Recogn Artif Intell 24(1):72–81CrossRef Wang HQ, Cai YN, Sun FC, Zhao ZT (2011) Adaptive sequence learning and applications for multi-scale kernel method. Pattern Recogn Artif Intell 24(1):72–81CrossRef
8.
go back to reference Rakotomamonjy A, Bach F, Canu S, Grandvalet Y (2007) More efficiency in multiple kernel learning, vol 36. In: International conference on machine learning, 24st. Corvallis, OR, pp 73–75 Rakotomamonjy A, Bach F, Canu S, Grandvalet Y (2007) More efficiency in multiple kernel learning, vol 36. In: International conference on machine learning, 24st. Corvallis, OR, pp 73–75
9.
go back to reference Xu Z, Jin R, Yang H, King I, Lyu MR (2010) Simple and efficient multiple kernel learning by Group Lasso, vol 24. In: International conference on machine learning, 27st. Haifa, Israel, pp 62–66 Xu Z, Jin R, Yang H, King I, Lyu MR (2010) Simple and efficient multiple kernel learning by Group Lasso, vol 24. In: International conference on machine learning, 27st. Haifa, Israel, pp 62–66
10.
go back to reference Kloft M, Sonnenburg S, Laskov P, M¨uller KR, Zien A (2009) Efficient and accurate lp-norm multiple kernel learning. Adv Neural Inf Process Syst 22:997–1005 Kloft M, Sonnenburg S, Laskov P, M¨uller KR, Zien A (2009) Efficient and accurate lp-norm multiple kernel learning. Adv Neural Inf Process Syst 22:997–1005
11.
go back to reference Kloft M, Brefeld U, Laskov P, Sonnenburg S (2008) Non-sparse multiple kernel learning, vol 325. In: NIPS workshop on kernel learning: automatic selection of optimal kernels. Whistler, Canada, pp 62–66 Kloft M, Brefeld U, Laskov P, Sonnenburg S (2008) Non-sparse multiple kernel learning, vol 325. In: NIPS workshop on kernel learning: automatic selection of optimal kernels. Whistler, Canada, pp 62–66
13.
go back to reference Wu ZP, Zhang XG (2010) Elastic multiple kernel learning. Acta Automatica Sinica 37(6):693–699 Wu ZP, Zhang XG (2010) Elastic multiple kernel learning. Acta Automatica Sinica 37(6):693–699
14.
go back to reference Kloft M, Brefeld U, Sonnenburg S, Zien A (2011) lp-norm multiple kernel learning. J Mach Learn Res 12:663–709 Kloft M, Brefeld U, Sonnenburg S, Zien A (2011) lp-norm multiple kernel learning. J Mach Learn Res 12:663–709
Metadata
Title
Efficient Mixed-Norm Multiple Kernel Learning
Authors
Yan Wei
Han-shu Qin
Shao-hua Zeng
Copyright Year
2013
Publisher
Springer London
DOI
https://doi.org/10.1007/978-1-4471-4856-2_77