Skip to main content
Top

2018 | OriginalPaper | Chapter

A Novel Nonlinear Multi-feature Fusion Algorithm: Multiple Kernel Multiset Integrated Canonical Correlation Analysis

Authors : Jing Yang, Liya Fan, Quansen Sun, Yuhua Fan

Published in: Cloud Computing and Security

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multiset integrated canonical correlation analysis (MICCA) can distinctly express the integral correlation among multi-group feature. Thus, MICCA is very powerful for multiple feature extraction. However, it is difficult to capture nonlinear relationships with the linear mapping. In order to overcome this problem, we, in this paper, propose a multi-kernel multiset integrated canonical correlation analysis (MK-MICCA) framework for subspace learning. In the MK-MICCA framework, the input data of each feature are mapped into multiple higher dimensional feature spaces by implicitly nonlinear mappings determined by different kernels. This enables MK-MICCA to uncover a variety of different geometrical structures of the original data in the feature spaces. Extensive experimental results on multiple feature database and ORL database show that MK-MICCA is very effective and obviously outperforms the single-kernel-based MICCA.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Hardoon, D.R., Szedmak, S., Shawe-Taylor, J.: Canonical correlation analysis: an overview with application to learning methods. Neural Comput. 16, 2639–2664 (2004)CrossRef Hardoon, D.R., Szedmak, S., Shawe-Taylor, J.: Canonical correlation analysis: an overview with application to learning methods. Neural Comput. 16, 2639–2664 (2004)CrossRef
2.
go back to reference Sun, Q.-S., Zeng, S.-G., Liu, Y., Heng, P.-A., Xia, D.-S.: A new method of feature fusion and its application in image recognition. Pattern Recognit. 38, 2437–2448 (2005)CrossRef Sun, Q.-S., Zeng, S.-G., Liu, Y., Heng, P.-A., Xia, D.-S.: A new method of feature fusion and its application in image recognition. Pattern Recognit. 38, 2437–2448 (2005)CrossRef
4.
go back to reference Hou, S.-D., Sun, Q.-S., Xia, D.-S.: Supervised locality preserving canonical correlation analysis algorithm. Pattern Recognit. Artif. Intell. 25(1), 143–149 (2012) Hou, S.-D., Sun, Q.-S., Xia, D.-S.: Supervised locality preserving canonical correlation analysis algorithm. Pattern Recognit. Artif. Intell. 25(1), 143–149 (2012)
5.
go back to reference Melzer, T., Reiter, M., Bischof, H.: Appearance models based on kernel canonical correlation analysis. Pattern Recognit. 36, 1961–1971 (2003)CrossRef Melzer, T., Reiter, M., Bischof, H.: Appearance models based on kernel canonical correlation analysis. Pattern Recognit. 36, 1961–1971 (2003)CrossRef
6.
go back to reference Kidron, E., Schechner, Y.Y., Elad, M.: Pixels that Sound. IEEE Proc. Comput. Vis. Pattern Recognit. 1, 88–95 (2005) Kidron, E., Schechner, Y.Y., Elad, M.: Pixels that Sound. IEEE Proc. Comput. Vis. Pattern Recognit. 1, 88–95 (2005)
7.
go back to reference Fortuna, B.: Kernel canonical correlation analysis with applications. In: SIKDD 2004 at Multiconference IS 2004, Ljubljana, Slovenia, pp. 12–15, October 2004 Fortuna, B.: Kernel canonical correlation analysis with applications. In: SIKDD 2004 at Multiconference IS 2004, Ljubljana, Slovenia, pp. 12–15, October 2004
8.
go back to reference Shawe-Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge Press, Cambridge (2004)CrossRef Shawe-Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge Press, Cambridge (2004)CrossRef
9.
go back to reference Sun, Q.-S., Liu, Z.-D., Heng, P.-A., Xia, D.-S.: A theorem on the generalized canonical projective vectors. Pattern Recognit. 38, 449–452 (2005)CrossRef Sun, Q.-S., Liu, Z.-D., Heng, P.-A., Xia, D.-S.: A theorem on the generalized canonical projective vectors. Pattern Recognit. 38, 449–452 (2005)CrossRef
10.
go back to reference Sun, T., Chen, S., Yang, J., Shi, P.: A novel method of combined feature extraction for recognition. In: Eighth IEEE International Conference on Data Mining, ICDM08, pp. 1043–1048. IEEE (2008) Sun, T., Chen, S., Yang, J., Shi, P.: A novel method of combined feature extraction for recognition. In: Eighth IEEE International Conference on Data Mining, ICDM08, pp. 1043–1048. IEEE (2008)
11.
go back to reference Sun, T., Chen, S.: Locality preserving CCA with applications to data visualization and pose estimation. Image Vis. Comput. 25, 531–543 (2007)CrossRef Sun, T., Chen, S.: Locality preserving CCA with applications to data visualization and pose estimation. Image Vis. Comput. 25, 531–543 (2007)CrossRef
12.
go back to reference Peng, Y., Zhang, D., Zhang, J.: A new canonical correlation analysis algorithm with local discrimination. Neural Process. Lett. 31, 1–15 (2010)CrossRef Peng, Y., Zhang, D., Zhang, J.: A new canonical correlation analysis algorithm with local discrimination. Neural Process. Lett. 31, 1–15 (2010)CrossRef
14.
go back to reference Yuan, Y.-H., Sun, Q.-S., Zhou, Q., Xia, D.-S.: A novel multiset integrated canonical correlation analysis framework and its application in feature fusion. Pattern Recognit. 44, 1031–1040 (2011)CrossRef Yuan, Y.-H., Sun, Q.-S., Zhou, Q., Xia, D.-S.: A novel multiset integrated canonical correlation analysis framework and its application in feature fusion. Pattern Recognit. 44, 1031–1040 (2011)CrossRef
16.
go back to reference Sonnenburg, S., Räatsch, G., Schäfer, C., Schölkopf, B.: Large scale multiple kernel learning. J. Mach. Learn. Res. 7, 1531–1565 (2006)MathSciNetMATH Sonnenburg, S., Räatsch, G., Schäfer, C., Schölkopf, B.: Large scale multiple kernel learning. J. Mach. Learn. Res. 7, 1531–1565 (2006)MathSciNetMATH
17.
go back to reference Rakotomamonjy, A., Bach, F., Canu, S., Grandvalet, Y.: More efficiency in multiple kernel learning. In: Proceedings of the 24th International Conference on Machine Learning, pp. 775–782 (2007) Rakotomamonjy, A., Bach, F., Canu, S., Grandvalet, Y.: More efficiency in multiple kernel learning. In: Proceedings of the 24th International Conference on Machine Learning, pp. 775–782 (2007)
18.
go back to reference Xu, X., Tsang, I.W., Xu, D.: Soft margin multiple kernel learning. IEEE Trans. Neural Netw. Learn. Syst. 24(5), 749–761 (2013)CrossRef Xu, X., Tsang, I.W., Xu, D.: Soft margin multiple kernel learning. IEEE Trans. Neural Netw. Learn. Syst. 24(5), 749–761 (2013)CrossRef
19.
go back to reference Zhang, G.Q., Sun, H., Xia, G., Sun, Q.: Multiple kernel sparse representation based orthogonal discriminative projection and its cost-sensitive extension. IEEE Trans. Image Process. 25(9), 4271–4285 (2016)MathSciNet Zhang, G.Q., Sun, H., Xia, G., Sun, Q.: Multiple kernel sparse representation based orthogonal discriminative projection and its cost-sensitive extension. IEEE Trans. Image Process. 25(9), 4271–4285 (2016)MathSciNet
20.
go back to reference Kim, S.J., Magnani, A., Boyd, S.: Optimal kernel selection in kernel fisher discriminant analysis. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 465–472 (2006) Kim, S.J., Magnani, A., Boyd, S.: Optimal kernel selection in kernel fisher discriminant analysis. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 465–472 (2006)
21.
go back to reference Yan, F., Kittler, J., Mikolajczyk, K., Tahir, A.: Nonsparse multiple kernel fisher discriminant analysis. J. Mach. Learn. Res. 13(1), 607–642 (2012)MathSciNetMATH Yan, F., Kittler, J., Mikolajczyk, K., Tahir, A.: Nonsparse multiple kernel fisher discriminant analysis. J. Mach. Learn. Res. 13(1), 607–642 (2012)MathSciNetMATH
22.
go back to reference Lin, Y.Y., Liu, T.L., Fuh, C.S.: Multiple kernel learning for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 33(6), 1147–1160 (2011)CrossRef Lin, Y.Y., Liu, T.L., Fuh, C.S.: Multiple kernel learning for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 33(6), 1147–1160 (2011)CrossRef
23.
go back to reference Gan, H.: Multi-class semi-supervised kernel minimum squared error for face recognition. Opt. Int. J. Light. Electron Opt. 126(23), 3496–3500 (2015)CrossRef Gan, H.: Multi-class semi-supervised kernel minimum squared error for face recognition. Opt. Int. J. Light. Electron Opt. 126(23), 3496–3500 (2015)CrossRef
24.
go back to reference Sun, Q.-S.: Research on Feature Extraction and Image Recognition Based on Correlation Projection Analysis, Ph.D. Dissertation, Nanjing University of Science and Technology, Nanjing (2006) Sun, Q.-S.: Research on Feature Extraction and Image Recognition Based on Correlation Projection Analysis, Ph.D. Dissertation, Nanjing University of Science and Technology, Nanjing (2006)
25.
go back to reference Sun, J.: An algorithm for the solution of multi-parameter eigenvalue problems (II). J. Comput. Math. 4, 354–363 (1986)MathSciNetMATH Sun, J.: An algorithm for the solution of multi-parameter eigenvalue problems (II). J. Comput. Math. 4, 354–363 (1986)MathSciNetMATH
26.
go back to reference Wang, Z., Chen, S., Sun, T.: MultiK-MHKS: a novel multiple kernel learning algorithm. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 348–353 (2008)CrossRef Wang, Z., Chen, S., Sun, T.: MultiK-MHKS: a novel multiple kernel learning algorithm. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 348–353 (2008)CrossRef
27.
go back to reference Jain, A.K., Duin, R.P.W., Mao, J.: Statistical pattern recognition: a review. IEEE Trans. Pattern Anal. Mach. Intell. 22(1), 4–37 (2000)CrossRef Jain, A.K., Duin, R.P.W., Mao, J.: Statistical pattern recognition: a review. IEEE Trans. Pattern Anal. Mach. Intell. 22(1), 4–37 (2000)CrossRef
28.
go back to reference Li, B., Huo, G.: Face recognition using locality sensitive histograms of oriented gradients. Opt. Int. J. Light. Electron Opt. 127(6), 3489–3494 (2016)MathSciNetCrossRef Li, B., Huo, G.: Face recognition using locality sensitive histograms of oriented gradients. Opt. Int. J. Light. Electron Opt. 127(6), 3489–3494 (2016)MathSciNetCrossRef
Metadata
Title
A Novel Nonlinear Multi-feature Fusion Algorithm: Multiple Kernel Multiset Integrated Canonical Correlation Analysis
Authors
Jing Yang
Liya Fan
Quansen Sun
Yuhua Fan
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-00021-9_24

Premium Partner