Skip to main content
Top
Published in: Pattern Analysis and Applications 2/2017

26-09-2015 | Theoretical Advances

A multiple attributes convolution kernel with reproducing property

Authors: Lixiang Xu, Xiu Chen, Xin Niu, Cheng Zhang, Bin Luo

Published in: Pattern Analysis and Applications | Issue 2/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Various kernel-based methods have been developed with great success in many fields, but very little research has been published that is concerned with a multiple attribute kernel in reproducing kernel Hilbert space (RKHS). In this paper, we propose a novel elastic kernel called a multiple attribute convolution kernel with reproducing property (MACKRP) and present improved classification results over conventional approaches in the RKHS rather than the more commonly used Hilbert space. The MACKRP consists of two major steps. First, we find the basic solution of a generalized differential operator by the delta function, and then we design a convolution function using this solution. This convolution function is proven to be a specific reproducing kernel called a convolution reproducing kernel (CRK) in H 3-space. Second, we prove that the CRK satisfies the condition of Mercer kernel. And the CRK is composed of three attributes (L 1-norm, L 2-norm and Laplace kernel), and each attribute can capture a different feature, with all attributes generating a novel kernel which we call an MACKRP. The experimental results demonstrate that the MACKRP possesses approximation and regularization performance and that classification results are consistently comparable or superior to a number of other state-of-the-art kernel functions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Lu H et al (2011) On feature combination and multiple kernel learning for object tracking. In: Computer vision (ACCV 2010). Springer, Berlin, pp 511–522 Lu H et al (2011) On feature combination and multiple kernel learning for object tracking. In: Computer vision (ACCV 2010). Springer, Berlin, pp 511–522
2.
go back to reference Kim J, Scott CD (2010) L2 kernel classification. IEEE Trans Pattern Anal Mach Intell 32:1822–1831CrossRef Kim J, Scott CD (2010) L2 kernel classification. IEEE Trans Pattern Anal Mach Intell 32:1822–1831CrossRef
3.
go back to reference He R et al (2011) A regularized correntropy framework for robust pattern recognition. Neural Comput 23:2074–2100CrossRefMATH He R et al (2011) A regularized correntropy framework for robust pattern recognition. Neural Comput 23:2074–2100CrossRefMATH
4.
go back to reference Shen C et al (2007) Fast global kernel density mode seeking: applications to localization and tracking. IEEE Trans Image Process 16:1457–1469MathSciNetCrossRef Shen C et al (2007) Fast global kernel density mode seeking: applications to localization and tracking. IEEE Trans Image Process 16:1457–1469MathSciNetCrossRef
5.
go back to reference Tzortzis GF, Likas C (2009) The global kernel-means algorithm for clustering in feature space. IEEE Trans Neural Netw 20:1181–1194CrossRef Tzortzis GF, Likas C (2009) The global kernel-means algorithm for clustering in feature space. IEEE Trans Neural Netw 20:1181–1194CrossRef
6.
go back to reference Jorstad A et al (2011) A deformation and lighting insensitive metric for face recognition based on dense correspondences. In: 2011 IEEE conference on computer vision and pattern recognition (CVPR), pp 2353–2360 Jorstad A et al (2011) A deformation and lighting insensitive metric for face recognition based on dense correspondences. In: 2011 IEEE conference on computer vision and pattern recognition (CVPR), pp 2353–2360
7.
go back to reference Gao S et al (2010) Kernel sparse representation for image classification and face recognition. In: Computer vision (ECCV 2010). Springer, Berlin, pp 1–14 Gao S et al (2010) Kernel sparse representation for image classification and face recognition. In: Computer vision (ECCV 2010). Springer, Berlin, pp 1–14
8.
go back to reference Jose C et al (2013) Local deep kernel learning for efficient non-linear SVM prediction. In: Proceedings of the 30th international conference on machine learning (ICML-13), pp 486–494 Jose C et al (2013) Local deep kernel learning for efficient non-linear SVM prediction. In: Proceedings of the 30th international conference on machine learning (ICML-13), pp 486–494
9.
go back to reference Caputo B et al (2004) Object categorization via local kernels. In: Proceedings of the 17th international conference on pattern recognition, 2004 (ICPR 2004), pp 132–135 Caputo B et al (2004) Object categorization via local kernels. In: Proceedings of the 17th international conference on pattern recognition, 2004 (ICPR 2004), pp 132–135
10.
go back to reference Boughorbel S et al (2005) Conditionally positive definite kernels for SVM based image recognition. In: IEEE international conference on multimedia and expo, 2005 (ICME 2005), pp 113–116 Boughorbel S et al (2005) Conditionally positive definite kernels for SVM based image recognition. In: IEEE international conference on multimedia and expo, 2005 (ICME 2005), pp 113–116
11.
go back to reference Shen C et al (2007) Fast global kernel density mode seeking: applications to localization and tracking. IEEE Trans Image Process 16:1457–1469MathSciNetCrossRef Shen C et al (2007) Fast global kernel density mode seeking: applications to localization and tracking. IEEE Trans Image Process 16:1457–1469MathSciNetCrossRef
12.
go back to reference Tzortzis G, Likas A (2008) The global kernel k-means clustering algorithm. In: IEEE international joint conference on neural networks, 2008 (IJCNN 2008). IEEE World Congress on Computational Intelligence, pp 1977–1984 Tzortzis G, Likas A (2008) The global kernel k-means clustering algorithm. In: IEEE international joint conference on neural networks, 2008 (IJCNN 2008). IEEE World Congress on Computational Intelligence, pp 1977–1984
13.
go back to reference Gönen M, Alpaydin E (2008) Localized multiple kernel learning. In: Proceedings of the 25th international conference on machine learning, pp 352–359 Gönen M, Alpaydin E (2008) Localized multiple kernel learning. In: Proceedings of the 25th international conference on machine learning, pp 352–359
16.
go back to reference Bai L et al (2015) A quantum Jensen–Shannon graph kernel for unattributed graphs. Pattern Recognit 48:344–355CrossRef Bai L et al (2015) A quantum Jensen–Shannon graph kernel for unattributed graphs. Pattern Recognit 48:344–355CrossRef
17.
go back to reference Bai L, Hancock ER (2013) Graph kernels from the Jensen–Shannon divergence. J Math Imaging Vis 47:60–69CrossRefMATH Bai L, Hancock ER (2013) Graph kernels from the Jensen–Shannon divergence. J Math Imaging Vis 47:60–69CrossRefMATH
18.
go back to reference Tuytelaars T et al (2011) The NBNN kernel. In: 2011 IEEE international conference on computer vision (ICCV), pp 1824–1831 Tuytelaars T et al (2011) The NBNN kernel. In: 2011 IEEE international conference on computer vision (ICCV), pp 1824–1831
19.
go back to reference Zhang D et al (2010) Gaussian ERP kernel classifier for pulse waveforms classification. In: 20th international conference on pattern recognition 2010 (ICPR 10), pp 2736–2739 Zhang D et al (2010) Gaussian ERP kernel classifier for pulse waveforms classification. In: 20th international conference on pattern recognition 2010 (ICPR 10), pp 2736–2739
20.
go back to reference Liu Z et al (2013) Multi-fault classification based on wavelet SVM with PSO algorithm to analyze vibration signals from rolling element bearings. Neurocomputing 99:399–410CrossRef Liu Z et al (2013) Multi-fault classification based on wavelet SVM with PSO algorithm to analyze vibration signals from rolling element bearings. Neurocomputing 99:399–410CrossRef
21.
go back to reference Rossi L et al (2013) A continuous-time quantum walk kernel for unattributed graphs. In: Graph-based representations in pattern recognition. Springer, Berlin, pp 101–110 Rossi L et al (2013) A continuous-time quantum walk kernel for unattributed graphs. In: Graph-based representations in pattern recognition. Springer, Berlin, pp 101–110
22.
go back to reference Luo Y et al (2013) Multiview vector-valued manifold regularization for multilabel image classification. IEEE Trans Neural Netw Learn Syst 24:709–722CrossRef Luo Y et al (2013) Multiview vector-valued manifold regularization for multilabel image classification. IEEE Trans Neural Netw Learn Syst 24:709–722CrossRef
23.
go back to reference Luo Y et al (2013) Manifold regularized multitask learning for semi-supervised multilabel image classification. IEEE Trans Image Process 22:523–536MathSciNetCrossRef Luo Y et al (2013) Manifold regularized multitask learning for semi-supervised multilabel image classification. IEEE Trans Image Process 22:523–536MathSciNetCrossRef
24.
go back to reference Yu J et al (2012) Semisupervised multiview distance metric learning for cartoon synthesis. IEEE Trans Image Process 21:4636–4648MathSciNetCrossRef Yu J et al (2012) Semisupervised multiview distance metric learning for cartoon synthesis. IEEE Trans Image Process 21:4636–4648MathSciNetCrossRef
25.
go back to reference Xu L et al (2015) An efficient multiple kernel learning in reproducing kernel Hilbert spaces (RKHS). Int J Wavelets Multiresolut Inf Process Xu L et al (2015) An efficient multiple kernel learning in reproducing kernel Hilbert spaces (RKHS). Int J Wavelets Multiresolut Inf Process
26.
go back to reference Xu L et al (2015) A local–global mixed kernel with reproducing property. Neurocomputing 168:190–199CrossRef Xu L et al (2015) A local–global mixed kernel with reproducing property. Neurocomputing 168:190–199CrossRef
27.
go back to reference Yu J et al (2014) Click prediction for web image reranking using multimodal sparse coding Yu J et al (2014) Click prediction for web image reranking using multimodal sparse coding
28.
go back to reference Xu C et al (2014) Large-margin multi-view information bottleneck. IEEE Trans Pattern Anal Mach Intell 36:1559–1572CrossRef Xu C et al (2014) Large-margin multi-view information bottleneck. IEEE Trans Pattern Anal Mach Intell 36:1559–1572CrossRef
29.
go back to reference Yu J et al (2014) High-order distance-based multiview stochastic learning in image classification Yu J et al (2014) High-order distance-based multiview stochastic learning in image classification
30.
31.
go back to reference Xu C et al (2015) Multi-view intact space learning. IEEE Trans Pattern Anal Mach Intell Xu C et al (2015) Multi-view intact space learning. IEEE Trans Pattern Anal Mach Intell 
32.
go back to reference Luo Y et al (2015) Multi-view matrix completion for multi-label image classification. IEEE Trans Image Process 24:2355–2368 Luo Y et al (2015) Multi-view matrix completion for multi-label image classification. IEEE Trans Image Process 24:2355–2368
33.
go back to reference Vito ED et al (2010) Spectral regularization for support estimation. In: Advances in neural information processing systems, pp 487–495 Vito ED et al (2010) Spectral regularization for support estimation. In: Advances in neural information processing systems, pp 487–495
34.
go back to reference Chapelle O et al (1999) Support vector machines for histogram-based image classification. IEEE Trans Neural Netw 10:1055–1064CrossRef Chapelle O et al (1999) Support vector machines for histogram-based image classification. IEEE Trans Neural Netw 10:1055–1064CrossRef
36.
go back to reference Tao D et al (2006) Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. IEEE Trans Pattern Anal Mach Intell 28:1088–1099CrossRef Tao D et al (2006) Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. IEEE Trans Pattern Anal Mach Intell 28:1088–1099CrossRef
37.
go back to reference Shawe-Taylor J, Cristianini N (2004) Kernel methods for pattern analysis. Cambridge University Press, London Shawe-Taylor J, Cristianini N (2004) Kernel methods for pattern analysis. Cambridge University Press, London
38.
go back to reference Lapidus L, Pinder GF (2011) Numerical solution of partial differential equations in science and engineering. Wiley, New York Lapidus L, Pinder GF (2011) Numerical solution of partial differential equations in science and engineering. Wiley, New York
39.
go back to reference Ding L (2009) L1-norm and L2-norm neuroimaging methods in reconstructing extended cortical sources from EEG. In: Annual international conference of the IEEE on engineering in medicine and biology society, 2009 (EMBC 2009), pp 1922–1925 Ding L (2009) L1-norm and L2-norm neuroimaging methods in reconstructing extended cortical sources from EEG. In: Annual international conference of the IEEE on engineering in medicine and biology society, 2009 (EMBC 2009), pp 1922–1925
40.
go back to reference Bektaş S, Şişman Y (2010) The comparison of L1 and L2-norm minimization methods. Int J Phys Sci Bektaş S, Şişman Y (2010) The comparison of L1 and L2-norm minimization methods. Int J Phys Sci
41.
go back to reference Yi H et al (2013) Reconstruction algorithms based on l1-norm and l2-norm for two imaging models of fluorescence molecular tomography: a comparative study. J Biomed Opt 18:056013–056014CrossRef Yi H et al (2013) Reconstruction algorithms based on l1-norm and l2-norm for two imaging models of fluorescence molecular tomography: a comparative study. J Biomed Opt 18:056013–056014CrossRef
42.
go back to reference Drucker H et al (1997) Support vector regression machines. Adv Neural Inf Process Syst 9:155–161 Drucker H et al (1997) Support vector regression machines. Adv Neural Inf Process Syst 9:155–161
43.
go back to reference Chang C-C, Lin C-J (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2:27 Chang C-C, Lin C-J (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2:27
44.
go back to reference Cheng J et al (2013) Superpixel classification based optic disc and optic cup segmentation for glaucoma screening. IEEE Trans Med Imaging 32:1019–1032CrossRef Cheng J et al (2013) Superpixel classification based optic disc and optic cup segmentation for glaucoma screening. IEEE Trans Med Imaging 32:1019–1032CrossRef
Metadata
Title
A multiple attributes convolution kernel with reproducing property
Authors
Lixiang Xu
Xiu Chen
Xin Niu
Cheng Zhang
Bin Luo
Publication date
26-09-2015
Publisher
Springer London
Published in
Pattern Analysis and Applications / Issue 2/2017
Print ISSN: 1433-7541
Electronic ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-015-0514-y

Other articles of this Issue 2/2017

Pattern Analysis and Applications 2/2017 Go to the issue

Premium Partner