Skip to main content
Top
Published in: Pattern Analysis and Applications 4/2015

01-11-2015 | Theoretical Advances

A modified kernel clustering method with multiple factors

Authors: Changming Zhu, Daqi Gao

Published in: Pattern Analysis and Applications | Issue 4/2015

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We propose a simple and effective method about kernel clustering. This method takes many factors about kernel clustering into account. These factors include the selection of the initial centers of kernels, the ways of how to compute widths of kernels and the distances between patterns, different growing ways of kernels, and different kernel clustering criterions. Experiments have validated that these factors have influence on the final experimental results while not each factor has a great influence. Furthermore, some classifiers with this proposed kernel clustering method have higher classification accuracies and lower generalization risks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Novikoff AB (1962) On convergence proofs on perceptrons. Polytechnic Institute of Brooklyn 12:615–622 Novikoff AB (1962) On convergence proofs on perceptrons. Polytechnic Institute of Brooklyn 12:615–622
2.
go back to reference Freund Y, Schapire RE (1999) Large margin classification using the perceptron algorithm. Mach Learn 37(3):277–296MATHCrossRef Freund Y, Schapire RE (1999) Large margin classification using the perceptron algorithm. Mach Learn 37(3):277–296MATHCrossRef
3.
4.
go back to reference Arora S, Babai L, Stern J, Sweedyk Z (1993) The hardness of approximate optima in lattices, codes, and systems of linear equations. In: 34th Annual Symposium on Foundations of Computer Science, pp 724–733 Arora S, Babai L, Stern J, Sweedyk Z (1993) The hardness of approximate optima in lattices, codes, and systems of linear equations. In: 34th Annual Symposium on Foundations of Computer Science, pp 724–733
6.
go back to reference Mazurowski MA, Zurada JM, Tourassi GD (2009) An adaptive incremental approach to constructing ensemble classifiers: application in an information-theoretic computer-aided decision system for detection of masses in mammograms. Med Phys 36(7):2976–2984CrossRef Mazurowski MA, Zurada JM, Tourassi GD (2009) An adaptive incremental approach to constructing ensemble classifiers: application in an information-theoretic computer-aided decision system for detection of masses in mammograms. Med Phys 36(7):2976–2984CrossRef
7.
go back to reference Hart P (1968) The condensed nearest neighbor rule. IEEE Trans Inf Theory 14:515–516CrossRef Hart P (1968) The condensed nearest neighbor rule. IEEE Trans Inf Theory 14:515–516CrossRef
8.
go back to reference Gates W (1972) The reduced nearest neighbor rule. IEEE Trans Inf Theory 18:431–433CrossRef Gates W (1972) The reduced nearest neighbor rule. IEEE Trans Inf Theory 18:431–433CrossRef
9.
go back to reference Ritter GL, Woodruff HB, Lowry SR, Isenhour TL (1975) An algorithm for a selective nearest neighbor decision rule. IEEE Trans Inf Theory 21(6):665–669MATHCrossRef Ritter GL, Woodruff HB, Lowry SR, Isenhour TL (1975) An algorithm for a selective nearest neighbor decision rule. IEEE Trans Inf Theory 21(6):665–669MATHCrossRef
10.
go back to reference Vapnik V (1998) Statistical learning theory. Wiley-Interscience, New YorkMATH Vapnik V (1998) Statistical learning theory. Wiley-Interscience, New YorkMATH
11.
go back to reference Leski J (2003) Ho-kashyap classifier with generalization control. Pattern Recogn Lett 24(14):2281–2290MATHCrossRef Leski J (2003) Ho-kashyap classifier with generalization control. Pattern Recogn Lett 24(14):2281–2290MATHCrossRef
12.
go back to reference Yeh IC, Zhang XY, Wu C, Huang KC (2010) Radial basis function networks with adjustable kernel shape parameters. In: 2010 International Conference on Machine Learning and Cybernetics (ICMLC), vol 3, pp 1482–1 Yeh IC, Zhang XY, Wu C, Huang KC (2010) Radial basis function networks with adjustable kernel shape parameters. In: 2010 International Conference on Machine Learning and Cybernetics (ICMLC), vol 3, pp 1482–1
13.
go back to reference Haikin S (1998) Neural networks: a comprehensive foundation. Prentice Hall PTR, Indianapolis Haikin S (1998) Neural networks: a comprehensive foundation. Prentice Hall PTR, Indianapolis
14.
go back to reference Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, CambridgeCrossRef Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, CambridgeCrossRef
15.
go back to reference Lanckriet GRG, Cristianini N, Bartlett P, Ghaoui LE, Jordan MI (2004) Learning the kernel matrix with semidefinite programming. J Mach Learn Res 5:27–72MATH Lanckriet GRG, Cristianini N, Bartlett P, Ghaoui LE, Jordan MI (2004) Learning the kernel matrix with semidefinite programming. J Mach Learn Res 5:27–72MATH
16.
go back to reference Huang KZ, Yang HQ, King I, Lyu MR (2004) Learning large margin classifiers locally and globally. In: Proceedings of the twenty-first international conference on Machine learning, p 51 Huang KZ, Yang HQ, King I, Lyu MR (2004) Learning large margin classifiers locally and globally. In: Proceedings of the twenty-first international conference on Machine learning, p 51
17.
go back to reference Sonnenburg S, Ratsch G, Schafer C, Scholkopf B (2006) Large scale multiple kernel learning. J Mach Learn Res 7:1531–1565MATHMathSciNet Sonnenburg S, Ratsch G, Schafer C, Scholkopf B (2006) Large scale multiple kernel learning. J Mach Learn Res 7:1531–1565MATHMathSciNet
18.
go back to reference Gao DQ, Li J (2006) Kernel fisher discriminants and kernel nearest neighbor classifiers: a comparative study for large-scale learning problems. In: International joint conference on neural networks pp 1333–1338 Gao DQ, Li J (2006) Kernel fisher discriminants and kernel nearest neighbor classifiers: a comparative study for large-scale learning problems. In: International joint conference on neural networks pp 1333–1338
19.
go back to reference Hartigan JA, Wong MA (1978) Algorithm AS 136: a k-means clustering algorithm. Appl Stat 28(1):100–108CrossRef Hartigan JA, Wong MA (1978) Algorithm AS 136: a k-means clustering algorithm. Appl Stat 28(1):100–108CrossRef
20.
go back to reference Day WH, Edelsbrunner H (1984) Efficient algorithms for agglomerative hierarchical clustering methods. J Classif 1(1):7–24MATHCrossRef Day WH, Edelsbrunner H (1984) Efficient algorithms for agglomerative hierarchical clustering methods. J Classif 1(1):7–24MATHCrossRef
21.
go back to reference Newman CBDJ, Hettich S, Merz C (2012) UCI repository of machine learning databases Newman CBDJ, Hettich S, Merz C (2012) UCI repository of machine learning databases
22.
go back to reference Nene SA, Nayar SK, Murase H (1996) Columbia Object Image Library (COIL-20). Technical Report CUCS-005-96, Columbia University Nene SA, Nayar SK, Murase H (1996) Columbia Object Image Library (COIL-20). Technical Report CUCS-005-96, Columbia University
23.
go back to reference Cun BBL, Denker JS, Henderson D, Howard RE, Hubbard W, Jackel LD (1990) Handwritten digit recognition with a back-propagation network. Advances in neural information processing systems Cun BBL, Denker JS, Henderson D, Howard RE, Hubbard W, Jackel LD (1990) Handwritten digit recognition with a back-propagation network. Advances in neural information processing systems
24.
go back to reference Bennett F, Richardson T, Harter A (1994) Teleporting-making applications mobile. Mobile Computing Systems and Applications pp 82–84 Bennett F, Richardson T, Harter A (1994) Teleporting-making applications mobile. Mobile Computing Systems and Applications pp 82–84
25.
go back to reference Kumar N, Berg AC, Belhumeur PN, Nayar SK (2009) Attribute and simile classifiers for face verification. In: International Conference on Computer Vision, pp 365–372 Kumar N, Berg AC, Belhumeur PN, Nayar SK (2009) Attribute and simile classifiers for face verification. In: International Conference on Computer Vision, pp 365–372
26.
go back to reference Smith BA, Yin Q, Feiner SK, Nayar SK (2013) Gaze locking: passive eye contact detection for human object interaction. In: ACM Symposium on User Interface Software and Technology (UIST), pp 271–280 Smith BA, Yin Q, Feiner SK, Nayar SK (2013) Gaze locking: passive eye contact detection for human object interaction. In: ACM Symposium on User Interface Software and Technology (UIST), pp 271–280
27.
go back to reference Galar M, Fernandez A, Barrenechea E, Bustince H, Herrera F (2011) An overview of ensemble methods for binary classifiers in multi-class problems: experimental study on one-vs-one and one-vs-all schemes. Pattern Recogn 44(8):1761–1776CrossRef Galar M, Fernandez A, Barrenechea E, Bustince H, Herrera F (2011) An overview of ensemble methods for binary classifiers in multi-class problems: experimental study on one-vs-one and one-vs-all schemes. Pattern Recogn 44(8):1761–1776CrossRef
28.
go back to reference Wang Z, Zhu CM, Gao DQ, Chen SC (2013) Three-fold structured classifier design based on matrix pattern. Pattern Recogn 46(6):1532–1555MATHCrossRef Wang Z, Zhu CM, Gao DQ, Chen SC (2013) Three-fold structured classifier design based on matrix pattern. Pattern Recogn 46(6):1532–1555MATHCrossRef
29.
go back to reference Scholkopf B, Shawe-Taylor J, Smola A, Gmd B, Smola E, Williamson R (1999) Generalization bounds via eigenvalues of the gram matrix. Technical Report 1999–035, NeuroColt Scholkopf B, Shawe-Taylor J, Smola A, Gmd B, Smola E, Williamson R (1999) Generalization bounds via eigenvalues of the gram matrix. Technical Report 1999–035, NeuroColt
30.
go back to reference Kashima H, Oyama S, Yamanishi Y, Tsuda K (2009) On pairwise kernels on efficient alternative and generalization analysis. Adv Knowl Discov Data Min 5476:1030–1037 Kashima H, Oyama S, Yamanishi Y, Tsuda K (2009) On pairwise kernels on efficient alternative and generalization analysis. Adv Knowl Discov Data Min 5476:1030–1037
31.
go back to reference Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MATHMathSciNet Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MATHMathSciNet
32.
go back to reference Iman RL, Davenport JM (1980) Approximations of the critical region of the Friedman statistic. Commun Stat Theory Methods 9(6):571–595CrossRef Iman RL, Davenport JM (1980) Approximations of the critical region of the Friedman statistic. Commun Stat Theory Methods 9(6):571–595CrossRef
Metadata
Title
A modified kernel clustering method with multiple factors
Authors
Changming Zhu
Daqi Gao
Publication date
01-11-2015
Publisher
Springer London
Published in
Pattern Analysis and Applications / Issue 4/2015
Print ISSN: 1433-7541
Electronic ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-014-0377-7

Other articles of this Issue 4/2015

Pattern Analysis and Applications 4/2015 Go to the issue

Premium Partner