Skip to main content
Erschienen in: Pattern Analysis and Applications 4/2015

01.11.2015 | Theoretical Advances

A modified kernel clustering method with multiple factors

verfasst von: Changming Zhu, Daqi Gao

Erschienen in: Pattern Analysis and Applications | Ausgabe 4/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We propose a simple and effective method about kernel clustering. This method takes many factors about kernel clustering into account. These factors include the selection of the initial centers of kernels, the ways of how to compute widths of kernels and the distances between patterns, different growing ways of kernels, and different kernel clustering criterions. Experiments have validated that these factors have influence on the final experimental results while not each factor has a great influence. Furthermore, some classifiers with this proposed kernel clustering method have higher classification accuracies and lower generalization risks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Novikoff AB (1962) On convergence proofs on perceptrons. Polytechnic Institute of Brooklyn 12:615–622 Novikoff AB (1962) On convergence proofs on perceptrons. Polytechnic Institute of Brooklyn 12:615–622
2.
Zurück zum Zitat Freund Y, Schapire RE (1999) Large margin classification using the perceptron algorithm. Mach Learn 37(3):277–296MATHCrossRef Freund Y, Schapire RE (1999) Large margin classification using the perceptron algorithm. Mach Learn 37(3):277–296MATHCrossRef
3.
Zurück zum Zitat Hoffgen KU, Simon HU, Vanhorn KS (1995) Robust trainability of single neurons. J Comput Syst Sci 50(1):114–125MathSciNetCrossRef Hoffgen KU, Simon HU, Vanhorn KS (1995) Robust trainability of single neurons. J Comput Syst Sci 50(1):114–125MathSciNetCrossRef
4.
Zurück zum Zitat Arora S, Babai L, Stern J, Sweedyk Z (1993) The hardness of approximate optima in lattices, codes, and systems of linear equations. In: 34th Annual Symposium on Foundations of Computer Science, pp 724–733 Arora S, Babai L, Stern J, Sweedyk Z (1993) The hardness of approximate optima in lattices, codes, and systems of linear equations. In: 34th Annual Symposium on Foundations of Computer Science, pp 724–733
6.
Zurück zum Zitat Mazurowski MA, Zurada JM, Tourassi GD (2009) An adaptive incremental approach to constructing ensemble classifiers: application in an information-theoretic computer-aided decision system for detection of masses in mammograms. Med Phys 36(7):2976–2984CrossRef Mazurowski MA, Zurada JM, Tourassi GD (2009) An adaptive incremental approach to constructing ensemble classifiers: application in an information-theoretic computer-aided decision system for detection of masses in mammograms. Med Phys 36(7):2976–2984CrossRef
7.
Zurück zum Zitat Hart P (1968) The condensed nearest neighbor rule. IEEE Trans Inf Theory 14:515–516CrossRef Hart P (1968) The condensed nearest neighbor rule. IEEE Trans Inf Theory 14:515–516CrossRef
8.
Zurück zum Zitat Gates W (1972) The reduced nearest neighbor rule. IEEE Trans Inf Theory 18:431–433CrossRef Gates W (1972) The reduced nearest neighbor rule. IEEE Trans Inf Theory 18:431–433CrossRef
9.
Zurück zum Zitat Ritter GL, Woodruff HB, Lowry SR, Isenhour TL (1975) An algorithm for a selective nearest neighbor decision rule. IEEE Trans Inf Theory 21(6):665–669MATHCrossRef Ritter GL, Woodruff HB, Lowry SR, Isenhour TL (1975) An algorithm for a selective nearest neighbor decision rule. IEEE Trans Inf Theory 21(6):665–669MATHCrossRef
10.
Zurück zum Zitat Vapnik V (1998) Statistical learning theory. Wiley-Interscience, New YorkMATH Vapnik V (1998) Statistical learning theory. Wiley-Interscience, New YorkMATH
11.
Zurück zum Zitat Leski J (2003) Ho-kashyap classifier with generalization control. Pattern Recogn Lett 24(14):2281–2290MATHCrossRef Leski J (2003) Ho-kashyap classifier with generalization control. Pattern Recogn Lett 24(14):2281–2290MATHCrossRef
12.
Zurück zum Zitat Yeh IC, Zhang XY, Wu C, Huang KC (2010) Radial basis function networks with adjustable kernel shape parameters. In: 2010 International Conference on Machine Learning and Cybernetics (ICMLC), vol 3, pp 1482–1 Yeh IC, Zhang XY, Wu C, Huang KC (2010) Radial basis function networks with adjustable kernel shape parameters. In: 2010 International Conference on Machine Learning and Cybernetics (ICMLC), vol 3, pp 1482–1
13.
Zurück zum Zitat Haikin S (1998) Neural networks: a comprehensive foundation. Prentice Hall PTR, Indianapolis Haikin S (1998) Neural networks: a comprehensive foundation. Prentice Hall PTR, Indianapolis
14.
Zurück zum Zitat Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, CambridgeCrossRef Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, CambridgeCrossRef
15.
Zurück zum Zitat Lanckriet GRG, Cristianini N, Bartlett P, Ghaoui LE, Jordan MI (2004) Learning the kernel matrix with semidefinite programming. J Mach Learn Res 5:27–72MATH Lanckriet GRG, Cristianini N, Bartlett P, Ghaoui LE, Jordan MI (2004) Learning the kernel matrix with semidefinite programming. J Mach Learn Res 5:27–72MATH
16.
Zurück zum Zitat Huang KZ, Yang HQ, King I, Lyu MR (2004) Learning large margin classifiers locally and globally. In: Proceedings of the twenty-first international conference on Machine learning, p 51 Huang KZ, Yang HQ, King I, Lyu MR (2004) Learning large margin classifiers locally and globally. In: Proceedings of the twenty-first international conference on Machine learning, p 51
17.
Zurück zum Zitat Sonnenburg S, Ratsch G, Schafer C, Scholkopf B (2006) Large scale multiple kernel learning. J Mach Learn Res 7:1531–1565MATHMathSciNet Sonnenburg S, Ratsch G, Schafer C, Scholkopf B (2006) Large scale multiple kernel learning. J Mach Learn Res 7:1531–1565MATHMathSciNet
18.
Zurück zum Zitat Gao DQ, Li J (2006) Kernel fisher discriminants and kernel nearest neighbor classifiers: a comparative study for large-scale learning problems. In: International joint conference on neural networks pp 1333–1338 Gao DQ, Li J (2006) Kernel fisher discriminants and kernel nearest neighbor classifiers: a comparative study for large-scale learning problems. In: International joint conference on neural networks pp 1333–1338
19.
Zurück zum Zitat Hartigan JA, Wong MA (1978) Algorithm AS 136: a k-means clustering algorithm. Appl Stat 28(1):100–108CrossRef Hartigan JA, Wong MA (1978) Algorithm AS 136: a k-means clustering algorithm. Appl Stat 28(1):100–108CrossRef
20.
Zurück zum Zitat Day WH, Edelsbrunner H (1984) Efficient algorithms for agglomerative hierarchical clustering methods. J Classif 1(1):7–24MATHCrossRef Day WH, Edelsbrunner H (1984) Efficient algorithms for agglomerative hierarchical clustering methods. J Classif 1(1):7–24MATHCrossRef
21.
Zurück zum Zitat Newman CBDJ, Hettich S, Merz C (2012) UCI repository of machine learning databases Newman CBDJ, Hettich S, Merz C (2012) UCI repository of machine learning databases
22.
Zurück zum Zitat Nene SA, Nayar SK, Murase H (1996) Columbia Object Image Library (COIL-20). Technical Report CUCS-005-96, Columbia University Nene SA, Nayar SK, Murase H (1996) Columbia Object Image Library (COIL-20). Technical Report CUCS-005-96, Columbia University
23.
Zurück zum Zitat Cun BBL, Denker JS, Henderson D, Howard RE, Hubbard W, Jackel LD (1990) Handwritten digit recognition with a back-propagation network. Advances in neural information processing systems Cun BBL, Denker JS, Henderson D, Howard RE, Hubbard W, Jackel LD (1990) Handwritten digit recognition with a back-propagation network. Advances in neural information processing systems
24.
Zurück zum Zitat Bennett F, Richardson T, Harter A (1994) Teleporting-making applications mobile. Mobile Computing Systems and Applications pp 82–84 Bennett F, Richardson T, Harter A (1994) Teleporting-making applications mobile. Mobile Computing Systems and Applications pp 82–84
25.
Zurück zum Zitat Kumar N, Berg AC, Belhumeur PN, Nayar SK (2009) Attribute and simile classifiers for face verification. In: International Conference on Computer Vision, pp 365–372 Kumar N, Berg AC, Belhumeur PN, Nayar SK (2009) Attribute and simile classifiers for face verification. In: International Conference on Computer Vision, pp 365–372
26.
Zurück zum Zitat Smith BA, Yin Q, Feiner SK, Nayar SK (2013) Gaze locking: passive eye contact detection for human object interaction. In: ACM Symposium on User Interface Software and Technology (UIST), pp 271–280 Smith BA, Yin Q, Feiner SK, Nayar SK (2013) Gaze locking: passive eye contact detection for human object interaction. In: ACM Symposium on User Interface Software and Technology (UIST), pp 271–280
27.
Zurück zum Zitat Galar M, Fernandez A, Barrenechea E, Bustince H, Herrera F (2011) An overview of ensemble methods for binary classifiers in multi-class problems: experimental study on one-vs-one and one-vs-all schemes. Pattern Recogn 44(8):1761–1776CrossRef Galar M, Fernandez A, Barrenechea E, Bustince H, Herrera F (2011) An overview of ensemble methods for binary classifiers in multi-class problems: experimental study on one-vs-one and one-vs-all schemes. Pattern Recogn 44(8):1761–1776CrossRef
28.
Zurück zum Zitat Wang Z, Zhu CM, Gao DQ, Chen SC (2013) Three-fold structured classifier design based on matrix pattern. Pattern Recogn 46(6):1532–1555MATHCrossRef Wang Z, Zhu CM, Gao DQ, Chen SC (2013) Three-fold structured classifier design based on matrix pattern. Pattern Recogn 46(6):1532–1555MATHCrossRef
29.
Zurück zum Zitat Scholkopf B, Shawe-Taylor J, Smola A, Gmd B, Smola E, Williamson R (1999) Generalization bounds via eigenvalues of the gram matrix. Technical Report 1999–035, NeuroColt Scholkopf B, Shawe-Taylor J, Smola A, Gmd B, Smola E, Williamson R (1999) Generalization bounds via eigenvalues of the gram matrix. Technical Report 1999–035, NeuroColt
30.
Zurück zum Zitat Kashima H, Oyama S, Yamanishi Y, Tsuda K (2009) On pairwise kernels on efficient alternative and generalization analysis. Adv Knowl Discov Data Min 5476:1030–1037 Kashima H, Oyama S, Yamanishi Y, Tsuda K (2009) On pairwise kernels on efficient alternative and generalization analysis. Adv Knowl Discov Data Min 5476:1030–1037
31.
Zurück zum Zitat Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MATHMathSciNet Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MATHMathSciNet
32.
Zurück zum Zitat Iman RL, Davenport JM (1980) Approximations of the critical region of the Friedman statistic. Commun Stat Theory Methods 9(6):571–595CrossRef Iman RL, Davenport JM (1980) Approximations of the critical region of the Friedman statistic. Commun Stat Theory Methods 9(6):571–595CrossRef
Metadaten
Titel
A modified kernel clustering method with multiple factors
verfasst von
Changming Zhu
Daqi Gao
Publikationsdatum
01.11.2015
Verlag
Springer London
Erschienen in
Pattern Analysis and Applications / Ausgabe 4/2015
Print ISSN: 1433-7541
Elektronische ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-014-0377-7

Weitere Artikel der Ausgabe 4/2015

Pattern Analysis and Applications 4/2015 Zur Ausgabe

Premium Partner