Skip to main content
Top

2020 | OriginalPaper | Chapter

An Evolutionary Analytic Center Classifier

Authors : Renan Motta Goulart, Saulo Moraes Villela, Carlos Cristiano Hasenclever Borges, Raul Fonseca Neto

Published in: Intelligent Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Classification is an essential task in the field of Machine Learning, where developing a classifier that minimizes errors on unknown data is one of its central problems. It is known that the analytic center is a good approximation of the center of mass of the version space that is consistent with the Bayes-optimal decision surface. Therefore, in this work, we propose an evolutionary algorithm, relying on the convexity properties of the version space, that evolves a population of perceptron classifiers in order to find a solution that approximates its analytic center. Hyperspherical coordinates are used to guarantee feasibility when generating new individuals and enabling exploration to be uniformly distributed through the search space. To evaluate the individuals we consider using a potential function that employs a logarithmic barrier penalty. Experiments were performed on real datasets, and the obtained results indicate concrete possibilities for applying the proposed algorithm for solving practical problems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Alon, U., et al.: Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proc. Natl. Acad. Sci. United States Am. 96(12), 6745–6750 (1999)CrossRef Alon, U., et al.: Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proc. Natl. Acad. Sci. United States Am. 96(12), 6745–6750 (1999)CrossRef
3.
go back to reference Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)MATH Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)MATH
4.
go back to reference Eiben, A., Schippers, C.: On evolutionary exploration and exploitation. Fundam. Inf. 35, 35–50 (1998)CrossRef Eiben, A., Schippers, C.: On evolutionary exploration and exploitation. Fundam. Inf. 35, 35–50 (1998)CrossRef
5.
go back to reference Enes, K.B., Villela, S.M., Fonseca Neto, R.: Version space reduction based on ensembles of dissimilar balanced perceptrons. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, pp. 1448–1454 (2016) Enes, K.B., Villela, S.M., Fonseca Neto, R.: Version space reduction based on ensembles of dissimilar balanced perceptrons. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, pp. 1448–1454 (2016)
7.
go back to reference Golub, T.R., et al.: Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286, 531–537 (1999)CrossRef Golub, T.R., et al.: Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286, 531–537 (1999)CrossRef
8.
go back to reference Herbrich, R., Graepel, T., Campbell, C.: Bayes point machines. J. Mach. Learn. Res. 1, 245–279 (2001)MathSciNetMATH Herbrich, R., Graepel, T., Campbell, C.: Bayes point machines. J. Mach. Learn. Res. 1, 245–279 (2001)MathSciNetMATH
9.
go back to reference Kaiser, M.J., Morin, T.L., Trafalis, T.B.: Centers and invariant points of convex bodies. In: Applied Geometry And Discrete Mathematics (1990) Kaiser, M.J., Morin, T.L., Trafalis, T.B.: Centers and invariant points of convex bodies. In: Applied Geometry And Discrete Mathematics (1990)
10.
go back to reference Lasserre, J.B.: An analytical expression and an algorithm for the volume of a convex polyhedron in \({R}^n\). J. Optim. Theory Appl. 39, 363–377 (1983)MathSciNetCrossRef Lasserre, J.B.: An analytical expression and an algorithm for the volume of a convex polyhedron in \({R}^n\). J. Optim. Theory Appl. 39, 363–377 (1983)MathSciNetCrossRef
11.
go back to reference McCulloch, W.S., Pitts, W.: A Logical Calculus of the Ideas Immanent in Nervous Activity, pp. 15–27. MIT Press, Cambridge (1988)MATH McCulloch, W.S., Pitts, W.: A Logical Calculus of the Ideas Immanent in Nervous Activity, pp. 15–27. MIT Press, Cambridge (1988)MATH
13.
go back to reference MinShu, M.: Genetic algorithms designed for solving support vector classifier. In: International Symposium on Data, Privacy, and E-Commerce, pp. 167–169 (2007) MinShu, M.: Genetic algorithms designed for solving support vector classifier. In: International Symposium on Data, Privacy, and E-Commerce, pp. 167–169 (2007)
14.
go back to reference Mitchell, M.: An Introduction to Genetic Algorithms. MIT Press, Cambridge (1998)CrossRef Mitchell, M.: An Introduction to Genetic Algorithms. MIT Press, Cambridge (1998)CrossRef
16.
go back to reference Nesterov, Y., Nemirovskii, A.S.: Interior point polynomial methods in convex programming: Theory and algorithms (1993) Nesterov, Y., Nemirovskii, A.S.: Interior point polynomial methods in convex programming: Theory and algorithms (1993)
17.
go back to reference Novikoff, A.: On convergence proofs on perceptrons. In: Proceedings of the Symposium on the Mathematical Theory of Automata, vol. 12, pp. 615–622 (1962) Novikoff, A.: On convergence proofs on perceptrons. In: Proceedings of the Symposium on the Mathematical Theory of Automata, vol. 12, pp. 615–622 (1962)
18.
go back to reference Paquet, U., Engelbrecht, A.: Training support vector machines with particle swarms. In: Proceedings of the International Joint Conference on Neural Networks, vol. 2, pp. 1593–1598 (2003) Paquet, U., Engelbrecht, A.: Training support vector machines with particle swarms. In: Proceedings of the International Joint Conference on Neural Networks, vol. 2, pp. 1593–1598 (2003)
19.
go back to reference Raupp, F.M., Svaiter, B.F.: Analytic center of spherical shells and its application to analytic center machine. Comput. Optim. Appl. 43(3), 329–352 (2009)MathSciNetCrossRef Raupp, F.M., Svaiter, B.F.: Analytic center of spherical shells and its application to analytic center machine. Comput. Optim. Appl. 43(3), 329–352 (2009)MathSciNetCrossRef
20.
go back to reference Rosenblatt: The perceptron, a perceiving and recognizing automaton, Project Para. Cornell Aeronautical Laboratory (1957) Rosenblatt: The perceptron, a perceiving and recognizing automaton, Project Para. Cornell Aeronautical Laboratory (1957)
21.
go back to reference Singh, D., et al.: Gene expression correlates of clinical prostate cancer behavior. Cancer Cell 1(2), 203–209 (2002)CrossRef Singh, D., et al.: Gene expression correlates of clinical prostate cancer behavior. Cancer Cell 1(2), 203–209 (2002)CrossRef
22.
go back to reference Trafalis, T., Malyscheff, A.: An analytic center machine. Mach. Learn. 46, 203–223 (2002)CrossRef Trafalis, T., Malyscheff, A.: An analytic center machine. Mach. Learn. 46, 203–223 (2002)CrossRef
23.
go back to reference Zhu, Z., Ong, Y.S., Dash, M.: Markov blanket-embedded genetic algorithm for gene selection. Pattern Recogn. 40, 3236–3248 (2007)CrossRef Zhu, Z., Ong, Y.S., Dash, M.: Markov blanket-embedded genetic algorithm for gene selection. Pattern Recogn. 40, 3236–3248 (2007)CrossRef
Metadata
Title
An Evolutionary Analytic Center Classifier
Authors
Renan Motta Goulart
Saulo Moraes Villela
Carlos Cristiano Hasenclever Borges
Raul Fonseca Neto
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-61377-8_3

Premium Partner