Skip to main content

2016 | OriginalPaper | Buchkapitel

Ant Colony Optimisation-Based Classification Using Two-Dimensional Polygons

verfasst von : Morten Goodwin, Anis Yazidi

Erschienen in: Swarm Intelligence

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The application of Ant Colony Optimization to the field of classification has mostly been limited to hybrid approaches which attempt at boosting the performance of existing classifiers (such as Decision Trees and Support Vector Machines (SVM)) — often through guided feature reductions or parameter optimizations.
In this paper we introduce PolyACO: A novel Ant Colony based classifier operating in two dimensional space that utilizes ray casting. To the best of our knowledge, our work is the first reported Ant Colony based classifier which is non-hybrid, in the sense, that it does not build on any legacy classifiers. The essence of the scheme is to create a separator in the feature space by imposing ant-guided random walks in a grid system. The walks are self-enclosing so that the ants return back to the starting node forming a closed classification path yielding a many edged polygon. Experimental results on both synthetic and real-life data show that our scheme is able to perfectly separate both simple and complex patterns, without utilizing “kernel tricks” and outperforming existing classifiers, such as polynomial and linear SVM. The results are impressive given the simplicity of PolyACO compared to other approaches such as SVM.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The hyperplane is a line in a two-dimensional space.
 
2
Note that s is one of the possible polygons with the shortest circumference that is able to perfectly separate the data. The reason for this is explained in Sect. 3.3.
 
3
Many more data sets where tested, but due to the limited space in the paper only the most interesting results are included.
 
Literatur
1.
Zurück zum Zitat Asmar, D., Elshamli, A., Areibi, S.: A comparative assessment of ACO algorithms within a TSP environment. Dyn. Continous Discrete Impulsive Syst.-Ser. B-Appl. Algorithms 1, 462–467 (2005) Asmar, D., Elshamli, A., Areibi, S.: A comparative assessment of ACO algorithms within a TSP environment. Dyn. Continous Discrete Impulsive Syst.-Ser. B-Appl. Algorithms 1, 462–467 (2005)
2.
Zurück zum Zitat Chan, A., Freitas, A.A.: A new classification-rule pruning procedure for an ant colony algorithm. In: Talbi, E.-G., Liardet, P., Collet, P., Lutton, E., Schoenauer, M. (eds.) EA 2005. LNCS, vol. 3871, pp. 25–36. Springer, Heidelberg (2006)CrossRef Chan, A., Freitas, A.A.: A new classification-rule pruning procedure for an ant colony algorithm. In: Talbi, E.-G., Liardet, P., Collet, P., Lutton, E., Schoenauer, M. (eds.) EA 2005. LNCS, vol. 3871, pp. 25–36. Springer, Heidelberg (2006)CrossRef
3.
Zurück zum Zitat Daly, R., Shen, Q.: Learning Bayesian Network Equivalence Classes with Ant Colony Optimization (2014). arXiv preprint arXiv:1401.3464 Daly, R., Shen, Q.: Learning Bayesian Network Equivalence Classes with Ant Colony Optimization (2014). arXiv preprint arXiv:​1401.​3464
4.
Zurück zum Zitat Dorigo, M., Birattari, M., Stutzle, T.: Ant colony optimization. IEEE Comput. Intell. Mag. 1(4), 28–39 (2006)CrossRef Dorigo, M., Birattari, M., Stutzle, T.: Ant colony optimization. IEEE Comput. Intell. Mag. 1(4), 28–39 (2006)CrossRef
5.
Zurück zum Zitat Gutjahr, W.J.: ACO algorithms with guaranteed convergence to the optimal solution. Inf. Process. Lett. 82(3), 145–153 (2002)MathSciNetCrossRefMATH Gutjahr, W.J.: ACO algorithms with guaranteed convergence to the optimal solution. Inf. Process. Lett. 82(3), 145–153 (2002)MathSciNetCrossRefMATH
6.
Zurück zum Zitat Hota, S., Satapathy, P., Jagadev, A.K.: Modified ant colony optimization algorithm (MAnt-Miner) for classification rule mining. In: Jain, L.C., Patnaik, S., Ichalkaranje, N. (eds.) Intelligent Computing, Communication and Devices, pp. 267–275. Springer, New Delhi (2015)CrossRef Hota, S., Satapathy, P., Jagadev, A.K.: Modified ant colony optimization algorithm (MAnt-Miner) for classification rule mining. In: Jain, L.C., Patnaik, S., Ichalkaranje, N. (eds.) Intelligent Computing, Communication and Devices, pp. 267–275. Springer, New Delhi (2015)CrossRef
7.
Zurück zum Zitat Junior, I.C.: Data mining with ant colony algorithms. In: Huang, D.-S., Jo, K.-H., Zhou, Y.-Q., Han, K. (eds.) ICIC 2013. LNCS, vol. 7996, pp. 30–38. Springer, Heidelberg (2013)CrossRef Junior, I.C.: Data mining with ant colony algorithms. In: Huang, D.-S., Jo, K.-H., Zhou, Y.-Q., Han, K. (eds.) ICIC 2013. LNCS, vol. 7996, pp. 30–38. Springer, Heidelberg (2013)CrossRef
8.
Zurück zum Zitat Karaboga, D., Ozturk, C.: A novel clustering approach: Artificial Bee Colony (ABC) algorithm. Appl. Soft Comput. 11(1), 652–657 (2011)CrossRef Karaboga, D., Ozturk, C.: A novel clustering approach: Artificial Bee Colony (ABC) algorithm. Appl. Soft Comput. 11(1), 652–657 (2011)CrossRef
9.
Zurück zum Zitat Lian, T.A., Llave, M.R., Goodwin, M., Bouhmala, N.: Towards multilevel ant colony optimisation for the Euclidean symmetric traveling salesman problem. In: Ali, M., Kwon, Y.S., Lee, C.-H., Kim, J., Kim, Y. (eds.) IEA/AIE 2015. LNCS, vol. 9101, pp. 222–231. Springer, Heidelberg (2015) Lian, T.A., Llave, M.R., Goodwin, M., Bouhmala, N.: Towards multilevel ant colony optimisation for the Euclidean symmetric traveling salesman problem. In: Ali, M., Kwon, Y.S., Lee, C.-H., Kim, J., Kim, Y. (eds.) IEA/AIE 2015. LNCS, vol. 9101, pp. 222–231. Springer, Heidelberg (2015)
10.
Zurück zum Zitat Liu, B., Abbas, H., McKay, B.: Classification rule discovery with ant colony optimization. In: IEEE/WIC International Conference on Intelligent Agent Technology, IAT 2003, pp. 83–88. IEEE (2003) Liu, B., Abbas, H., McKay, B.: Classification rule discovery with ant colony optimization. In: IEEE/WIC International Conference on Intelligent Agent Technology, IAT 2003, pp. 83–88. IEEE (2003)
11.
Zurück zum Zitat Madjarov, G., Kocev, D., Gjorgjevikj, D., Džeroski, S.: An extensive experimental comparison of methods for multi-label learning. Pattern Recogn. 45(9), 3084–3104 (2012)CrossRef Madjarov, G., Kocev, D., Gjorgjevikj, D., Džeroski, S.: An extensive experimental comparison of methods for multi-label learning. Pattern Recogn. 45(9), 3084–3104 (2012)CrossRef
12.
Zurück zum Zitat Martens, D., De Backer, M., Haesen, R., Vanthienen, J., Snoeck, M., Baesens, B.: Classification with ant colony optimization. IEEE Trans. Evol. Comput. 11(5), 651–665 (2007)CrossRef Martens, D., De Backer, M., Haesen, R., Vanthienen, J., Snoeck, M., Baesens, B.: Classification with ant colony optimization. IEEE Trans. Evol. Comput. 11(5), 651–665 (2007)CrossRef
13.
Zurück zum Zitat Neumann, F., Sudholt, D., Witt, C.: Analysis of different MMAS ACO algorithms on unimodal functions and plateaus. Swarm Intell. 3(1), 35–68 (2009)CrossRef Neumann, F., Sudholt, D., Witt, C.: Analysis of different MMAS ACO algorithms on unimodal functions and plateaus. Swarm Intell. 3(1), 35–68 (2009)CrossRef
14.
Zurück zum Zitat Parpinelli, R.S., Lopes, H.S., Freitas, A., et al.: Data mining with an ant colony optimization algorithm. IEEE Trans. Evol. Comput. 6(4), 321–332 (2002)CrossRefMATH Parpinelli, R.S., Lopes, H.S., Freitas, A., et al.: Data mining with an ant colony optimization algorithm. IEEE Trans. Evol. Comput. 6(4), 321–332 (2002)CrossRefMATH
15.
Zurück zum Zitat Roth, S.D.: Ray casting for modeling solids. Comput. Graph. Image Process. 18(2), 109–144 (1982)CrossRef Roth, S.D.: Ray casting for modeling solids. Comput. Graph. Image Process. 18(2), 109–144 (1982)CrossRef
16.
Zurück zum Zitat Salama, K.M., Abdelbar, A.M.: Learning neural network structures with ant colony algorithms. Swarm Intell. 1–37, 229–265 (2015)CrossRef Salama, K.M., Abdelbar, A.M.: Learning neural network structures with ant colony algorithms. Swarm Intell. 1–37, 229–265 (2015)CrossRef
17.
Zurück zum Zitat Salama, K.M., Freitas, A.A.: Ant colony algorithms for constructing Bayesian multi-net classifiers. Intell. Data Anal. 19(2), 233–257 (2015) Salama, K.M., Freitas, A.A.: Ant colony algorithms for constructing Bayesian multi-net classifiers. Intell. Data Anal. 19(2), 233–257 (2015)
18.
Zurück zum Zitat Stützle, T., Hoos, H.: MAX-MIN Ant System and local search for the traveling salesman problem. In: IEEE International Conference on Evolutionary Computation, 1997, pp. 309–314. IEEE (1997) Stützle, T., Hoos, H.: MAX-MIN Ant System and local search for the traveling salesman problem. In: IEEE International Conference on Evolutionary Computation, 1997, pp. 309–314. IEEE (1997)
19.
Zurück zum Zitat Stützle, T., Hoos, H.H.: MAX-MIN ant system. Future Gener. Comput. Syst. 16(8), 889–914 (2000)CrossRefMATH Stützle, T., Hoos, H.H.: MAX-MIN ant system. Future Gener. Comput. Syst. 16(8), 889–914 (2000)CrossRefMATH
20.
Zurück zum Zitat Stützle, T., López-Ibáñez, M., Dorigo, M.: A concise overview of applications of ant colony optimization. Wiley Encycl. Oper. Res. Manage. Sci. 26(2), 25–27 (2011) Stützle, T., López-Ibáñez, M., Dorigo, M.: A concise overview of applications of ant colony optimization. Wiley Encycl. Oper. Res. Manage. Sci. 26(2), 25–27 (2011)
Metadaten
Titel
Ant Colony Optimisation-Based Classification Using Two-Dimensional Polygons
verfasst von
Morten Goodwin
Anis Yazidi
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-44427-7_5