Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 3/2012

01-09-2012 | Original Article

Classification rule discovery using learning automata

Author: Seyed-Hamid Zahiri

Published in: International Journal of Machine Learning and Cybernetics | Issue 3/2012

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Learning automata (LA) are adaptive decision making units that can learn to choose the optimal action from a set of actions by interaction with an environment (search space). This article proposes the use of the learning automata as a new tool for data mining (namely LA-miner). The basic scheme is utilizing LA as an effective optimizer for searching the rule-set space. In fact, LA-miner searches the rule-set space to discover an effective rule-set which maximizes a predefined fitness function. The fitness function is related to the total true positives, false positives, true negatives, and false negatives. Extensive experimental results on different kinds of benchmarks with nonlinear, overlapping class boundaries and different feature space dimensions are provided to show the powerfulness of the proposed method. The comparative results illustrate that the performance of the proposed LA-miner is comparable to, sometimes better than those of the CN2 (a traditional data mining method) and similar approaches which are designed based on the swarm intelligence algorithms (ant colony optimization and particle swarm optimization) and an evolutionary algorithm (genetic algorithm).

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Footnotes
1
This data set is available at University of California, Irvine, via anonymous ftp http://​ftp.​ics.​uci.​edu/​pub/​machine-learning-databases.
 
Literature
1.
go back to reference Sousa T, Silva A, Neves A (2004) Particle swarm based data mining algorithms for classification tasks. Parallel Comput 30:767–783CrossRef Sousa T, Silva A, Neves A (2004) Particle swarm based data mining algorithms for classification tasks. Parallel Comput 30:767–783CrossRef
2.
go back to reference Sarkar R, Abbas H, Newton C (2002). Introducing data mining and knowledge discovery. In: Heuristic and optimization for knowledge discovery. Idea Group Publishing, USA, pp 1–23 Sarkar R, Abbas H, Newton C (2002). Introducing data mining and knowledge discovery. In: Heuristic and optimization for knowledge discovery. Idea Group Publishing, USA, pp 1–23
3.
go back to reference Parpinelli RS, Lopes HS, Freitas AA (2002) Data mining with an ant colony optimization algorithm. IEEE Trans Evol Comput 6(4):321–332CrossRef Parpinelli RS, Lopes HS, Freitas AA (2002) Data mining with an ant colony optimization algorithm. IEEE Trans Evol Comput 6(4):321–332CrossRef
4.
5.
go back to reference Wang X-Z, Dong C-R (2009) Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy. IEEE Tran Fuzzy Syst 17(3):556–567CrossRef Wang X-Z, Dong C-R (2009) Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy. IEEE Tran Fuzzy Syst 17(3):556–567CrossRef
6.
go back to reference Wang X-Z, Zhai J-H, Lu S-X (2008) Induction of multiple fuzzy decision trees based on rough set technique. Inf Sci 178(16):3188–3202MathSciNetMATHCrossRef Wang X-Z, Zhai J-H, Lu S-X (2008) Induction of multiple fuzzy decision trees based on rough set technique. Inf Sci 178(16):3188–3202MathSciNetMATHCrossRef
8.
go back to reference Zeng X, Zhou J, Vasseur C (2000) A strategy for controlling non-linear systems using a learning automaton. Automatica 36:1517–1524MathSciNetMATHCrossRef Zeng X, Zhou J, Vasseur C (2000) A strategy for controlling non-linear systems using a learning automaton. Automatica 36:1517–1524MathSciNetMATHCrossRef
10.
go back to reference Thathachar MAL, Sastry PS (2002) Varieties of learning automata: an overview. IEEE Trans Syst Man Cyber Part B Cyber 32:711–722CrossRef Thathachar MAL, Sastry PS (2002) Varieties of learning automata: an overview. IEEE Trans Syst Man Cyber Part B Cyber 32:711–722CrossRef
11.
go back to reference Zahiri SH (2008) Learning automata based classifier. Pattern Recognit Lett 29:40–48CrossRef Zahiri SH (2008) Learning automata based classifier. Pattern Recognit Lett 29:40–48CrossRef
12.
go back to reference Clark P, Niblet T (1989) The CN2 induction algorithm. Mach Learn 3(4):261–283 Clark P, Niblet T (1989) The CN2 induction algorithm. Mach Learn 3(4):261–283
14.
go back to reference Papadimitriou GI, Vakali AI, Pomportsis AS (2004) A learning-automata-based controller for client/server systems. Neurocomputing 61:381–394CrossRef Papadimitriou GI, Vakali AI, Pomportsis AS (2004) A learning-automata-based controller for client/server systems. Neurocomputing 61:381–394CrossRef
15.
go back to reference Eraghi AE, Torkestani JA, Meybodi MR, Fathy AH (2011) Cellular learning automata-based channel assignment algorithms for wireless mobile ad hoc networks. Int Conf Mach Learn Comput IPCSIT 3:173–177 Eraghi AE, Torkestani JA, Meybodi MR, Fathy AH (2011) Cellular learning automata-based channel assignment algorithms for wireless mobile ad hoc networks. Int Conf Mach Learn Comput IPCSIT 3:173–177
16.
go back to reference Ozbay K, Datta A, Kachroo P (2002) Application of stochastic learning automata for modeling departure time and route choice behavior, Faculty Publications (ECE). Paper 90 Ozbay K, Datta A, Kachroo P (2002) Application of stochastic learning automata for modeling departure time and route choice behavior, Faculty Publications (ECE). Paper 90
17.
go back to reference Martínez Y, Van Vreckem B, Catteeuw D, Nowé A (2010) Application of learning automata for stochastic online scheduling. In: Recent advances in optimization and its applications in engineering. Springer, Berlin, pp 491–498 Martínez Y, Van Vreckem B, Catteeuw D, Nowé A (2010) Application of learning automata for stochastic online scheduling. In: Recent advances in optimization and its applications in engineering. Springer, Berlin, pp 491–498
18.
go back to reference Alanyali M (2004) Learning automata in games with memory with application to circuit-switched routing. In: IEEE conf decision and control, vol 5, pp 4850–4855 Alanyali M (2004) Learning automata in games with memory with application to circuit-switched routing. In: IEEE conf decision and control, vol 5, pp 4850–4855
19.
go back to reference Ünsal C, Bay JS, Kachroo P (1995) Intelligent control of vehicles: preliminary results on the application of learning automata techniques to automated highway system, Faculty Publications (ECE). Paper 77 Ünsal C, Bay JS, Kachroo P (1995) Intelligent control of vehicles: preliminary results on the application of learning automata techniques to automated highway system, Faculty Publications (ECE). Paper 77
20.
go back to reference Howell MN, Gordon TJ (2001) Continuous action reinforcement learning automata and their application to adaptive digital filter design. Eng Appl Artif Intell 14:549–561CrossRef Howell MN, Gordon TJ (2001) Continuous action reinforcement learning automata and their application to adaptive digital filter design. Eng Appl Artif Intell 14:549–561CrossRef
21.
go back to reference Esnaashari M, Meybodi MR (2008) A novel clustering algorithm for wireless sensor networks using irregular cellular learning automata. In: International symposium on telecommunications, pp 330–336 Esnaashari M, Meybodi MR (2008) A novel clustering algorithm for wireless sensor networks using irregular cellular learning automata. In: International symposium on telecommunications, pp 330–336
22.
go back to reference Gosavi A (2005) Applications of the learning automata algorithm of Thathachar and Sastry. Technical Report SOPTL-05-02, Missouri University of Science and Technology Gosavi A (2005) Applications of the learning automata algorithm of Thathachar and Sastry. Technical Report SOPTL-05-02, Missouri University of Science and Technology
23.
go back to reference Abin AA, Fotouhi M, Kasaei S (2008) Skin segmentation based on cellular learning automata. In: Proceedings of the 6th international conference on advances in mobile computing and multimedia, pp 254–259 Abin AA, Fotouhi M, Kasaei S (2008) Skin segmentation based on cellular learning automata. In: Proceedings of the 6th international conference on advances in mobile computing and multimedia, pp 254–259
24.
go back to reference Shapiro IJ, Narendra KS (1969) Use of stochastic automata for parameter self-optimization with multi-modal performance criteria. IEEE Trans Syst Man Cybern 14:323–334 Shapiro IJ, Narendra KS (1969) Use of stochastic automata for parameter self-optimization with multi-modal performance criteria. IEEE Trans Syst Man Cybern 14:323–334
25.
go back to reference Thathachar MAL, Sastry PS (1985) A class of rapidly converging algorithms for learning automata. IEEE Trans Syst Man Cybern 15:168–175MathSciNetMATH Thathachar MAL, Sastry PS (1985) A class of rapidly converging algorithms for learning automata. IEEE Trans Syst Man Cybern 15:168–175MathSciNetMATH
26.
go back to reference Oommen BJ, Lanctôt JK (1990) Discretized pursuit learning automata. IEEE Trans Syst Man Cybern 20:931–938MATHCrossRef Oommen BJ, Lanctôt JK (1990) Discretized pursuit learning automata. IEEE Trans Syst Man Cybern 20:931–938MATHCrossRef
27.
28.
29.
30.
go back to reference Aghaebrahimi MR, Zahiri SH, Amiri M (2009) Data mining using learning automata. World Congress on science, engineering and technology, Dubai, vol 37, pp 308–311 Aghaebrahimi MR, Zahiri SH, Amiri M (2009) Data mining using learning automata. World Congress on science, engineering and technology, Dubai, vol 37, pp 308–311
31.
go back to reference Kohavi R, Sahami M (1996) Error-based and entropy-based discretization of continuous features. In: Proc. 2nd Int. conf. knowledge discovery and data mining, Menlo Park, CA, pp 114–119 Kohavi R, Sahami M (1996) Error-based and entropy-based discretization of continuous features. In: Proc. 2nd Int. conf. knowledge discovery and data mining, Menlo Park, CA, pp 114–119
32.
go back to reference Quinlan JR (1993) C4.5: programs for machine learning. Morgan Kaufmann, San Mateo Quinlan JR (1993) C4.5: programs for machine learning. Morgan Kaufmann, San Mateo
33.
go back to reference Chattopadhyay S, Daneshgar F (2011) A study on suicidal risks in psychiatric adults. Int J Biomed Eng Technol 5(4):390–408CrossRef Chattopadhyay S, Daneshgar F (2011) A study on suicidal risks in psychiatric adults. Int J Biomed Eng Technol 5(4):390–408CrossRef
35.
go back to reference Vagin V, Fomina M (2011) Problem of knowledge discovery in noisy databases. Int J Mach Learn Cybern 2(3):135–145CrossRef Vagin V, Fomina M (2011) Problem of knowledge discovery in noisy databases. Int J Mach Learn Cybern 2(3):135–145CrossRef
Metadata
Title
Classification rule discovery using learning automata
Author
Seyed-Hamid Zahiri
Publication date
01-09-2012
Publisher
Springer-Verlag
Published in
International Journal of Machine Learning and Cybernetics / Issue 3/2012
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-011-0056-6

Other articles of this Issue 3/2012

International Journal of Machine Learning and Cybernetics 3/2012 Go to the issue