Skip to main content
Erschienen in: Pattern Analysis and Applications 4/2009

01.12.2009 | Theoretical Advances

Algorithm of designing compound recognition system on the basis of combining classifiers with simultaneous splitting feature space into competence areas

verfasst von: Konrad Jackowski, Michal Wozniak

Erschienen in: Pattern Analysis and Applications | Ausgabe 4/2009

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The paper presents the novel adaptive splitting and selection algorithm (AdaSS) used for learning compound pattern recognition system. Splitting a feature space into its constituents and selection of the best area classifier from the pool of available recognizers for each region are key processes of the proposed model. Both take place simultaneously as part of a compound optimization process aimed at maximizing system performance. Evolutionary algorithms are used to find out the optimal solution. The results of experiments for algorithm evaluation purposes prove the quality of the proposed approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Jain AK, Duin PW, Mao J (2000) Statistical pattern recognition: a review. IEEE Trans PAMI 22(1):4–37 Jain AK, Duin PW, Mao J (2000) Statistical pattern recognition: a review. IEEE Trans PAMI 22(1):4–37
2.
Zurück zum Zitat Chow CK (1965) Statistical independence and threshold functions. IEEE Trans Electron Comput EC-16:66–68CrossRef Chow CK (1965) Statistical independence and threshold functions. IEEE Trans Electron Comput EC-16:66–68CrossRef
3.
Zurück zum Zitat Krzanowski W, Partrige D (1996) Software diversity: practical statistics for its measurement and exploitation. Department of Computer Science, Raport University of Exeter Krzanowski W, Partrige D (1996) Software diversity: practical statistics for its measurement and exploitation. Department of Computer Science, Raport University of Exeter
4.
Zurück zum Zitat Kuncheva LI, Whitaker CJ (2001) Ten measures of diversity in classifier ensembles: limits for two classifiers. In: IEEE workshop on intelligent sensor processing, Birmingham, pp. 10/1–10/6 Kuncheva LI, Whitaker CJ (2001) Ten measures of diversity in classifier ensembles: limits for two classifiers. In: IEEE workshop on intelligent sensor processing, Birmingham, pp. 10/1–10/6
5.
Zurück zum Zitat Xu L, Krzyżak A, Suen Ch Y (1992) Methods of combining multiple classifiers and their applications to handwritting recognition. IEEE Trans Syst Man Cybern 22(3):418–435CrossRef Xu L, Krzyżak A, Suen Ch Y (1992) Methods of combining multiple classifiers and their applications to handwritting recognition. IEEE Trans Syst Man Cybern 22(3):418–435CrossRef
6.
Zurück zum Zitat Kuncheva LI (2004) Combining pattern classifiers: methods and algorithms. Wiley-Interscience, New JerseyMATHCrossRef Kuncheva LI (2004) Combining pattern classifiers: methods and algorithms. Wiley-Interscience, New JerseyMATHCrossRef
7.
Zurück zum Zitat Ruta D, Gabrys B (2005) Classifier selection for majority voting. Inf Fusion 6:63–81CrossRef Ruta D, Gabrys B (2005) Classifier selection for majority voting. Inf Fusion 6:63–81CrossRef
8.
Zurück zum Zitat Kuncheva LI, Whitaker CJ, Shipp CA, Duin RPW (2003) Limits on the majority vote accuracy in classifier fusion. Pattern Anal Appl 6:22–31MATHCrossRefMathSciNet Kuncheva LI, Whitaker CJ, Shipp CA, Duin RPW (2003) Limits on the majority vote accuracy in classifier fusion. Pattern Anal Appl 6:22–31MATHCrossRefMathSciNet
9.
Zurück zum Zitat Hashem S (1997) Optimal linear combinations of neural networks. Neural Netw 10(4):599–614CrossRef Hashem S (1997) Optimal linear combinations of neural networks. Neural Netw 10(4):599–614CrossRef
10.
Zurück zum Zitat Kuncheva LI, Jain LC (2000) Designing classifier fusion systems by genetic algorithms. IEEE Trans Evol Comput 4:327–336CrossRef Kuncheva LI, Jain LC (2000) Designing classifier fusion systems by genetic algorithms. IEEE Trans Evol Comput 4:327–336CrossRef
11.
Zurück zum Zitat Inoue H, Narihisa H (2002) Optimizing a multiple classifier systems. Lect Notes Comput Sci 2417:285–294CrossRef Inoue H, Narihisa H (2002) Optimizing a multiple classifier systems. Lect Notes Comput Sci 2417:285–294CrossRef
12.
Zurück zum Zitat Wozniak M (2007) Experiments with trained and untrained fusers. In: Corchado E, Corchado JM, Abraham A (eds) Innovations in hybrid intelligent systems. Springer, Berlin, pp 144–150 Wozniak M (2007) Experiments with trained and untrained fusers. In: Corchado E, Corchado JM, Abraham A (eds) Innovations in hybrid intelligent systems. Springer, Berlin, pp 144–150
13.
Zurück zum Zitat Rao NSV (2004) A generic sensor fusion problem: classification and function estimation. LNCS 3077:16–30 Rao NSV (2004) A generic sensor fusion problem: classification and function estimation. LNCS 3077:16–30
14.
Zurück zum Zitat Fumera G, Roli F (2005) A theoretical and experimental analysis of linear combiners for multiple classifier systems. IEEE Trans Pattern Anal Mach Intell 27(6):942–956CrossRef Fumera G, Roli F (2005) A theoretical and experimental analysis of linear combiners for multiple classifier systems. IEEE Trans Pattern Anal Mach Intell 27(6):942–956CrossRef
15.
Zurück zum Zitat Biggio B et al (2007) Bayesian analysis of linear combiners. LNCS 4472:292–301 Biggio B et al (2007) Bayesian analysis of linear combiners. LNCS 4472:292–301
16.
Zurück zum Zitat Tumer K, Ghosh J (1999) Linear and order statistics combiners for pattern classification. In: Sharkley AJC (ed) Combining artificial neural networks. Springer, Berlin, pp 127–155 Tumer K, Ghosh J (1999) Linear and order statistics combiners for pattern classification. In: Sharkley AJC (ed) Combining artificial neural networks. Springer, Berlin, pp 127–155
17.
Zurück zum Zitat Duin RPW (2002) The combining classifier: to train or not to train? In: Proceedings of the ICPR2002, Quebec City Duin RPW (2002) The combining classifier: to train or not to train? In: Proceedings of the ICPR2002, Quebec City
18.
Zurück zum Zitat Rastrigin LA, Erenstein RH (1981) Method of collective recognition. Energoizdat, MoscowMATH Rastrigin LA, Erenstein RH (1981) Method of collective recognition. Energoizdat, MoscowMATH
19.
Zurück zum Zitat Baram Y (1998) Partial classification: the benefit of deferrer decision. IEEE Trans Pattern Anal Mach Intell 20(8):769–776CrossRefMathSciNet Baram Y (1998) Partial classification: the benefit of deferrer decision. IEEE Trans Pattern Anal Mach Intell 20(8):769–776CrossRefMathSciNet
20.
Zurück zum Zitat Cordella LP, Foggia P, Sansone C, Tortorella F, Vento M (2000) A cascade multiple expert system for verification. Lect Notes Comput Sci 1857:330–339CrossRef Cordella LP, Foggia P, Sansone C, Tortorella F, Vento M (2000) A cascade multiple expert system for verification. Lect Notes Comput Sci 1857:330–339CrossRef
21.
Zurück zum Zitat Giacinto G, Roli F, Fumera G (2000) Design of effective multiple classifier systems by clustering of classifiers. In: Proceedings of 15th international conference on pattern recognition—ICPR’00, vol 2, Barcelona, Spain, pp 160–163 Giacinto G, Roli F, Fumera G (2000) Design of effective multiple classifier systems by clustering of classifiers. In: Proceedings of 15th international conference on pattern recognition—ICPR’00, vol 2, Barcelona, Spain, pp 160–163
22.
Zurück zum Zitat Goebel K, Yan W (2004) Choosing classifier for decision fusion. In: Proceedings of the 7th international conference on information fusion, Stockholm, Sweden, pp 562–568 Goebel K, Yan W (2004) Choosing classifier for decision fusion. In: Proceedings of the 7th international conference on information fusion, Stockholm, Sweden, pp 562–568
23.
Zurück zum Zitat Kuncheva LI (2000) Cluster-and-selection method for classifier combination. In: Proceedings of the 4th international conference on knowledge-based intelligent engineering systems and allied technologies, Brighton, pp 185–188 Kuncheva LI (2000) Cluster-and-selection method for classifier combination. In: Proceedings of the 4th international conference on knowledge-based intelligent engineering systems and allied technologies, Brighton, pp 185–188
24.
Zurück zum Zitat Jain AK, Murty MN, Flynn PJ (1999) Data clustering: a review. ACM Comput Surv 31(3):264–323CrossRef Jain AK, Murty MN, Flynn PJ (1999) Data clustering: a review. ACM Comput Surv 31(3):264–323CrossRef
25.
Zurück zum Zitat Duda RO, Hart PE, Stork DG (2001) Pattern classification. Wiley-Interscience, New JerseyMATH Duda RO, Hart PE, Stork DG (2001) Pattern classification. Wiley-Interscience, New JerseyMATH
26.
Zurück zum Zitat Devijver PA, Kittler J (1982) Pattern recognition: a statistical approach. Prentice Hall, LondonMATH Devijver PA, Kittler J (1982) Pattern recognition: a statistical approach. Prentice Hall, LondonMATH
27.
Zurück zum Zitat Higleyman WH (1962) The design and analysis of pattern recognition experiments. Bell Syst Tech J 41:723–744 Higleyman WH (1962) The design and analysis of pattern recognition experiments. Bell Syst Tech J 41:723–744
28.
Zurück zum Zitat Kuratowski K, Mostowski A (1996) Set theory. North-Holland Pub. Co, Amsterdam Kuratowski K, Mostowski A (1996) Set theory. North-Holland Pub. Co, Amsterdam
29.
Zurück zum Zitat Rokach L (2006) Decomposition methodology for classification tasks—a meta decomposer framework. Pattern Anal Appl 9(2–3):257–271MathSciNet Rokach L (2006) Decomposition methodology for classification tasks—a meta decomposer framework. Pattern Anal Appl 9(2–3):257–271MathSciNet
30.
Zurück zum Zitat Gabrys B, Ruta D (2006) Genetic algorithms in classifier fusion. Appl Soft Comput J 6(4):337–347CrossRef Gabrys B, Ruta D (2006) Genetic algorithms in classifier fusion. Appl Soft Comput J 6(4):337–347CrossRef
31.
32.
Zurück zum Zitat Duin RPW, Juszczak P, Paclik P, Pekalska E, de Ridder D, Tax DMJ (2004) PRTools4, a matlab toolbox for pattern recognition. Delft University of Technology Duin RPW, Juszczak P, Paclik P, Pekalska E, de Ridder D, Tax DMJ (2004) PRTools4, a matlab toolbox for pattern recognition. Delft University of Technology
33.
Zurück zum Zitat Siegler RS (1976) Three aspects of cognitive development. Cognit Psychol 8:481–520 Siegler RS (1976) Three aspects of cognitive development. Cognit Psychol 8:481–520
35.
Zurück zum Zitat Duch W, Grudziński K (2001) Ensembles of similarity-based model. In: Advances in soft computing. Springer, Heidelberg, pp 75–85 Duch W, Grudziński K (2001) Ensembles of similarity-based model. In: Advances in soft computing. Springer, Heidelberg, pp 75–85
36.
Zurück zum Zitat Duin RPW, Tax DMJ, Experiments with Classifier Combining Rules, Lecture Notes in Computer Science, No. 1857, 2000, pp 16–29 Duin RPW, Tax DMJ, Experiments with Classifier Combining Rules, Lecture Notes in Computer Science, No. 1857, 2000, pp 16–29
37.
Zurück zum Zitat Kuncheva LI, Bezdek JC, Duin RPW (2001) Decision templates for multiple classifier fusion: an experimental comparision. Pattern Recognition 34:299–314MATHCrossRef Kuncheva LI, Bezdek JC, Duin RPW (2001) Decision templates for multiple classifier fusion: an experimental comparision. Pattern Recognition 34:299–314MATHCrossRef
38.
Zurück zum Zitat Van Erp M, Vuurpijl LG, Schomaker LRB, An overview and comparison of voting methods for pattern recognition. In: Proc. of the 8th International Workshop on Frontiers in Handwriting Recognition (IWFHR.8), Niagara-on-the-Lake, Canada, pp 195–200 Van Erp M, Vuurpijl LG, Schomaker LRB, An overview and comparison of voting methods for pattern recognition. In: Proc. of the 8th International Workshop on Frontiers in Handwriting Recognition (IWFHR.8), Niagara-on-the-Lake, Canada, pp 195–200
Metadaten
Titel
Algorithm of designing compound recognition system on the basis of combining classifiers with simultaneous splitting feature space into competence areas
verfasst von
Konrad Jackowski
Michal Wozniak
Publikationsdatum
01.12.2009
Verlag
Springer-Verlag
Erschienen in
Pattern Analysis and Applications / Ausgabe 4/2009
Print ISSN: 1433-7541
Elektronische ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-008-0137-7

Weitere Artikel der Ausgabe 4/2009

Pattern Analysis and Applications 4/2009 Zur Ausgabe