Skip to main content
Erschienen in: Pattern Analysis and Applications 3-4/2008

01.09.2008 | Theoretical Advances

Prototype reduction using an artificial immune model

verfasst von: Utpal Garain

Erschienen in: Pattern Analysis and Applications | Ausgabe 3-4/2008

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Artificial immune system (AIS)-based pattern classification approach is relatively new in the field of pattern recognition. The study explores the potentiality of this paradigm in the context of prototype selection task that is primarily effective in improving the classification performance of nearest-neighbor (NN) classifier and also partially in reducing its storage and computing time requirement. The clonal selection model of immunology has been incorporated to condense the original prototype set, and performance is verified by employing the proposed technique in a practical optical character recognition (OCR) system as well as for training and testing of a set of benchmark databases available in the public domain. The effect of control parameters is analyzed and the efficiency of the method is compared with another existing techniques often used for prototype selection. In the case of the OCR system, empirical study shows that the proposed approach exhibits very good generalization ability in generating a smaller prototype library from a larger one and at the same time giving a substantial improvement in the classification accuracy of the underlying NN classifier. The improvement in performance has been statistically verified. Consideration of both OCR data and public domain datasets demonstrate that the proposed method gives results better than or at least comparable to that of some existing techniques.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Instead of Hamming distance, the present experiment also considers the use of Euclidean distance in measuring stimulation value. In this case, 448-dimensional features need not be converted into binary. Since the minimum and maximum values that can occur in each dimension are known, distance between a pair of patterns is normalized to give a stimulation measure in [0, 1]. However, by using Euclidean distance instead of Hamming distance no significant change was observed in the experimental results. All the results presented here are obtained when Hamming distance was used to measure stimulation.
 
2
No iteration is needed if an antigen finds an exact match in the memory. In such a case, producing clones won’t help to find any better B cell and that is why hyper-mutation phase is not invoked at all.
 
Literatur
1.
Zurück zum Zitat Cover TM, Hart PE (1967) Nearest neighbor pattern classification. IEEE Trans Inform Theory 13:21–27MATHCrossRef Cover TM, Hart PE (1967) Nearest neighbor pattern classification. IEEE Trans Inform Theory 13:21–27MATHCrossRef
2.
Zurück zum Zitat Hart PE (1968) The condensed nearest neighbor rule. IEEE Trans Inform Theory (IT) 14(3):515–516CrossRef Hart PE (1968) The condensed nearest neighbor rule. IEEE Trans Inform Theory (IT) 14(3):515–516CrossRef
3.
Zurück zum Zitat Swonger CW (1972) Sample set condensation for a condensed NN decision rule for pattern recognition. In: Watanab S (ed) Frontiers of pattern recognition. Academic Press, New York, pp 511–519 Swonger CW (1972) Sample set condensation for a condensed NN decision rule for pattern recognition. In: Watanab S (ed) Frontiers of pattern recognition. Academic Press, New York, pp 511–519
4.
Zurück zum Zitat Gates GW (1972) The reduced nearest neighbour rule. IEEE Trans Inform Theory 18(3):431–433CrossRef Gates GW (1972) The reduced nearest neighbour rule. IEEE Trans Inform Theory 18(3):431–433CrossRef
5.
Zurück zum Zitat Sanchez JS, Pla F, Ferri FJ (1995) Prototype selection for the nearest neighbour rule through proximity graphs. Pattern Recognit Lett (PRL) 18(6):507–513CrossRef Sanchez JS, Pla F, Ferri FJ (1995) Prototype selection for the nearest neighbour rule through proximity graphs. Pattern Recognit Lett (PRL) 18(6):507–513CrossRef
6.
Zurück zum Zitat Skalak DB (1995) Prototype selection for composite nearest neighbor classifiers. PhD thesis, Computer Science, University of Massachusetts Amherst, USA Skalak DB (1995) Prototype selection for composite nearest neighbor classifiers. PhD thesis, Computer Science, University of Massachusetts Amherst, USA
7.
Zurück zum Zitat Wilson DR, Martinez TR (2000) Reduction techniques for instance-based learning algorithms. Mach Learn 38(3):257–286MATHCrossRef Wilson DR, Martinez TR (2000) Reduction techniques for instance-based learning algorithms. Mach Learn 38(3):257–286MATHCrossRef
8.
Zurück zum Zitat Brighton H, Mellish C (2002) Advances in instance selection for instance-based learning algorithms. Data Min Knowl Discov 6:153–172MATHCrossRefMathSciNet Brighton H, Mellish C (2002) Advances in instance selection for instance-based learning algorithms. Data Min Knowl Discov 6:153–172MATHCrossRefMathSciNet
9.
Zurück zum Zitat Susheela Devi V, Narasimha Murty M (2002) An incremental prototype set building technique. Pattern Recognit 35:505–513MATHCrossRef Susheela Devi V, Narasimha Murty M (2002) An incremental prototype set building technique. Pattern Recognit 35:505–513MATHCrossRef
10.
Zurück zum Zitat Mollineda R, Ferri FJ, Vidal E (2002) An efficient prototype merging strategy for the condensed 1-NN rule through class-conditional hierarchical clustering. Pattern Recognit 35:2771–2782MATHCrossRef Mollineda R, Ferri FJ, Vidal E (2002) An efficient prototype merging strategy for the condensed 1-NN rule through class-conditional hierarchical clustering. Pattern Recognit 35:2771–2782MATHCrossRef
11.
Zurück zum Zitat Pekalska E, Duin RPW (2002) Prototype selection for finding efficient representations of dissimilarity data. In: Sixteenth international conference on pattern recognition (ICPR), vol 3, pp 37–40 Pekalska E, Duin RPW (2002) Prototype selection for finding efficient representations of dissimilarity data. In: Sixteenth international conference on pattern recognition (ICPR), vol 3, pp 37–40
12.
Zurück zum Zitat Sanchez JS, Barandela R, Marques AI, Alejo R, Badenas J (2003) Analysis of new techniques to obtain quality training sets. Pattern Recognit Lett (PRL) 24(7):1015–1022CrossRef Sanchez JS, Barandela R, Marques AI, Alejo R, Badenas J (2003) Analysis of new techniques to obtain quality training sets. Pattern Recognit Lett (PRL) 24(7):1015–1022CrossRef
13.
Zurück zum Zitat Cano JR, Herrera F, Lozano M (2003) Using evolutionary algorithms as instance selection for data reduction in KDD: an experimental study. IEEE Trans Evol Comput 7(6):561–575CrossRef Cano JR, Herrera F, Lozano M (2003) Using evolutionary algorithms as instance selection for data reduction in KDD: an experimental study. IEEE Trans Evol Comput 7(6):561–575CrossRef
14.
Zurück zum Zitat Sanchez JS (2004) High training set size reduction by space partitioning and prototype abstraction. Pattern Recognit 37(7):1561–1564CrossRef Sanchez JS (2004) High training set size reduction by space partitioning and prototype abstraction. Pattern Recognit 37(7):1561–1564CrossRef
15.
Zurück zum Zitat Li Y, Hu Z, Cai Y, Zhang W (2005) Support vector based prototype selection method for nearest neighbor rules. Advances in natural computation. Lecture notes in computer science, vol 3610. Springer, Berlin, pp 528–535 Li Y, Hu Z, Cai Y, Zhang W (2005) Support vector based prototype selection method for nearest neighbor rules. Advances in natural computation. Lecture notes in computer science, vol 3610. Springer, Berlin, pp 528–535
16.
Zurück zum Zitat Barandela R, Ferri FJ, Sanchez JS (2005) Decision boundary preserving prototype selection for nearest neighbor classification. Int J Pattern Recognit Artif Intell (IJPRAI) 19(6):787–806CrossRef Barandela R, Ferri FJ, Sanchez JS (2005) Decision boundary preserving prototype selection for nearest neighbor classification. Int J Pattern Recognit Artif Intell (IJPRAI) 19(6):787–806CrossRef
17.
Zurück zum Zitat Huang DD, Chow TWS (2006) Enhancing density-based data reduction using entropy. Neural Comput 18(2):470–495MATHCrossRef Huang DD, Chow TWS (2006) Enhancing density-based data reduction using entropy. Neural Comput 18(2):470–495MATHCrossRef
18.
Zurück zum Zitat Paredes R, Vidal E (2006) Learning prototypes and distances: a prototype reduction technique based on nearest neighbor error minimization. Pattern Recognit 39(2):180–188MATHCrossRef Paredes R, Vidal E (2006) Learning prototypes and distances: a prototype reduction technique based on nearest neighbor error minimization. Pattern Recognit 39(2):180–188MATHCrossRef
19.
Zurück zum Zitat Kim S-W, John B Oommen (2003) A brief taxonomy and ranking of creative prototype reduction schemes. Pattern Anal Appl (PAA) 6(3):232–244CrossRef Kim S-W, John B Oommen (2003) A brief taxonomy and ranking of creative prototype reduction schemes. Pattern Anal Appl (PAA) 6(3):232–244CrossRef
20.
Zurück zum Zitat Dasgupta D, Ji Z, Gonzalez FF (2003) Artificial immune system (AIS) research in the last five years. In: Congress on evolutionary computation (CEC’03) 1:123–130CrossRef Dasgupta D, Ji Z, Gonzalez FF (2003) Artificial immune system (AIS) research in the last five years. In: Congress on evolutionary computation (CEC’03) 1:123–130CrossRef
21.
Zurück zum Zitat Dasgupta D (1998) An overview of artificial immune systems and their applications. In: Dasgupta D (ed) Artificial immune systems and their applications. Springer, Berlin, pp 3–21 Dasgupta D (1998) An overview of artificial immune systems and their applications. In: Dasgupta D (ed) Artificial immune systems and their applications. Springer, Berlin, pp 3–21
22.
Zurück zum Zitat Zheng Tang, Koichi Tashima, Cao QP (2003) Pattern recognition system using a clonal selection-based immune network. Syst Comput Japan 34(12):56–63CrossRef Zheng Tang, Koichi Tashima, Cao QP (2003) Pattern recognition system using a clonal selection-based immune network. Syst Comput Japan 34(12):56–63CrossRef
23.
Zurück zum Zitat Ji Z, Dasgupta D (2004) Real-valued negative selection algorithm with variable-sized detectors. In: Proceedings of GECCO. LNCS, vol 3102, pp 287–298 Ji Z, Dasgupta D (2004) Real-valued negative selection algorithm with variable-sized detectors. In: Proceedings of GECCO. LNCS, vol 3102, pp 287–298
24.
Zurück zum Zitat de Castro LN, Zuben FVJ (2002) Learning and optimization using the clonal selection principle. IEEE Trans Evol Comput Spec Issue Artif Immune Syst 6:239–251 de Castro LN, Zuben FVJ (2002) Learning and optimization using the clonal selection principle. IEEE Trans Evol Comput Spec Issue Artif Immune Syst 6:239–251
25.
Zurück zum Zitat Carter HJ (2000) The immune system as a model for pattern recognition and classification. J Am Med Inf Assoc 7(3):28–41 Carter HJ (2000) The immune system as a model for pattern recognition and classification. J Am Med Inf Assoc 7(3):28–41
26.
Zurück zum Zitat Watkins AB (2001) AIRS: a resource limited artificial immune classifier. Master’s dissertation, Department of Computer Science, Mississippi State University Watkins AB (2001) AIRS: a resource limited artificial immune classifier. Master’s dissertation, Department of Computer Science, Mississippi State University
27.
Zurück zum Zitat Garain U, Chakraborty PM, Dutta Majumder D (2006) Improvement of OCR accuracy by similar character pair discrimination: an approach based on artificial immune system. In: Proceedings of the 18th international conference on pattern recognition (ICPR), August 2006, Hong Kong II, pp 1046–1049 Garain U, Chakraborty PM, Dutta Majumder D (2006) Improvement of OCR accuracy by similar character pair discrimination: an approach based on artificial immune system. In: Proceedings of the 18th international conference on pattern recognition (ICPR), August 2006, Hong Kong II, pp 1046–1049
28.
Zurück zum Zitat Garain U, Chakraborty PM, Dasgupta D (2006) Recognition of handwritten indic script using clonal selection algorithm. In: Bersini H, Carneiro J (eds) 5th international conference on artificial immune systems (ICARIS), 2006, LNCS, vol 4163. Springer, Berlin, pp 256–266 Garain U, Chakraborty PM, Dasgupta D (2006) Recognition of handwritten indic script using clonal selection algorithm. In: Bersini H, Carneiro J (eds) 5th international conference on artificial immune systems (ICARIS), 2006, LNCS, vol 4163. Springer, Berlin, pp 256–266
29.
Zurück zum Zitat de Castro LN, Timmis J (2002) Artificial immune systems: a novel approach to pattern recognition. In: Alonso L, Corchado J, Fyfe C (eds) Artificial neural networks in pattern recognition. University of Paisley, pp 67–84 de Castro LN, Timmis J (2002) Artificial immune systems: a novel approach to pattern recognition. In: Alonso L, Corchado J, Fyfe C (eds) Artificial neural networks in pattern recognition. University of Paisley, pp 67–84
30.
Zurück zum Zitat Timmis J (2001) Artificial immune systems: a novel data analysis techniques inspired by the immune network theory. Ph.D. thesis, University of Wales, Aberystwyth Timmis J (2001) Artificial immune systems: a novel data analysis techniques inspired by the immune network theory. Ph.D. thesis, University of Wales, Aberystwyth
31.
Zurück zum Zitat Burnet FM (1959) The clonal selection theory of acquired immunity. Vanderbuilt University, Nashville, TN, USA Burnet FM (1959) The clonal selection theory of acquired immunity. Vanderbuilt University, Nashville, TN, USA
32.
Zurück zum Zitat Jerne NK (1974) Towards a network theory of the immune system. Ann Immunol (Inst Pasteur) 125C:373–389 Jerne NK (1974) Towards a network theory of the immune system. Ann Immunol (Inst Pasteur) 125C:373–389
33.
Zurück zum Zitat Perelsen AS, Oster GF (1979) Theoretical studies of clonal selection: minimal antibody repertoire size and reliability of self-nonself discrimination. J Theor Biol 81:645–670CrossRef Perelsen AS, Oster GF (1979) Theoretical studies of clonal selection: minimal antibody repertoire size and reliability of self-nonself discrimination. J Theor Biol 81:645–670CrossRef
34.
35.
Zurück zum Zitat Baird HS (1993) Perfect metrics. In: Proceedings of the second international conference on document analysis and recognition, Tsukuba, Japan, pp 593–597 Baird HS (1993) Perfect metrics. In: Proceedings of the second international conference on document analysis and recognition, Tsukuba, Japan, pp 593–597
36.
Zurück zum Zitat Garain U, Chaudhuri BB (1998) Compound character recognition by run number based metric distance. In: Proceedings of the IS&T/SPIE’s 10th international symposium on electronic imaging: Science & Technology, SPIE, vol 3305. San Jose, CA, USA, pp 90–97 Garain U, Chaudhuri BB (1998) Compound character recognition by run number based metric distance. In: Proceedings of the IS&T/SPIE’s 10th international symposium on electronic imaging: Science & Technology, SPIE, vol 3305. San Jose, CA, USA, pp 90–97
37.
40.
Zurück zum Zitat Box GEP, Hunter GW, Hunter SJ (1978) Statistics for experimenters. Wiley, New YorkMATH Box GEP, Hunter GW, Hunter SJ (1978) Statistics for experimenters. Wiley, New YorkMATH
Metadaten
Titel
Prototype reduction using an artificial immune model
verfasst von
Utpal Garain
Publikationsdatum
01.09.2008
Verlag
Springer-Verlag
Erschienen in
Pattern Analysis and Applications / Ausgabe 3-4/2008
Print ISSN: 1433-7541
Elektronische ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-008-0106-1

Weitere Artikel der Ausgabe 3-4/2008

Pattern Analysis and Applications 3-4/2008 Zur Ausgabe