Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 4/2013

01-08-2013 | Original Article

System-on-programmable-chip implementation of diminishing learning based pattern recognition system

Authors: J. Manikandan, B. Venkataramani

Published in: International Journal of Machine Learning and Cybernetics | Issue 4/2013

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Support vector machine (SVM) is one of the state-of-the-art tools for linear and nonlinear pattern classification. One of the design issues in SVM classifier is reducing the number of support vectors without compromising the classification accuracy. A technique denoted as diminishing learning (DL) is already proposed in literature for an SVM based multi-class isolated digit recognition system using speaker dependent TI46 database of isolated digits. In this paper, the computational complexity for SVM and SVM-DL based isolated digit recognition system is studied and the computation time for both the classifiers is evaluated by system-on-programmable-chip (SOPC) implementation of the recognition system onto an Altera Cyclone II Series FPGA using Nios II Soft-core processor. The number of support vectors is reduced by 38.28–90.25 % on using SVM-DL for isolated digit recognition problem. This in turn reduces the classification time for SVM-DL by 31.45–91.78 % over SVM. Recognition accuracies of 97 and 98 % are achieved for SVM classifier with and without DL technique, respectively. The study confirms the effect of, the order in which the classes are classified, on the recognition accuracy. For the TI46 database, about 2–4 % increase in recognition accuracy is obtained by choosing the optimum order for SVM-DL classifier. The proposed SOPC implementation of SVM-DL based recognition system can be employed for various other pattern recognition applications too such as face recognition, character recognition and target recognition.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Burges CJC (1999) A tutorial on support vector machines for pattern recognition. Data Mining Knowl Discov 2:121–167CrossRef Burges CJC (1999) A tutorial on support vector machines for pattern recognition. Data Mining Knowl Discov 2:121–167CrossRef
2.
go back to reference Martínez Ramón M, Nan X, Christodoulou CG (2005) Beamforming using support vector machines. IEEE Antennas Wirel Propagation Lett 4:439–442CrossRef Martínez Ramón M, Nan X, Christodoulou CG (2005) Beamforming using support vector machines. IEEE Antennas Wirel Propagation Lett 4:439–442CrossRef
3.
go back to reference Julia Fernández-Getino García M, Rojo-Álvarez JL (2006) Support vector machines for robust channel estimation in OFDM. IEEE Signal Process Lett 13(7):397–400CrossRef Julia Fernández-Getino García M, Rojo-Álvarez JL (2006) Support vector machines for robust channel estimation in OFDM. IEEE Signal Process Lett 13(7):397–400CrossRef
4.
go back to reference Maulik U, Chakraborty D (2011) A novel semisupervised SVM for pixel classification of remote sensing imagery. Int J Machine Learn Cybern, 1–12 Maulik U, Chakraborty D (2011) A novel semisupervised SVM for pixel classification of remote sensing imagery. Int J Machine Learn Cybern, 1–12
5.
go back to reference Xiao J, Wang H, Yang X, Gao Z (2012) Multiple faults diagnosis in motion system based on SVM. Int J Mach Learn Cybern, 77–82 Xiao J, Wang H, Yang X, Gao Z (2012) Multiple faults diagnosis in motion system based on SVM. Int J Mach Learn Cybern, 77–82
6.
go back to reference Wang X, Lu S, Zhai J (2008) Fast fuzzy multicategory SVM based on support vector domain description. Int J Patt Recognit Artif Intell 22(1):109–120CrossRef Wang X, Lu S, Zhai J (2008) Fast fuzzy multicategory SVM based on support vector domain description. Int J Patt Recognit Artif Intell 22(1):109–120CrossRef
7.
go back to reference Mota TC, Thome ACG (2009) One-against-all based multiclass SVM strategies applied to vehicle plate character recognition. International joint conference on neural networks (IJCNN), pp 2153–2159 Mota TC, Thome ACG (2009) One-against-all based multiclass SVM strategies applied to vehicle plate character recognition. International joint conference on neural networks (IJCNN), pp 2153–2159
8.
go back to reference El Barbri N, Llobet E, El Bari N, Correig X, Bouchikhi B (2008) Application of a portable electronic nose system to assess the freshness of Moroccan sardines. J Mater Sci Eng C 28:666–670CrossRef El Barbri N, Llobet E, El Bari N, Correig X, Bouchikhi B (2008) Application of a portable electronic nose system to assess the freshness of Moroccan sardines. J Mater Sci Eng C 28:666–670CrossRef
9.
go back to reference Lee S, Lee S, Jung H (2003) Real-time implementation of face recognition algorithms on DSP chip, vol 2688. Springer, LNCS, Berlin, pp 294–301 Lee S, Lee S, Jung H (2003) Real-time implementation of face recognition algorithms on DSP chip, vol 2688. Springer, LNCS, Berlin, pp 294–301
10.
go back to reference Arth C, Limberger F, Bischof H (2007) Real-time license plate recognition on an embedded DSP-platform. In: IEEE Conf Comput Vis Patt Recognit 17–22. Minneapolis, MN, USA, pp 1–8 Arth C, Limberger F, Bischof H (2007) Real-time license plate recognition on an embedded DSP-platform. In: IEEE Conf Comput Vis Patt Recognit 17–22. Minneapolis, MN, USA, pp 1–8
11.
go back to reference Pina-Ramirez O, Valdes-Cristerna R, Yanez-Suarez O (2006) An FPGA implementation of linear Kernel support vector machines. In: IEEE international conference on reconfigurable computing and FPGA’s, pp 1–6 Pina-Ramirez O, Valdes-Cristerna R, Yanez-Suarez O (2006) An FPGA implementation of linear Kernel support vector machines. In: IEEE international conference on reconfigurable computing and FPGA’s, pp 1–6
12.
go back to reference Anguita D, Boni A, Ridella S (2003) A digital architecture for support vector machines: theory, algorithm, and FPGA implementation. IEEE Trans Neural Netw 14(5):993–1009CrossRef Anguita D, Boni A, Ridella S (2003) A digital architecture for support vector machines: theory, algorithm, and FPGA implementation. IEEE Trans Neural Netw 14(5):993–1009CrossRef
13.
go back to reference Manikandan J, Venkataramani B, Avanthi V (2009) FPGA implementation of support vector machine based isolated digit recognition system. In: IEEE international conference on VLSI design, 05–09 Jan 2009, New Delhi, pp 347–352 Manikandan J, Venkataramani B, Avanthi V (2009) FPGA implementation of support vector machine based isolated digit recognition system. In: IEEE international conference on VLSI design, 05–09 Jan 2009, New Delhi, pp 347–352
14.
go back to reference Hossein G, Abdolreza N (2010) Baseband implementation of OTR-UWB receiver using FPGA. Int J Electron Commun 64(3):258–266CrossRef Hossein G, Abdolreza N (2010) Baseband implementation of OTR-UWB receiver using FPGA. Int J Electron Commun 64(3):258–266CrossRef
15.
go back to reference Manikandan J, Jayaraman M, Jayachandran M (2011) Design of an FPGA-based electronic flow regulator for spacecraft propulsion system. Adv Space Res 47(3):488–495CrossRef Manikandan J, Jayaraman M, Jayachandran M (2011) Design of an FPGA-based electronic flow regulator for spacecraft propulsion system. Adv Space Res 47(3):488–495CrossRef
16.
go back to reference Manikandan J, Jayachandran M (2006) Control a three phase full wave rectifier with an FPGA. Embedded Syst Design 19(11):28–39 Manikandan J, Jayachandran M (2006) Control a three phase full wave rectifier with an FPGA. Embedded Syst Design 19(11):28–39
18.
go back to reference Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, Cambridge Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, Cambridge
19.
go back to reference Haykin S (2003) Neural networks, 2nd edn. Prentice Hall of India, New Delhi Haykin S (2003) Neural networks, 2nd edn. Prentice Hall of India, New Delhi
20.
go back to reference Zhang L, Zhou W, Jiao L (2004) Wavelet support vector machine. IEEE Trans Syst Man Cybern Part B: Cybern 34(1): 34–39 Zhang L, Zhou W, Jiao L (2004) Wavelet support vector machine. IEEE Trans Syst Man Cybern Part B: Cybern 34(1): 34–39
21.
go back to reference Hagan MT, Demuth HB, Beale M (1996) Neural network design. PWS Publishing Company, Massachusetts Hagan MT, Demuth HB, Beale M (1996) Neural network design. PWS Publishing Company, Massachusetts
22.
go back to reference Huang Z, Kuh A (1992) A combined self-organizing feature map and multilayer perceptron for isolated word recognition. IEEE Trans Signal Proc 40(11):2651–2657CrossRef Huang Z, Kuh A (1992) A combined self-organizing feature map and multilayer perceptron for isolated word recognition. IEEE Trans Signal Proc 40(11):2651–2657CrossRef
23.
go back to reference Gold B, Morgan N (2000) Speech and audio signal processing: processing and perception of speech and music. Wiley, New York Gold B, Morgan N (2000) Speech and audio signal processing: processing and perception of speech and music. Wiley, New York
24.
go back to reference Rabiner L, Juang B (1993) Fundamentals of speech recognition. Prentice Hall signal processing series Rabiner L, Juang B (1993) Fundamentals of speech recognition. Prentice Hall signal processing series
26.
go back to reference Manikandan J, Venkataramani B (2010) Study and evaluation of a multi-class SVM classifier using diminishing learning technique. Neurocomputing 73(10–12):1676–1685CrossRef Manikandan J, Venkataramani B (2010) Study and evaluation of a multi-class SVM classifier using diminishing learning technique. Neurocomputing 73(10–12):1676–1685CrossRef
27.
go back to reference Pujol O, Radeva P, Vitria J (2006) Discriminant ECOC: a heuristic method for application dependent design of error correcting output codes. IEEE Trans Patt Anal Machine Intell 28(6):1007–1012CrossRef Pujol O, Radeva P, Vitria J (2006) Discriminant ECOC: a heuristic method for application dependent design of error correcting output codes. IEEE Trans Patt Anal Machine Intell 28(6):1007–1012CrossRef
29.
go back to reference Lyons JW (1993) DARPA TIMIT acoustic-phonetic continuous speech corpus, technical report NISTIR 4930, National Institute of Standards and Technology Lyons JW (1993) DARPA TIMIT acoustic-phonetic continuous speech corpus, technical report NISTIR 4930, National Institute of Standards and Technology
31.
go back to reference Lei H, Govindraju V (2005) Half-against-half multi-class support vector machines. Springer book series, lecture notes in computer science, pp 156–164 Lei H, Govindraju V (2005) Half-against-half multi-class support vector machines. Springer book series, lecture notes in computer science, pp 156–164
32.
go back to reference Platt JC, Cristianini N, Shawe-Taylor J (2000) Large margin DAGs for multiclass classification. MIT Press, Massachusetts Platt JC, Cristianini N, Shawe-Taylor J (2000) Large margin DAGs for multiclass classification. MIT Press, Massachusetts
33.
go back to reference (2007) Altera cyclone II device handbook. CII5V1-3.3. Altera Corporation, San Jose (2007) Altera cyclone II device handbook. CII5V1-3.3. Altera Corporation, San Jose
34.
go back to reference (2008) Quartus II version 8.0 handbook. QII5V1-8.0, Altera Corporation, San Jose (2008) Quartus II version 8.0 handbook. QII5V1-8.0, Altera Corporation, San Jose
35.
go back to reference (2010) Altera SOPC Builder User Guide. UG-01096-1.0. Altera Corporation, San Jose (2010) Altera SOPC Builder User Guide. UG-01096-1.0. Altera Corporation, San Jose
36.
go back to reference (2007) Nios II processor reference handbook. NII5V1-7.2. Altera Corporation, San Jose (2007) Nios II processor reference handbook. NII5V1-7.2. Altera Corporation, San Jose
37.
go back to reference (2007) Nios II custom instruction user guide. UG-N2CSTNST-1.4. Altera Corporation, San Jose (2007) Nios II custom instruction user guide. UG-N2CSTNST-1.4. Altera Corporation, San Jose
38.
go back to reference (2006) Using NiosII Floating-Point Custom Instructions. TU-N2FLTNGPNT-1.0. Altera Corporation, San Jose (2006) Using NiosII Floating-Point Custom Instructions. TU-N2FLTNGPNT-1.0. Altera Corporation, San Jose
Metadata
Title
System-on-programmable-chip implementation of diminishing learning based pattern recognition system
Authors
J. Manikandan
B. Venkataramani
Publication date
01-08-2013
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 4/2013
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-012-0102-z

Other articles of this Issue 4/2013

International Journal of Machine Learning and Cybernetics 4/2013 Go to the issue