Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 4/2013

01.08.2013 | Original Article

System-on-programmable-chip implementation of diminishing learning based pattern recognition system

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 4/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Support vector machine (SVM) is one of the state-of-the-art tools for linear and nonlinear pattern classification. One of the design issues in SVM classifier is reducing the number of support vectors without compromising the classification accuracy. A technique denoted as diminishing learning (DL) is already proposed in literature for an SVM based multi-class isolated digit recognition system using speaker dependent TI46 database of isolated digits. In this paper, the computational complexity for SVM and SVM-DL based isolated digit recognition system is studied and the computation time for both the classifiers is evaluated by system-on-programmable-chip (SOPC) implementation of the recognition system onto an Altera Cyclone II Series FPGA using Nios II Soft-core processor. The number of support vectors is reduced by 38.28–90.25 % on using SVM-DL for isolated digit recognition problem. This in turn reduces the classification time for SVM-DL by 31.45–91.78 % over SVM. Recognition accuracies of 97 and 98 % are achieved for SVM classifier with and without DL technique, respectively. The study confirms the effect of, the order in which the classes are classified, on the recognition accuracy. For the TI46 database, about 2–4 % increase in recognition accuracy is obtained by choosing the optimum order for SVM-DL classifier. The proposed SOPC implementation of SVM-DL based recognition system can be employed for various other pattern recognition applications too such as face recognition, character recognition and target recognition.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Burges CJC (1999) A tutorial on support vector machines for pattern recognition. Data Mining Knowl Discov 2:121–167CrossRef Burges CJC (1999) A tutorial on support vector machines for pattern recognition. Data Mining Knowl Discov 2:121–167CrossRef
2.
Zurück zum Zitat Martínez Ramón M, Nan X, Christodoulou CG (2005) Beamforming using support vector machines. IEEE Antennas Wirel Propagation Lett 4:439–442CrossRef Martínez Ramón M, Nan X, Christodoulou CG (2005) Beamforming using support vector machines. IEEE Antennas Wirel Propagation Lett 4:439–442CrossRef
3.
Zurück zum Zitat Julia Fernández-Getino García M, Rojo-Álvarez JL (2006) Support vector machines for robust channel estimation in OFDM. IEEE Signal Process Lett 13(7):397–400CrossRef Julia Fernández-Getino García M, Rojo-Álvarez JL (2006) Support vector machines for robust channel estimation in OFDM. IEEE Signal Process Lett 13(7):397–400CrossRef
4.
Zurück zum Zitat Maulik U, Chakraborty D (2011) A novel semisupervised SVM for pixel classification of remote sensing imagery. Int J Machine Learn Cybern, 1–12 Maulik U, Chakraborty D (2011) A novel semisupervised SVM for pixel classification of remote sensing imagery. Int J Machine Learn Cybern, 1–12
5.
Zurück zum Zitat Xiao J, Wang H, Yang X, Gao Z (2012) Multiple faults diagnosis in motion system based on SVM. Int J Mach Learn Cybern, 77–82 Xiao J, Wang H, Yang X, Gao Z (2012) Multiple faults diagnosis in motion system based on SVM. Int J Mach Learn Cybern, 77–82
6.
Zurück zum Zitat Wang X, Lu S, Zhai J (2008) Fast fuzzy multicategory SVM based on support vector domain description. Int J Patt Recognit Artif Intell 22(1):109–120CrossRef Wang X, Lu S, Zhai J (2008) Fast fuzzy multicategory SVM based on support vector domain description. Int J Patt Recognit Artif Intell 22(1):109–120CrossRef
7.
Zurück zum Zitat Mota TC, Thome ACG (2009) One-against-all based multiclass SVM strategies applied to vehicle plate character recognition. International joint conference on neural networks (IJCNN), pp 2153–2159 Mota TC, Thome ACG (2009) One-against-all based multiclass SVM strategies applied to vehicle plate character recognition. International joint conference on neural networks (IJCNN), pp 2153–2159
8.
Zurück zum Zitat El Barbri N, Llobet E, El Bari N, Correig X, Bouchikhi B (2008) Application of a portable electronic nose system to assess the freshness of Moroccan sardines. J Mater Sci Eng C 28:666–670CrossRef El Barbri N, Llobet E, El Bari N, Correig X, Bouchikhi B (2008) Application of a portable electronic nose system to assess the freshness of Moroccan sardines. J Mater Sci Eng C 28:666–670CrossRef
9.
Zurück zum Zitat Lee S, Lee S, Jung H (2003) Real-time implementation of face recognition algorithms on DSP chip, vol 2688. Springer, LNCS, Berlin, pp 294–301 Lee S, Lee S, Jung H (2003) Real-time implementation of face recognition algorithms on DSP chip, vol 2688. Springer, LNCS, Berlin, pp 294–301
10.
Zurück zum Zitat Arth C, Limberger F, Bischof H (2007) Real-time license plate recognition on an embedded DSP-platform. In: IEEE Conf Comput Vis Patt Recognit 17–22. Minneapolis, MN, USA, pp 1–8 Arth C, Limberger F, Bischof H (2007) Real-time license plate recognition on an embedded DSP-platform. In: IEEE Conf Comput Vis Patt Recognit 17–22. Minneapolis, MN, USA, pp 1–8
11.
Zurück zum Zitat Pina-Ramirez O, Valdes-Cristerna R, Yanez-Suarez O (2006) An FPGA implementation of linear Kernel support vector machines. In: IEEE international conference on reconfigurable computing and FPGA’s, pp 1–6 Pina-Ramirez O, Valdes-Cristerna R, Yanez-Suarez O (2006) An FPGA implementation of linear Kernel support vector machines. In: IEEE international conference on reconfigurable computing and FPGA’s, pp 1–6
12.
Zurück zum Zitat Anguita D, Boni A, Ridella S (2003) A digital architecture for support vector machines: theory, algorithm, and FPGA implementation. IEEE Trans Neural Netw 14(5):993–1009CrossRef Anguita D, Boni A, Ridella S (2003) A digital architecture for support vector machines: theory, algorithm, and FPGA implementation. IEEE Trans Neural Netw 14(5):993–1009CrossRef
13.
Zurück zum Zitat Manikandan J, Venkataramani B, Avanthi V (2009) FPGA implementation of support vector machine based isolated digit recognition system. In: IEEE international conference on VLSI design, 05–09 Jan 2009, New Delhi, pp 347–352 Manikandan J, Venkataramani B, Avanthi V (2009) FPGA implementation of support vector machine based isolated digit recognition system. In: IEEE international conference on VLSI design, 05–09 Jan 2009, New Delhi, pp 347–352
14.
Zurück zum Zitat Hossein G, Abdolreza N (2010) Baseband implementation of OTR-UWB receiver using FPGA. Int J Electron Commun 64(3):258–266CrossRef Hossein G, Abdolreza N (2010) Baseband implementation of OTR-UWB receiver using FPGA. Int J Electron Commun 64(3):258–266CrossRef
15.
Zurück zum Zitat Manikandan J, Jayaraman M, Jayachandran M (2011) Design of an FPGA-based electronic flow regulator for spacecraft propulsion system. Adv Space Res 47(3):488–495CrossRef Manikandan J, Jayaraman M, Jayachandran M (2011) Design of an FPGA-based electronic flow regulator for spacecraft propulsion system. Adv Space Res 47(3):488–495CrossRef
16.
Zurück zum Zitat Manikandan J, Jayachandran M (2006) Control a three phase full wave rectifier with an FPGA. Embedded Syst Design 19(11):28–39 Manikandan J, Jayachandran M (2006) Control a three phase full wave rectifier with an FPGA. Embedded Syst Design 19(11):28–39
17.
18.
Zurück zum Zitat Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, Cambridge Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, Cambridge
19.
Zurück zum Zitat Haykin S (2003) Neural networks, 2nd edn. Prentice Hall of India, New Delhi Haykin S (2003) Neural networks, 2nd edn. Prentice Hall of India, New Delhi
20.
Zurück zum Zitat Zhang L, Zhou W, Jiao L (2004) Wavelet support vector machine. IEEE Trans Syst Man Cybern Part B: Cybern 34(1): 34–39 Zhang L, Zhou W, Jiao L (2004) Wavelet support vector machine. IEEE Trans Syst Man Cybern Part B: Cybern 34(1): 34–39
21.
Zurück zum Zitat Hagan MT, Demuth HB, Beale M (1996) Neural network design. PWS Publishing Company, Massachusetts Hagan MT, Demuth HB, Beale M (1996) Neural network design. PWS Publishing Company, Massachusetts
22.
Zurück zum Zitat Huang Z, Kuh A (1992) A combined self-organizing feature map and multilayer perceptron for isolated word recognition. IEEE Trans Signal Proc 40(11):2651–2657CrossRef Huang Z, Kuh A (1992) A combined self-organizing feature map and multilayer perceptron for isolated word recognition. IEEE Trans Signal Proc 40(11):2651–2657CrossRef
23.
Zurück zum Zitat Gold B, Morgan N (2000) Speech and audio signal processing: processing and perception of speech and music. Wiley, New York Gold B, Morgan N (2000) Speech and audio signal processing: processing and perception of speech and music. Wiley, New York
24.
Zurück zum Zitat Rabiner L, Juang B (1993) Fundamentals of speech recognition. Prentice Hall signal processing series Rabiner L, Juang B (1993) Fundamentals of speech recognition. Prentice Hall signal processing series
26.
Zurück zum Zitat Manikandan J, Venkataramani B (2010) Study and evaluation of a multi-class SVM classifier using diminishing learning technique. Neurocomputing 73(10–12):1676–1685CrossRef Manikandan J, Venkataramani B (2010) Study and evaluation of a multi-class SVM classifier using diminishing learning technique. Neurocomputing 73(10–12):1676–1685CrossRef
27.
Zurück zum Zitat Pujol O, Radeva P, Vitria J (2006) Discriminant ECOC: a heuristic method for application dependent design of error correcting output codes. IEEE Trans Patt Anal Machine Intell 28(6):1007–1012CrossRef Pujol O, Radeva P, Vitria J (2006) Discriminant ECOC: a heuristic method for application dependent design of error correcting output codes. IEEE Trans Patt Anal Machine Intell 28(6):1007–1012CrossRef
29.
Zurück zum Zitat Lyons JW (1993) DARPA TIMIT acoustic-phonetic continuous speech corpus, technical report NISTIR 4930, National Institute of Standards and Technology Lyons JW (1993) DARPA TIMIT acoustic-phonetic continuous speech corpus, technical report NISTIR 4930, National Institute of Standards and Technology
31.
Zurück zum Zitat Lei H, Govindraju V (2005) Half-against-half multi-class support vector machines. Springer book series, lecture notes in computer science, pp 156–164 Lei H, Govindraju V (2005) Half-against-half multi-class support vector machines. Springer book series, lecture notes in computer science, pp 156–164
32.
Zurück zum Zitat Platt JC, Cristianini N, Shawe-Taylor J (2000) Large margin DAGs for multiclass classification. MIT Press, Massachusetts Platt JC, Cristianini N, Shawe-Taylor J (2000) Large margin DAGs for multiclass classification. MIT Press, Massachusetts
33.
Zurück zum Zitat (2007) Altera cyclone II device handbook. CII5V1-3.3. Altera Corporation, San Jose (2007) Altera cyclone II device handbook. CII5V1-3.3. Altera Corporation, San Jose
34.
Zurück zum Zitat (2008) Quartus II version 8.0 handbook. QII5V1-8.0, Altera Corporation, San Jose (2008) Quartus II version 8.0 handbook. QII5V1-8.0, Altera Corporation, San Jose
35.
Zurück zum Zitat (2010) Altera SOPC Builder User Guide. UG-01096-1.0. Altera Corporation, San Jose (2010) Altera SOPC Builder User Guide. UG-01096-1.0. Altera Corporation, San Jose
36.
Zurück zum Zitat (2007) Nios II processor reference handbook. NII5V1-7.2. Altera Corporation, San Jose (2007) Nios II processor reference handbook. NII5V1-7.2. Altera Corporation, San Jose
37.
Zurück zum Zitat (2007) Nios II custom instruction user guide. UG-N2CSTNST-1.4. Altera Corporation, San Jose (2007) Nios II custom instruction user guide. UG-N2CSTNST-1.4. Altera Corporation, San Jose
38.
Zurück zum Zitat (2006) Using NiosII Floating-Point Custom Instructions. TU-N2FLTNGPNT-1.0. Altera Corporation, San Jose (2006) Using NiosII Floating-Point Custom Instructions. TU-N2FLTNGPNT-1.0. Altera Corporation, San Jose
Metadaten
Titel
System-on-programmable-chip implementation of diminishing learning based pattern recognition system
Publikationsdatum
01.08.2013
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 4/2013
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-012-0102-z

Weitere Artikel der Ausgabe 4/2013

International Journal of Machine Learning and Cybernetics 4/2013 Zur Ausgabe

Neuer Inhalt