Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 3/2013

01-06-2013 | Original Article

Parameter selection algorithm with self adaptive growing neural network classifier for diagnosis issues

Authors: M. Barakat, D. Lefebvre, M. Khalil, F. Druaux, O. Mustapha

Published in: International Journal of Machine Learning and Cybernetics | Issue 3/2013

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Neural networks have been widely used in the field of intelligent information processing such as classification, clustering, prediction, and recognition. In this paper, a non-parametric supervised classifier based on neural networks is proposed for diagnosis issues. A parameter selection with self adaptive growing neural network (SAGNN) is developed for automatic fault detection and diagnosis in industrial environments. The growing and adaptive skill of SAGNN allows it to change its size and structure according to the training data. An advanced parameter selection criterion is embedded in SAGNN algorithm based on the computed performance rate of training samples. This approach (1) improves classification results in comparison to recent works, (2) achieves more optimization at both stages preprocessing and classification stage, (3) facilitates data visualization and data understanding, (4) reduces the measurement and storage requirements and (5) reduces training and time consumption. In growing stage, neurons are added to hidden subspaces of SAGNN while its competitive learning is an adaptive process in which neurons become more sensitive to different input patterns. The proposed classifier is applied to classify experimental machinery faults of rotary elements and to detect and diagnose disturbances in chemical plant. Classification results are analyzed, explained and compared with various non-parametric supervised neural networks that have been widely investigated for fault diagnosis.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Isermann R (2005) Fault diagnosis systems: an introduction from fault detection to fault tolerance. Springer, Berlin Isermann R (2005) Fault diagnosis systems: an introduction from fault detection to fault tolerance. Springer, Berlin
2.
go back to reference Korbicz J, Koscielny JM, Kowalczuk Z, Cholewa W (2004) Fault diagnosis models, artificial intelligence applications. Springer, BerlinMATH Korbicz J, Koscielny JM, Kowalczuk Z, Cholewa W (2004) Fault diagnosis models, artificial intelligence applications. Springer, BerlinMATH
3.
go back to reference Patton RJ, Chen J (1999) Robust model-based fault diagnosis for dynamic systems. Kluwer Academic Publishers, LondonMATH Patton RJ, Chen J (1999) Robust model-based fault diagnosis for dynamic systems. Kluwer Academic Publishers, LondonMATH
4.
go back to reference Haykin S (1999) Neural networks, a comprehensive foundation, 2nd edn. Macmillan, New YorkMATH Haykin S (1999) Neural networks, a comprehensive foundation, 2nd edn. Macmillan, New YorkMATH
5.
go back to reference Vikas C, Anil K, Ahlawat, R.S. Bhatia, (2011) Growing neural networks using soft competitive learning. Int J Comput Appl 21(3) Vikas C, Anil K, Ahlawat, R.S. Bhatia, (2011) Growing neural networks using soft competitive learning. Int J Comput Appl 21(3)
6.
go back to reference Xinjian Q, Guojian C, Zheng W, (2010) An overview of some classical growing neural networks and new developments. In: 2nd international conference on education technology and computer (ICETC) Xinjian Q, Guojian C, Zheng W, (2010) An overview of some classical growing neural networks and new developments. In: 2nd international conference on education technology and computer (ICETC)
7.
go back to reference Marsland S, Sphairo J, Nehmzow U (2002) A self-organizing network that grows when required. Neural Netw 15:1041–1058CrossRef Marsland S, Sphairo J, Nehmzow U (2002) A self-organizing network that grows when required. Neural Netw 15:1041–1058CrossRef
8.
go back to reference Daxin T, Yueou R, Qiuju L (2008) Dynamic growing self-organizing neural network for clustering. Springer, Berlin, pp 589–595 Daxin T, Yueou R, Qiuju L (2008) Dynamic growing self-organizing neural network for clustering. Springer, Berlin, pp 589–595
9.
go back to reference Kamimura R (2003) Competitive learning by information maximization: eliminating dead neurons in competitive learning. In: Kaynak O, Alpaydın E, Oja E, Xu L (eds) ICANN 2003 and ICONIP 2003, vol 2714. LNCS, Springer, Heidelberg, pp 99–106 Kamimura R (2003) Competitive learning by information maximization: eliminating dead neurons in competitive learning. In: Kaynak O, Alpaydın E, Oja E, Xu L (eds) ICANN 2003 and ICONIP 2003, vol 2714. LNCS, Springer, Heidelberg, pp 99–106
10.
go back to reference Andrew L (2000) Analyses on the generalized lotto-type competitive learning. In: Leung K-S, Chan L, Meng H (eds) IDEAL 2000, vol 1983. LNCS, Springer, Heidelberg, pp. 9–16 Andrew L (2000) Analyses on the generalized lotto-type competitive learning. In: Leung K-S, Chan L, Meng H (eds) IDEAL 2000, vol 1983. LNCS, Springer, Heidelberg, pp. 9–16
11.
go back to reference Dellomo MR (1999) Helicopter gearbox fault detection: a neural network based approach. J Vib Acoust 121(3):265–272CrossRef Dellomo MR (1999) Helicopter gearbox fault detection: a neural network based approach. J Vib Acoust 121(3):265–272CrossRef
12.
go back to reference Su H, Chong KT (2007) Induction machine condition monitoring using neural network modeling. IEEE Trans Ind Electron 54(1):241–249CrossRef Su H, Chong KT (2007) Induction machine condition monitoring using neural network modeling. IEEE Trans Ind Electron 54(1):241–249CrossRef
13.
go back to reference Wasserman PD (1999) Advanced methods in neural computing. Van Nostrand Reinhold, New York Wasserman PD (1999) Advanced methods in neural computing. Van Nostrand Reinhold, New York
14.
15.
go back to reference Guang-Bin H, Dian HW, Yuan L (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2):107–122CrossRef Guang-Bin H, Dian HW, Yuan L (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2):107–122CrossRef
16.
go back to reference Xi-zhao W, Aixia C, Huimin F (2011) Upper integral network with extreme learning mechanism. Neurocomputing 74(16):2520–2525CrossRef Xi-zhao W, Aixia C, Huimin F (2011) Upper integral network with extreme learning mechanism. Neurocomputing 74(16):2520–2525CrossRef
17.
go back to reference Fukunaga K (1972) Introduction to statistical pattern recognition. Purdue University/Academic Press, Lafayette/London Fukunaga K (1972) Introduction to statistical pattern recognition. Purdue University/Academic Press, Lafayette/London
18.
go back to reference Dong LT, Robert M (2010) Genetic algorithm-neural network (GANN): a study of neural network activation functions and depth of genetic algorithm search applied to feature selection. Int J Mach Learn Cybern 1(1–4):75–87 Dong LT, Robert M (2010) Genetic algorithm-neural network (GANN): a study of neural network activation functions and depth of genetic algorithm search applied to feature selection. Int J Mach Learn Cybern 1(1–4):75–87
19.
go back to reference Xi-Zhao W, Li Chun-Guo, Daniel SY, Shi JS, Hui MF (2008) A definition of partial derivative of random functions and its application to RBFNN sensitivity analysis. Neurocomputing 71(7–9):1515–1526 Xi-Zhao W, Li Chun-Guo, Daniel SY, Shi JS, Hui MF (2008) A definition of partial derivative of random functions and its application to RBFNN sensitivity analysis. Neurocomputing 71(7–9):1515–1526
20.
go back to reference Samanta B, Al-Baulshi KR (2003) Artificial neural network based fault diagnostics of rolling element bearings using time domain features. Mech Syst Signal Process 17(2):317–328CrossRef Samanta B, Al-Baulshi KR (2003) Artificial neural network based fault diagnostics of rolling element bearings using time domain features. Mech Syst Signal Process 17(2):317–328CrossRef
21.
go back to reference Fernández S, Jesús M, Murakami S (2004) A comparison of two learning mechanisms for the automatic design of fuzzy diagnosis systems for rotating machinery. Appl Soft Comput 4:413–422CrossRef Fernández S, Jesús M, Murakami S (2004) A comparison of two learning mechanisms for the automatic design of fuzzy diagnosis systems for rotating machinery. Appl Soft Comput 4:413–422CrossRef
22.
go back to reference Nandi AK (2000) Advanced digital vibration signal processing for condition monitoring. In: Proceedings of COMADEM2000, Houston, TX, pp 129–143 Nandi AK (2000) Advanced digital vibration signal processing for condition monitoring. In: Proceedings of COMADEM2000, Houston, TX, pp 129–143
23.
go back to reference Jack LB, Nandi AK (2000) Genetic algorithms for feature extraction in machine condition monitoring with vibration signals. IEEE Proc Vis Image Signal Process 147:205–212CrossRef Jack LB, Nandi AK (2000) Genetic algorithms for feature extraction in machine condition monitoring with vibration signals. IEEE Proc Vis Image Signal Process 147:205–212CrossRef
24.
go back to reference Belotti V, Crenna F, Michelini RC, Rossi GB (2006) Wheel-flat diagnostic tool via wavelet transform. Mech Syst Signal Process 20:1953–1966CrossRef Belotti V, Crenna F, Michelini RC, Rossi GB (2006) Wheel-flat diagnostic tool via wavelet transform. Mech Syst Signal Process 20:1953–1966CrossRef
25.
go back to reference Binu P, Chacko V, Vimal Krishnan R, Raju G, Babu Anto P (2011) Handwritten character recognition using wavelet energy and extreme learning machine. Int J Mach Learn Cybern. doi:10.1007/s13042-011-0049-5 Binu P, Chacko V, Vimal Krishnan R, Raju G, Babu Anto P (2011) Handwritten character recognition using wavelet energy and extreme learning machine. Int J Mach Learn Cybern. doi:10.​1007/​s13042-011-0049-5
26.
go back to reference Wang XZ, Dong CR (2009) Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy. IEEE Trans Fuzzy Syst 17(3):556–567CrossRef Wang XZ, Dong CR (2009) Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy. IEEE Trans Fuzzy Syst 17(3):556–567CrossRef
27.
go back to reference Wang XZ, Zhai JH, Lu SX (2008) Induction of multiple fuzzy decision trees based on rough set technique. Inf Sci 178(16):3188–3202MathSciNetCrossRefMATH Wang XZ, Zhai JH, Lu SX (2008) Induction of multiple fuzzy decision trees based on rough set technique. Inf Sci 178(16):3188–3202MathSciNetCrossRefMATH
28.
go back to reference Mendel T, Rauber W, Varejao FM, Batista RJ (2009), Rolling element bearing fault diagnosis in rotating machines of oil extraction rigs. 17th European signal processing conference, Scotland Mendel T, Rauber W, Varejao FM, Batista RJ (2009), Rolling element bearing fault diagnosis in rotating machines of oil extraction rigs. 17th European signal processing conference, Scotland
29.
go back to reference Barakat M, Lefebvre D, Khalil M, Mustapha O, Druaux F (2010), Input–output classification mapping for the fault detection, identification and accommodation. In: Proc. IEEE-SMC, Istanbul (to appear) Barakat M, Lefebvre D, Khalil M, Mustapha O, Druaux F (2010), Input–output classification mapping for the fault detection, identification and accommodation. In: Proc. IEEE-SMC, Istanbul (to appear)
30.
go back to reference Hsin-Chang Y, Chung-Hong L (2003) A text mining approach on automatic generation of web directories and hierarchies. In: Proceedings of the IEEE/WIC international conference on web intelligence (WI’03) Hsin-Chang Y, Chung-Hong L (2003) A text mining approach on automatic generation of web directories and hierarchies. In: Proceedings of the IEEE/WIC international conference on web intelligence (WI’03)
31.
go back to reference Yan Y, Pederson JO (1997) Comparative study of feature selection in text categorization. In: Proceedings on fourteenth international conference on machine learning (ICML’97), pp 412–420 Yan Y, Pederson JO (1997) Comparative study of feature selection in text categorization. In: Proceedings on fourteenth international conference on machine learning (ICML’97), pp 412–420
32.
go back to reference Hecht-Nielsen R (1990) Neurocomputing. Addison-Wesley, Reading Hecht-Nielsen R (1990) Neurocomputing. Addison-Wesley, Reading
34.
go back to reference Park J, Sandberg JW (1991) Universal approximation using radial basis functions network. Neural Comput 3:246–257 Park J, Sandberg JW (1991) Universal approximation using radial basis functions network. Neural Comput 3:246–257
35.
go back to reference Poggio T, Girosi F (1990) Networks for approximation and learning. Proc IEEE 78:1481–1497CrossRef Poggio T, Girosi F (1990) Networks for approximation and learning. Proc IEEE 78:1481–1497CrossRef
36.
go back to reference Jack LB, Nandi AK (2002) Fault detection using support vector machines and artificial neural networks, augmented by genetic algorithms. Mech Syst Signal Process 16:373–390CrossRef Jack LB, Nandi AK (2002) Fault detection using support vector machines and artificial neural networks, augmented by genetic algorithms. Mech Syst Signal Process 16:373–390CrossRef
37.
go back to reference Yang W (2006) Establishment of the mathematical model for diagnosing the engine valve faults by genetic programming. J Sound Vib 293:213–226CrossRef Yang W (2006) Establishment of the mathematical model for diagnosing the engine valve faults by genetic programming. J Sound Vib 293:213–226CrossRef
38.
go back to reference Merry R, Steinbuch M (2005) Wavelet theory and applications, literature study. Eindhoven University of Technology, Department of Mechanical Engineering, Control systems technology group Merry R, Steinbuch M (2005) Wavelet theory and applications, literature study. Eindhoven University of Technology, Department of Mechanical Engineering, Control systems technology group
39.
go back to reference Arthur A (2003) Signal processing applications of wavelets. University of California, Information and Computer Sciences, USA Arthur A (2003) Signal processing applications of wavelets. University of California, Information and Computer Sciences, USA
40.
41.
go back to reference Schneiders MGE (2001) Wavelets in control engineering. Master’s thesis, Eindhoven University of Technology Schneiders MGE (2001) Wavelets in control engineering. Master’s thesis, Eindhoven University of Technology
42.
go back to reference Barakat M, Druaux F, Lefebvre D, Khalil M, Mustapha O (2011) Self adaptive growing neural network classifier for faults detection and diagnosis. Neurocomput J Elsevier 74:3865–3876CrossRef Barakat M, Druaux F, Lefebvre D, Khalil M, Mustapha O (2011) Self adaptive growing neural network classifier for faults detection and diagnosis. Neurocomput J Elsevier 74:3865–3876CrossRef
43.
go back to reference Chen G, McAvoy TJ (1997) Predictive on-line monitoring of continuous processes, J. Process Control 8:409–420CrossRef Chen G, McAvoy TJ (1997) Predictive on-line monitoring of continuous processes, J. Process Control 8:409–420CrossRef
44.
go back to reference McAvoy TJ (1998) A methodology for screening level control structures in plant-wide control systems. Comput Chem Eng 22:1543–1552CrossRef McAvoy TJ (1998) A methodology for screening level control structures in plant-wide control systems. Comput Chem Eng 22:1543–1552CrossRef
45.
go back to reference Downs JJ, Vogel EF (1993) A plant-wide industrial control problem. Comput Chem Eng 17:245–255CrossRef Downs JJ, Vogel EF (1993) A plant-wide industrial control problem. Comput Chem Eng 17:245–255CrossRef
47.
go back to reference Leclercq E, Druaux F, Lefebvre D, Zerkaoui S (2005) Autonomous learning algorithm for fully connected recurrent networks. Neurocomputing 63:25–44CrossRef Leclercq E, Druaux F, Lefebvre D, Zerkaoui S (2005) Autonomous learning algorithm for fully connected recurrent networks. Neurocomputing 63:25–44CrossRef
48.
go back to reference Zerkaoui S, Druaux F, Leclercq E, and Lefebvre D (2007) Multivariable adaptive control for non-linear systems: application to the Tennessee Eastman Challenge Process, Greece Zerkaoui S, Druaux F, Leclercq E, and Lefebvre D (2007) Multivariable adaptive control for non-linear systems: application to the Tennessee Eastman Challenge Process, Greece
49.
go back to reference Barakat M, Druaux F, Lefebvre D, Khalil M, and Mustapha O (2011) Intelligent condition monitoring of rotary machine by mean of self adaptive growing neural network, IEEE-MED, Greece Barakat M, Druaux F, Lefebvre D, Khalil M, and Mustapha O (2011) Intelligent condition monitoring of rotary machine by mean of self adaptive growing neural network, IEEE-MED, Greece
50.
go back to reference Barakat M, Lefebvre D, Khalil M, Mustapha O, Druaux F (2010) FDI based on wavelet decomposition combined with parameters selection and RBF networks: application to the diagnosis of TECP reactor. In: Proc. IEEE-MED, Invited session ‘Diagnosis and Environmental issues’, Marrakech, pp 1347–1352 Barakat M, Lefebvre D, Khalil M, Mustapha O, Druaux F (2010) FDI based on wavelet decomposition combined with parameters selection and RBF networks: application to the diagnosis of TECP reactor. In: Proc. IEEE-MED, Invited session ‘Diagnosis and Environmental issues’, Marrakech, pp 1347–1352
51.
go back to reference Barakat M, Lefebvre D, Khalil M, Mustapha O, Druaux F (2010) BSP-BDT Classification technique: application to rolling elements bearing. In: Conference on control and fault tolerant systems, “sys-Tol”, Nice, pp 654–659 Barakat M, Lefebvre D, Khalil M, Mustapha O, Druaux F (2010) BSP-BDT Classification technique: application to rolling elements bearing. In: Conference on control and fault tolerant systems, “sys-Tol”, Nice, pp 654–659
52.
go back to reference Barakat M, Lefebvre D, Khalil M, Mustapha O, Druaux F (2009) FDD using wavelet decomposition combined with parameters elimination method and radial basis function network, LAAS16, Beirut Barakat M, Lefebvre D, Khalil M, Mustapha O, Druaux F (2009) FDD using wavelet decomposition combined with parameters elimination method and radial basis function network, LAAS16, Beirut
53.
go back to reference Khalil M, Khalil K (2007) Faults identification in industrial machines using non parametric classification methods. Int J Comput Cognit 5:21–26 Khalil M, Khalil K (2007) Faults identification in industrial machines using non parametric classification methods. Int J Comput Cognit 5:21–26
Metadata
Title
Parameter selection algorithm with self adaptive growing neural network classifier for diagnosis issues
Authors
M. Barakat
D. Lefebvre
M. Khalil
F. Druaux
O. Mustapha
Publication date
01-06-2013
Publisher
Springer-Verlag
Published in
International Journal of Machine Learning and Cybernetics / Issue 3/2013
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-012-0089-5

Other articles of this Issue 3/2013

International Journal of Machine Learning and Cybernetics 3/2013 Go to the issue