Skip to main content
Top
Published in: Neural Computing and Applications 2/2010

01-03-2010 | KES 2008

Design of an auto-associative neural network by using design of experiments approach

Authors: Božidar Bratina, Nenad Muškinja, Boris Tovornik

Published in: Neural Computing and Applications | Issue 2/2010

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Advanced monitoring systems enable integration of data-driven algorithms for various tasks, for e.g., control, decision support, fault detection and isolation (FDI), etc. Due to improvement of monitoring systems, statistical or other computational methods can be implemented to real industrial systems. Algorithms which rely on process history data sets are promising for real-time operation especially for online process monitoring tasks, e.g., FDI. However, a reliable FDI system should be robust to uncertainties and small process deviations, thus, false alarms can be avoided. To achieve this, a good model for comparison between process and model is needed and for easier FDI implementation, the model has to be derived directly from process history data. In such cases, model-based FDI approaches are not very practical. In this paper a nonlinear statistical multivariate method (nonlinear principal component analysis) was used for modeling, and realized with auto-associative artificial neural network (AANN). A Taguchi design of experiments (DoE) technique was used and compared with a classic approach, where according to the analysis best AANN model structure was chosen for nonlinear model. Parameters that are important for neural network’s performance have been included into a joint orthogonal array to consider interactions between noise and control process variables. Results are compared to AANN design recommendations by other authors, where obtained nonlinear model was designed for reliable fault detection of very small faults under closed-loop conditions. By using Taguchi DoE robust design on AANN, an improved and reliable FDI scheme was achieved even in case of small faults introduced to the system. The accuracy and performance of AANN and FDI scheme were tested by experiments carried out on a real laboratory hydraulic system, to validate the proposed design for industrial cases.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Iserman R (1984) Fault diagnosis of machines via parameter estimation and knowledge processing—tutorial paper. Automatica 20:387–404CrossRef Iserman R (1984) Fault diagnosis of machines via parameter estimation and knowledge processing—tutorial paper. Automatica 20:387–404CrossRef
2.
go back to reference Basseville M, Nikiforov IV (1993) Detection of abrupt changes: theory and applications. Prentice Hall, Englewood Cliffs Basseville M, Nikiforov IV (1993) Detection of abrupt changes: theory and applications. Prentice Hall, Englewood Cliffs
3.
go back to reference Patton R, Frank P (1989) Fault diagnosis in dynamic systems. Prentice Hall, New York Patton R, Frank P (1989) Fault diagnosis in dynamic systems. Prentice Hall, New York
4.
go back to reference Chiang LH, Russell EL, Braatz RD (2001) Fault detection and diagnosis in industrial control. Springer, New York Chiang LH, Russell EL, Braatz RD (2001) Fault detection and diagnosis in industrial control. Springer, New York
5.
go back to reference Korbitz JK, Kościelny JM, Kowalczuk Z, Cholewa W (2004) Fault diagnosis. Springer, Berlin Korbitz JK, Kościelny JM, Kowalczuk Z, Cholewa W (2004) Fault diagnosis. Springer, Berlin
7.
go back to reference Mok HT, Chan CW (2008) Online fault detection and isolation of nonlinear systems based on neurofuzzy networks. Eng Appl Artif Intel 21:171–181CrossRef Mok HT, Chan CW (2008) Online fault detection and isolation of nonlinear systems based on neurofuzzy networks. Eng Appl Artif Intel 21:171–181CrossRef
8.
go back to reference Venkatesan D, Kannan K, Saravanan R (2009) A genetic algorithm-based artificial neural network model for the optimization of machining processes. Neural Comput Appl 18:135–140CrossRef Venkatesan D, Kannan K, Saravanan R (2009) A genetic algorithm-based artificial neural network model for the optimization of machining processes. Neural Comput Appl 18:135–140CrossRef
9.
go back to reference Jolliffe IT (2004) Principal component analysis, 2nd edn. Springer, New York Jolliffe IT (2004) Principal component analysis, 2nd edn. Springer, New York
10.
go back to reference Klančar G, Škrjanc I (2002) A principal component analysis in fault detection and isolation: hydraulic and fermentation process example. Electrotech Rev 69:311–316 Klančar G, Škrjanc I (2002) A principal component analysis in fault detection and isolation: hydraulic and fermentation process example. Electrotech Rev 69:311–316
11.
go back to reference Chen J, Liao C (2002) Dynamic process fault monitoring based on neural network and PCA. J Process Control 12:277–289CrossRef Chen J, Liao C (2002) Dynamic process fault monitoring based on neural network and PCA. J Process Control 12:277–289CrossRef
12.
go back to reference Kramer MA (1991) Nonlinear principal component analysis using autoassociative neural networks. AIChE J 37:233–243CrossRef Kramer MA (1991) Nonlinear principal component analysis using autoassociative neural networks. AIChE J 37:233–243CrossRef
13.
go back to reference Frank PM (1992) Robust model-based fault detection in dynamic systems. In: IFAC symposium on on-line fault detection and supervision in the chemical process industries. Newark, Delaware Frank PM (1992) Robust model-based fault detection in dynamic systems. In: IFAC symposium on on-line fault detection and supervision in the chemical process industries. Newark, Delaware
14.
go back to reference Dunia R, Qin SJ (1998) Joint diagnosis of process and sensor faults using principal component analysis. Control Eng Pract 6:457–469CrossRef Dunia R, Qin SJ (1998) Joint diagnosis of process and sensor faults using principal component analysis. Control Eng Pract 6:457–469CrossRef
15.
go back to reference Gertler J (1998) Fault detection and diagnosis in engineering systems. Marcel Dekker, New York Gertler J (1998) Fault detection and diagnosis in engineering systems. Marcel Dekker, New York
16.
go back to reference Venkatasubramanian V, Raghunathan R, Yin K, Kavuri NS (2003) A review of process fault detection and diagnosis. Comput Chem Eng 27:293–311 (Part I)CrossRef Venkatasubramanian V, Raghunathan R, Yin K, Kavuri NS (2003) A review of process fault detection and diagnosis. Comput Chem Eng 27:293–311 (Part I)CrossRef
17.
go back to reference Venkatasubramanian V, Raghunathan R, Yin K, Kavuri NS (2003) A review of process fault detection and diagnosis. Comput Chem Eng 27:313–326 (Part II)CrossRef Venkatasubramanian V, Raghunathan R, Yin K, Kavuri NS (2003) A review of process fault detection and diagnosis. Comput Chem Eng 27:313–326 (Part II)CrossRef
18.
go back to reference Venkatasubramanian V, Raghunathan R, Yin K, Kavuri NS (2003) A review of process fault detection and diagnosis. Comput Chem Eng 27:327–346 (Part III)CrossRef Venkatasubramanian V, Raghunathan R, Yin K, Kavuri NS (2003) A review of process fault detection and diagnosis. Comput Chem Eng 27:327–346 (Part III)CrossRef
19.
go back to reference Uraikul V, Chan CW, Tontiwachwuthikul P (2007) Artificial intelligence for monitoring and supervisory control of process systems. Eng Appl Artif Intel 20:115–131CrossRef Uraikul V, Chan CW, Tontiwachwuthikul P (2007) Artificial intelligence for monitoring and supervisory control of process systems. Eng Appl Artif Intel 20:115–131CrossRef
20.
go back to reference MacGregor JF, Kourti T (1995) Statistical process control of multivariate processes. Control Eng Pract 3:403–414CrossRef MacGregor JF, Kourti T (1995) Statistical process control of multivariate processes. Control Eng Pract 3:403–414CrossRef
21.
go back to reference Zhang J, Martin EB, Morris AJ (1997) Process monitoring using non-linear statistical techniques. Chem Eng J 67:181–189CrossRef Zhang J, Martin EB, Morris AJ (1997) Process monitoring using non-linear statistical techniques. Chem Eng J 67:181–189CrossRef
22.
go back to reference Patton RJ, Uppal FJ, Lopez-Toribio CJ (2000) Soft computing approaches to fault diagnosis for dynamic systems: a survey. In: IFAC symposium SAFEPROCESS 2000, pp 298–311 Patton RJ, Uppal FJ, Lopez-Toribio CJ (2000) Soft computing approaches to fault diagnosis for dynamic systems: a survey. In: IFAC symposium SAFEPROCESS 2000, pp 298–311
23.
go back to reference Jiang J, Wang J, Chu X, Yu R (1996) Neural network learning to non-linear principal component analysis. Anal Chim Acta 336:209–222CrossRef Jiang J, Wang J, Chu X, Yu R (1996) Neural network learning to non-linear principal component analysis. Anal Chim Acta 336:209–222CrossRef
24.
go back to reference Milde S, Kobe A (1997) An exact learning algorithm for autoassociative neural networks with binary couplings. J Phys A Math Gen 30:2349–2352MATHCrossRef Milde S, Kobe A (1997) An exact learning algorithm for autoassociative neural networks with binary couplings. J Phys A Math Gen 30:2349–2352MATHCrossRef
25.
go back to reference Hidden HG, Willis MJ, Tham MT, Turner P, Montague GA (1997) Non-linear principal components analysis using genetic programming. Genetic algorithms in engineering systems: innovations and applications, Glasgow, UK, pp 302–307 Hidden HG, Willis MJ, Tham MT, Turner P, Montague GA (1997) Non-linear principal components analysis using genetic programming. Genetic algorithms in engineering systems: innovations and applications, Glasgow, UK, pp 302–307
26.
go back to reference Jia F, Martin EB, Morris AJ (1998) Non-linear principal components analysis for process fault detection. Comput Chem Eng 20:851–854CrossRef Jia F, Martin EB, Morris AJ (1998) Non-linear principal components analysis for process fault detection. Comput Chem Eng 20:851–854CrossRef
27.
go back to reference Hines JW, Uhrig RE, Wrest DJ (1998) Use of autoassociative neural networks for signal validation. J Intell Robot Syst 21:143–154CrossRef Hines JW, Uhrig RE, Wrest DJ (1998) Use of autoassociative neural networks for signal validation. J Intell Robot Syst 21:143–154CrossRef
28.
go back to reference Yang T, Wang S (2000) Fuzzy auto-associative neural networks for principal component extraction of noisy data. IEEE T Neural Netw 11:808–810CrossRef Yang T, Wang S (2000) Fuzzy auto-associative neural networks for principal component extraction of noisy data. IEEE T Neural Netw 11:808–810CrossRef
30.
go back to reference Malthouse EC (1998) Limitations of nonlinear PCA as performed with generic neural networks. IEEE T Neural Netw 9:165–173CrossRef Malthouse EC (1998) Limitations of nonlinear PCA as performed with generic neural networks. IEEE T Neural Netw 9:165–173CrossRef
31.
go back to reference Yegnanarayana B, Kishore SP (2002) AANN: an alternative to GMM for pattern recognition. Neural Netw 15:459–469CrossRef Yegnanarayana B, Kishore SP (2002) AANN: an alternative to GMM for pattern recognition. Neural Netw 15:459–469CrossRef
32.
go back to reference Yeh T, Huang M, Huang C (2003) Estimate of process compositions and plantwide control from multiple secondary measurements using artificial neural networks. Comput Chem Eng 27:55–72CrossRef Yeh T, Huang M, Huang C (2003) Estimate of process compositions and plantwide control from multiple secondary measurements using artificial neural networks. Comput Chem Eng 27:55–72CrossRef
33.
go back to reference Scholz M, Kaplan F, Guy CG, Kopka J, Selbig J (2005) Non-linear PCA: a missing data approach. Bioinformatics 21:3887–3895CrossRef Scholz M, Kaplan F, Guy CG, Kopka J, Selbig J (2005) Non-linear PCA: a missing data approach. Bioinformatics 21:3887–3895CrossRef
35.
go back to reference Taguchi G, Chowdhury S, Wu Y (2004) Taguchi’s quality engineering handbook. Wiley and Sons, New JerseyCrossRef Taguchi G, Chowdhury S, Wu Y (2004) Taguchi’s quality engineering handbook. Wiley and Sons, New JerseyCrossRef
36.
go back to reference Taguchi G, Jugulum R (2002) The Mahalanobis–Taguchi strategy. Wiley and Sons, New YorkCrossRef Taguchi G, Jugulum R (2002) The Mahalanobis–Taguchi strategy. Wiley and Sons, New YorkCrossRef
37.
go back to reference Di Mascio R, Barton GW (2001) The economic assessment of process control quality using a Taguchi-based method. J Process Control 11:81–88CrossRef Di Mascio R, Barton GW (2001) The economic assessment of process control quality using a Taguchi-based method. J Process Control 11:81–88CrossRef
38.
go back to reference Vlachogiannis JG, Roy RK (2005) Robust PID controllers by Taguchi’s method. TQM Mag 17:456–466CrossRef Vlachogiannis JG, Roy RK (2005) Robust PID controllers by Taguchi’s method. TQM Mag 17:456–466CrossRef
39.
go back to reference Kim Y, Yum B (2004) Robust design of multilayer feedforward neural networks: an experimental approach. Eng Appl Artif Intel 17:249–263CrossRef Kim Y, Yum B (2004) Robust design of multilayer feedforward neural networks: an experimental approach. Eng Appl Artif Intel 17:249–263CrossRef
40.
go back to reference Sukthomya W, Tannock J (2005) The optimisation of neural network parameters using Taguchi’s design of experiments approach: an application in manufacturing process modeling. Neural Comput Appl 14:337–344CrossRef Sukthomya W, Tannock J (2005) The optimisation of neural network parameters using Taguchi’s design of experiments approach: an application in manufacturing process modeling. Neural Comput Appl 14:337–344CrossRef
Metadata
Title
Design of an auto-associative neural network by using design of experiments approach
Authors
Božidar Bratina
Nenad Muškinja
Boris Tovornik
Publication date
01-03-2010
Publisher
Springer-Verlag
Published in
Neural Computing and Applications / Issue 2/2010
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-009-0287-6

Other articles of this Issue 2/2010

Neural Computing and Applications 2/2010 Go to the issue

Premium Partner