Skip to main content
Top
Published in: Neural Computing and Applications 5/2023

19-10-2022 | Original Article

Anomaly detection for process monitoring based on machine learning technique

Authors: Imen Hamrouni, Hajer Lahdhiri, Khaoula Ben Abdellafou, Ahamed Aljuhani, Okba Taouali

Published in: Neural Computing and Applications | Issue 5/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Anomaly detection is critical to process modeling, monitoring, and control since successful execution of these engineering tasks depends on access to validated data. The industrial process is uncertain in several situations, and the available information is formalized in terms of intervals. This article deals with the diagnostic of uncertain systems by multivariate static analysis. Linear Principal Component Analysis (PCA) and nonlinear Kernel PCA (KPCA) are generally used to deal with certain systems; they exploit single-valued variables. While in real situations these data are marred by uncertainties, these uncertainties cause difficulties in making decision in relation to the presence of defects. Thus, we have studied a recent and robust solution which consists in capturing the variability of multivariate observations by interval variables. In the first part, we treated a fault detection strategy based on interval PCA in the case of static linear systems. It includes first of all a comparative study between the deferent methods of detection of faults with interval PCA in which we proposed a new detection statistics of faults. In the second part, we studied a fault detection strategy based on interval KPCA method; we propose a reduction approach to solve the problem of nonlinearity and uncertainty and the problem of large data. The proposed fault detection methods are illustrated by synthetic data with an in-depth study and comparison using simulations of the air quality monitoring network and the Tennessee Eastman process.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Bounoua W, et al (2019) Online monitoring scheme. Using principal component analysis through Kullback-Leibler. Divergence analysis. Technique for fault detection. Trans Inst Meas Control 57–101. Bounoua W, et al (2019) Online monitoring scheme. Using principal component analysis through Kullback-Leibler. Divergence analysis. Technique for fault detection. Trans Inst Meas Control 57–101.
2.
go back to reference Russell EL, Chiang LH, Braatz RD (2012) Data-driven methods for fault detection and diagnosis in chemical processes. Springer, New York Russell EL, Chiang LH, Braatz RD (2012) Data-driven methods for fault detection and diagnosis in chemical processes. Springer, New York
3.
go back to reference Pearson K (1901) On lines and planes of closest fit to systems of points in space. Lond Edinb Dublin Phylosophical Mag J Sci 6:559–572MATH Pearson K (1901) On lines and planes of closest fit to systems of points in space. Lond Edinb Dublin Phylosophical Mag J Sci 6:559–572MATH
4.
go back to reference Hotelling H (1947) Techniques of statis-tical analysis- multivariate quality control-illustrated by air testing of sample bombsights. Mcgraw-Hill, New York, pp 11–148 Hotelling H (1947) Techniques of statis-tical analysis- multivariate quality control-illustrated by air testing of sample bombsights. Mcgraw-Hill, New York, pp 11–148
5.
go back to reference Jolliffe IT (2002) Principal component analysis. Springer series in statistics. Springer, New York Jolliffe IT (2002) Principal component analysis. Springer series in statistics. Springer, New York
6.
go back to reference Jackson JE (1991) A users guide to principal components and sons. Wiley, New JerseyCrossRef Jackson JE (1991) A users guide to principal components and sons. Wiley, New JerseyCrossRef
7.
go back to reference Rao CR (1964) The use and interpretation of principal component analysis in applied research. Sankhyā Indian J Stat 26:329–358MATH Rao CR (1964) The use and interpretation of principal component analysis in applied research. Sankhyā Indian J Stat 26:329–358MATH
8.
go back to reference Harkat MF, Mourot G, Ragot J (2006) An improved pca scheme for sensor fdi: Application to an air quality monitoring network. J Process Control 16:625–634CrossRef Harkat MF, Mourot G, Ragot J (2006) An improved pca scheme for sensor fdi: Application to an air quality monitoring network. J Process Control 16:625–634CrossRef
9.
go back to reference Ku W, Storer R, Storer H, Georgakis C (1995) Disturbance detection and isolation by dynamic principal component analysis. Chemom Intell Lab 30:179CrossRef Ku W, Storer R, Storer H, Georgakis C (1995) Disturbance detection and isolation by dynamic principal component analysis. Chemom Intell Lab 30:179CrossRef
10.
go back to reference Qin SJ (2003) Statistical process monitoring: basics and beyond. J Chemom 17:480–502CrossRef Qin SJ (2003) Statistical process monitoring: basics and beyond. J Chemom 17:480–502CrossRef
11.
go back to reference Tulsyan A, Barton PI (2017) Interval enclosures for reachable sets of chemical kinetic flow systems. Part 1: Sparse transformation. Chem Eng Sci 166:334–344CrossRef Tulsyan A, Barton PI (2017) Interval enclosures for reachable sets of chemical kinetic flow systems. Part 1: Sparse transformation. Chem Eng Sci 166:334–344CrossRef
12.
go back to reference D’Urso P, Giordani P (2004) A least squares approach to principal component analysis for interval valued data. Chemometr Itell Lab Syst 70(179):192 D’Urso P, Giordani P (2004) A least squares approach to principal component analysis for interval valued data. Chemometr Itell Lab Syst 70(179):192
13.
go back to reference Gioia P, Lauro C (2006) Principal component analysis on interval data. Comput Satat 21:343–363CrossRefMATH Gioia P, Lauro C (2006) Principal component analysis on interval data. Comput Satat 21:343–363CrossRefMATH
14.
go back to reference Irpino A (2006) “Spaghetti” PCA analysis: an extension of principal components analysis to time dependent interval data. Pattern Recognit Lett. 27:504–513CrossRef Irpino A (2006) “Spaghetti” PCA analysis: an extension of principal components analysis to time dependent interval data. Pattern Recognit Lett. 27:504–513CrossRef
15.
go back to reference Cazes P et al (1997) Extension de l’analyse en composantes principales à des données de type intervalle. Stat Appl 45(3):5–24 Cazes P et al (1997) Extension de l’analyse en composantes principales à des données de type intervalle. Stat Appl 45(3):5–24
16.
go back to reference Chouakria A (1998) Extension des méthodes d'analyse factorielle à des données de type intervalle. Ph.D. dissertation, Université Paris-Dauphine, vol 6. pp 414,415,424,425 Chouakria A (1998) Extension des méthodes d'analyse factorielle à des données de type intervalle. Ph.D. dissertation, Université Paris-Dauphine, vol 6. pp 414,415,424,425
17.
go back to reference Lauro CN, Palumbo F (2000) Principal component analysis of interval data: a symbolic data analysis approach. Comput Stat 15(1):73–78CrossRefMATH Lauro CN, Palumbo F (2000) Principal component analysis of interval data: a symbolic data analysis approach. Comput Stat 15(1):73–78CrossRefMATH
18.
go back to reference Le-Rademacher J, Billard L (2012) Symbolic covariance principal component analysis and visualization for interval-valued data. J Comput Graph Stat 21(2):413–432CrossRef Le-Rademacher J, Billard L (2012) Symbolic covariance principal component analysis and visualization for interval-valued data. J Comput Graph Stat 21(2):413–432CrossRef
19.
go back to reference Ait-Izem T, et al (2017a) Approche neuronale d’ACP par intervalle appliquèe au diagnosti. In: (Quali 12 ème coninternational pluridisciplinaire en qualité, sûreté de fonctionnement et développement durable, Bourges- France Ait-Izem T, et al (2017a) Approche neuronale d’ACP par intervalle appliquèe au diagnosti. In: (Quali 12 ème coninternational pluridisciplinaire en qualité, sûreté de fonctionnement et développement durable, Bourges- France
20.
go back to reference Ait-Izem T et al (2017) Sensor fault detection based on principal component analysis for interval-valued data. Qual Eng 11:1–13 Ait-Izem T et al (2017) Sensor fault detection based on principal component analysis for interval-valued data. Qual Eng 11:1–13
21.
go back to reference Plumbo F, Lauro NC (2003) A PCA for interval-valued data based on midpoints and radii. In New developments in psychometrics. Springer, Tokyo Plumbo F, Lauro NC (2003) A PCA for interval-valued data based on midpoints and radii. In New developments in psychometrics. Springer, Tokyo
22.
go back to reference Ait-Izem T et al (2018) On the application of interval pca to process monitoring: a robust strategy for sensor fdi with new efficient control statistics. J Process Control 13:29–46CrossRef Ait-Izem T et al (2018) On the application of interval pca to process monitoring: a robust strategy for sensor fdi with new efficient control statistics. J Process Control 13:29–46CrossRef
23.
go back to reference Jaffel I et al (2016) Moving window KPCA with reduced complexity for nonlinear dynamic process monitoring. ISA Trans 64:184–192CrossRef Jaffel I et al (2016) Moving window KPCA with reduced complexity for nonlinear dynamic process monitoring. ISA Trans 64:184–192CrossRef
24.
go back to reference Taouali O et al (2015) New fault detection method based In reduced kernel principal component analysis(RKPCA). Int J Adv Manuf Technol 15:1547–1552 Taouali O et al (2015) New fault detection method based In reduced kernel principal component analysis(RKPCA). Int J Adv Manuf Technol 15:1547–1552
25.
go back to reference Harakat MF (2003) Détection et localisation de défauts par analyse en composantes principales. Thèse de doctorat de l’Institut National Polytechnique de Lorraine Harakat MF (2003) Détection et localisation de défauts par analyse en composantes principales. Thèse de doctorat de l’Institut National Polytechnique de Lorraine
26.
go back to reference Harakat MF (2003) Détection et localisation de défauts par analyse en composantes principales. Thèse de doctorat l’Institut National Polytechnique de Lorraine Harakat MF (2003) Détection et localisation de défauts par analyse en composantes principales. Thèse de doctorat l’Institut National Polytechnique de Lorraine
27.
go back to reference Costa AQ, Pimentel B, Souza R (2010) K-means clustering for symbolic interval data based on aggregated kernel functions, tools with artificial intelligence (ICTAI). In: 22nd IEEE international conference IEEE. pp 375–379 Costa AQ, Pimentel B, Souza R (2010) K-means clustering for symbolic interval data based on aggregated kernel functions, tools with artificial intelligence (ICTAI). In: 22nd IEEE international conference IEEE. pp 375–379
28.
go back to reference Costa A, Pimentel B, Souza R (2013) Clustering interval data through kernel-induced feature space. J Intell Inf Syst 40:109–140CrossRef Costa A, Pimentel B, Souza R (2013) Clustering interval data through kernel-induced feature space. J Intell Inf Syst 40:109–140CrossRef
29.
go back to reference Pimentel B, Costa A, Souza R (2011) A partitioning method for symbolic interval data based on kernelized metric. In: Proceedings of the 20th ACM. International conference on Information and knowledg management, ACM. pp 2189–2191 Pimentel B, Costa A, Souza R (2011) A partitioning method for symbolic interval data based on kernelized metric. In: Proceedings of the 20th ACM. International conference on Information and knowledg management, ACM. pp 2189–2191
30.
go back to reference Hamrouni I et al (2020) Fault detection of uncertain nonlinear process using reduced interval kernel principal component analysis (RIKPCA). Int J Adv Manuf Technol Hamrouni I et al (2020) Fault detection of uncertain nonlinear process using reduced interval kernel principal component analysis (RIKPCA). Int J Adv Manuf Technol
31.
go back to reference Lahdhiri H et al (2017) Nonlinear process monitoring based on new reduced Rank-KPCA method. Stoch Environ Res Risk Assess 16:1833–1848 Lahdhiri H et al (2017) Nonlinear process monitoring based on new reduced Rank-KPCA method. Stoch Environ Res Risk Assess 16:1833–1848
32.
go back to reference Jaffel I, Taouali O, Harkat MF (2016) Fault detection and isolation in nonlinear. Systems with partial reduced kernel principal component analysis method. Trans Inst Meas Control 40:1289–1296CrossRef Jaffel I, Taouali O, Harkat MF (2016) Fault detection and isolation in nonlinear. Systems with partial reduced kernel principal component analysis method. Trans Inst Meas Control 40:1289–1296CrossRef
33.
go back to reference Chakour C, Benyounes A, Boudiaf M (2018) Diagnosis of uncertain nonlinear systems using interval kernel principal components analysis: application to a weather station. ISA Trans 83:126–141CrossRef Chakour C, Benyounes A, Boudiaf M (2018) Diagnosis of uncertain nonlinear systems using interval kernel principal components analysis: application to a weather station. ISA Trans 83:126–141CrossRef
34.
go back to reference Harkat MF et al (2019) Fault detection of uncertain nonlinear process using interval-valued data-driven approach. Chem Eng Sci 205:36–45CrossRef Harkat MF et al (2019) Fault detection of uncertain nonlinear process using interval-valued data-driven approach. Chem Eng Sci 205:36–45CrossRef
35.
go back to reference Mansouri M et al (2020) Data-driven and model-based methods for fault detection and diagnosis [Rapport]. Elsevier, New York Mansouri M et al (2020) Data-driven and model-based methods for fault detection and diagnosis [Rapport]. Elsevier, New York
36.
go back to reference Wang H, Guan R, Wu J (2012) CIPCA: complete-information-based principal component analysis for interval-valued data. Neurocomputing 86:158–169CrossRef Wang H, Guan R, Wu J (2012) CIPCA: complete-information-based principal component analysis for interval-valued data. Neurocomputing 86:158–169CrossRef
37.
go back to reference Ait Izem T, et al (2015) Vertices and centers principal component analysis for fault detection and isolation. In: 2nd International conference on automationcontrol, engineering and computer science, Sousse-Tunisia Ait Izem T, et al (2015) Vertices and centers principal component analysis for fault detection and isolation. In: 2nd International conference on automationcontrol, engineering and computer science, Sousse-Tunisia
38.
go back to reference Box G (1954) Some theorems on quadratic forms applied in the study of analysis of variance problems, I. Effect of inequality of variance in the one-way classification. Ann Math Stat 20:290–302CrossRefMATH Box G (1954) Some theorems on quadratic forms applied in the study of analysis of variance problems, I. Effect of inequality of variance in the one-way classification. Ann Math Stat 20:290–302CrossRefMATH
39.
go back to reference Carlos F, Alaca S, Joe Q (2010) Reconstruction-based contribution for monitoring with kernel principal component analysis. Trans Inst Meas Control 17:7849–7857 Carlos F, Alaca S, Joe Q (2010) Reconstruction-based contribution for monitoring with kernel principal component analysis. Trans Inst Meas Control 17:7849–7857
40.
go back to reference Yanjie L, et al (2020) The instrument fault dection and identification based on Kernel principal component analysis and coupling analysis in process industry. Trans Inst Meas Control Yanjie L, et al (2020) The instrument fault dection and identification based on Kernel principal component analysis and coupling analysis in process industry. Trans Inst Meas Control
41.
go back to reference Scholkopf B et al (1998) Kernel pca pattern reconstruction via approximate pre-image. ICANN 98:147–152CrossRef Scholkopf B et al (1998) Kernel pca pattern reconstruction via approximate pre-image. ICANN 98:147–152CrossRef
42.
go back to reference Aizerman M, Braverman E, Rozonoer L (1964) Theoretical foundations of the potential function method in pattern recognition learning. Autom Remote Control 98:821–837MATH Aizerman M, Braverman E, Rozonoer L (1964) Theoretical foundations of the potential function method in pattern recognition learning. Autom Remote Control 98:821–837MATH
43.
go back to reference Choi SW et al (2005) Fault detection and identification of nonlinear processes based on kernel PCA. Chemom Intell Lab Syst 75:55–67CrossRef Choi SW et al (2005) Fault detection and identification of nonlinear processes based on kernel PCA. Chemom Intell Lab Syst 75:55–67CrossRef
44.
go back to reference Harkat MF (2018) Fault detection of uncertain nonlinear process using interval-valued data-driven approach. Chem Eng Sci 14 Harkat MF (2018) Fault detection of uncertain nonlinear process using interval-valued data-driven approach. Chem Eng Sci 14
45.
go back to reference Nomikos P, MacGregor JF (1995) Multivariate SPC charts for monitoring batch processes. Technometrics 37:41–59CrossRefMATH Nomikos P, MacGregor JF (1995) Multivariate SPC charts for monitoring batch processes. Technometrics 37:41–59CrossRefMATH
46.
go back to reference Alcala CF, Qin SJ (2010) Reconstruction based conntribution for process monitoring with kernel principal component analysis. Ind Eng Chem Res 19:7849–7857CrossRef Alcala CF, Qin SJ (2010) Reconstruction based conntribution for process monitoring with kernel principal component analysis. Ind Eng Chem Res 19:7849–7857CrossRef
47.
go back to reference Cui P, Li J, Wang G (2008) Improved kernel principal component analysis for fault detection. Expert Syst Appl 23:1210–1219CrossRef Cui P, Li J, Wang G (2008) Improved kernel principal component analysis for fault detection. Expert Syst Appl 23:1210–1219CrossRef
Metadata
Title
Anomaly detection for process monitoring based on machine learning technique
Authors
Imen Hamrouni
Hajer Lahdhiri
Khaoula Ben Abdellafou
Ahamed Aljuhani
Okba Taouali
Publication date
19-10-2022
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 5/2023
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-022-07901-2

Other articles of this Issue 5/2023

Neural Computing and Applications 5/2023 Go to the issue

S.I. : Deep Geospatial Data Understanding

Influence maximization based on maximum inner product search

Premium Partner