Skip to main content
Erschienen in: Neural Processing Letters 2/2021

03.02.2021

Multi-objective Optimization Based Recursive Feature Elimination for Process Monitoring

verfasst von: Shivendra Singh, Anubha Agrawal, Hariprasad Kodamana, Manojkumar Ramteke

Erschienen in: Neural Processing Letters | Ausgabe 2/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Process monitoring helps to estimate the quality of the end products, equipment health parameters, and operational reliability of chemical processes. This is an area in which data-driven approaches are widely used by academic and industrial practitioners. With the ever-increasing complexities in process industries, there is an increased thrust in developing the process monitoring methods of generic nature which are capable of handling the inherent nonlinear characteristics of the chemical process. This demanded the employment of complex data-driven model paradigms in the process monitoring framework. To circumvent the issues related to high-dimensional process data, a large body of these process monitoring algorithms extract only relevant features during the training. Further, model complexity is another important issue that needs to be accounted while employing these methods. In this work, an optimization-based features selection method for process monitoring is proposed, that simultaneously trades-off between the optimal feature selection and the resulting model complexity, by means of solving a multi-objective optimization problem. Particularly, this paper focuses on combining neural network architecture with recursive feature elimination and genetic algorithm to obtain an improved identification accuracy while reducing the number of variables to be measured continuously in the process plant. The efficacy of the proposed approach was validated using a basic numerical case and tested upon the operational data collected from the benchmark Tennessee Eastman plant data, and steel plates manufacturing case studies.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Qin SJ (2003) Statistical process monitoring: basics and beyond. J Chem J Chemomet Soc 17(8–9):480–502 Qin SJ (2003) Statistical process monitoring: basics and beyond. J Chem J Chemomet Soc 17(8–9):480–502
2.
Zurück zum Zitat Qin SJ (2012) Survey on data-driven industrial process monitoring and diagnosis. Ann Rev Control 36(2):220–234CrossRef Qin SJ (2012) Survey on data-driven industrial process monitoring and diagnosis. Ann Rev Control 36(2):220–234CrossRef
3.
Zurück zum Zitat Russell EL, Chiang LH, Braatz RD (2012) Data-driven methods for fault detection and diagnosis in chemical processes. Springer, Berlin Russell EL, Chiang LH, Braatz RD (2012) Data-driven methods for fault detection and diagnosis in chemical processes. Springer, Berlin
4.
5.
Zurück zum Zitat Chiang LH, Kotanchek ME, Kordon AK (2004) Fault diagnosis based on fisher discriminant analysis and support vector machines. Comput Chem Eng 28(8):1389–1401CrossRef Chiang LH, Kotanchek ME, Kordon AK (2004) Fault diagnosis based on fisher discriminant analysis and support vector machines. Comput Chem Eng 28(8):1389–1401CrossRef
6.
Zurück zum Zitat Wise BM, Gallagher NB (1996) The process chemometrics approach to process monitoring and fault detection. J Process Control 6(6):329–348CrossRef Wise BM, Gallagher NB (1996) The process chemometrics approach to process monitoring and fault detection. J Process Control 6(6):329–348CrossRef
7.
Zurück zum Zitat Kodamana H, Raveendran R, Huang B (2017) Mixtures of probabilistic PCA with common structure latent bases for process monitoring. IEEE Trans Control Syst Technol 27(2):838–846CrossRef Kodamana H, Raveendran R, Huang B (2017) Mixtures of probabilistic PCA with common structure latent bases for process monitoring. IEEE Trans Control Syst Technol 27(2):838–846CrossRef
8.
Zurück zum Zitat Raveendran R, Kodamana H, Huang B (2018) Process monitoring using a generalized probabilistic linear latent variable model. Automatica 96:73–83MathSciNetMATHCrossRef Raveendran R, Kodamana H, Huang B (2018) Process monitoring using a generalized probabilistic linear latent variable model. Automatica 96:73–83MathSciNetMATHCrossRef
9.
Zurück zum Zitat Ghosh K, Ramteke M, Srinivasan R (2014) Optimal variable selection for effective statistical process monitoring. Comput Chem Eng 60:260–276CrossRef Ghosh K, Ramteke M, Srinivasan R (2014) Optimal variable selection for effective statistical process monitoring. Comput Chem Eng 60:260–276CrossRef
10.
Zurück zum Zitat Ge Z, Yang C, Song Z (2009) Improved kernel PCA-based monitoring approach for nonlinear processes. Chem Eng Sci 64(9):2245–2255CrossRef Ge Z, Yang C, Song Z (2009) Improved kernel PCA-based monitoring approach for nonlinear processes. Chem Eng Sci 64(9):2245–2255CrossRef
11.
Zurück zum Zitat Choi SW, Lee C, Lee JM, Park JH, Lee IB (2005) Fault detection and identification of nonlinear processes based on kernel PCA. Chemometr Intell Lab Syst 75(1):55–67CrossRef Choi SW, Lee C, Lee JM, Park JH, Lee IB (2005) Fault detection and identification of nonlinear processes based on kernel PCA. Chemometr Intell Lab Syst 75(1):55–67CrossRef
12.
Zurück zum Zitat Jack L, Nandi A (2002) Fault detection using support vector machines and artificial neural networks, augmented by genetic algorithms. Mech Syst Signal Process 16(2–3):373–390 CrossRef Jack L, Nandi A (2002) Fault detection using support vector machines and artificial neural networks, augmented by genetic algorithms. Mech Syst Signal Process 16(2–3):373–390 CrossRef
13.
Zurück zum Zitat Nashalji MN, Shoorehdeli MA, Teshnehlab M (2010) Fault detection of the Tennessee Eastman process using improved PCA and neural classifier. In: Soft computing in industrial applications. Springer, Berlin, pp 41–50 Nashalji MN, Shoorehdeli MA, Teshnehlab M (2010) Fault detection of the Tennessee Eastman process using improved PCA and neural classifier. In: Soft computing in industrial applications. Springer, Berlin, pp 41–50
14.
Zurück zum Zitat Zaman B, Riaz M, Ahmad S, Abbasi SA (2015) On artificial neural networking-based process monitoring under bootstrapping using runs rules schemes. Int J Adv Manuf Technol 76(1–4):311–327CrossRef Zaman B, Riaz M, Ahmad S, Abbasi SA (2015) On artificial neural networking-based process monitoring under bootstrapping using runs rules schemes. Int J Adv Manuf Technol 76(1–4):311–327CrossRef
15.
Zurück zum Zitat Wu D, Gu Y, Luo D, Yang Q (2020) Fault diagnosis of TE process based on incremental learning. In: Fu J, Sun J (eds) 2020 39th Chinese control conference (CCC). IEEE, New York, pp 4227–4232 Wu D, Gu Y, Luo D, Yang Q (2020) Fault diagnosis of TE process based on incremental learning. In: Fu J, Sun J (eds) 2020 39th Chinese control conference (CCC). IEEE, New York, pp 4227–4232
16.
Zurück zum Zitat Han Y, Ding N, Geng Z, Wang Z, Chu C (2020) An optimized long short-term memory network based fault diagnosis model for chemical processes. J Process Control 92:161–168CrossRef Han Y, Ding N, Geng Z, Wang Z, Chu C (2020) An optimized long short-term memory network based fault diagnosis model for chemical processes. J Process Control 92:161–168CrossRef
17.
Zurück zum Zitat Wang Y, Pan Z, Yuan X, Yang C, Gui W (2020) A novel deep learning based fault diagnosis approach for chemical process with extended deep belief network. ISA Trans 96:457–467CrossRef Wang Y, Pan Z, Yuan X, Yang C, Gui W (2020) A novel deep learning based fault diagnosis approach for chemical process with extended deep belief network. ISA Trans 96:457–467CrossRef
18.
Zurück zum Zitat Chandrashekar G, Sahin F (2014) A survey on feature selection methods. Comput Electr Eng 40(1):16–28CrossRef Chandrashekar G, Sahin F (2014) A survey on feature selection methods. Comput Electr Eng 40(1):16–28CrossRef
19.
Zurück zum Zitat Kira K, Rendell LA (1992) A practical approach to feature selection. In: Edwards P, Sleeman D (eds) Machine learning proceedings. Elsevier, London, pp 249–256 Kira K, Rendell LA (1992) A practical approach to feature selection. In: Edwards P, Sleeman D (eds) Machine learning proceedings. Elsevier, London, pp 249–256
20.
Zurück zum Zitat Deb K (2001) Multi-objective optimization using evolutionary algorithms, vol 16. Wiley, LondonMATH Deb K (2001) Multi-objective optimization using evolutionary algorithms, vol 16. Wiley, LondonMATH
21.
Zurück zum Zitat Guyon I, Weston J, Barnhill S, Vapnik V (2002) Gene selection for cancer classification using support vector machines. Mach Learn 46(1–3):389–422MATHCrossRef Guyon I, Weston J, Barnhill S, Vapnik V (2002) Gene selection for cancer classification using support vector machines. Mach Learn 46(1–3):389–422MATHCrossRef
22.
Zurück zum Zitat Tibshirani R (1996) Regression shrinkage and selection via the lasso. J R Stat Soc Ser B (Methodol) 58(1):267–288MathSciNetMATH Tibshirani R (1996) Regression shrinkage and selection via the lasso. J R Stat Soc Ser B (Methodol) 58(1):267–288MathSciNetMATH
23.
Zurück zum Zitat Granitto PM, Furlanello C, Biasioli F, Gasperi F (2006) Recursive feature elimination with random forest for PTR-MS analysis of agroindustrial products. Chemometr Intell Lab Syst 83(2):83–90CrossRef Granitto PM, Furlanello C, Biasioli F, Gasperi F (2006) Recursive feature elimination with random forest for PTR-MS analysis of agroindustrial products. Chemometr Intell Lab Syst 83(2):83–90CrossRef
24.
Zurück zum Zitat Chen Q, Meng Z, Liu X, Jin Q, Su R (2018) Decision variants for the automatic determination of optimal feature subset in RF-RFE. Genes 9(6):301CrossRef Chen Q, Meng Z, Liu X, Jin Q, Su R (2018) Decision variants for the automatic determination of optimal feature subset in RF-RFE. Genes 9(6):301CrossRef
25.
Zurück zum Zitat Sun L, Yin T, Ding W, Qian Y, Xu J (2020) Multilabel feature selection using ml-Relieff and neighborhood mutual information for multilabel neighborhood decision systems. Inf Sci 537:401–424MathSciNetCrossRef Sun L, Yin T, Ding W, Qian Y, Xu J (2020) Multilabel feature selection using ml-Relieff and neighborhood mutual information for multilabel neighborhood decision systems. Inf Sci 537:401–424MathSciNetCrossRef
26.
Zurück zum Zitat Bocca FF, Rodrigues LHA (2016) The effect of tuning, feature engineering, and feature selection in data mining applied to rainfed sugarcane yield modelling. Comput Electron Agric 128:67–76CrossRef Bocca FF, Rodrigues LHA (2016) The effect of tuning, feature engineering, and feature selection in data mining applied to rainfed sugarcane yield modelling. Comput Electron Agric 128:67–76CrossRef
27.
Zurück zum Zitat Zhang X, Zhang Q, Chen M, Sun Y, Qin X, Li H (2018) A two-stage feature selection and intelligent fault diagnosis method for rotating machinery using hybrid filter and wrapper method. Neurocomputing 275:2426–2439CrossRef Zhang X, Zhang Q, Chen M, Sun Y, Qin X, Li H (2018) A two-stage feature selection and intelligent fault diagnosis method for rotating machinery using hybrid filter and wrapper method. Neurocomputing 275:2426–2439CrossRef
28.
Zurück zum Zitat Liu P, Li B, Han C, Wang F (2016) Feature extraction and selection scheme for intelligent engine fault diagnosis based on 2DNMF, mutual information, and NSGA-II. Shock Vib 2016:13 Liu P, Li B, Han C, Wang F (2016) Feature extraction and selection scheme for intelligent engine fault diagnosis based on 2DNMF, mutual information, and NSGA-II. Shock Vib 2016:13
29.
Zurück zum Zitat Stief A, Ottewill JR, Baranowski J (2019) Investigation of the diagnostic properties of sensors and features in a multiphase flow facility case study. In: 12th IFAC symposium on dynamics and control of process systems Stief A, Ottewill JR, Baranowski J (2019) Investigation of the diagnostic properties of sensors and features in a multiphase flow facility case study. In: 12th IFAC symposium on dynamics and control of process systems
30.
Zurück zum Zitat Reddy TR, Vardhan BV, GopiChand M, Karunakar K (2018) Gender prediction in author profiling using Relieff feature selection algorithm. In: Bhateja V, Coello Coello CA, Satapathy SC, Pattnaik PK (eds) Intelligent engineering informatics. Springer, New York, pp 169–176 Reddy TR, Vardhan BV, GopiChand M, Karunakar K (2018) Gender prediction in author profiling using Relieff feature selection algorithm. In: Bhateja V, Coello Coello CA, Satapathy SC, Pattnaik PK (eds) Intelligent engineering informatics. Springer, New York, pp 169–176
31.
Zurück zum Zitat Coelho F, Costa M, Verleysen M, Braga AP (2020) Lasso multi-objective learning algorithm for feature selection. Soft Comput 2020:1–9 Coelho F, Costa M, Verleysen M, Braga AP (2020) Lasso multi-objective learning algorithm for feature selection. Soft Comput 2020:1–9
32.
Zurück zum Zitat Arabasadi Z, Alizadehsani R, Roshanzamir M, Moosaei H, Yarifard AA (2017) Computer aided decision making for heart disease detection using hybrid neural network-genetic algorithm. Comput Methods Programs Biomed 141:19–26CrossRef Arabasadi Z, Alizadehsani R, Roshanzamir M, Moosaei H, Yarifard AA (2017) Computer aided decision making for heart disease detection using hybrid neural network-genetic algorithm. Comput Methods Programs Biomed 141:19–26CrossRef
33.
Zurück zum Zitat Xue Y, Zhang L, Wang B, Zhang Z, Li F (2018) Nonlinear feature selection using gaussian kernel SVM-RFE for fault diagnosis. Appl Intell 48(10):3306–3331CrossRef Xue Y, Zhang L, Wang B, Zhang Z, Li F (2018) Nonlinear feature selection using gaussian kernel SVM-RFE for fault diagnosis. Appl Intell 48(10):3306–3331CrossRef
34.
Zurück zum Zitat Onel M, Kieslich CA, Pistikopoulos EN (2019) A nonlinear support vector machine-based feature selection approach for fault detection and diagnosis: application to the tennessee eastman process. AIChE J 65(3):992–1005CrossRef Onel M, Kieslich CA, Pistikopoulos EN (2019) A nonlinear support vector machine-based feature selection approach for fault detection and diagnosis: application to the tennessee eastman process. AIChE J 65(3):992–1005CrossRef
35.
Zurück zum Zitat Rad MAA, Yazdanpanah MJ (2015) Designing supervised local neural network classifiers based on EM clustering for fault diagnosis of Tennessee Eastman process. Chemometr Intell Lab Syst 146:149–157CrossRef Rad MAA, Yazdanpanah MJ (2015) Designing supervised local neural network classifiers based on EM clustering for fault diagnosis of Tennessee Eastman process. Chemometr Intell Lab Syst 146:149–157CrossRef
36.
Zurück zum Zitat Vahed SH, Mokhtare M, Nozari HA, Shoorehdeli MA, Simani S (2010) Fault detection and isolation of Tennessee Eastman process using improved RBF network by genetic algorithm. In: Simani S (ed) Proceedings of the 8th European workshop on advanced control and diagnosis—ACD2010, no. FrA3, vol 6, pp 362–367 Vahed SH, Mokhtare M, Nozari HA, Shoorehdeli MA, Simani S (2010) Fault detection and isolation of Tennessee Eastman process using improved RBF network by genetic algorithm. In: Simani S (ed) Proceedings of the 8th European workshop on advanced control and diagnosis—ACD2010, no. FrA3, vol 6, pp 362–367
37.
Zurück zum Zitat Burges CJ (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2(2):121–167CrossRef Burges CJ (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2(2):121–167CrossRef
39.
Zurück zum Zitat Yang SL, Weng W, Rong G, Feng YP (2017) Multiple kernel learning based feature selection for process monitoring. In: 2017 IEEE/ACIS 16th international conference on computer and information science (ICIS). IEEE, New York, pp 809–814 Yang SL, Weng W, Rong G, Feng YP (2017) Multiple kernel learning based feature selection for process monitoring. In: 2017 IEEE/ACIS 16th international conference on computer and information science (ICIS). IEEE, New York, pp 809–814
40.
Zurück zum Zitat Goodfellow I, Bengio Y, Courville A, Bengio Y (2016) Deep learning, vol 1. MIT Press, CambridgeMATH Goodfellow I, Bengio Y, Courville A, Bengio Y (2016) Deep learning, vol 1. MIT Press, CambridgeMATH
42.
Zurück zum Zitat Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182–197CrossRef Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182–197CrossRef
43.
Zurück zum Zitat Ricker N, Lee J (1995) Nonlinear modeling and state estimation for the Tennessee Eastman challenge process. Comput Chem Eng 19(9):983–1005CrossRef Ricker N, Lee J (1995) Nonlinear modeling and state estimation for the Tennessee Eastman challenge process. Comput Chem Eng 19(9):983–1005CrossRef
44.
Zurück zum Zitat Downs JJ, Vogel EF (1993) A plant-wide industrial process control problem. Comput Chem Eng 17(3):245–255CrossRef Downs JJ, Vogel EF (1993) A plant-wide industrial process control problem. Comput Chem Eng 17(3):245–255CrossRef
45.
Zurück zum Zitat Bathelt A, Ricker NL, Jelali M (2015) Revision of the Tennessee Eastman process model. IFAC Pap Online 48(8):309–314CrossRef Bathelt A, Ricker NL, Jelali M (2015) Revision of the Tennessee Eastman process model. IFAC Pap Online 48(8):309–314CrossRef
46.
Zurück zum Zitat Yadav A, Ramteke M, Pant HJ, Roy S (2017) Monte Carlo real coded genetic algorithm (MC-RGA) for radioactive particle tracking (RPT) experimentation. AIChE J 63(7):2850–2863CrossRef Yadav A, Ramteke M, Pant HJ, Roy S (2017) Monte Carlo real coded genetic algorithm (MC-RGA) for radioactive particle tracking (RPT) experimentation. AIChE J 63(7):2850–2863CrossRef
47.
Zurück zum Zitat Buscema M, Tastle W (2010) (2010) A new meta-classifier. In: Fuzzy Information Processing Society (NAFIPS). Annual meeting of the North American. IEEE, New York, pp 1–7 Buscema M, Tastle W (2010) (2010) A new meta-classifier. In: Fuzzy Information Processing Society (NAFIPS). Annual meeting of the North American. IEEE, New York, pp 1–7
48.
Zurück zum Zitat Fakhr M, Elsayad AM (2012) Steel plates faults diagnosis with data mining models. J Comput Sci 8(4):506CrossRef Fakhr M, Elsayad AM (2012) Steel plates faults diagnosis with data mining models. J Comput Sci 8(4):506CrossRef
49.
Zurück zum Zitat Nguyen D, Bagajewicz M (2010) Optimization of preventive maintenance in chemical process plants. Ind Eng Chem Res 49(9):4329–4339CrossRef Nguyen D, Bagajewicz M (2010) Optimization of preventive maintenance in chemical process plants. Ind Eng Chem Res 49(9):4329–4339CrossRef
Metadaten
Titel
Multi-objective Optimization Based Recursive Feature Elimination for Process Monitoring
verfasst von
Shivendra Singh
Anubha Agrawal
Hariprasad Kodamana
Manojkumar Ramteke
Publikationsdatum
03.02.2021
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 2/2021
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-021-10430-z

Weitere Artikel der Ausgabe 2/2021

Neural Processing Letters 2/2021 Zur Ausgabe

Neuer Inhalt