Skip to main content
Top
Published in: Soft Computing 17/2020

29-01-2020 | Methodologies and Application

Adaptive parameter tuning stacked autoencoders for process monitoring

Authors: Diehao Kong, Xuefeng Yan

Published in: Soft Computing | Issue 17/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In process monitoring based on stacked autoencoders (SAEs), the performance of monitoring models is directly decided by the validity of the structure and parameters, which are primarily determined by time-consuming manual adjustments. This paper presents a novel method that can adaptively select parameters rather than tuning them manually. The proposed method is called adaptive parameter tuning SAE (APT-SAE). Basic SAEs aim to compress the original input data and extract simple and abstract features. Thus, the redundant information of each hidden layer output should be as small as possible. The next layer of nodes can be remarkably reduced if the amount of redundant information is large. During the pre-training stage of APT-SAE, an adaptive parameter tuning strategy is used for rapidly determining the number of layers and nodes in the paper. The cross-covariance of each AE’s input data is used to determine the node number of succeeding AE. The pre-training stage ends when the correlation is weak, which is decided by the average value of cross-variance matrix. The proposed method is applied to a benchmark problem, and it outperforms several state-of-the-art methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Al-Smadi M, Qawasmeh O, Al-Ayyoub M, Jararweh Y, Gupta B (2018) Deep recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels’ reviews. J Comput Sci Neth 27:386–393CrossRef Al-Smadi M, Qawasmeh O, Al-Ayyoub M, Jararweh Y, Gupta B (2018) Deep recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels’ reviews. J Comput Sci Neth 27:386–393CrossRef
go back to reference Chen J, Wu Z, Zhang J, Li F, Li W, Wu Z (2018) Cross-covariance regularized autoencoders for nonredundant sparse feature representation. Neurocomputing 316:49–58CrossRef Chen J, Wu Z, Zhang J, Li F, Li W, Wu Z (2018) Cross-covariance regularized autoencoders for nonredundant sparse feature representation. Neurocomputing 316:49–58CrossRef
go back to reference Clohessy T, Acton T, Morgan L (2017) The impact of cloud-based digital transformation on IT service providers: evidence from focus groups. Int J Cloud Appl Comput 7:1–19 Clohessy T, Acton T, Morgan L (2017) The impact of cloud-based digital transformation on IT service providers: evidence from focus groups. Int J Cloud Appl Comput 7:1–19
go back to reference Deng X, Tian X, Chen S (2013) Modified kernel principal component analysis based on local structure analysis and its application to nonlinear process fault diagnosis. Chemom Intell Lab Syst 127:195–209CrossRef Deng X, Tian X, Chen S (2013) Modified kernel principal component analysis based on local structure analysis and its application to nonlinear process fault diagnosis. Chemom Intell Lab Syst 127:195–209CrossRef
go back to reference Downs JJ, Vogel EF (1993) A plant-wide industrial process control problem. Comput Chem Eng 17:245–255CrossRef Downs JJ, Vogel EF (1993) A plant-wide industrial process control problem. Comput Chem Eng 17:245–255CrossRef
go back to reference Gupta BB, Sheng Q (2018) Machine learning for computer and cyber security: principle, algorithms, and practices. CRC Press, Taylor & Francis Gupta BB, Sheng Q (2018) Machine learning for computer and cyber security: principle, algorithms, and practices. CRC Press, Taylor & Francis
go back to reference Hien TD, Nakao Z, Chen Y-W (2006) Robust RDWT-ICA based information hiding. Soft Comput 10:1135–1144CrossRef Hien TD, Nakao Z, Chen Y-W (2006) Robust RDWT-ICA based information hiding. Soft Comput 10:1135–1144CrossRef
go back to reference Jiang W, Yi Y, Mao J, Huang Z, Wei X (2016) CNN-RNN: a unified framework for multi-label image classification. In: IEEE conference on computer vision and pattern recognition, Las Vegas, pp 2285–2294 Jiang W, Yi Y, Mao J, Huang Z, Wei X (2016) CNN-RNN: a unified framework for multi-label image classification. In: IEEE conference on computer vision and pattern recognition, Las Vegas, pp 2285–2294
go back to reference Li Z, Yan X (2018) Ensemble learning model based on selected diverse principal component analysis models for process monitoring. J Chemom 32(6):e3010CrossRef Li Z, Yan X (2018) Ensemble learning model based on selected diverse principal component analysis models for process monitoring. J Chemom 32(6):e3010CrossRef
go back to reference Li HD, Xu QS, Liang YZ (2018) libPLS: an integrated library for partial least squares regression and linear discriminant analysis. Chemom Intell Lab Syst 176:34–43CrossRef Li HD, Xu QS, Liang YZ (2018) libPLS: an integrated library for partial least squares regression and linear discriminant analysis. Chemom Intell Lab Syst 176:34–43CrossRef
go back to reference Liu X-Z, Zhang C-G (2016) Fisher discriminant analysis based on kernel cuboid for face recognition. Soft Comput 20:831–840CrossRef Liu X-Z, Zhang C-G (2016) Fisher discriminant analysis based on kernel cuboid for face recognition. Soft Comput 20:831–840CrossRef
go back to reference Liu H, Zhou J, Zheng Y, Jiang W, Zhang Y (2018) Fault diagnosis of rolling bearings with recurrent neural network-based autoencoders. ISA Trans 77:167–178CrossRef Liu H, Zhou J, Zheng Y, Jiang W, Zhang Y (2018) Fault diagnosis of rolling bearings with recurrent neural network-based autoencoders. ISA Trans 77:167–178CrossRef
go back to reference Sankaran A, Vatsa M, Singh R, Majumdar A (2017) Group sparse autoencoder. Image Vis Comput 60:64–74CrossRef Sankaran A, Vatsa M, Singh R, Majumdar A (2017) Group sparse autoencoder. Image Vis Comput 60:64–74CrossRef
go back to reference Shao H, Jiang H, Zhao H, Wang F (2017) A novel deep autoencoder feature learning method for rotating machinery fault diagnosis. Mech Syst Signal Proc 95:187–204CrossRef Shao H, Jiang H, Zhao H, Wang F (2017) A novel deep autoencoder feature learning method for rotating machinery fault diagnosis. Mech Syst Signal Proc 95:187–204CrossRef
go back to reference Shen Y, Ding SX, Haghani A, Hao H, Zhang P (2012) A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process. J Process Control 22:1567–1581CrossRef Shen Y, Ding SX, Haghani A, Hao H, Zhang P (2012) A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process. J Process Control 22:1567–1581CrossRef
go back to reference Tang J, Yan X (2017) Neural network modeling relationship between inputs and state mapping plane obtained by FDA–t-SNE for visual industrial process monitoring. Appl Soft Comput 60:577–590CrossRef Tang J, Yan X (2017) Neural network modeling relationship between inputs and state mapping plane obtained by FDA–t-SNE for visual industrial process monitoring. Appl Soft Comput 60:577–590CrossRef
go back to reference Wan L, Zeiler M, Zhang S, Lecun Y, Fergus R (2013) Regularization of neural networks using DropConnect. J Mach Learn Res 28:1058–1066 Wan L, Zeiler M, Zhang S, Lecun Y, Fergus R (2013) Regularization of neural networks using DropConnect. J Mach Learn Res 28:1058–1066
go back to reference Xin G, Jian H (2016) An improved SVM integrated GS-PCA fault diagnosis approach of Tennessee Eastman process. Neurocomputing 174:906–911CrossRef Xin G, Jian H (2016) An improved SVM integrated GS-PCA fault diagnosis approach of Tennessee Eastman process. Neurocomputing 174:906–911CrossRef
go back to reference Xu L, Cao M, Song B, Zhang J, Liu Y, Alsaadi FE (2018) Open-circuit fault diagnosis of power rectifier using sparse autoencoder based deep neural network. Neurocomputing 311:1–10CrossRef Xu L, Cao M, Song B, Zhang J, Liu Y, Alsaadi FE (2018) Open-circuit fault diagnosis of power rectifier using sparse autoencoder based deep neural network. Neurocomputing 311:1–10CrossRef
go back to reference Yan S, Yan X (2019) Using labeled autoencoder to supervise neural network combined with k-nearest neighbor for visual industrial process monitoring. Ind Eng Chem Res 58:9952–9958CrossRef Yan S, Yan X (2019) Using labeled autoencoder to supervise neural network combined with k-nearest neighbor for visual industrial process monitoring. Ind Eng Chem Res 58:9952–9958CrossRef
go back to reference Yu J, Yan X (2018) Active features extracted by deep belief network for process monitoring. ISA Trans 84:247–261CrossRef Yu J, Yan X (2018) Active features extracted by deep belief network for process monitoring. ISA Trans 84:247–261CrossRef
go back to reference Yu J, Yan X (2019) Whole process monitoring based on unstable neuron output information in hidden layers of deep belief network. IEEE Trans Cybern 58:21614–21624 Yu J, Yan X (2019) Whole process monitoring based on unstable neuron output information in hidden layers of deep belief network. IEEE Trans Cybern 58:21614–21624
go back to reference Zhang Z, Jiang T, Li S, Yang Y (2018) Automated feature learning for nonlinear process monitoring—an approach using stacked denoising autoencoder and k-nearest neighbor rule. J Process Control 64:49–61CrossRef Zhang Z, Jiang T, Li S, Yang Y (2018) Automated feature learning for nonlinear process monitoring—an approach using stacked denoising autoencoder and k-nearest neighbor rule. J Process Control 64:49–61CrossRef
go back to reference Zhao H (2017) Neural component analysis for fault detection. Chemom Intell Lab Syst 176:11–21CrossRef Zhao H (2017) Neural component analysis for fault detection. Chemom Intell Lab Syst 176:11–21CrossRef
go back to reference Zhao H, Lai Z (2019) Neighborhood preserving neural network for fault detection. Neural Netw 109:6–18CrossRef Zhao H, Lai Z (2019) Neighborhood preserving neural network for fault detection. Neural Netw 109:6–18CrossRef
Metadata
Title
Adaptive parameter tuning stacked autoencoders for process monitoring
Authors
Diehao Kong
Xuefeng Yan
Publication date
29-01-2020
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 17/2020
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-020-04717-x

Other articles of this Issue 17/2020

Soft Computing 17/2020 Go to the issue

Premium Partner