Skip to main content
Erschienen in: Neural Processing Letters 3/2019

13.02.2019

Two-Stage Method for Diagonal Recurrent Neural Network Identification of a High-Power Continuous Microwave Heating System

verfasst von: Tong Liu, Shan Liang, Qingyu Xiong, Kai Wang

Erschienen in: Neural Processing Letters | Ausgabe 3/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a diagonal recurrent neural network (DRNN) based identification scheme to handle the complexity and nonlinearity of high-power continuous microwave heating system (HPCMHS). The new DRNN design involves a two-stage training process that couples an efficient forward model selection technique with gradient-based optimization. In the first stage, an impact recurrent network structure is obtained by a fast recursive algorithm in a stepwise forward procedure. To ensure stability, update rules are further developed using Lyapunov stability criterion to tune parameters of reduced size model at the second stage. The proposed approach is tested with an experimental regression problem and a practical HPCMHS identification, and the results are compared with four typical network models. The results show that the new design demonstrates improved accuracy and model compactness with reduced computational complexity over the existing methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Vongpradubchai S, Rattanadecho P (2009) The microwave processing of wood using a continuous microwave belt drier. Chem Eng Process Process Intensif 48(5):997–1003CrossRef Vongpradubchai S, Rattanadecho P (2009) The microwave processing of wood using a continuous microwave belt drier. Chem Eng Process Process Intensif 48(5):997–1003CrossRef
2.
Zurück zum Zitat Rattanadecho P, Suwannapum N, Chatveera B, Atong D, Makul N (2008) Development of compressive strength of cement paste under accelerated curing by using a continuous microwave thermal processor. Mater Sci Eng A 472(1):299–307CrossRef Rattanadecho P, Suwannapum N, Chatveera B, Atong D, Makul N (2008) Development of compressive strength of cement paste under accelerated curing by using a continuous microwave thermal processor. Mater Sci Eng A 472(1):299–307CrossRef
3.
Zurück zum Zitat Atong D, Ratanadecho P, Vongpradubchai S (2006) Drying of a slip casting for tableware product using microwave continuous belt dryer. Dry Technol 24(5):589–594CrossRef Atong D, Ratanadecho P, Vongpradubchai S (2006) Drying of a slip casting for tableware product using microwave continuous belt dryer. Dry Technol 24(5):589–594CrossRef
4.
Zurück zum Zitat Zhao D, Wang Y, Zhu Y, Ni Y (2016) Effect of carbonic maceration pre-treatment on drying behaviour and physicochemical compositions of sweet potato dried with intermittent or continuous microwave. Dry Technol 34(13):1604–1612CrossRef Zhao D, Wang Y, Zhu Y, Ni Y (2016) Effect of carbonic maceration pre-treatment on drying behaviour and physicochemical compositions of sweet potato dried with intermittent or continuous microwave. Dry Technol 34(13):1604–1612CrossRef
5.
Zurück zum Zitat Shi X, Li J, Xiong Q, Wu Y, Yuan Y (2016) Research of uniformity evaluation model based on entropy clustering in the microwave heating processes. Neurocomputing 173:562–572CrossRef Shi X, Li J, Xiong Q, Wu Y, Yuan Y (2016) Research of uniformity evaluation model based on entropy clustering in the microwave heating processes. Neurocomputing 173:562–572CrossRef
6.
Zurück zum Zitat Chen S, Billings SA (1991) Neural networks for nonlinear dynamic system modelling and identification. Int J Control 56(2):319–346MathSciNetMATHCrossRef Chen S, Billings SA (1991) Neural networks for nonlinear dynamic system modelling and identification. Int J Control 56(2):319–346MathSciNetMATHCrossRef
7.
Zurück zum Zitat Chen D, Zhang Y, Li S (2018) Tracking control of robot manipulators with unknown models: a Jacobian-matrix-adaption method. IEEE Trans Ind Inform 14(7):3044–3053CrossRef Chen D, Zhang Y, Li S (2018) Tracking control of robot manipulators with unknown models: a Jacobian-matrix-adaption method. IEEE Trans Ind Inform 14(7):3044–3053CrossRef
8.
Zurück zum Zitat Chen D, Zhang Y (2018) Robust zeroing neural-dynamics and its time-varying disturbances suppression model applied to mobile robot manipulators. IEEE Trans Neural Netw Learn Syst 29(9):4385–4397CrossRef Chen D, Zhang Y (2018) Robust zeroing neural-dynamics and its time-varying disturbances suppression model applied to mobile robot manipulators. IEEE Trans Neural Netw Learn Syst 29(9):4385–4397CrossRef
9.
Zurück zum Zitat Li S, Zhou M, Luo X (2018) Modified primal-dual neural networks for motion control of redundant manipulators with dynamic rejection of harmonic noises. IEEE Trans Neural Netw Learn Syst 29(10):4791–4801MathSciNetCrossRef Li S, Zhou M, Luo X (2018) Modified primal-dual neural networks for motion control of redundant manipulators with dynamic rejection of harmonic noises. IEEE Trans Neural Netw Learn Syst 29(10):4791–4801MathSciNetCrossRef
10.
Zurück zum Zitat Chen D, Zhang Y (2017) A hybrid multi-objective scheme applied to redundant robot manipulators. IEEE Trans Autom Sci Eng 14(3):1337–1350CrossRef Chen D, Zhang Y (2017) A hybrid multi-objective scheme applied to redundant robot manipulators. IEEE Trans Autom Sci Eng 14(3):1337–1350CrossRef
11.
Zurück zum Zitat Chen D, Zhang Y, Li S, Chen D, Zhang Y, Li S (2017) Zeroing neural-dynamics approach and its robust and rapid solution for parallel robot manipulators against superposition of multiple disturbances. Neurocomputing 275:845–858CrossRef Chen D, Zhang Y, Li S, Chen D, Zhang Y, Li S (2017) Zeroing neural-dynamics approach and its robust and rapid solution for parallel robot manipulators against superposition of multiple disturbances. Neurocomputing 275:845–858CrossRef
12.
Zurück zum Zitat Li S, Zhang Y, Jin L (2017) Kinematic control of redundant manipulators using neural networks. IEEE Trans Neural Netw Learn Syst 28(10):2243–2254MathSciNetCrossRef Li S, Zhang Y, Jin L (2017) Kinematic control of redundant manipulators using neural networks. IEEE Trans Neural Netw Learn Syst 28(10):2243–2254MathSciNetCrossRef
13.
Zurück zum Zitat Momenzadeh L, Zomorodian A, Mowla D (2011) Experimental and theoretical investigation of shelled corn drying in a microwave-assisted fluidized bed dryer using artificial neural network. Food Bioprod Process 89(1):15–21CrossRef Momenzadeh L, Zomorodian A, Mowla D (2011) Experimental and theoretical investigation of shelled corn drying in a microwave-assisted fluidized bed dryer using artificial neural network. Food Bioprod Process 89(1):15–21CrossRef
14.
Zurück zum Zitat Krishna Murthy TP, Manohar B (2012) Microwave drying of mango ginger (Curcuma amada roxb): prediction of drying kinetics by mathematical modelling and artificial neural network. Int J Food Sci Technol 47(6):1229–1236CrossRef Krishna Murthy TP, Manohar B (2012) Microwave drying of mango ginger (Curcuma amada roxb): prediction of drying kinetics by mathematical modelling and artificial neural network. Int J Food Sci Technol 47(6):1229–1236CrossRef
15.
Zurück zum Zitat Motavali A, Najafi GH, Abbasi S, Minaei S, Ghaderi A (2013) Microwavevacuum drying of sour cherry: comparison of mathematical models and artificial neural networks. J Food Sci Technol 50(4):714CrossRef Motavali A, Najafi GH, Abbasi S, Minaei S, Ghaderi A (2013) Microwavevacuum drying of sour cherry: comparison of mathematical models and artificial neural networks. J Food Sci Technol 50(4):714CrossRef
16.
Zurück zum Zitat Yousefi G, Emam-Djomeh PZ, Omid M, Askari GR (2014) Prediction of physicochemical properties of raspberry dried by microwave-assisted fluidized bed dryer using artificial neural network. Dry Technol 32(1):4–12CrossRef Yousefi G, Emam-Djomeh PZ, Omid M, Askari GR (2014) Prediction of physicochemical properties of raspberry dried by microwave-assisted fluidized bed dryer using artificial neural network. Dry Technol 32(1):4–12CrossRef
17.
Zurück zum Zitat Qin SZ, Su HT, Mcavoy TJ (1992) Comparison of four neural net learning methods for dynamic system identification. IEEE Trans Neural Netw 3(1):122–130CrossRef Qin SZ, Su HT, Mcavoy TJ (1992) Comparison of four neural net learning methods for dynamic system identification. IEEE Trans Neural Netw 3(1):122–130CrossRef
18.
Zurück zum Zitat Coban R (2013) A context layered locally recurrent neural network for dynamic system identification. Eng Appl Artif Intell 26(1):241–250CrossRef Coban R (2013) A context layered locally recurrent neural network for dynamic system identification. Eng Appl Artif Intell 26(1):241–250CrossRef
19.
Zurück zum Zitat Jin L, Li S, Luo X, Li Y, Qin B (2018) Neural dynamics for cooperative control of redundant robot manipulators. IEEE Trans Ind Inform 14(9):3812–3821CrossRef Jin L, Li S, Luo X, Li Y, Qin B (2018) Neural dynamics for cooperative control of redundant robot manipulators. IEEE Trans Ind Inform 14(9):3812–3821CrossRef
20.
Zurück zum Zitat Jin L, Li S, Hu B, Liu M, Yu J (2018) A noise-suppressing neural algorithm for solving the time-varying system of linear equations: a control-based approach. IEEE Trans Ind Inform 15(1):236–246CrossRef Jin L, Li S, Hu B, Liu M, Yu J (2018) A noise-suppressing neural algorithm for solving the time-varying system of linear equations: a control-based approach. IEEE Trans Ind Inform 15(1):236–246CrossRef
21.
Zurück zum Zitat Li S, Wang H, Rafique MU (2018) A novel recurrent neural network for manipulator control with improved noise tolerance. IEEE Trans Neural Netw Learn Syst 29(5):1908–1918MathSciNetCrossRef Li S, Wang H, Rafique MU (2018) A novel recurrent neural network for manipulator control with improved noise tolerance. IEEE Trans Neural Netw Learn Syst 29(5):1908–1918MathSciNetCrossRef
22.
Zurück zum Zitat Tsoi AC, Back AD (1994) Locally recurrent globally feedforward networks: a critical review of architectures. IEEE Trans Neural Netw 5(2):229–39CrossRef Tsoi AC, Back AD (1994) Locally recurrent globally feedforward networks: a critical review of architectures. IEEE Trans Neural Netw 5(2):229–39CrossRef
23.
Zurück zum Zitat Ku CC, Lee KY (1995) Diagonal recurrent neural networks for dynamic systems control. IEEE Trans Neural Netw 6(1):144–156CrossRef Ku CC, Lee KY (1995) Diagonal recurrent neural networks for dynamic systems control. IEEE Trans Neural Netw 6(1):144–156CrossRef
24.
Zurück zum Zitat Blanco A, Delgado M, Pegalajar MC (2001) A real-coded genetic algorithm for training recurrent neural networks. Neural Netw 14(1):93–105CrossRef Blanco A, Delgado M, Pegalajar MC (2001) A real-coded genetic algorithm for training recurrent neural networks. Neural Netw 14(1):93–105CrossRef
25.
Zurück zum Zitat Luitel B, Venayagamoorthy GK (2010) Quantum inspired PSO for the optimization of simultaneous recurrent neural networks as mimo learning systems. Neural Netw 23(5):583CrossRef Luitel B, Venayagamoorthy GK (2010) Quantum inspired PSO for the optimization of simultaneous recurrent neural networks as mimo learning systems. Neural Netw 23(5):583CrossRef
26.
Zurück zum Zitat Seyab RKA, Cao Y (2008) Nonlinear system identification for predictive control using continuous time recurrent neural networks and automatic differentiation. J Process Control 18(6):568–581CrossRef Seyab RKA, Cao Y (2008) Nonlinear system identification for predictive control using continuous time recurrent neural networks and automatic differentiation. J Process Control 18(6):568–581CrossRef
27.
Zurück zum Zitat Chen CC, Shen LP (2018) Improve the accuracy of recurrent fuzzy system design using an efficient continuous ant colony optimization. Int J Fuzzy Syst 20(2):1–18MathSciNet Chen CC, Shen LP (2018) Improve the accuracy of recurrent fuzzy system design using an efficient continuous ant colony optimization. Int J Fuzzy Syst 20(2):1–18MathSciNet
28.
Zurück zum Zitat Puskorius GV, Feldkamp LA (1994) Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks. IEEE Trans Neural Netw 5(2):279–297CrossRef Puskorius GV, Feldkamp LA (1994) Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks. IEEE Trans Neural Netw 5(2):279–297CrossRef
29.
Zurück zum Zitat De Jesus Rubio J, Yu W (2005) Dead-zone Kalman filter algorithm for recurrent neural networks. In: IEEE Conference on Decision and Control, pp 2562–2567 De Jesus Rubio J, Yu W (2005) Dead-zone Kalman filter algorithm for recurrent neural networks. In: IEEE Conference on Decision and Control, pp 2562–2567
30.
Zurück zum Zitat Kumar R, Srivastava S, Gupta JRP, Mohindru A (2018) Diagonal recurrent neural network based identification of nonlinear dynamical systems with Lyapunov stability based adaptive learning rates. Neurocomputing 287(26):102–117CrossRef Kumar R, Srivastava S, Gupta JRP, Mohindru A (2018) Diagonal recurrent neural network based identification of nonlinear dynamical systems with Lyapunov stability based adaptive learning rates. Neurocomputing 287(26):102–117CrossRef
31.
Zurück zum Zitat Kumar R, Srivastava S, Gupta JR (2017) Diagonal recurrent neural network based adaptive control of nonlinear dynamical systems using lyapunov stability criterion. ISA Trans 67:407CrossRef Kumar R, Srivastava S, Gupta JR (2017) Diagonal recurrent neural network based adaptive control of nonlinear dynamical systems using lyapunov stability criterion. ISA Trans 67:407CrossRef
32.
Zurück zum Zitat Bergstra J, Bengio Y (2012) Random search for hyper-parameter optimization. J Mach Learn Res 13(1):281–305MathSciNetMATH Bergstra J, Bengio Y (2012) Random search for hyper-parameter optimization. J Mach Learn Res 13(1):281–305MathSciNetMATH
33.
Zurück zum Zitat Juang CF (2004) A hybrid of genetic algorithm and particle swarm optimization for recurrent network design. IEEE Trans Syst Man Cybern Part B Cybern 34(2):997–1006CrossRef Juang CF (2004) A hybrid of genetic algorithm and particle swarm optimization for recurrent network design. IEEE Trans Syst Man Cybern Part B Cybern 34(2):997–1006CrossRef
34.
Zurück zum Zitat Subrahmanya N, Shin YC (2010) Constructive training of recurrent neural networks using hybrid optimization. Neurocomputing 73(1315):2624–2631CrossRef Subrahmanya N, Shin YC (2010) Constructive training of recurrent neural networks using hybrid optimization. Neurocomputing 73(1315):2624–2631CrossRef
35.
Zurück zum Zitat Wang X, Ma L, Wang B, Wang T (2013) A hybrid optimization-based recurrent neural network for real-time data prediction. Neurocomputing 120(10):547–559CrossRef Wang X, Ma L, Wang B, Wang T (2013) A hybrid optimization-based recurrent neural network for real-time data prediction. Neurocomputing 120(10):547–559CrossRef
36.
Zurück zum Zitat Chen S, Billings SA, Luo W (1989) Orthogonal least squares methods and their application to non-linear system identification. Int J Control 50(5):1873–1896MATHCrossRef Chen S, Billings SA, Luo W (1989) Orthogonal least squares methods and their application to non-linear system identification. Int J Control 50(5):1873–1896MATHCrossRef
37.
Zurück zum Zitat Chen S, Cowan CFN, Grant PM (1991) Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans Neural Netw 2(2):302–309CrossRef Chen S, Cowan CFN, Grant PM (1991) Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans Neural Netw 2(2):302–309CrossRef
38.
Zurück zum Zitat Chen S, Wu Y, Luk BL (1999) Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks. IEEE Trans Neural Netw 10(5):1239–43CrossRef Chen S, Wu Y, Luk BL (1999) Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks. IEEE Trans Neural Netw 10(5):1239–43CrossRef
39.
Zurück zum Zitat Bataineh M, Marler T (2017) Neural network for regression problems with reduced training sets. Neural Netw 95(11):1–9CrossRef Bataineh M, Marler T (2017) Neural network for regression problems with reduced training sets. Neural Netw 95(11):1–9CrossRef
40.
Zurück zum Zitat Wei HL, Billings SA, Zhao YF, Guo LZ (2010) An adaptive wavelet neural network for spatio-temporal system identification. Neural Netw 23(10):1286–1299CrossRef Wei HL, Billings SA, Zhao YF, Guo LZ (2010) An adaptive wavelet neural network for spatio-temporal system identification. Neural Netw 23(10):1286–1299CrossRef
41.
Zurück zum Zitat Chen S, Wigger J (1995) Fast orthogonal least squares algorithm for efficient subset model selection. IEEE Trans Signal Process 43(7):1713–1715CrossRef Chen S, Wigger J (1995) Fast orthogonal least squares algorithm for efficient subset model selection. IEEE Trans Signal Process 43(7):1713–1715CrossRef
42.
Zurück zum Zitat Zhu QM, Billings SA (1994) Fast orthogonal identification of nonlinear stochastic models and radial basis function neural networks. Int J Control 64(5):871–886MATHCrossRef Zhu QM, Billings SA (1994) Fast orthogonal identification of nonlinear stochastic models and radial basis function neural networks. Int J Control 64(5):871–886MATHCrossRef
43.
Zurück zum Zitat Mao KZ (2002) Fast orthogonal forward selection algorithm for feature subset selection. IEEE Trans Neural Netw 13(5):1218–1224CrossRef Mao KZ (2002) Fast orthogonal forward selection algorithm for feature subset selection. IEEE Trans Neural Netw 13(5):1218–1224CrossRef
44.
45.
Zurück zum Zitat Zhang L, Li K, Bai EW, Irwin GW (2015) Two-stage orthogonal least squares methods for neural network construction. IEEE Trans Neural Netw Learn Syst 26(8):1608MathSciNetCrossRef Zhang L, Li K, Bai EW, Irwin GW (2015) Two-stage orthogonal least squares methods for neural network construction. IEEE Trans Neural Netw Learn Syst 26(8):1608MathSciNetCrossRef
Metadaten
Titel
Two-Stage Method for Diagonal Recurrent Neural Network Identification of a High-Power Continuous Microwave Heating System
verfasst von
Tong Liu
Shan Liang
Qingyu Xiong
Kai Wang
Publikationsdatum
13.02.2019
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 3/2019
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-019-09992-w

Weitere Artikel der Ausgabe 3/2019

Neural Processing Letters 3/2019 Zur Ausgabe

Neuer Inhalt