Skip to main content
Erschienen in: Soft Computing 22/2017

24.06.2016 | Methodologies and Application

Bidirectional reservoir networks trained using SVM\(+\) privileged information for manufacturing process modeling

verfasst von: Ali Rodan, Alaa F. Sheta, Hossam Faris

Erschienen in: Soft Computing | Ausgabe 22/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the last decade, a wide range of machine learning approaches were proposed and experimented to model highly nonlinear manufacturing processes. However, improving the performance of such models is challenging due to the complexity and high dimensionality of the manufacturing processes in general. In this paper, we propose bidirectional echo state reservoir networks (Bi-ESNs) trained using support vector machine privileged information method (SVM\(+\)) to model a winding machine process. The proposed model will be applied, tested and compared to reported models in the literature such as classical ESN with linear regression, ESN with a linear SVM readout, genetic programming, feedfoward neural network with backpropagation, radial basis function network, adaptive neural fuzzy inference system and local linear wavelet neural network. The developed results show that Bi-ESNs trained with SVM\(+\) are promising. It was able to provide better generalization performance compared to other models.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
A hyperplane with maximal normalized margin.
 
Literatur
Zurück zum Zitat Abbasi Nozari H, Dehghan Banadaki H, Mokhtare M, Hekmati Vahed S (2012) Intelligent non-linear modelling of an industrial winding process using recurrent local linear neuro-fuzzy networks. J Zhejiang Univ Sci C 13:403–412CrossRef Abbasi Nozari H, Dehghan Banadaki H, Mokhtare M, Hekmati Vahed S (2012) Intelligent non-linear modelling of an industrial winding process using recurrent local linear neuro-fuzzy networks. J Zhejiang Univ Sci C 13:403–412CrossRef
Zurück zum Zitat Al-Hiary H, Sheta A, Ayesh A (2008) Identification of a chemical process reactor using soft computing techniques. In: Proceedings of the 2008 international conference on fuzzy systems (FUZZ2008) within the 2008 IEEE world congress on computational intelligence (WCCI2008), Hong Kong, 1–6 June, pp 845–653 Al-Hiary H, Sheta A, Ayesh A (2008) Identification of a chemical process reactor using soft computing techniques. In: Proceedings of the 2008 international conference on fuzzy systems (FUZZ2008) within the 2008 IEEE world congress on computational intelligence (WCCI2008), Hong Kong, 1–6 June, pp 845–653
Zurück zum Zitat Babinec S, Pospíchal J (2011) modular state space of echo state neural network in time series prediction. Comput Inform 30:321–334MATH Babinec S, Pospíchal J (2011) modular state space of echo state neural network in time series prediction. Comput Inform 30:321–334MATH
Zurück zum Zitat Bastogne T, Noura H, Sibille P, Richard A (1998) Multivariable identification of a winding process by subspace methods for tension control. Control Eng Pract 6(9):1077–1088CrossRef Bastogne T, Noura H, Sibille P, Richard A (1998) Multivariable identification of a winding process by subspace methods for tension control. Control Eng Pract 6(9):1077–1088CrossRef
Zurück zum Zitat Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5:157–166CrossRef Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5:157–166CrossRef
Zurück zum Zitat Braatz R, Ogunnaike B, Featherstone A (1996) Identification, estimation and control of sheet and film processes. In: Proceedings of the 13th IFAC world congress. San Francisco, CA, pp 319–324 Braatz R, Ogunnaike B, Featherstone A (1996) Identification, estimation and control of sheet and film processes. In: Proceedings of the 13th IFAC world congress. San Francisco, CA, pp 319–324
Zurück zum Zitat Buesing L, Schrauwen B, Legenstein R (2010) Connectivity, dynamics and memory in reservoir computing with binary and analog neurons. Neural Comput 22:1272–1311 Buesing L, Schrauwen B, Legenstein R (2010) Connectivity, dynamics and memory in reservoir computing with binary and analog neurons. Neural Comput 22:1272–1311
Zurück zum Zitat Chan WC, Cheung KC, Harris CJ (2001) On the modelling of nonlinear dynamic system using support vector neural networks. Eng. Appl. Artif. Intell. 14:105–113CrossRef Chan WC, Cheung KC, Harris CJ (2001) On the modelling of nonlinear dynamic system using support vector neural networks. Eng. Appl. Artif. Intell. 14:105–113CrossRef
Zurück zum Zitat Chen Y, Yang B, Dong J (2006) Time-series prediction using a local linear wavelet neural network. Neurocomputing 69:449–456CrossRef Chen Y, Yang B, Dong J (2006) Time-series prediction using a local linear wavelet neural network. Neurocomputing 69:449–456CrossRef
Zurück zum Zitat Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines: and other kernel-based learning methods. Cambridge University Press, New YorkCrossRefMATH Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines: and other kernel-based learning methods. Cambridge University Press, New YorkCrossRefMATH
Zurück zum Zitat Du H, Zhang N (2008) Time series prediction using evolving radial basis function networks with new encoding scheme. Neurocomputing 71:1388–1400CrossRef Du H, Zhang N (2008) Time series prediction using evolving radial basis function networks with new encoding scheme. Neurocomputing 71:1388–1400CrossRef
Zurück zum Zitat Ebler N, Arnason R, Michaelis G, D’Sa N (1993) Tension control: dancer rolls or load cells. IEEE Trans Ind Appl 29(4):727–739CrossRef Ebler N, Arnason R, Michaelis G, D’Sa N (1993) Tension control: dancer rolls or load cells. IEEE Trans Ind Appl 29(4):727–739CrossRef
Zurück zum Zitat Faris H, Sheta A, Öznergiz E (2013) Modelling hot rolling manufacturing process using soft computing techniques. Int J Comput Integr Manuf 26(8):762–771CrossRef Faris H, Sheta A, Öznergiz E (2013) Modelling hot rolling manufacturing process using soft computing techniques. Int J Comput Integr Manuf 26(8):762–771CrossRef
Zurück zum Zitat Faris H, Sheta AF, Öznergiz E (2016) MGP-CC: a hybrid multigene GP-cuckoo search method for hot rolling manufacture process modeling. Syst Sci Control Eng 4:39–49CrossRef Faris H, Sheta AF, Öznergiz E (2016) MGP-CC: a hybrid multigene GP-cuckoo search method for hot rolling manufacture process modeling. Syst Sci Control Eng 4:39–49CrossRef
Zurück zum Zitat Faris H, Sheta AF (2016) A comparison between parametric and non-parametric soft computing approaches to model the temperature of a metal cutting tool. Int J Comput Integr Manuf 29(1):64–75 Faris H, Sheta AF (2016) A comparison between parametric and non-parametric soft computing approaches to model the temperature of a metal cutting tool. Int J Comput Integr Manuf 29(1):64–75
Zurück zum Zitat Fukushima H, Kim T-H, Sugie T (2007) Brief paper: adaptive model predictive control for a class of constrained linear systems based on the comparison model. Automatica 43:301–308MathSciNetCrossRefMATH Fukushima H, Kim T-H, Sugie T (2007) Brief paper: adaptive model predictive control for a class of constrained linear systems based on the comparison model. Automatica 43:301–308MathSciNetCrossRefMATH
Zurück zum Zitat Good J, Roisum DR (2008) Machines, mechanics and measurements. DEStech Publication, Lancaster Good J, Roisum DR (2008) Machines, mechanics and measurements. DEStech Publication, Lancaster
Zurück zum Zitat Hailiang H, Zhong W, Xiaohong N, Jing S (2015) Robust decentralized control of web-winding systems without tension sensor. In: Proceedings of the 2015 34th Chinese control conference (CCC), pp 8850–8854, July 2015 Hailiang H, Zhong W, Xiaohong N, Jing S (2015) Robust decentralized control of web-winding systems without tension sensor. In: Proceedings of the 2015 34th Chinese control conference (CCC), pp 8850–8854, July 2015
Zurück zum Zitat Haykin S (1998) Neural networks: a comprehensive foundation, 2nd edn. Prentice Hall PTR, Upper Saddle RiverMATH Haykin S (1998) Neural networks: a comprehensive foundation, 2nd edn. Prentice Hall PTR, Upper Saddle RiverMATH
Zurück zum Zitat Hoshino I, Maekawa Y, Fujimoto T, Kimura H (1988) Observer-based multivariable control of the aluminum cold tandem mill. Automatica 24(6):741–754MathSciNetCrossRefMATH Hoshino I, Maekawa Y, Fujimoto T, Kimura H (1988) Observer-based multivariable control of the aluminum cold tandem mill. Automatica 24(6):741–754MathSciNetCrossRefMATH
Zurück zum Zitat Hussian A, Sheta A, Abdelwahab A (2001) Modeling of a winding machine using non-parametric neural network model. In: WSEAS international conference on scientific computation and soft computing. Athens, Greece, pp 528–553 Hussian A, Sheta A, Abdelwahab A (2001) Modeling of a winding machine using non-parametric neural network model. In: WSEAS international conference on scientific computation and soft computing. Athens, Greece, pp 528–553
Zurück zum Zitat Hussian A, Sheta A, Kamel M, Telbany M, Abdelwahab A (2000) Modeling of a winding machine using genetic programming. In: Proceedings of the congress on evolutionary computation (CEC2000), vol 82, pp 398–402 Hussian A, Sheta A, Kamel M, Telbany M, Abdelwahab A (2000) Modeling of a winding machine using genetic programming. In: Proceedings of the congress on evolutionary computation (CEC2000), vol 82, pp 398–402
Zurück zum Zitat Inoue Y, Takanashi K, Miyazawa N, Hyuga Y (1984) Management and control systems in the steel industry. Comput Ind 5(2):143–152 (Special Issue: Computers in Japanese Industry) Inoue Y, Takanashi K, Miyazawa N, Hyuga Y (1984) Management and control systems in the steel industry. Comput Ind 5(2):143–152 (Special Issue: Computers in Japanese Industry)
Zurück zum Zitat Isobe T (1970) Automatic control in the iron and steel industry. Automatica 6(1):111–121CrossRef Isobe T (1970) Automatic control in the iron and steel industry. Automatica 6(1):111–121CrossRef
Zurück zum Zitat Jaeger H (2001) The echo state approach to analysing and training recurrent neural networks. Technical report GMD report 148, German National Research Center for Information Technology Jaeger H (2001) The echo state approach to analysing and training recurrent neural networks. Technical report GMD report 148, German National Research Center for Information Technology
Zurück zum Zitat Jang J-S (1993) ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans Syst Man Cybern 23:665–685CrossRef Jang J-S (1993) ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans Syst Man Cybern 23:665–685CrossRef
Zurück zum Zitat Jian W, Xu Z, Minghong W, Dehong D (2007) Research on spindle drive control system of high speed winding machine. In: Proceedings of the 8th international conference on electronic measurement and instruments (ICEMI’07), pp 473–477, Aug 2007 Jian W, Xu Z, Minghong W, Dehong D (2007) Research on spindle drive control system of high speed winding machine. In: Proceedings of the 8th international conference on electronic measurement and instruments (ICEMI’07), pp 473–477, Aug 2007
Zurück zum Zitat Kara Y, Acar Boyacioglu M, Baykan OK (2011) Predicting direction of stock price index movement using artificial neural networks and support vector machines. Expert Syst Appl 38:5311–5319CrossRef Kara Y, Acar Boyacioglu M, Baykan OK (2011) Predicting direction of stock price index movement using artificial neural networks and support vector machines. Expert Syst Appl 38:5311–5319CrossRef
Zurück zum Zitat Lukoševičius M, Jaeger H (2009) Reservoir computing approaches to recurrent neural network training. Comput Sci Rev 3:127–149CrossRefMATH Lukoševičius M, Jaeger H (2009) Reservoir computing approaches to recurrent neural network training. Comput Sci Rev 3:127–149CrossRefMATH
Zurück zum Zitat Lukoševičius M, Jaeger H, Schrauwen B (2012) Reservoir computing trends. KI - Künstliche Intelligenz, pp 1–7, 05/2012 Lukoševičius M, Jaeger H, Schrauwen B (2012) Reservoir computing trends. KI - Künstliche Intelligenz, pp 1–7, 05/2012
Zurück zum Zitat Lukoševičius M, Marozas V (2014) Noninvasive fetal qrs detection using an echo state network and dynamic programming. Physiol Meas 35:1685CrossRef Lukoševičius M, Marozas V (2014) Noninvasive fetal qrs detection using an echo state network and dynamic programming. Physiol Meas 35:1685CrossRef
Zurück zum Zitat Mo W, Wang M, Lin J-S, Zan H, Sun G (2014) Control system based on plc for winding machine. In: Proceedings of the 2014 international symposium on computer, consumer and control (IS3C), pp 74–77, June 2014 Mo W, Wang M, Lin J-S, Zan H, Sun G (2014) Control system based on plc for winding machine. In: Proceedings of the 2014 international symposium on computer, consumer and control (IS3C), pp 74–77, June 2014
Zurück zum Zitat Muller K, Smola A, Ratsch G, Scholkopf B, kohlmorgen J, Vapnik V (1997) Predicting rime series with support vector machines. In: Proceedings of the 7th international conference on artificial neural networks (ICANN’97), pp 999–1004 Muller K, Smola A, Ratsch G, Scholkopf B, kohlmorgen J, Vapnik V (1997) Predicting rime series with support vector machines. In: Proceedings of the 7th international conference on artificial neural networks (ICANN’97), pp 999–1004
Zurück zum Zitat Nozari HA, Banadaki HD, Mokhtare M, Vahed SH (2012) Intelligent non-linear modelling of an industrial winding process using recurrent local linear neuro-fuzzy networks. J Zhejiang Univ Sci C 13(6):403–412CrossRef Nozari HA, Banadaki HD, Mokhtare M, Vahed SH (2012) Intelligent non-linear modelling of an industrial winding process using recurrent local linear neuro-fuzzy networks. J Zhejiang Univ Sci C 13(6):403–412CrossRef
Zurück zum Zitat Parant F, Coeffier C, Iung C (1992) Modeling of a web tension in a continuous annealing line. Iron and Steel Engineer, Pittsburgh Parant F, Coeffier C, Iung C (1992) Modeling of a web tension in a continuous annealing line. Iron and Steel Engineer, Pittsburgh
Zurück zum Zitat Rodan A, Tiňo P (2010) Simple deterministically constructed recurrent neural networks. In: Fyfe C et al (eds) Intelligent data engineering and automated learning—IDEAL 2010. Springer, pp 267–274 Rodan A, Tiňo P (2010) Simple deterministically constructed recurrent neural networks. In: Fyfe C et al (eds) Intelligent data engineering and automated learning—IDEAL 2010. Springer, pp 267–274
Zurück zum Zitat Rodan A, Tino P (2011) Negatively correlated echo state networks. In: ESANN, Citeseer Rodan A, Tino P (2011) Negatively correlated echo state networks. In: ESANN, Citeseer
Zurück zum Zitat Rumelhart DE, Hinton GE, Williams RJ (1988) Neurocomputing: foundations of research. Ch. Learning internal representations by error propagation. MIT Press, Cambridge, pp 673–695 Rumelhart DE, Hinton GE, Williams RJ (1988) Neurocomputing: foundations of research. Ch. Learning internal representations by error propagation. MIT Press, Cambridge, pp 673–695
Zurück zum Zitat Scardapane S, Wang D, Panella M (2015) A decentralized training algorithm for echo state networks in distributed big data applications. Neural Netw 78:65–74CrossRef Scardapane S, Wang D, Panella M (2015) A decentralized training algorithm for echo state networks in distributed big data applications. Neural Netw 78:65–74CrossRef
Zurück zum Zitat Sheta AF, Faris H, Öznergiz E (2014) Improving production quality of a hot-rolling industrial process via genetic programming model. Int J Comput Appl Technol 49:239–250 Sheta AF, Faris H, Öznergiz E (2014) Improving production quality of a hot-rolling industrial process via genetic programming model. Int J Comput Appl Technol 49:239–250
Zurück zum Zitat Sheta A, Ahmed SE, Faris H (2015) A comparison between regression, artificial neural networks and support vector machines for predicting stock market index. Int J Adv Res Artif Intell IJARAI 4(7):55–63 Sheta A, Ahmed SE, Faris H (2015) A comparison between regression, artificial neural networks and support vector machines for predicting stock market index. Int J Adv Res Artif Intell IJARAI 4(7):55–63
Zurück zum Zitat Sheta A, Al-Hiary H, Braik M (2009) Identification and model predictive controller design of the Tennessee Eastman chemical process using ANN. In: Proceedings of the 2009 international conference on artificial intelligence (ICAI’09), July 13–16, USA, vol 1, pp 25–31 Sheta A, Al-Hiary H, Braik M (2009) Identification and model predictive controller design of the Tennessee Eastman chemical process using ANN. In: Proceedings of the 2009 international conference on artificial intelligence (ICAI’09), July 13–16, USA, vol 1, pp 25–31
Zurück zum Zitat Sievers L, Balas M, von Flotow A (1988) Modeling of web conveyance systems for multivariable control. IEEE Trans Autom Control 33:524–531CrossRefMATH Sievers L, Balas M, von Flotow A (1988) Modeling of web conveyance systems for multivariable control. IEEE Trans Autom Control 33:524–531CrossRefMATH
Zurück zum Zitat Sievers L, Balas M, Flotow AV (1988) Modeling of web conveyance systems for multivariable control. IEEE Trans Autom Control 33(6):524–531CrossRefMATH Sievers L, Balas M, Flotow AV (1988) Modeling of web conveyance systems for multivariable control. IEEE Trans Autom Control 33(6):524–531CrossRefMATH
Zurück zum Zitat Smola AJ, Scholkopf B (1998) A tutorial on support vector regression. Technical report, Technical report NC2-TR-1998-030, University of London, Royal Holloway Smola AJ, Scholkopf B (1998) A tutorial on support vector regression. Technical report, Technical report NC2-TR-1998-030, University of London, Royal Holloway
Zurück zum Zitat Tiňo P, Rodan A (2013) Short term memory in input-driven linear dynamical systems. Neurocomputing 112:58–63CrossRef Tiňo P, Rodan A (2013) Short term memory in input-driven linear dynamical systems. Neurocomputing 112:58–63CrossRef
Zurück zum Zitat Vapnik VN (1999) An overview of statistical learning theory. Trans Neural Netw 10:988–999CrossRef Vapnik VN (1999) An overview of statistical learning theory. Trans Neural Netw 10:988–999CrossRef
Zurück zum Zitat Vapnik V, Izmailov R (2015) Learning using privileged information: similarity control and knowledge transfer. J Mach Learn Res 16:2023–2049MathSciNetMATH Vapnik V, Izmailov R (2015) Learning using privileged information: similarity control and knowledge transfer. J Mach Learn Res 16:2023–2049MathSciNetMATH
Zurück zum Zitat Vapnik V, Vashist A (2009) A new learning paradigm: learning using privileged information. Neural Netw 22(5–6):544–557CrossRefMATH Vapnik V, Vashist A (2009) A new learning paradigm: learning using privileged information. Neural Netw 22(5–6):544–557CrossRefMATH
Zurück zum Zitat Walker N, Wyatt-Mair G (1995) Sensor signal validation using analytical redundancy for an aluminum cold rolling mill. Control Eng Pract 3(6):753–760CrossRef Walker N, Wyatt-Mair G (1995) Sensor signal validation using analytical redundancy for an aluminum cold rolling mill. Control Eng Pract 3(6):753–760CrossRef
Zurück zum Zitat Wang WJ, Xu ZB, Lu WZ (2003) Determination of the spread parameter in the gaussian kernel for classification and regression. Neurocomputing 55:643–663CrossRef Wang WJ, Xu ZB, Lu WZ (2003) Determination of the spread parameter in the gaussian kernel for classification and regression. Neurocomputing 55:643–663CrossRef
Zurück zum Zitat Wang X, Yan Heshan (2015) Optimizing the echo state network with a binary particle swarm optimization algorithm. Knowl Based Syst 86:09 Wang X, Yan Heshan (2015) Optimizing the echo state network with a binary particle swarm optimization algorithm. Knowl Based Syst 86:09
Zurück zum Zitat Wei C-H, Wu C-H (2004) A simulator of winding machine controller using LabView environment. In: Control, automation, robotics and vision conference, 2004. ICARCV 2004 8th vol 3, pp 2105–2110, Dec 2004 Wei C-H, Wu C-H (2004) A simulator of winding machine controller using LabView environment. In: Control, automation, robotics and vision conference, 2004. ICARCV 2004 8th vol 3, pp 2105–2110, Dec 2004
Zurück zum Zitat Zhu GQ, Liu SR, Yu JS (2002) Support vector machine and its applications to function approximation. J East China Univ Sci Technol 5:555–559 Zhu GQ, Liu SR, Yu JS (2002) Support vector machine and its applications to function approximation. J East China Univ Sci Technol 5:555–559
Metadaten
Titel
Bidirectional reservoir networks trained using SVM privileged information for manufacturing process modeling
verfasst von
Ali Rodan
Alaa F. Sheta
Hossam Faris
Publikationsdatum
24.06.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 22/2017
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-016-2232-9

Weitere Artikel der Ausgabe 22/2017

Soft Computing 22/2017 Zur Ausgabe

Premium Partner