Skip to main content

2018 | OriginalPaper | Buchkapitel

Data Driven Analytics (Machine Learning) for System Characterization, Diagnostics and Control Optimization

verfasst von : Jinkyoo Park, Max Ferguson, Kincho H. Law

Erschienen in: Advanced Computing Strategies for Engineering

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This presentation discusses the potential use of machine learning techniques to build data-driven models to characterize an engineering system for performance assessment, diagnostic analysis and control optimization. Focusing on the Gaussian Process modeling approach, engineering applications on constructing predictive models for energy consumption analysis and tool condition monitoring of a milling machine tool are presented. Furthermore, a cooperative control optimization approach for maximizing wind farm power production by combining Gaussian Process modeling with Bayesian Optimization is discussed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Jordan, M.I., Mitchell, T.M.: Machine learning: trends, perspectives and prospects. Science 349, 255–269 (2015)MathSciNetCrossRef Jordan, M.I., Mitchell, T.M.: Machine learning: trends, perspectives and prospects. Science 349, 255–269 (2015)MathSciNetCrossRef
2.
Zurück zum Zitat Wuest, T., Weimer, D., Irgens, C., Thoben, K.-D.: Machine learning in manufacturing: advantages, challenges, and applications. Prod. Manuf. Res. An Open Access J. 4, 23–45 (2016) Wuest, T., Weimer, D., Irgens, C., Thoben, K.-D.: Machine learning in manufacturing: advantages, challenges, and applications. Prod. Manuf. Res. An Open Access J. 4, 23–45 (2016)
3.
Zurück zum Zitat Suresh, P.V.S., Venkateswara Rao, P., Deshmukh, S.G.: A genetic algorithmic approach for optimization of surface roughness prediction model. Int. J. Mach. Tools Manuf. 42, 675–680 (2002)CrossRef Suresh, P.V.S., Venkateswara Rao, P., Deshmukh, S.G.: A genetic algorithmic approach for optimization of surface roughness prediction model. Int. J. Mach. Tools Manuf. 42, 675–680 (2002)CrossRef
4.
Zurück zum Zitat Ghosh, N., Ravi, Y.B., Patra, A., Mukhopadhyay, S., Paul, S., Mohanty, A.R., Chattopadhyay, A.B.: Estimation of tool wear during CNC milling using neural network-based sensor fusion. Mech. Syst. Sign. Process. 21, 466–479 (2007)CrossRef Ghosh, N., Ravi, Y.B., Patra, A., Mukhopadhyay, S., Paul, S., Mohanty, A.R., Chattopadhyay, A.B.: Estimation of tool wear during CNC milling using neural network-based sensor fusion. Mech. Syst. Sign. Process. 21, 466–479 (2007)CrossRef
5.
Zurück zum Zitat Ak, R., Helu, M., Rachuri, S.: Ensemble neural network model for predicting the energy consumption of a milling machine. In: 2015 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE 2015), p. V004T05A056. ASME (2015) Ak, R., Helu, M., Rachuri, S.: Ensemble neural network model for predicting the energy consumption of a milling machine. In: 2015 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE 2015), p. V004T05A056. ASME (2015)
6.
Zurück zum Zitat Jihong, Y., Lee, J.: Degradation assessment and fault modes classification using logistic regression. J. Manuf. Sci. Eng. 127, 912–914 (2005)CrossRef Jihong, Y., Lee, J.: Degradation assessment and fault modes classification using logistic regression. J. Manuf. Sci. Eng. 127, 912–914 (2005)CrossRef
7.
Zurück zum Zitat Carbonneau, R., Laframboise, K., Vahidov, R.: Application of machine learning techniques for supply chain demand forecasting. Eur. J. Oper. Res. 184, 1140–1154 (2008)CrossRef Carbonneau, R., Laframboise, K., Vahidov, R.: Application of machine learning techniques for supply chain demand forecasting. Eur. J. Oper. Res. 184, 1140–1154 (2008)CrossRef
8.
Zurück zum Zitat Ghahramani, Z.: Probabilistic machine learning and artificial intelligence. Nature 521, 452–459 (2015)CrossRef Ghahramani, Z.: Probabilistic machine learning and artificial intelligence. Nature 521, 452–459 (2015)CrossRef
9.
Zurück zum Zitat Orbanz, P., Teh, Y.W.: Bayesian nonparametric models. In: Encyclopedia of Machine Learning, pp. 81–89. Springer, New York (2011) Orbanz, P., Teh, Y.W.: Bayesian nonparametric models. In: Encyclopedia of Machine Learning, pp. 81–89. Springer, New York (2011)
10.
Zurück zum Zitat Murphy, K.P.: Machine Learning: A Probabilistic Perspective. MIT Press, Cambridge (2012)MATH Murphy, K.P.: Machine Learning: A Probabilistic Perspective. MIT Press, Cambridge (2012)MATH
12.
Zurück zum Zitat Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. MIT Press, Cambridge (2006)MATH Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. MIT Press, Cambridge (2006)MATH
13.
Zurück zum Zitat Bhinge, R., Park, J., Law, K.H., Dornfeld, D., Moneer, M., Rachuri, S.: Towards a generalized energy prediction model for machine tools. J. Manuf. Sci. Eng. 139(4), 041013 (2017)CrossRef Bhinge, R., Park, J., Law, K.H., Dornfeld, D., Moneer, M., Rachuri, S.: Towards a generalized energy prediction model for machine tools. J. Manuf. Sci. Eng. 139(4), 041013 (2017)CrossRef
14.
Zurück zum Zitat Park, J., Law, K.H., Bhinge, R., Biswas, N., Srinivasan, A., Dornfeld, D., Helu, M., Rachuri, S.: A generalized data-driven energy prediction model with uncertainty for a milling machine tool using Gaussian Process. In: 2015 International Manufacturing Science and Engineering Conference (MSEC 2015), p. V002T05A010. ASME (2015) Park, J., Law, K.H., Bhinge, R., Biswas, N., Srinivasan, A., Dornfeld, D., Helu, M., Rachuri, S.: A generalized data-driven energy prediction model with uncertainty for a milling machine tool using Gaussian Process. In: 2015 International Manufacturing Science and Engineering Conference (MSEC 2015), p. V002T05A010. ASME (2015)
15.
Zurück zum Zitat Nguyen-Tuong, D., Peters, J.R., Seeger, M.: Local Gaussian process regression for real time online model learning. In: 22nd Annual Conference on Neural Information Processing Systems. Advances in Neural Information Processing Systems 21, pp. 1193–1200 (2008) Nguyen-Tuong, D., Peters, J.R., Seeger, M.: Local Gaussian process regression for real time online model learning. In: 22nd Annual Conference on Neural Information Processing Systems. Advances in Neural Information Processing Systems 21, pp. 1193–1200 (2008)
16.
Zurück zum Zitat Teramura, K., Hideharu, O., Yuusaku, T., Shimpei, M., Shinichi, M.: Gaussian process regression for rendering music performance. In: International Conference on Music Perception and Cognition (ICMPC 10), pp. 167–172 (2008) Teramura, K., Hideharu, O., Yuusaku, T., Shimpei, M., Shinichi, M.: Gaussian process regression for rendering music performance. In: International Conference on Music Perception and Cognition (ICMPC 10), pp. 167–172 (2008)
17.
Zurück zum Zitat Alpaydm, E.: Introduction to Machine Learning, 3rd edn. MIT Press, Cambridge (2014) Alpaydm, E.: Introduction to Machine Learning, 3rd edn. MIT Press, Cambridge (2014)
18.
Zurück zum Zitat Brochu, E., Cora, M.V., Freitas, N.: A tutorial on Bayesian optimization of expensive cost functions with application to active user modelling and hierarchical reinforcement learning. Technical report, University of British Columbia, Canada (2010). arXiv:1012.2599 Brochu, E., Cora, M.V., Freitas, N.: A tutorial on Bayesian optimization of expensive cost functions with application to active user modelling and hierarchical reinforcement learning. Technical report, University of British Columbia, Canada (2010). arXiv:​1012.​2599
19.
Zurück zum Zitat Jones, D., Schonlau, M., Welch, W.: Efficient global optimization of expensive black-box functions. J. Global Optim. 13, 455–492 (1998)MathSciNetCrossRef Jones, D., Schonlau, M., Welch, W.: Efficient global optimization of expensive black-box functions. J. Global Optim. 13, 455–492 (1998)MathSciNetCrossRef
20.
Zurück zum Zitat Osborne, M.: Bayesian Gaussian process for sequential prediction, optimization and quadrature. Ph.D. Dissertation, Department of Computer Science, University of Oxford, UK (2010) Osborne, M.: Bayesian Gaussian process for sequential prediction, optimization and quadrature. Ph.D. Dissertation, Department of Computer Science, University of Oxford, UK (2010)
21.
Zurück zum Zitat Bubeck, S., Munos, R., Stoltz, G., Szepesvari. C.: X-armed Bandits. J. Mach. Learn. Res. 12, 1655–1695 (2011) Bubeck, S., Munos, R., Stoltz, G., Szepesvari. C.: X-armed Bandits. J. Mach. Learn. Res. 12, 1655–1695 (2011)
22.
Zurück zum Zitat Scott, S.L.: A modern Bayesian look at the multi-armed bandits. Appl. Stochast. Models Bus. Indus. 26(6), 639–658 (2010)MathSciNetCrossRef Scott, S.L.: A modern Bayesian look at the multi-armed bandits. Appl. Stochast. Models Bus. Indus. 26(6), 639–658 (2010)MathSciNetCrossRef
24.
Zurück zum Zitat Garnett, R., Osborne, M., Roberts, S.: Bayesian optimization for sensor set selection. In: Proceedings of the 9th ACM/IEEE International Conference on Information Processing in Sensor Network, pp. 209–219 (2010) Garnett, R., Osborne, M., Roberts, S.: Bayesian optimization for sensor set selection. In: Proceedings of the 9th ACM/IEEE International Conference on Information Processing in Sensor Network, pp. 209–219 (2010)
25.
Zurück zum Zitat Park, J., Law, K.H.: Bayesian ascent: a data-driven optimization scheme for real-time control with application to wind farm power maximization. IEEE Trans. Control Syst. Technol. 24(5), 1655–1668 (2016)CrossRef Park, J., Law, K.H.: Bayesian ascent: a data-driven optimization scheme for real-time control with application to wind farm power maximization. IEEE Trans. Control Syst. Technol. 24(5), 1655–1668 (2016)CrossRef
26.
Zurück zum Zitat Duvenand, D.K.: Automatic model construction with Gaussian processes. Ph.D. Thesis, University of Cambridge (2014) Duvenand, D.K.: Automatic model construction with Gaussian processes. Ph.D. Thesis, University of Cambridge (2014)
27.
Zurück zum Zitat Genton, M.G.: Classes of kernels for machine learning: a statistics perspectives. J. Mach. Learn. Res. 2, 299–312 (2001)MathSciNetMATH Genton, M.G.: Classes of kernels for machine learning: a statistics perspectives. J. Mach. Learn. Res. 2, 299–312 (2001)MathSciNetMATH
28.
Zurück zum Zitat Rasmussen, C.E., Nickisch, H.: Gaussian processes for machine learning (GPML) toolbox. J. Mach. Learn. Res. 11, 3011–3015 (2010)MathSciNetMATH Rasmussen, C.E., Nickisch, H.: Gaussian processes for machine learning (GPML) toolbox. J. Mach. Learn. Res. 11, 3011–3015 (2010)MathSciNetMATH
30.
Zurück zum Zitat Sobel, W.: MTConnect Standard. Part 1—Overview and Protocol, Version 1.3.0 (2015) Sobel, W.: MTConnect Standard. Part 1—Overview and Protocol, Version 1.3.0 (2015)
31.
Zurück zum Zitat Vijayaraghavan, A., Dornfeld, D.: Automated energy monitoring of machine tools. CIRP Ann. Manuf. Technol. 59, 21–24 (2010)CrossRef Vijayaraghavan, A., Dornfeld, D.: Automated energy monitoring of machine tools. CIRP Ann. Manuf. Technol. 59, 21–24 (2010)CrossRef
32.
Zurück zum Zitat Bhinge, R., Biswas, N., Dornfeld, D., Park, J., Law, K.H., Helu, M., Rachuri, S.: An intelligent machine monitoring system for energy prediction using a Gaussian process regression. In: IEEE International Conference on Big Data, pp. 978–986. IEEE (2014) Bhinge, R., Biswas, N., Dornfeld, D., Park, J., Law, K.H., Helu, M., Rachuri, S.: An intelligent machine monitoring system for energy prediction using a Gaussian process regression. In: IEEE International Conference on Big Data, pp. 978–986. IEEE (2014)
33.
Zurück zum Zitat Fan, J., Han, F., Liu, H.: Challenges of big data analysis. Natl. Sci. Rev. 1(2), 293–314 (2014)CrossRef Fan, J., Han, F., Liu, H.: Challenges of big data analysis. Natl. Sci. Rev. 1(2), 293–314 (2014)CrossRef
34.
Zurück zum Zitat Kannatey-Asibu, E., Dornfeld, D.A.: A study of tool wear using statistical analysis of metal-cutting acoustic emission. Wear 76(2), 247–261 (1982)CrossRef Kannatey-Asibu, E., Dornfeld, D.A.: A study of tool wear using statistical analysis of metal-cutting acoustic emission. Wear 76(2), 247–261 (1982)CrossRef
35.
Zurück zum Zitat Dimla, D., Lister, M.: Online metal cutting tool condition monitoring - I: force and vibration analyses. Int. J. Mach. Tools Manuf. 40(5), 739–768 (2000)CrossRef Dimla, D., Lister, M.: Online metal cutting tool condition monitoring - I: force and vibration analyses. Int. J. Mach. Tools Manuf. 40(5), 739–768 (2000)CrossRef
36.
Zurück zum Zitat Stoica, P., Moses, R.L.: Spectral Analysis of Signals, vol. 452. Pearson Prentice Hall, Upper Saddle River (2005) Stoica, P., Moses, R.L.: Spectral Analysis of Signals, vol. 452. Pearson Prentice Hall, Upper Saddle River (2005)
37.
Zurück zum Zitat Allen, R.L., Mills, D.: Signal Analysis: Time, Frequency, Scale, and Structure. Wiley, New York (2004) Allen, R.L., Mills, D.: Signal Analysis: Time, Frequency, Scale, and Structure. Wiley, New York (2004)
38.
Zurück zum Zitat Welch, P.: The use of Fast Fourier Transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Trans. Audio Electroacoust. 15(2), 70–73 (1967)CrossRef Welch, P.: The use of Fast Fourier Transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Trans. Audio Electroacoust. 15(2), 70–73 (1967)CrossRef
39.
Zurück zum Zitat Williams, C.K., Rasmussen, C.E.: Gaussian processes for regression. In: Advances in Neural Information Processing Systems, pp. 514–520 (1996) Williams, C.K., Rasmussen, C.E.: Gaussian processes for regression. In: Advances in Neural Information Processing Systems, pp. 514–520 (1996)
40.
Zurück zum Zitat Wilson, A.G., Adams, R.P.: Gaussian process kernels for pattern discovery and extrapolation. In: Proceedings of the 30th International Conference on Machine Learning, ICML 2013, vol. 28, pp. III-1067–III-1075 (2013) Wilson, A.G., Adams, R.P.: Gaussian process kernels for pattern discovery and extrapolation. In: Proceedings of the 30th International Conference on Machine Learning, ICML 2013, vol. 28, pp. III-1067–III-1075 (2013)
41.
Zurück zum Zitat Mockus, J., Fretitas, A., Castelanous, J.A.: Toward Global Optimization. North-Holland, Amsterdam (1978) Mockus, J., Fretitas, A., Castelanous, J.A.: Toward Global Optimization. North-Holland, Amsterdam (1978)
42.
Zurück zum Zitat Park, J., Law, K.H.: Cooperative wind turbine control for maximizing wind farm power using sequential convex programming. Energy Convers. Manag. 101, 295–316 (2015)CrossRef Park, J., Law, K.H.: Cooperative wind turbine control for maximizing wind farm power using sequential convex programming. Energy Convers. Manag. 101, 295–316 (2015)CrossRef
43.
Zurück zum Zitat Park, J., Kwon, S., Law, K.H.: A data-driven, cooperative approach for wind farm control: a wind tunnel experimentation. Energies 10, 852 (2017)CrossRef Park, J., Kwon, S., Law, K.H.: A data-driven, cooperative approach for wind farm control: a wind tunnel experimentation. Energies 10, 852 (2017)CrossRef
44.
Zurück zum Zitat Snelson, E., Ghahramani, Z.: Sparse Gaussian processes using pseudo-inputs. In: Neural Information Processing Systems (NIPS) Conference, pp. 1257–1264 (2005) Snelson, E., Ghahramani, Z.: Sparse Gaussian processes using pseudo-inputs. In: Neural Information Processing Systems (NIPS) Conference, pp. 1257–1264 (2005)
45.
Zurück zum Zitat Quiñonero-Candela, J., Rasmussen, C.E.: A unifying view of sparse approximate Gaussian process regression. J. Mach. Learn. Res. 6, 1939–1959 (2005)MathSciNetMATH Quiñonero-Candela, J., Rasmussen, C.E.: A unifying view of sparse approximate Gaussian process regression. J. Mach. Learn. Res. 6, 1939–1959 (2005)MathSciNetMATH
46.
Zurück zum Zitat Ranganathan, A., Yang, M.H., Ho, J.: Online sparse Gaussian process regression and its applications. IEEE Trans. Image Process. 20(2), 391–404 (2011)MathSciNetCrossRef Ranganathan, A., Yang, M.H., Ho, J.: Online sparse Gaussian process regression and its applications. IEEE Trans. Image Process. 20(2), 391–404 (2011)MathSciNetCrossRef
47.
Zurück zum Zitat Park, J., Bhinge, R., Law, K.H., Dornfeld, D., Mason, C., Rachuri, S.: Real time energy prediction for a milling machine tool using sparse Gaussian process regression. In: International Conference on Big Data, pp. 1451–1460 (2015) Park, J., Bhinge, R., Law, K.H., Dornfeld, D., Mason, C., Rachuri, S.: Real time energy prediction for a milling machine tool using sparse Gaussian process regression. In: International Conference on Big Data, pp. 1451–1460 (2015)
Metadaten
Titel
Data Driven Analytics (Machine Learning) for System Characterization, Diagnostics and Control Optimization
verfasst von
Jinkyoo Park
Max Ferguson
Kincho H. Law
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-91635-4_2

Premium Partner