Skip to main content
Top
Published in: Journal of Intelligent Manufacturing 6/2015

26-11-2013

Autoregressive coefficient-invariant control chart pattern recognition in autocorrelated manufacturing processes using neural network ensemble

Authors: Wen-An Yang, Wei Zhou

Published in: Journal of Intelligent Manufacturing | Issue 6/2015

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Pattern recognition is an important issue in statistical process control because unnatural control chart patterns (CCPs) exhibited on control charts can be associated with specific causes that adversely affect the manufacturing process. In recent years, many machine learning techniques [e.g., artificial neural networks (ANNs) and support vector machine (SVM)] have been successfully used to the CCP recognition (CCPR) in autocorrelated manufacturing processes. However, these existing researches can only detect and classify unnatural CCPs but do not provide more detailed process information, for example the autocorrelation level, which would be very useful for quality practitioners to search the assignable causes that give rise to the out-of-control situation. This study proposes a neural network ensemble-enabled autoregressive coefficient-invariant CCPR model for on-line recognition of seven typical types of unnatural CCP, assuming that the process observations are AR(1) correlated over time with unknown constant autoregressive coefficient. In this model, each individual back propagation network (BPN) is trained to recognize only CCPs with the specific autoregressive coefficient of the underlying process, while the outputs of all these individual BPNs are combined via a learning vector quantization network (LVQN). The experimental results indicate that the proposed CCPR model can not only accurately recognize the specific CCP types but also efficiently identify the autoregressive coefficient of the underlying autocorrelated manufacturing process. Empirical comparisons also show that the proposed CCPR model outperform other existing CCPR approaches in literature. In addition, a demonstrative application is provided to illustrate the utilization of the proposed CCPR model to the CCPR in autocorrelated manufacturing processes.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Aparisi, F., Avendaño, G., & Sanz, J. (2006). Techniques to interpret T2 control chart signals. IIE Transactions, 38(8), 647–657 Aparisi, F., Avendaño, G., & Sanz, J. (2006). Techniques to interpret T2 control chart signals. IIE Transactions, 38(8), 647–657
go back to reference Barghash, M. A., & Santarisi, N. S. (2004). Pattern recognition of control charts using artificial neural networks—analyzing the effect of the training parameters. Journal of Intelligent Manufacturing, 15(5), 635–644.CrossRef Barghash, M. A., & Santarisi, N. S. (2004). Pattern recognition of control charts using artificial neural networks—analyzing the effect of the training parameters. Journal of Intelligent Manufacturing, 15(5), 635–644.CrossRef
go back to reference Box, G. E. P., Jenkins, G. M., & Reinsel, G. C. (2008). Time series analysis: Forecasting and control (4th ed.). Englewood Cliffs, NJ: Prentice Hall.CrossRef Box, G. E. P., Jenkins, G. M., & Reinsel, G. C. (2008). Time series analysis: Forecasting and control (4th ed.). Englewood Cliffs, NJ: Prentice Hall.CrossRef
go back to reference Cheng, C.-S. (1997). A neural network approach for the analysis of control chart patterns. International Journal of Production Research, 35(3), 667–697.CrossRefMATH Cheng, C.-S. (1997). A neural network approach for the analysis of control chart patterns. International Journal of Production Research, 35(3), 667–697.CrossRefMATH
go back to reference Cheng, C.-S., & Cheng, H.-P. (2008). Identifying the source of variance shifts in the multivariate process using neural networks and support vector machines. Expert Systems with Applications, 35(1–2), 198–206.CrossRef Cheng, C.-S., & Cheng, H.-P. (2008). Identifying the source of variance shifts in the multivariate process using neural networks and support vector machines. Expert Systems with Applications, 35(1–2), 198–206.CrossRef
go back to reference Chinnam, R. B. (2002). Support vector machines for recognizing shifts in correlated and other manufacturing processes. International Journal of Production Research, 40(17), 4449–4466.CrossRefMATH Chinnam, R. B. (2002). Support vector machines for recognizing shifts in correlated and other manufacturing processes. International Journal of Production Research, 40(17), 4449–4466.CrossRefMATH
go back to reference Datta, S., & McCormick, W. P. (1995). Bootstrap inference for a first-order autoregression with positive innovations. Journal of the American Statistical Association, 90(432), 1289–1300.MathSciNetCrossRefMATH Datta, S., & McCormick, W. P. (1995). Bootstrap inference for a first-order autoregression with positive innovations. Journal of the American Statistical Association, 90(432), 1289–1300.MathSciNetCrossRefMATH
go back to reference Davis, R. B., & Woodall, W. H. (1988). Performance of the control chart trend rule under linear shift. Journal of Quality Technology, 20(4), 260–262. Davis, R. B., & Woodall, W. H. (1988). Performance of the control chart trend rule under linear shift. Journal of Quality Technology, 20(4), 260–262.
go back to reference DeSieno, D. (1988). Adding a conscience to competitive learning. In Proceedings of international joint conference on neural networks (pp. 117–124). San Diego, CA: IEEE Press. DeSieno, D. (1988). Adding a conscience to competitive learning. In Proceedings of international joint conference on neural networks (pp. 117–124). San Diego, CA: IEEE Press.
go back to reference Du, S. C., & Lv, J. (2013). Minimal Euclidean distance chart based on support vector regression for monitoring mean shifts of auto-correlated processes. International Journal of Production Economics, 141(1), 377–387.CrossRef Du, S. C., & Lv, J. (2013). Minimal Euclidean distance chart based on support vector regression for monitoring mean shifts of auto-correlated processes. International Journal of Production Economics, 141(1), 377–387.CrossRef
go back to reference El-Midany, T. T., El-Baz, M. A., & Abd-Elwahed, M. S. (2010). A proposed framework for control chart pattern recognition in multivariate process using artificial neural networks. Expert Systems with Applications, 37(2), 1035–1042.CrossRef El-Midany, T. T., El-Baz, M. A., & Abd-Elwahed, M. S. (2010). A proposed framework for control chart pattern recognition in multivariate process using artificial neural networks. Expert Systems with Applications, 37(2), 1035–1042.CrossRef
go back to reference Grant, E. L., & Leavenworth, R. S. (1996). Statistical quality control (7th ed.). New York: McGraw-Hill. Grant, E. L., & Leavenworth, R. S. (1996). Statistical quality control (7th ed.). New York: McGraw-Hill.
go back to reference Gu, N., Cao, Z. Q., Xie, L. J., et al. (2012). Identification of concurrent control chart patterns with singular spectrum analysis and learning vector quantization. Journal of Intelligent Manufacturing,. doi:10.1007/s10845-012-0659-0. Gu, N., Cao, Z. Q., Xie, L. J., et al. (2012). Identification of concurrent control chart patterns with singular spectrum analysis and learning vector quantization. Journal of Intelligent Manufacturing,. doi:10.​1007/​s10845-012-0659-0.
go back to reference Guh, R.-S. (2002). Robustness of the neural network based control chart pattern recognition system to non-normality. International Journal of Quality and Reliability Management, 19(1), 97–112.CrossRef Guh, R.-S. (2002). Robustness of the neural network based control chart pattern recognition system to non-normality. International Journal of Quality and Reliability Management, 19(1), 97–112.CrossRef
go back to reference Guh, R.-S. (2004). Optimizing feedforward neural networks for control chart pattern recognition through genetic algorithms. International Journal of Pattern Recognition and Artificial Intelligence, 18(2), 75–99.CrossRef Guh, R.-S. (2004). Optimizing feedforward neural networks for control chart pattern recognition through genetic algorithms. International Journal of Pattern Recognition and Artificial Intelligence, 18(2), 75–99.CrossRef
go back to reference Guh, R.-S. (2005). A hybrid learning-based model for on-line detection and analysis of control chart patterns. Computers and Industrial Engineering, 49(1), 35–62.CrossRefADS Guh, R.-S. (2005). A hybrid learning-based model for on-line detection and analysis of control chart patterns. Computers and Industrial Engineering, 49(1), 35–62.CrossRefADS
go back to reference Guh, R.-S. (2008). Real-time recognition of control chart patterns in autocorrelated manufacturing processes using a learning vector quantization network-based approach. International Journal of Production Research, 46(14), 3959–3991.CrossRefMATH Guh, R.-S. (2008). Real-time recognition of control chart patterns in autocorrelated manufacturing processes using a learning vector quantization network-based approach. International Journal of Production Research, 46(14), 3959–3991.CrossRefMATH
go back to reference Guh, R.-S., & Hsieh, Y.-C. (1999). A neural network based model for abnormal pattern recognition of control charts. Computers and Industrial Engineering, 36(1), 97–108.CrossRef Guh, R.-S., & Hsieh, Y.-C. (1999). A neural network based model for abnormal pattern recognition of control charts. Computers and Industrial Engineering, 36(1), 97–108.CrossRef
go back to reference Guh, R. S., & Shiue, Y. R. (2008). An effective application of decision tree learning for online detection of mean shifts in multivariate control charts. Computers and Industrial Engineering, 55(2), 475–493.CrossRef Guh, R. S., & Shiue, Y. R. (2008). An effective application of decision tree learning for online detection of mean shifts in multivariate control charts. Computers and Industrial Engineering, 55(2), 475–493.CrossRef
go back to reference Guh, R.-S., & Tannock, J. D. T. (1999). A neural network approach to characterize pattern parameters in process control charts. Journal of Intelligent Manufacturing, 10(5), 449–462.CrossRef Guh, R.-S., & Tannock, J. D. T. (1999). A neural network approach to characterize pattern parameters in process control charts. Journal of Intelligent Manufacturing, 10(5), 449–462.CrossRef
go back to reference He, S.-G., He, Z., & Wang, G. A. (2013). Online monitoring and fault identification of mean shifts in bivariate processes using decision tree learning techniques. Journal of Intelligent Manufacturing, 24, 25–34.CrossRef He, S.-G., He, Z., & Wang, G. A. (2013). Online monitoring and fault identification of mean shifts in bivariate processes using decision tree learning techniques. Journal of Intelligent Manufacturing, 24, 25–34.CrossRef
go back to reference Hsu, C.-W., Chang, C.-C., & Lin, C.-J. (2010). A practical guide to support vector classification. Technical report: Department of Computer Science and Information Engineering, National Taiwan University. Hsu, C.-W., Chang, C.-C., & Lin, C.-J. (2010). A practical guide to support vector classification. Technical report: Department of Computer Science and Information Engineering, National Taiwan University.
go back to reference Hwarng, H. B. (1995). Multilayer perceptions for detecting cyclic data on control charts. International Journal of Production Research, 33(11), 3101–3117.CrossRefMATH Hwarng, H. B. (1995). Multilayer perceptions for detecting cyclic data on control charts. International Journal of Production Research, 33(11), 3101–3117.CrossRefMATH
go back to reference Hwarng, H. B. (2004). Detecting process mean shift in the presence of autocorrelation: A neural-network based monitoring scheme. International Journal of Production Research, 42(3), 573– 595. Hwarng, H. B. (2004). Detecting process mean shift in the presence of autocorrelation: A neural-network based monitoring scheme. International Journal of Production Research, 42(3), 573– 595.
go back to reference Hwarng, H. B. (2005). Simultaneous identification of mean shift and correlation change in AR(1) processes. International Journal of Production Research, 43(9), 1761–1783.CrossRefMATH Hwarng, H. B. (2005). Simultaneous identification of mean shift and correlation change in AR(1) processes. International Journal of Production Research, 43(9), 1761–1783.CrossRefMATH
go back to reference Hwarng, H. B., & Hubele, N. F. (1993a). X-bar control chart pattern identification through efficient off-line neural network training. IIE Transactions, 25(3), 27–40.CrossRef Hwarng, H. B., & Hubele, N. F. (1993a). X-bar control chart pattern identification through efficient off-line neural network training. IIE Transactions, 25(3), 27–40.CrossRef
go back to reference Hwarng, H. B., & Hubele, N. F. (1993b). Back-propagation pattern recognizers for X-bar control charts: Methodology and performance. Computers and Industrial Engineering, 24(2), 219–235.CrossRef Hwarng, H. B., & Hubele, N. F. (1993b). Back-propagation pattern recognizers for X-bar control charts: Methodology and performance. Computers and Industrial Engineering, 24(2), 219–235.CrossRef
go back to reference Jiang, P. Y., Liu, D. Y., & Zeng, Z. J. (2009). Recognizing control chart patterns with neural network and numerical fitting. Journal of Intelligent Manufacturing, 20, 625–635.CrossRef Jiang, P. Y., Liu, D. Y., & Zeng, Z. J. (2009). Recognizing control chart patterns with neural network and numerical fitting. Journal of Intelligent Manufacturing, 20, 625–635.CrossRef
go back to reference Kohonen, T. (2001). Self-organizing maps, 3rd extended edition. In Springer series in information sciences (Vol. 30). Springer, Berlin, Heidelberg, New York. Kohonen, T. (2001). Self-organizing maps, 3rd extended edition. In Springer series in information sciences (Vol. 30). Springer, Berlin, Heidelberg, New York.
go back to reference Kohonen, T., Barna, G., & Chrisley, R. (1988). Statistical pattern recognition with neural networks: Benchmarking studies. In Proceedings of international joint conference on neural networks (pp. 161–168). San Diego, CA: IEEE Press. Kohonen, T., Barna, G., & Chrisley, R. (1988). Statistical pattern recognition with neural networks: Benchmarking studies. In Proceedings of international joint conference on neural networks (pp. 161–168). San Diego, CA: IEEE Press.
go back to reference Lapedes, A., & Farber, R. (1988). How neural nets work. In Z. A. Anderson (Ed.), Neural information processing systems (pp. 442–456). New York: American Institute of Physics. Lapedes, A., & Farber, R. (1988). How neural nets work. In Z. A. Anderson (Ed.), Neural information processing systems (pp. 442–456). New York: American Institute of Physics.
go back to reference Lin, S.-Y., Guh, R.-S., & Shiue, Y.-R. (2011). Effective recognition of control chart patterns in autocorrelated data using a support vector machine based approach. Computers and Industrial Engineering, 61(4), 1123–1134.CrossRef Lin, S.-Y., Guh, R.-S., & Shiue, Y.-R. (2011). Effective recognition of control chart patterns in autocorrelated data using a support vector machine based approach. Computers and Industrial Engineering, 61(4), 1123–1134.CrossRef
go back to reference Low, C., Hsu, C. M., & Yu, F. J. (2003). Analysis of variations in a multi-variate process using neural networks. International Journal of Advanced Manufacturing Technology, 22(11–12), 911–921.CrossRef Low, C., Hsu, C. M., & Yu, F. J. (2003). Analysis of variations in a multi-variate process using neural networks. International Journal of Advanced Manufacturing Technology, 22(11–12), 911–921.CrossRef
go back to reference Lucy-Bouler, T. L. (1993). Application to forecasting of neural network recognition of shifts and trends in quality control data. In Proceedings of world congress on neural networks (pp. 631–633). Portland, UK: IEEE Press. Lucy-Bouler, T. L. (1993). Application to forecasting of neural network recognition of shifts and trends in quality control data. In Proceedings of world congress on neural networks (pp. 631–633). Portland, UK: IEEE Press.
go back to reference Minitab Inc. (2006). Meet MINITAB release 15. State College, PA: Minitab. Minitab Inc. (2006). Meet MINITAB release 15. State College, PA: Minitab.
go back to reference Montgomery, D. C. (2009). Introduction to statistical quality control (6th ed.). New York: Wiley. Montgomery, D. C. (2009). Introduction to statistical quality control (6th ed.). New York: Wiley.
go back to reference Niaki, S. T. A., & Abbasi, B. (2005). Fault diagnosis in multivariate control charts using artificial neural networks. International Quality and Reliability Engineering, 21(8), 825–840. Niaki, S. T. A., & Abbasi, B. (2005). Fault diagnosis in multivariate control charts using artificial neural networks. International Quality and Reliability Engineering, 21(8), 825–840.
go back to reference Pacella, M., & Semeraro, Q. (2007). Using recurrent neural networks to detect changes in autocorrelated manufacturing processes for quality monitoring. Computers and Industrial Engineering, 52(4), 502–520.CrossRef Pacella, M., & Semeraro, Q. (2007). Using recurrent neural networks to detect changes in autocorrelated manufacturing processes for quality monitoring. Computers and Industrial Engineering, 52(4), 502–520.CrossRef
go back to reference Packianather, M. S., Drake, P. R., & Rowlands, H. (2000). Optimizing the parameters of multilayered feedforward neural networks through Taguchi design of experiments. Quality and Reliability Engineering International, 16(6), 461–473.CrossRef Packianather, M. S., Drake, P. R., & Rowlands, H. (2000). Optimizing the parameters of multilayered feedforward neural networks through Taguchi design of experiments. Quality and Reliability Engineering International, 16(6), 461–473.CrossRef
go back to reference Pandit, S. M., & Wu, S. (1983). Time series and system analysis with applications. New York: Wiley.MATH Pandit, S. M., & Wu, S. (1983). Time series and system analysis with applications. New York: Wiley.MATH
go back to reference Runger, G. C., Willemain, T. R., & Prabhu, S. (1995). Average run lengths for CUSUM control charts applied to residuals. Communications in Statistics-Theory and Methods, 24(1), 273–282.CrossRefMATH Runger, G. C., Willemain, T. R., & Prabhu, S. (1995). Average run lengths for CUSUM control charts applied to residuals. Communications in Statistics-Theory and Methods, 24(1), 273–282.CrossRefMATH
go back to reference Salehi, M., Bahreininejad, A., & Nakhai, I. (2011). On-line analysis of out-of-control signals in multivariate manufacturing processes using a hybrid learning-based model. Neurocomputing, 74(12–13), 2083–2095.CrossRef Salehi, M., Bahreininejad, A., & Nakhai, I. (2011). On-line analysis of out-of-control signals in multivariate manufacturing processes using a hybrid learning-based model. Neurocomputing, 74(12–13), 2083–2095.CrossRef
go back to reference Tsacle, E. G., & Aly, N. A. (1996). An expert system model for implementing statistical process control in the health care industry. Computers and Industrial Engineering, 31(1–2), 447–450.CrossRef Tsacle, E. G., & Aly, N. A. (1996). An expert system model for implementing statistical process control in the health care industry. Computers and Industrial Engineering, 31(1–2), 447–450.CrossRef
go back to reference Wang, C.-H., Dong, T.-P., & Kuo, W. (2009). A hybrid approach for identification of concurrent control chart patterns. Journal of Intelligent Manufacturing, 20, 409–419.CrossRef Wang, C.-H., Dong, T.-P., & Kuo, W. (2009). A hybrid approach for identification of concurrent control chart patterns. Journal of Intelligent Manufacturing, 20, 409–419.CrossRef
go back to reference Wang, C.-H., & Kuo, W. (2007). Identification of control chart patterns using wavelet filtering and robust fuzzy clustering. Journal of Intelligent Manufacturing, 18, 343–350.CrossRef Wang, C.-H., & Kuo, W. (2007). Identification of control chart patterns using wavelet filtering and robust fuzzy clustering. Journal of Intelligent Manufacturing, 18, 343–350.CrossRef
go back to reference Wang, T. Y., & Chen, L. H. (2002). Mean shifts detection and classification in multivariate process: A neural-fuzzy approach. Journal of Intelligent Manufacturing, 13(3), 211–221.CrossRef Wang, T. Y., & Chen, L. H. (2002). Mean shifts detection and classification in multivariate process: A neural-fuzzy approach. Journal of Intelligent Manufacturing, 13(3), 211–221.CrossRef
go back to reference Wardell, D. G., Moskowitz, H., & Plante, R. D. (1994). Run-length distributions of special-cause control charts for correlated processes. Technometrics, 36(1), 3–17.MathSciNetCrossRefMATH Wardell, D. G., Moskowitz, H., & Plante, R. D. (1994). Run-length distributions of special-cause control charts for correlated processes. Technometrics, 36(1), 3–17.MathSciNetCrossRefMATH
go back to reference Western Electric Company. (1958). Statistical quality control handbook. Indianapolis: Western Electric. Western Electric Company. (1958). Statistical quality control handbook. Indianapolis: Western Electric.
go back to reference Wu, B., & Yu, J. B. (2009). A neural network ensemble model for on-line monitoring of process mean and variance shifts in correlated processes. Expert Systems with Applications, 36(1), 909–921.CrossRefADS Wu, B., & Yu, J. B. (2009). A neural network ensemble model for on-line monitoring of process mean and variance shifts in correlated processes. Expert Systems with Applications, 36(1), 909–921.CrossRefADS
go back to reference Zobel, C. W., Cook, D. F., & Nottingham, Q. J. (2004). An augmented neural network classification approach to detecting mean shifts in correlated manufacturing process parameters. International Journal of Production Research, 42(4), 741–758.CrossRef Zobel, C. W., Cook, D. F., & Nottingham, Q. J. (2004). An augmented neural network classification approach to detecting mean shifts in correlated manufacturing process parameters. International Journal of Production Research, 42(4), 741–758.CrossRef
Metadata
Title
Autoregressive coefficient-invariant control chart pattern recognition in autocorrelated manufacturing processes using neural network ensemble
Authors
Wen-An Yang
Wei Zhou
Publication date
26-11-2013
Publisher
Springer US
Published in
Journal of Intelligent Manufacturing / Issue 6/2015
Print ISSN: 0956-5515
Electronic ISSN: 1572-8145
DOI
https://doi.org/10.1007/s10845-013-0847-6

Other articles of this Issue 6/2015

Journal of Intelligent Manufacturing 6/2015 Go to the issue

Premium Partners