Skip to main content
Erschienen in: Journal of Intelligent Manufacturing 6/2015

26.11.2013

Autoregressive coefficient-invariant control chart pattern recognition in autocorrelated manufacturing processes using neural network ensemble

verfasst von: Wen-An Yang, Wei Zhou

Erschienen in: Journal of Intelligent Manufacturing | Ausgabe 6/2015

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Pattern recognition is an important issue in statistical process control because unnatural control chart patterns (CCPs) exhibited on control charts can be associated with specific causes that adversely affect the manufacturing process. In recent years, many machine learning techniques [e.g., artificial neural networks (ANNs) and support vector machine (SVM)] have been successfully used to the CCP recognition (CCPR) in autocorrelated manufacturing processes. However, these existing researches can only detect and classify unnatural CCPs but do not provide more detailed process information, for example the autocorrelation level, which would be very useful for quality practitioners to search the assignable causes that give rise to the out-of-control situation. This study proposes a neural network ensemble-enabled autoregressive coefficient-invariant CCPR model for on-line recognition of seven typical types of unnatural CCP, assuming that the process observations are AR(1) correlated over time with unknown constant autoregressive coefficient. In this model, each individual back propagation network (BPN) is trained to recognize only CCPs with the specific autoregressive coefficient of the underlying process, while the outputs of all these individual BPNs are combined via a learning vector quantization network (LVQN). The experimental results indicate that the proposed CCPR model can not only accurately recognize the specific CCP types but also efficiently identify the autoregressive coefficient of the underlying autocorrelated manufacturing process. Empirical comparisons also show that the proposed CCPR model outperform other existing CCPR approaches in literature. In addition, a demonstrative application is provided to illustrate the utilization of the proposed CCPR model to the CCPR in autocorrelated manufacturing processes.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Aparisi, F., Avendaño, G., & Sanz, J. (2006). Techniques to interpret T2 control chart signals. IIE Transactions, 38(8), 647–657 Aparisi, F., Avendaño, G., & Sanz, J. (2006). Techniques to interpret T2 control chart signals. IIE Transactions, 38(8), 647–657
Zurück zum Zitat Barghash, M. A., & Santarisi, N. S. (2004). Pattern recognition of control charts using artificial neural networks—analyzing the effect of the training parameters. Journal of Intelligent Manufacturing, 15(5), 635–644.CrossRef Barghash, M. A., & Santarisi, N. S. (2004). Pattern recognition of control charts using artificial neural networks—analyzing the effect of the training parameters. Journal of Intelligent Manufacturing, 15(5), 635–644.CrossRef
Zurück zum Zitat Box, G. E. P., Jenkins, G. M., & Reinsel, G. C. (2008). Time series analysis: Forecasting and control (4th ed.). Englewood Cliffs, NJ: Prentice Hall.CrossRef Box, G. E. P., Jenkins, G. M., & Reinsel, G. C. (2008). Time series analysis: Forecasting and control (4th ed.). Englewood Cliffs, NJ: Prentice Hall.CrossRef
Zurück zum Zitat Cheng, C.-S. (1997). A neural network approach for the analysis of control chart patterns. International Journal of Production Research, 35(3), 667–697.CrossRefMATH Cheng, C.-S. (1997). A neural network approach for the analysis of control chart patterns. International Journal of Production Research, 35(3), 667–697.CrossRefMATH
Zurück zum Zitat Cheng, C.-S., & Cheng, H.-P. (2008). Identifying the source of variance shifts in the multivariate process using neural networks and support vector machines. Expert Systems with Applications, 35(1–2), 198–206.CrossRef Cheng, C.-S., & Cheng, H.-P. (2008). Identifying the source of variance shifts in the multivariate process using neural networks and support vector machines. Expert Systems with Applications, 35(1–2), 198–206.CrossRef
Zurück zum Zitat Chinnam, R. B. (2002). Support vector machines for recognizing shifts in correlated and other manufacturing processes. International Journal of Production Research, 40(17), 4449–4466.CrossRefMATH Chinnam, R. B. (2002). Support vector machines for recognizing shifts in correlated and other manufacturing processes. International Journal of Production Research, 40(17), 4449–4466.CrossRefMATH
Zurück zum Zitat Datta, S., & McCormick, W. P. (1995). Bootstrap inference for a first-order autoregression with positive innovations. Journal of the American Statistical Association, 90(432), 1289–1300.MathSciNetCrossRefMATH Datta, S., & McCormick, W. P. (1995). Bootstrap inference for a first-order autoregression with positive innovations. Journal of the American Statistical Association, 90(432), 1289–1300.MathSciNetCrossRefMATH
Zurück zum Zitat Davis, R. B., & Woodall, W. H. (1988). Performance of the control chart trend rule under linear shift. Journal of Quality Technology, 20(4), 260–262. Davis, R. B., & Woodall, W. H. (1988). Performance of the control chart trend rule under linear shift. Journal of Quality Technology, 20(4), 260–262.
Zurück zum Zitat DeSieno, D. (1988). Adding a conscience to competitive learning. In Proceedings of international joint conference on neural networks (pp. 117–124). San Diego, CA: IEEE Press. DeSieno, D. (1988). Adding a conscience to competitive learning. In Proceedings of international joint conference on neural networks (pp. 117–124). San Diego, CA: IEEE Press.
Zurück zum Zitat Du, S. C., & Lv, J. (2013). Minimal Euclidean distance chart based on support vector regression for monitoring mean shifts of auto-correlated processes. International Journal of Production Economics, 141(1), 377–387.CrossRef Du, S. C., & Lv, J. (2013). Minimal Euclidean distance chart based on support vector regression for monitoring mean shifts of auto-correlated processes. International Journal of Production Economics, 141(1), 377–387.CrossRef
Zurück zum Zitat El-Midany, T. T., El-Baz, M. A., & Abd-Elwahed, M. S. (2010). A proposed framework for control chart pattern recognition in multivariate process using artificial neural networks. Expert Systems with Applications, 37(2), 1035–1042.CrossRef El-Midany, T. T., El-Baz, M. A., & Abd-Elwahed, M. S. (2010). A proposed framework for control chart pattern recognition in multivariate process using artificial neural networks. Expert Systems with Applications, 37(2), 1035–1042.CrossRef
Zurück zum Zitat Grant, E. L., & Leavenworth, R. S. (1996). Statistical quality control (7th ed.). New York: McGraw-Hill. Grant, E. L., & Leavenworth, R. S. (1996). Statistical quality control (7th ed.). New York: McGraw-Hill.
Zurück zum Zitat Gu, N., Cao, Z. Q., Xie, L. J., et al. (2012). Identification of concurrent control chart patterns with singular spectrum analysis and learning vector quantization. Journal of Intelligent Manufacturing,. doi:10.1007/s10845-012-0659-0. Gu, N., Cao, Z. Q., Xie, L. J., et al. (2012). Identification of concurrent control chart patterns with singular spectrum analysis and learning vector quantization. Journal of Intelligent Manufacturing,. doi:10.​1007/​s10845-012-0659-0.
Zurück zum Zitat Guh, R.-S. (2002). Robustness of the neural network based control chart pattern recognition system to non-normality. International Journal of Quality and Reliability Management, 19(1), 97–112.CrossRef Guh, R.-S. (2002). Robustness of the neural network based control chart pattern recognition system to non-normality. International Journal of Quality and Reliability Management, 19(1), 97–112.CrossRef
Zurück zum Zitat Guh, R.-S. (2004). Optimizing feedforward neural networks for control chart pattern recognition through genetic algorithms. International Journal of Pattern Recognition and Artificial Intelligence, 18(2), 75–99.CrossRef Guh, R.-S. (2004). Optimizing feedforward neural networks for control chart pattern recognition through genetic algorithms. International Journal of Pattern Recognition and Artificial Intelligence, 18(2), 75–99.CrossRef
Zurück zum Zitat Guh, R.-S. (2005). A hybrid learning-based model for on-line detection and analysis of control chart patterns. Computers and Industrial Engineering, 49(1), 35–62.CrossRefADS Guh, R.-S. (2005). A hybrid learning-based model for on-line detection and analysis of control chart patterns. Computers and Industrial Engineering, 49(1), 35–62.CrossRefADS
Zurück zum Zitat Guh, R.-S. (2008). Real-time recognition of control chart patterns in autocorrelated manufacturing processes using a learning vector quantization network-based approach. International Journal of Production Research, 46(14), 3959–3991.CrossRefMATH Guh, R.-S. (2008). Real-time recognition of control chart patterns in autocorrelated manufacturing processes using a learning vector quantization network-based approach. International Journal of Production Research, 46(14), 3959–3991.CrossRefMATH
Zurück zum Zitat Guh, R.-S., & Hsieh, Y.-C. (1999). A neural network based model for abnormal pattern recognition of control charts. Computers and Industrial Engineering, 36(1), 97–108.CrossRef Guh, R.-S., & Hsieh, Y.-C. (1999). A neural network based model for abnormal pattern recognition of control charts. Computers and Industrial Engineering, 36(1), 97–108.CrossRef
Zurück zum Zitat Guh, R. S., & Shiue, Y. R. (2008). An effective application of decision tree learning for online detection of mean shifts in multivariate control charts. Computers and Industrial Engineering, 55(2), 475–493.CrossRef Guh, R. S., & Shiue, Y. R. (2008). An effective application of decision tree learning for online detection of mean shifts in multivariate control charts. Computers and Industrial Engineering, 55(2), 475–493.CrossRef
Zurück zum Zitat Guh, R.-S., & Tannock, J. D. T. (1999). A neural network approach to characterize pattern parameters in process control charts. Journal of Intelligent Manufacturing, 10(5), 449–462.CrossRef Guh, R.-S., & Tannock, J. D. T. (1999). A neural network approach to characterize pattern parameters in process control charts. Journal of Intelligent Manufacturing, 10(5), 449–462.CrossRef
Zurück zum Zitat He, S.-G., He, Z., & Wang, G. A. (2013). Online monitoring and fault identification of mean shifts in bivariate processes using decision tree learning techniques. Journal of Intelligent Manufacturing, 24, 25–34.CrossRef He, S.-G., He, Z., & Wang, G. A. (2013). Online monitoring and fault identification of mean shifts in bivariate processes using decision tree learning techniques. Journal of Intelligent Manufacturing, 24, 25–34.CrossRef
Zurück zum Zitat Hsu, C.-W., Chang, C.-C., & Lin, C.-J. (2010). A practical guide to support vector classification. Technical report: Department of Computer Science and Information Engineering, National Taiwan University. Hsu, C.-W., Chang, C.-C., & Lin, C.-J. (2010). A practical guide to support vector classification. Technical report: Department of Computer Science and Information Engineering, National Taiwan University.
Zurück zum Zitat Hwarng, H. B. (1995). Multilayer perceptions for detecting cyclic data on control charts. International Journal of Production Research, 33(11), 3101–3117.CrossRefMATH Hwarng, H. B. (1995). Multilayer perceptions for detecting cyclic data on control charts. International Journal of Production Research, 33(11), 3101–3117.CrossRefMATH
Zurück zum Zitat Hwarng, H. B. (2004). Detecting process mean shift in the presence of autocorrelation: A neural-network based monitoring scheme. International Journal of Production Research, 42(3), 573– 595. Hwarng, H. B. (2004). Detecting process mean shift in the presence of autocorrelation: A neural-network based monitoring scheme. International Journal of Production Research, 42(3), 573– 595.
Zurück zum Zitat Hwarng, H. B. (2005). Simultaneous identification of mean shift and correlation change in AR(1) processes. International Journal of Production Research, 43(9), 1761–1783.CrossRefMATH Hwarng, H. B. (2005). Simultaneous identification of mean shift and correlation change in AR(1) processes. International Journal of Production Research, 43(9), 1761–1783.CrossRefMATH
Zurück zum Zitat Hwarng, H. B., & Hubele, N. F. (1993a). X-bar control chart pattern identification through efficient off-line neural network training. IIE Transactions, 25(3), 27–40.CrossRef Hwarng, H. B., & Hubele, N. F. (1993a). X-bar control chart pattern identification through efficient off-line neural network training. IIE Transactions, 25(3), 27–40.CrossRef
Zurück zum Zitat Hwarng, H. B., & Hubele, N. F. (1993b). Back-propagation pattern recognizers for X-bar control charts: Methodology and performance. Computers and Industrial Engineering, 24(2), 219–235.CrossRef Hwarng, H. B., & Hubele, N. F. (1993b). Back-propagation pattern recognizers for X-bar control charts: Methodology and performance. Computers and Industrial Engineering, 24(2), 219–235.CrossRef
Zurück zum Zitat Jiang, P. Y., Liu, D. Y., & Zeng, Z. J. (2009). Recognizing control chart patterns with neural network and numerical fitting. Journal of Intelligent Manufacturing, 20, 625–635.CrossRef Jiang, P. Y., Liu, D. Y., & Zeng, Z. J. (2009). Recognizing control chart patterns with neural network and numerical fitting. Journal of Intelligent Manufacturing, 20, 625–635.CrossRef
Zurück zum Zitat Kohonen, T. (2001). Self-organizing maps, 3rd extended edition. In Springer series in information sciences (Vol. 30). Springer, Berlin, Heidelberg, New York. Kohonen, T. (2001). Self-organizing maps, 3rd extended edition. In Springer series in information sciences (Vol. 30). Springer, Berlin, Heidelberg, New York.
Zurück zum Zitat Kohonen, T., Barna, G., & Chrisley, R. (1988). Statistical pattern recognition with neural networks: Benchmarking studies. In Proceedings of international joint conference on neural networks (pp. 161–168). San Diego, CA: IEEE Press. Kohonen, T., Barna, G., & Chrisley, R. (1988). Statistical pattern recognition with neural networks: Benchmarking studies. In Proceedings of international joint conference on neural networks (pp. 161–168). San Diego, CA: IEEE Press.
Zurück zum Zitat Lapedes, A., & Farber, R. (1988). How neural nets work. In Z. A. Anderson (Ed.), Neural information processing systems (pp. 442–456). New York: American Institute of Physics. Lapedes, A., & Farber, R. (1988). How neural nets work. In Z. A. Anderson (Ed.), Neural information processing systems (pp. 442–456). New York: American Institute of Physics.
Zurück zum Zitat Lin, S.-Y., Guh, R.-S., & Shiue, Y.-R. (2011). Effective recognition of control chart patterns in autocorrelated data using a support vector machine based approach. Computers and Industrial Engineering, 61(4), 1123–1134.CrossRef Lin, S.-Y., Guh, R.-S., & Shiue, Y.-R. (2011). Effective recognition of control chart patterns in autocorrelated data using a support vector machine based approach. Computers and Industrial Engineering, 61(4), 1123–1134.CrossRef
Zurück zum Zitat Low, C., Hsu, C. M., & Yu, F. J. (2003). Analysis of variations in a multi-variate process using neural networks. International Journal of Advanced Manufacturing Technology, 22(11–12), 911–921.CrossRef Low, C., Hsu, C. M., & Yu, F. J. (2003). Analysis of variations in a multi-variate process using neural networks. International Journal of Advanced Manufacturing Technology, 22(11–12), 911–921.CrossRef
Zurück zum Zitat Lucy-Bouler, T. L. (1993). Application to forecasting of neural network recognition of shifts and trends in quality control data. In Proceedings of world congress on neural networks (pp. 631–633). Portland, UK: IEEE Press. Lucy-Bouler, T. L. (1993). Application to forecasting of neural network recognition of shifts and trends in quality control data. In Proceedings of world congress on neural networks (pp. 631–633). Portland, UK: IEEE Press.
Zurück zum Zitat Minitab Inc. (2006). Meet MINITAB release 15. State College, PA: Minitab. Minitab Inc. (2006). Meet MINITAB release 15. State College, PA: Minitab.
Zurück zum Zitat Montgomery, D. C. (2009). Introduction to statistical quality control (6th ed.). New York: Wiley. Montgomery, D. C. (2009). Introduction to statistical quality control (6th ed.). New York: Wiley.
Zurück zum Zitat Niaki, S. T. A., & Abbasi, B. (2005). Fault diagnosis in multivariate control charts using artificial neural networks. International Quality and Reliability Engineering, 21(8), 825–840. Niaki, S. T. A., & Abbasi, B. (2005). Fault diagnosis in multivariate control charts using artificial neural networks. International Quality and Reliability Engineering, 21(8), 825–840.
Zurück zum Zitat Pacella, M., & Semeraro, Q. (2007). Using recurrent neural networks to detect changes in autocorrelated manufacturing processes for quality monitoring. Computers and Industrial Engineering, 52(4), 502–520.CrossRef Pacella, M., & Semeraro, Q. (2007). Using recurrent neural networks to detect changes in autocorrelated manufacturing processes for quality monitoring. Computers and Industrial Engineering, 52(4), 502–520.CrossRef
Zurück zum Zitat Packianather, M. S., Drake, P. R., & Rowlands, H. (2000). Optimizing the parameters of multilayered feedforward neural networks through Taguchi design of experiments. Quality and Reliability Engineering International, 16(6), 461–473.CrossRef Packianather, M. S., Drake, P. R., & Rowlands, H. (2000). Optimizing the parameters of multilayered feedforward neural networks through Taguchi design of experiments. Quality and Reliability Engineering International, 16(6), 461–473.CrossRef
Zurück zum Zitat Pandit, S. M., & Wu, S. (1983). Time series and system analysis with applications. New York: Wiley.MATH Pandit, S. M., & Wu, S. (1983). Time series and system analysis with applications. New York: Wiley.MATH
Zurück zum Zitat Runger, G. C., Willemain, T. R., & Prabhu, S. (1995). Average run lengths for CUSUM control charts applied to residuals. Communications in Statistics-Theory and Methods, 24(1), 273–282.CrossRefMATH Runger, G. C., Willemain, T. R., & Prabhu, S. (1995). Average run lengths for CUSUM control charts applied to residuals. Communications in Statistics-Theory and Methods, 24(1), 273–282.CrossRefMATH
Zurück zum Zitat Salehi, M., Bahreininejad, A., & Nakhai, I. (2011). On-line analysis of out-of-control signals in multivariate manufacturing processes using a hybrid learning-based model. Neurocomputing, 74(12–13), 2083–2095.CrossRef Salehi, M., Bahreininejad, A., & Nakhai, I. (2011). On-line analysis of out-of-control signals in multivariate manufacturing processes using a hybrid learning-based model. Neurocomputing, 74(12–13), 2083–2095.CrossRef
Zurück zum Zitat Tsacle, E. G., & Aly, N. A. (1996). An expert system model for implementing statistical process control in the health care industry. Computers and Industrial Engineering, 31(1–2), 447–450.CrossRef Tsacle, E. G., & Aly, N. A. (1996). An expert system model for implementing statistical process control in the health care industry. Computers and Industrial Engineering, 31(1–2), 447–450.CrossRef
Zurück zum Zitat Wang, C.-H., Dong, T.-P., & Kuo, W. (2009). A hybrid approach for identification of concurrent control chart patterns. Journal of Intelligent Manufacturing, 20, 409–419.CrossRef Wang, C.-H., Dong, T.-P., & Kuo, W. (2009). A hybrid approach for identification of concurrent control chart patterns. Journal of Intelligent Manufacturing, 20, 409–419.CrossRef
Zurück zum Zitat Wang, C.-H., & Kuo, W. (2007). Identification of control chart patterns using wavelet filtering and robust fuzzy clustering. Journal of Intelligent Manufacturing, 18, 343–350.CrossRef Wang, C.-H., & Kuo, W. (2007). Identification of control chart patterns using wavelet filtering and robust fuzzy clustering. Journal of Intelligent Manufacturing, 18, 343–350.CrossRef
Zurück zum Zitat Wang, T. Y., & Chen, L. H. (2002). Mean shifts detection and classification in multivariate process: A neural-fuzzy approach. Journal of Intelligent Manufacturing, 13(3), 211–221.CrossRef Wang, T. Y., & Chen, L. H. (2002). Mean shifts detection and classification in multivariate process: A neural-fuzzy approach. Journal of Intelligent Manufacturing, 13(3), 211–221.CrossRef
Zurück zum Zitat Wardell, D. G., Moskowitz, H., & Plante, R. D. (1994). Run-length distributions of special-cause control charts for correlated processes. Technometrics, 36(1), 3–17.MathSciNetCrossRefMATH Wardell, D. G., Moskowitz, H., & Plante, R. D. (1994). Run-length distributions of special-cause control charts for correlated processes. Technometrics, 36(1), 3–17.MathSciNetCrossRefMATH
Zurück zum Zitat Western Electric Company. (1958). Statistical quality control handbook. Indianapolis: Western Electric. Western Electric Company. (1958). Statistical quality control handbook. Indianapolis: Western Electric.
Zurück zum Zitat Wu, B., & Yu, J. B. (2009). A neural network ensemble model for on-line monitoring of process mean and variance shifts in correlated processes. Expert Systems with Applications, 36(1), 909–921.CrossRefADS Wu, B., & Yu, J. B. (2009). A neural network ensemble model for on-line monitoring of process mean and variance shifts in correlated processes. Expert Systems with Applications, 36(1), 909–921.CrossRefADS
Zurück zum Zitat Zobel, C. W., Cook, D. F., & Nottingham, Q. J. (2004). An augmented neural network classification approach to detecting mean shifts in correlated manufacturing process parameters. International Journal of Production Research, 42(4), 741–758.CrossRef Zobel, C. W., Cook, D. F., & Nottingham, Q. J. (2004). An augmented neural network classification approach to detecting mean shifts in correlated manufacturing process parameters. International Journal of Production Research, 42(4), 741–758.CrossRef
Metadaten
Titel
Autoregressive coefficient-invariant control chart pattern recognition in autocorrelated manufacturing processes using neural network ensemble
verfasst von
Wen-An Yang
Wei Zhou
Publikationsdatum
26.11.2013
Verlag
Springer US
Erschienen in
Journal of Intelligent Manufacturing / Ausgabe 6/2015
Print ISSN: 0956-5515
Elektronische ISSN: 1572-8145
DOI
https://doi.org/10.1007/s10845-013-0847-6

Weitere Artikel der Ausgabe 6/2015

Journal of Intelligent Manufacturing 6/2015 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.