Skip to main content
Erschienen in: Journal of Intelligent Manufacturing 3/2016

27.03.2014

A multi-stage control chart pattern recognition scheme based on independent component analysis and support vector machine

verfasst von: Ling-Jing Kao, Tian-Shyug Lee, Chi-Jie Lu

Erschienen in: Journal of Intelligent Manufacturing | Ausgabe 3/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Recognition of unnatural control chart patterns (CCPs) is an important issue because the unnatural CCPs can be associated with specific assignable causes negatively affecting the manufacturing process. By assuming that an unnatural CCP is a combination of normal pattern and process disturbance, a multi-stage control chart pattern recognition scheme which integrates independent component analysis (ICA) and support vector machine (SVM) is proposed in this study. The proposed multi-stage ICA-SVM scheme first uses ICA to extract independent components (ICs) from the monitoring process data containing CCPs. The normal pattern and process disturbance hidden in the process data can be discovered in the ICs. Then, the IC representing the process disturbance can be identified. Finally, the identified IC and the data of the monitoring process are used as input variables to develop three different SVM models for CCP recognition. The simulation results show that the proposed multi-stage ICA-SVM scheme not only produces accurate and stable recognition results but also has better classification accuracy than four competing models.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Assaleh, K., & Al-assaf, Y. (2005). Feature extraction and analysis for classifying causable patterns in control charts. Computer & Industrial Engineering, 49, 168–181.CrossRef Assaleh, K., & Al-assaf, Y. (2005). Feature extraction and analysis for classifying causable patterns in control charts. Computer & Industrial Engineering, 49, 168–181.CrossRef
Zurück zum Zitat Cao, L. J. (2003). Support vector machines experts for time series forecasting. Neurocomputing, 51, 321–339.CrossRef Cao, L. J. (2003). Support vector machines experts for time series forecasting. Neurocomputing, 51, 321–339.CrossRef
Zurück zum Zitat Chan, W., Cheung, K. C., & Harris, C. J. (2001). On the modelling of nonlinear dynamic system using support vector neural networks. Engineering Applications of Artificial Intelligence, 14, 105–113.CrossRef Chan, W., Cheung, K. C., & Harris, C. J. (2001). On the modelling of nonlinear dynamic system using support vector neural networks. Engineering Applications of Artificial Intelligence, 14, 105–113.CrossRef
Zurück zum Zitat Chaudhuri, A., & De, K. (2011). Fuzzy support vector machine for bankruptcy prediction. Applied Soft Computing, 11, 472–486.CrossRef Chaudhuri, A., & De, K. (2011). Fuzzy support vector machine for bankruptcy prediction. Applied Soft Computing, 11, 472–486.CrossRef
Zurück zum Zitat Chawla, M. P. S. (2011). PCA and ICA processing methods for removal of artifacts and noise in electrocardiograms: A survey and comparison. Applied Soft Computing, 11(2), 2216–2226.CrossRef Chawla, M. P. S. (2011). PCA and ICA processing methods for removal of artifacts and noise in electrocardiograms: A survey and comparison. Applied Soft Computing, 11(2), 2216–2226.CrossRef
Zurück zum Zitat Cherkassky, V., & Ma, Y. (2004). Practical selection of SVM parameters and noise estimation for SVM regression. Neural Networks, 17, 113–126.CrossRef Cherkassky, V., & Ma, Y. (2004). Practical selection of SVM parameters and noise estimation for SVM regression. Neural Networks, 17, 113–126.CrossRef
Zurück zum Zitat Cheung, Y. M., & Xu, L. (2001). Independent component ordering in ICA time series analysis. Neurocomputing, 41, 145–152.CrossRef Cheung, Y. M., & Xu, L. (2001). Independent component ordering in ICA time series analysis. Neurocomputing, 41, 145–152.CrossRef
Zurück zum Zitat Chinnam, R. B. (2002). Support vector machines for recognizing shifts in correlated and other manufacturing processes. International Journal of Production Research, 40, 4449–4466.CrossRef Chinnam, R. B. (2002). Support vector machines for recognizing shifts in correlated and other manufacturing processes. International Journal of Production Research, 40, 4449–4466.CrossRef
Zurück zum Zitat Chowdhury, S., Sing, J. K., Basu, D. K., & Nasipuri, M. (2011). Face recognition by generalized two-dimensional FLD method and multi-class support vector machines. Applied Soft Computing, 11(7), 282–292.CrossRef Chowdhury, S., Sing, J. K., Basu, D. K., & Nasipuri, M. (2011). Face recognition by generalized two-dimensional FLD method and multi-class support vector machines. Applied Soft Computing, 11(7), 282–292.CrossRef
Zurück zum Zitat Chuang, C. C., & Lee, Z. J. (2011). Hybrid robust support vector machines for regression with outliers. Applied Soft Computing, 11, 64–72. Chuang, C. C., & Lee, Z. J. (2011). Hybrid robust support vector machines for regression with outliers. Applied Soft Computing, 11, 64–72.
Zurück zum Zitat Das, P., & Banerjee, I. (2011). An hybrid detection system of control chart patterns using cascaded SVM and neural network-based detector. Neural Computing and Applications, 20, 287–296.CrossRef Das, P., & Banerjee, I. (2011). An hybrid detection system of control chart patterns using cascaded SVM and neural network-based detector. Neural Computing and Applications, 20, 287–296.CrossRef
Zurück zum Zitat David, V., & Sanchez, A. (2002). Frontiers of research in BSS/ICA. Neurocomputing, 49, 7–23.CrossRef David, V., & Sanchez, A. (2002). Frontiers of research in BSS/ICA. Neurocomputing, 49, 7–23.CrossRef
Zurück zum Zitat Fatemi Ghomi, S. M. T., Lesany, S. A., & Koochakzadeh, A. (2011). Recognition of unnatural patterns in process control charts through combining two types of neural networks. Applied Soft Computing, 11(8), 5444–5456.CrossRef Fatemi Ghomi, S. M. T., Lesany, S. A., & Koochakzadeh, A. (2011). Recognition of unnatural patterns in process control charts through combining two types of neural networks. Applied Soft Computing, 11(8), 5444–5456.CrossRef
Zurück zum Zitat Gauri, S. K., & Charkaborty, S. (2006). Feature-based recognition of control chart patterns. Computer & Industrial Engineering, 51, 726–742.CrossRef Gauri, S. K., & Charkaborty, S. (2006). Feature-based recognition of control chart patterns. Computer & Industrial Engineering, 51, 726–742.CrossRef
Zurück zum Zitat Gauri, S. K., & Charkaborty, S. (2009). Recognition of control chart patterns using improved selection of features. Computer & Industrial Engineering, 56, 1577–1588.CrossRef Gauri, S. K., & Charkaborty, S. (2009). Recognition of control chart patterns using improved selection of features. Computer & Industrial Engineering, 56, 1577–1588.CrossRef
Zurück zum Zitat Guh, R. S. (2005). A hybrid learning-based model for on-line detection and analysis of control chart patterns. Computer & Industrial Engineering, 49, 35–62.CrossRef Guh, R. S. (2005). A hybrid learning-based model for on-line detection and analysis of control chart patterns. Computer & Industrial Engineering, 49, 35–62.CrossRef
Zurück zum Zitat Guh, R. S., & Shiue, Y. R. (2005). On-line identification of control chart patterns using self-organizing approaches. International Journal of Production Research, 43(6), 1225–1254.CrossRef Guh, R. S., & Shiue, Y. R. (2005). On-line identification of control chart patterns using self-organizing approaches. International Journal of Production Research, 43(6), 1225–1254.CrossRef
Zurück zum Zitat Guh, R. S., & Tannock, J. D. T. (1999). Recognition of control chart concurrent patterns using a neural network approach. International Journal of Production Research, 37(8), 1743–1765.CrossRef Guh, R. S., & Tannock, J. D. T. (1999). Recognition of control chart concurrent patterns using a neural network approach. International Journal of Production Research, 37(8), 1743–1765.CrossRef
Zurück zum Zitat Hachicha, W., & Ghorbel, A. (2012). A survey of control-chart pattern-recognition literature (1991–2010) based on a new conceptual classification scheme. Computers & Industrial Engineering, 63(1), 204–222.CrossRef Hachicha, W., & Ghorbel, A. (2012). A survey of control-chart pattern-recognition literature (1991–2010) based on a new conceptual classification scheme. Computers & Industrial Engineering, 63(1), 204–222.CrossRef
Zurück zum Zitat Hsu, C. C., & Chen, L. S. (2008). Integrate independent component analysis and support vector machine for monitoring Non-Gaussian multivariate process. IEEE international conference on wireless communications, networking and mobile computing (pp. 1–4). Dalian, China. Hsu, C. C., & Chen, L. S. (2008). Integrate independent component analysis and support vector machine for monitoring Non-Gaussian multivariate process. IEEE international conference on wireless communications, networking and mobile computing (pp. 1–4). Dalian, China.
Zurück zum Zitat Hsu, C. C., Chen, M. C., & Chen, L. S. (2010a). Integrating independent component analysis and support vector machine for multivariate process monitoring. Computers & Industrial Engineering, 59(1), 145–156.CrossRef Hsu, C. C., Chen, M. C., & Chen, L. S. (2010a). Integrating independent component analysis and support vector machine for multivariate process monitoring. Computers & Industrial Engineering, 59(1), 145–156.CrossRef
Zurück zum Zitat Hsu, C. C., Chen, M. C., & Chen, L. S. (2010b). Intelligent ICA-SVM fault detector for non-Gaussian multivariate process monitoring. Expert Systems with Applications, 37(4), 3264–3273.CrossRef Hsu, C. C., Chen, M. C., & Chen, L. S. (2010b). Intelligent ICA-SVM fault detector for non-Gaussian multivariate process monitoring. Expert Systems with Applications, 37(4), 3264–3273.CrossRef
Zurück zum Zitat Hsu, C. C., & Cheng, C. Y. (2010). Adaptive chart based on independent component analysis for multivariate statistical process monitoring. International Journal of Innovative Computing, Information and Control, 6(8), 3365–3380. Hsu, C. C., & Cheng, C. Y. (2010). Adaptive chart based on independent component analysis for multivariate statistical process monitoring. International Journal of Innovative Computing, Information and Control, 6(8), 3365–3380.
Zurück zum Zitat Hsu, C. W., & Lin, C. J. (2002). A comparison of methods for multiclass support vector machines. IEEE Transactions on Neural, Network, 13, 415–425.CrossRef Hsu, C. W., & Lin, C. J. (2002). A comparison of methods for multiclass support vector machines. IEEE Transactions on Neural, Network, 13, 415–425.CrossRef
Zurück zum Zitat Hsu, C. W., Chang, C. C., & Lin, C. J. (2003). A practical guide to support vector classification. Technical report, Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan. Hsu, C. W., Chang, C. C., & Lin, C. J. (2003). A practical guide to support vector classification. Technical report, Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan.
Zurück zum Zitat Hyvärinen, A. (1999). Fast and robust fixed-point algorithms for independent component analysis. IEEE Transactions on Neural Networks, 10(3), 623–634.CrossRef Hyvärinen, A. (1999). Fast and robust fixed-point algorithms for independent component analysis. IEEE Transactions on Neural Networks, 10(3), 623–634.CrossRef
Zurück zum Zitat Hyvärinen, A., & Oja, E. (2000). Independent component analysis: Algorithms and applications. Neural Networks, 13, 411–430.CrossRef Hyvärinen, A., & Oja, E. (2000). Independent component analysis: Algorithms and applications. Neural Networks, 13, 411–430.CrossRef
Zurück zum Zitat Hyvärinen, A., Karhunen, J., & Oja, E. (2001). Independent component analysis. New York: Wiley.CrossRef Hyvärinen, A., Karhunen, J., & Oja, E. (2001). Independent component analysis. New York: Wiley.CrossRef
Zurück zum Zitat Kim, K. I., Jung, K., Park, S. H., & Kim, H. J. (2002). Support vector machines for texture classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 1542–1550.CrossRef Kim, K. I., Jung, K., Park, S. H., & Kim, H. J. (2002). Support vector machines for texture classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 1542–1550.CrossRef
Zurück zum Zitat Lin, S. Y., Guh, R. S., & Shiue, Y. R. (2011). Effective recognition of control chart patterns in autocorrelated data using a support vector machine based approach. Computers and Industrial Engineering, 61(4), 1123–1134.CrossRef Lin, S. Y., Guh, R. S., & Shiue, Y. R. (2011). Effective recognition of control chart patterns in autocorrelated data using a support vector machine based approach. Computers and Industrial Engineering, 61(4), 1123–1134.CrossRef
Zurück zum Zitat Lu, C. J. (2012). An independent component analysis-based disturbance separation scheme for statistical process monitoring. Journal of Intelligent Manufacturing, 23, 561–573.CrossRef Lu, C. J. (2012). An independent component analysis-based disturbance separation scheme for statistical process monitoring. Journal of Intelligent Manufacturing, 23, 561–573.CrossRef
Zurück zum Zitat Lu, C. J. (2010). Integrating independent component analysis-based denoising scheme with neural network for stock price prediction. Expert Systems with Applications, 37(10), 7056–7064.CrossRef Lu, C. J. (2010). Integrating independent component analysis-based denoising scheme with neural network for stock price prediction. Expert Systems with Applications, 37(10), 7056–7064.CrossRef
Zurück zum Zitat Lu, C. J., & Tsai, D. M. (2008). Independent component analysis-based defect detection in patterned liquid crystal display surfaces. Image & Vision Computing, 26(7), 955–970.CrossRef Lu, C. J., & Tsai, D. M. (2008). Independent component analysis-based defect detection in patterned liquid crystal display surfaces. Image & Vision Computing, 26(7), 955–970.CrossRef
Zurück zum Zitat Lu, C. J., Lee, T. S., & Chiu, C. C. (2009). Financial time series forecasting using independent component analysis and support vector regression. Decision Support Systems, 47(2), 115–125.CrossRef Lu, C. J., Lee, T. S., & Chiu, C. C. (2009). Financial time series forecasting using independent component analysis and support vector regression. Decision Support Systems, 47(2), 115–125.CrossRef
Zurück zum Zitat Lu, C. J., Shao, Y. E., & Li, B. S. (2011). Mixture control chart patterns recognition using independent component analysis and support vector machine. Neurocomputing, 74(11), 1908–1914.CrossRef Lu, C. J., Shao, Y. E., & Li, B. S. (2011). Mixture control chart patterns recognition using independent component analysis and support vector machine. Neurocomputing, 74(11), 1908–1914.CrossRef
Zurück zum Zitat Lu, C. J., Wu, C. M., Keng, C. J., & Chiu, C. C. (2008). Integrated application of SPC/EPC/ICA and neural networks. International Journal of Production Research, 46(4), 873–893.CrossRef Lu, C. J., Wu, C. M., Keng, C. J., & Chiu, C. C. (2008). Integrated application of SPC/EPC/ICA and neural networks. International Journal of Production Research, 46(4), 873–893.CrossRef
Zurück zum Zitat Mitra, V., Wang, C. J., & Banerjee, S. (2007). Text classification: A least square support vector machine approach. Applied Soft Computing, 7(3), 908–914.CrossRef Mitra, V., Wang, C. J., & Banerjee, S. (2007). Text classification: A least square support vector machine approach. Applied Soft Computing, 7(3), 908–914.CrossRef
Zurück zum Zitat Montgomery, D. C. (2001). Introduction to statistical quality control. New York: Wiley. Montgomery, D. C. (2001). Introduction to statistical quality control. New York: Wiley.
Zurück zum Zitat Ranaee, V., & Ebrahimzadeh, A. (2011). Control chart pattern recognition using a novel hybrid intelligent method. Applied Soft Computing, 11(2), 2676–2686. Ranaee, V., & Ebrahimzadeh, A. (2011). Control chart pattern recognition using a novel hybrid intelligent method. Applied Soft Computing, 11(2), 2676–2686.
Zurück zum Zitat Tay, F. E. H., & Cao, L. J. (2003). Support vector machine with adaptive parameters in financial time series forecastin. IEEE Transactions on Neural Networks, 14, 1506–1518. Tay, F. E. H., & Cao, L. J. (2003). Support vector machine with adaptive parameters in financial time series forecastin. IEEE Transactions on Neural Networks, 14, 1506–1518.
Zurück zum Zitat Vapnik, V. (1999). An overview of statistical learning theory. IEEE Transactions on Neural Networks, 5, 988–999. Vapnik, V. (1999). An overview of statistical learning theory. IEEE Transactions on Neural Networks, 5, 988–999.
Zurück zum Zitat Vapnik, V. N. (2000). The nature of statistical learning theory. Berlin: Springer.CrossRef Vapnik, V. N. (2000). The nature of statistical learning theory. Berlin: Springer.CrossRef
Zurück zum Zitat Wang, C. H., Dong, T. P., & Kuo, W. (2009). A hybrid approach for identification of concurrent control chart patterns. Journal of Intelligent Manufacturing, 20, 409–419.CrossRef Wang, C. H., Dong, T. P., & Kuo, W. (2009). A hybrid approach for identification of concurrent control chart patterns. Journal of Intelligent Manufacturing, 20, 409–419.CrossRef
Zurück zum Zitat Wang, C. H., & Kuo, W. (2007). Identification of control chart patterns using wavelet filtering and robust fuzzy clustering. Journal of Intelligent Manufacturing, 18, 343–350.CrossRef Wang, C. H., & Kuo, W. (2007). Identification of control chart patterns using wavelet filtering and robust fuzzy clustering. Journal of Intelligent Manufacturing, 18, 343–350.CrossRef
Zurück zum Zitat Wang, C. H., Kuo, W., & Qi, H. (2007). An integrated approach for process monitoring using wavelet analysis and competitive neural network. International Journal of Production Research, 45(1), 227–244.CrossRef Wang, C. H., Kuo, W., & Qi, H. (2007). An integrated approach for process monitoring using wavelet analysis and competitive neural network. International Journal of Production Research, 45(1), 227–244.CrossRef
Zurück zum Zitat Western Electric Company. (1958). Statistical quality control handbook. Indianapolis, Indiana: Western Electric Co. Inc. Western Electric Company. (1958). Statistical quality control handbook. Indianapolis, Indiana: Western Electric Co. Inc.
Zurück zum Zitat Yang, J. H., & Yang, M. S. (2005). A control chart pattern recognition scheme using a statistical correlation coefficient method. Computers & Industrial Engineering, 48, 205–221.CrossRef Yang, J. H., & Yang, M. S. (2005). A control chart pattern recognition scheme using a statistical correlation coefficient method. Computers & Industrial Engineering, 48, 205–221.CrossRef
Metadaten
Titel
A multi-stage control chart pattern recognition scheme based on independent component analysis and support vector machine
verfasst von
Ling-Jing Kao
Tian-Shyug Lee
Chi-Jie Lu
Publikationsdatum
27.03.2014
Verlag
Springer US
Erschienen in
Journal of Intelligent Manufacturing / Ausgabe 3/2016
Print ISSN: 0956-5515
Elektronische ISSN: 1572-8145
DOI
https://doi.org/10.1007/s10845-014-0903-x

Weitere Artikel der Ausgabe 3/2016

Journal of Intelligent Manufacturing 3/2016 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.