Skip to main content
Erschienen in: Neural Computing and Applications 12/2021

10.11.2020 | Original Article

Product failure prediction with missing data using graph neural networks

verfasst von: Seokho Kang

Erschienen in: Neural Computing and Applications | Ausgabe 12/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In real-world production data, missing values often occur randomly or systematically with various missing patterns. Missing values need to be handled properly to build effective prediction models. This paper presents a novel method based on graph representation and graph neural networks for improving prediction in missing value conditions. To utilize the entire information of a training dataset without direct manipulation, all instances of the dataset are represented as graphs of varying sizes, in which nodes and edges represent the observed input variables and their pairwise relationships. Prediction models learn from the graph representations. These models can make predictions of unknown labels for new instances that have arbitrary missing patterns. The superiority of the proposed method was investigated on seven different product failure prediction tasks from a home appliance manufacturer. The proposed method outperformed all other methods in six of the seven tasks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Battaglia PW, Hamrick JB, Bapst V, Sanchez-Gonzalez A, Zambaldi V, Malinowski M, Tacchetti A, Raposo D, Santoro A, Faulkner R, et al (2018) Relational inductive biases, deep learning, and graph networks. arXiv preprint arXiv:180601261 Battaglia PW, Hamrick JB, Bapst V, Sanchez-Gonzalez A, Zambaldi V, Malinowski M, Tacchetti A, Raposo D, Santoro A, Faulkner R, et al (2018) Relational inductive biases, deep learning, and graph networks. arXiv preprint arXiv:​180601261
2.
Zurück zum Zitat Camino RD, Hammerschmidt CA, State R (2019) Improving missing data imputation with deep generative models. arXiv preprint arXiv:190210666 Camino RD, Hammerschmidt CA, State R (2019) Improving missing data imputation with deep generative models. arXiv preprint arXiv:​190210666
3.
Zurück zum Zitat Chien CF, Wang WC, Cheng JC (2007) Data mining for yield enhancement in semiconductor manufacturing and an empirical study. Expert Syst Appl 33(1):192–198CrossRef Chien CF, Wang WC, Cheng JC (2007) Data mining for yield enhancement in semiconductor manufacturing and an empirical study. Expert Syst Appl 33(1):192–198CrossRef
4.
Zurück zum Zitat Chien CF, Liu CW, Chuang SC (2017) Analysing semiconductor manufacturing big data for root cause detection of excursion for yield enhancement. Int J Prod Res 55(17):5095–5107CrossRef Chien CF, Liu CW, Chuang SC (2017) Analysing semiconductor manufacturing big data for root cause detection of excursion for yield enhancement. Int J Prod Res 55(17):5095–5107CrossRef
5.
Zurück zum Zitat Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder-decoder for statistical machine translation. In: Proceedings of conference on empirical methods in natural language processing, pp 1724–1734 Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder-decoder for statistical machine translation. In: Proceedings of conference on empirical methods in natural language processing, pp 1724–1734
6.
Zurück zum Zitat Choudhary AK, Harding JA, Tiwari MK (2009) Data mining in manufacturing: a review based on the kind of knowledge. J Intel Manuf 20(5):501–521CrossRef Choudhary AK, Harding JA, Tiwari MK (2009) Data mining in manufacturing: a review based on the kind of knowledge. J Intel Manuf 20(5):501–521CrossRef
7.
Zurück zum Zitat Choudhury SJ, Pal NR (2019) Imputation of missing data with neural networks for classification. Knowl Based Syst 182:104838CrossRef Choudhury SJ, Pal NR (2019) Imputation of missing data with neural networks for classification. Knowl Based Syst 182:104838CrossRef
8.
Zurück zum Zitat García-Laencina PJ, Sancho-Gómez JL, Figueiras-Vidal AR (2010) Pattern classification with missing data: a review. Neural Comput Appl 19(2):263–282CrossRef García-Laencina PJ, Sancho-Gómez JL, Figueiras-Vidal AR (2010) Pattern classification with missing data: a review. Neural Comput Appl 19(2):263–282CrossRef
9.
Zurück zum Zitat Ghorai S, Mukherjee A, Gangadaran M, Dutta PK (2013) Automatic defect detection on hot-rolled flat steel products. IEEE Trans Instrum Meas 62(3):612–621CrossRef Ghorai S, Mukherjee A, Gangadaran M, Dutta PK (2013) Automatic defect detection on hot-rolled flat steel products. IEEE Trans Instrum Meas 62(3):612–621CrossRef
10.
Zurück zum Zitat Gilmer J, Schoenholz SS, Riley PF, Vinyals O, Dahl GE (2017) Neural message passing for quantum chemistry. In: Proceedings of international conference on machine learning, pp 1263–1272 Gilmer J, Schoenholz SS, Riley PF, Vinyals O, Dahl GE (2017) Neural message passing for quantum chemistry. In: Proceedings of international conference on machine learning, pp 1263–1272
11.
Zurück zum Zitat He H, Garcia EA (2009) Learning from imbalanced data. IEEE Trans Knowl Data Eng 21(9):1263–1284CrossRef He H, Garcia EA (2009) Learning from imbalanced data. IEEE Trans Knowl Data Eng 21(9):1263–1284CrossRef
12.
Zurück zum Zitat He W, Li Z, Chen CLP (2017) A survey of human-centered intelligent robots: issues and challenges. IEEE/CAA J Autom Sin 4(4):602–609CrossRef He W, Li Z, Chen CLP (2017) A survey of human-centered intelligent robots: issues and challenges. IEEE/CAA J Autom Sin 4(4):602–609CrossRef
13.
Zurück zum Zitat Hong TP, Wu CW (2011) Mining rules from an incomplete dataset with a high missing rate. Expert Syst Appl 38(4):3931–3936CrossRef Hong TP, Wu CW (2011) Mining rules from an incomplete dataset with a high missing rate. Expert Syst Appl 38(4):3931–3936CrossRef
14.
Zurück zum Zitat Jia X, Di Y, Feng J, Yang Q, Dai H, Lee J (2018) Adaptive virtual metrology for semiconductor chemical mechanical planarization process using gmdh-type polynomial neural networks. J Process Control 62:44–54CrossRef Jia X, Di Y, Feng J, Yang Q, Dai H, Lee J (2018) Adaptive virtual metrology for semiconductor chemical mechanical planarization process using gmdh-type polynomial neural networks. J Process Control 62:44–54CrossRef
15.
Zurück zum Zitat Kang S (2020) Joint modeling of classification and regression for improving faulty wafer detection in semiconductor manufacturing. J Intel Manuf 31:319–326CrossRef Kang S (2020) Joint modeling of classification and regression for improving faulty wafer detection in semiconductor manufacturing. J Intel Manuf 31:319–326CrossRef
16.
Zurück zum Zitat Kang S, Kim E, Shim J, Cho S, Chang W, Kim J (2017) Mining the relationship between production and customer service data for failure analysis of industrial products. Comput Ind Eng 106:137–146CrossRef Kang S, Kim E, Shim J, Cho S, Chang W, Kim J (2017) Mining the relationship between production and customer service data for failure analysis of industrial products. Comput Ind Eng 106:137–146CrossRef
18.
Zurück zum Zitat Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: Proceedings of international conference on learning representations Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: Proceedings of international conference on learning representations
19.
Zurück zum Zitat Köksal G, Batmaz I, Testik MC (2011) A review of data mining applications for quality improvement in manufacturing industry. Expert Syst Appl 38(10):13448–13467CrossRef Köksal G, Batmaz I, Testik MC (2011) A review of data mining applications for quality improvement in manufacturing industry. Expert Syst Appl 38(10):13448–13467CrossRef
20.
Zurück zum Zitat Kumar S, Chow TWS, Pecht M (2010) Approach to fault identification for electronic products using mahalanobis distance. IEEE Trans Instrum Meas 59(8):2055–2064CrossRef Kumar S, Chow TWS, Pecht M (2010) Approach to fault identification for electronic products using mahalanobis distance. IEEE Trans Instrum Meas 59(8):2055–2064CrossRef
21.
Zurück zum Zitat Kwak DS, Kim KJ (2012) A data mining approach considering missing values for the optimization of semiconductor-manufacturing processes. Expert Syst Appl 39(3):2590–2596CrossRef Kwak DS, Kim KJ (2012) A data mining approach considering missing values for the optimization of semiconductor-manufacturing processes. Expert Syst Appl 39(3):2590–2596CrossRef
22.
Zurück zum Zitat Lakshminarayan K, Harp SA, Samad T (1999) Imputation of missing data in industrial databases. Appl Intel 11(3):259–275CrossRef Lakshminarayan K, Harp SA, Samad T (1999) Imputation of missing data in industrial databases. Appl Intel 11(3):259–275CrossRef
23.
Zurück zum Zitat Li Y, Tarlow D, Brockschmidt M, Zemel R (2016) Gated graph sequence neural networks. In: Proceedings of international conference on learning representations Li Y, Tarlow D, Brockschmidt M, Zemel R (2016) Gated graph sequence neural networks. In: Proceedings of international conference on learning representations
24.
Zurück zum Zitat Little RJA, Rubin DB (2002) Statistical analysis with missing data, 2nd edn. Wiley, New JerseyCrossRef Little RJA, Rubin DB (2002) Statistical analysis with missing data, 2nd edn. Wiley, New JerseyCrossRef
25.
Zurück zum Zitat Myneni MB, Srividya Y, Dandamudi A (2017) Correlated cluster-based imputation for treatment of missing values. In: Proceedings of international conference on computational intelligence and informatics, pp 171–178 Myneni MB, Srividya Y, Dandamudi A (2017) Correlated cluster-based imputation for treatment of missing values. In: Proceedings of international conference on computational intelligence and informatics, pp 171–178
26.
Zurück zum Zitat Qin SJ (2014) Process data analytics in the era of big data. AICHE J 60(9):3092–3100CrossRef Qin SJ (2014) Process data analytics in the era of big data. AICHE J 60(9):3092–3100CrossRef
27.
Zurück zum Zitat Rodriguez JD, Perez A, Lozano JA (2010) Sensitivity analysis of k-fold cross validation in prediction error estimation. IEEE Trans Pattern Anal Mach Intel 32(3):569–575CrossRef Rodriguez JD, Perez A, Lozano JA (2010) Sensitivity analysis of k-fold cross validation in prediction error estimation. IEEE Trans Pattern Anal Mach Intel 32(3):569–575CrossRef
28.
Zurück zum Zitat Shin CK, Park SC (2000) A machine learning approach to yield management in semiconductor manufacturing. Int J Prod Res 38(17):4261–4271CrossRef Shin CK, Park SC (2000) A machine learning approach to yield management in semiconductor manufacturing. Int J Prod Res 38(17):4261–4271CrossRef
29.
Zurück zum Zitat Siddiqui YA, Saif AWA, Cheded L, Elshafei M, Rahim A (2015) Integration of multivariate statistical process control and engineering process control: a novel framework. Int J Adv Manuf Technol 78(1–4):259–268CrossRef Siddiqui YA, Saif AWA, Cheded L, Elshafei M, Rahim A (2015) Integration of multivariate statistical process control and engineering process control: a novel framework. Int J Adv Manuf Technol 78(1–4):259–268CrossRef
30.
Zurück zum Zitat Silva LO, Zárate LE (2014) A brief review of the main approaches for treatment of missing data. Intel Data Anal 18(6):1177–1198CrossRef Silva LO, Zárate LE (2014) A brief review of the main approaches for treatment of missing data. Intel Data Anal 18(6):1177–1198CrossRef
33.
Zurück zum Zitat Veličković P, Cucurull G, Casanova A, Romero A, Lio P, Bengio Y (2018) Graph attention networks. In: Proceedings of international conference on learning representations Veličković P, Cucurull G, Casanova A, Romero A, Lio P, Bengio Y (2018) Graph attention networks. In: Proceedings of international conference on learning representations
34.
Zurück zum Zitat Wang Z, Liu L, Zhang H (2017) Neural network-based model-free adaptive fault-tolerant control for discrete-time nonlinear systems with sensor fault. IEEE Trans Syst Man Cybern Syst 47(8):2351–2362CrossRef Wang Z, Liu L, Zhang H (2017) Neural network-based model-free adaptive fault-tolerant control for discrete-time nonlinear systems with sensor fault. IEEE Trans Syst Man Cybern Syst 47(8):2351–2362CrossRef
35.
Zurück zum Zitat Wuest T, Weimer D, Irgens C, Thoben KD (2016) Machine learning in manufacturing: advantages, challenges, and applications. Prod Manuf Res 4(1):23–45 Wuest T, Weimer D, Irgens C, Thoben KD (2016) Machine learning in manufacturing: advantages, challenges, and applications. Prod Manuf Res 4(1):23–45
36.
Zurück zum Zitat Yang CC (2008) Improving the definition and quantification of quality costs. Total Qual Manag 19(3):175–191CrossRef Yang CC (2008) Improving the definition and quantification of quality costs. Total Qual Manag 19(3):175–191CrossRef
37.
Zurück zum Zitat Yang HC, Tieng H, Cheng FT (2016) Automatic virtual metrology for wheel machining automation. Int J Prod Res 54(21):6367–6377CrossRef Yang HC, Tieng H, Cheng FT (2016) Automatic virtual metrology for wheel machining automation. Int J Prod Res 54(21):6367–6377CrossRef
38.
Zurück zum Zitat Yin S, Ding SX, Xie X, Luo H (2014) A review on basic data-driven approaches for industrial process monitoring. IEEE Trans Ind Electr 61(11):6418–6428CrossRef Yin S, Ding SX, Xie X, Luo H (2014) A review on basic data-driven approaches for industrial process monitoring. IEEE Trans Ind Electr 61(11):6418–6428CrossRef
39.
Zurück zum Zitat Yoon J, Jordon J, Schaar M (2018) GAIN: Missing data imputation using generative adversarial nets. In: Proceedings of international conference on machine learning, pp 5675–5684 Yoon J, Jordon J, Schaar M (2018) GAIN: Missing data imputation using generative adversarial nets. In: Proceedings of international conference on machine learning, pp 5675–5684
40.
Zurück zum Zitat Zhou J, Cui G, Zhang Z, Yang C, Liu Z, Wang L, Li C, Sun M (2018) Graph neural networks: a review of methods and applications. arXiv preprint arXiv:181208434 Zhou J, Cui G, Zhang Z, Yang C, Liu Z, Wang L, Li C, Sun M (2018) Graph neural networks: a review of methods and applications. arXiv preprint arXiv:​181208434
41.
Zurück zum Zitat Zhu X, Zhang S, Jin Z, Zhang Z, Xu Z (2011) Missing value estimation for mixed-attribute data sets. IEEE Trans Knowl Data Eng 23(1):110–121CrossRef Zhu X, Zhang S, Jin Z, Zhang Z, Xu Z (2011) Missing value estimation for mixed-attribute data sets. IEEE Trans Knowl Data Eng 23(1):110–121CrossRef
Metadaten
Titel
Product failure prediction with missing data using graph neural networks
verfasst von
Seokho Kang
Publikationsdatum
10.11.2020
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 12/2021
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-05486-2

Weitere Artikel der Ausgabe 12/2021

Neural Computing and Applications 12/2021 Zur Ausgabe

Premium Partner