Skip to main content
Top
Published in: Chinese Journal of Mechanical Engineering 5/2017

01-09-2017 | Original Article

MapReduce Based Parallel Bayesian Network for Manufacturing Quality Control

Authors: Mao-Kuan Zheng, Xin-Guo Ming, Xian-Yu Zhang, Guo-Ming Li

Published in: Chinese Journal of Mechanical Engineering | Issue 5/2017

Login to get access

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Increasing complexity of industrial products and manufacturing processes have challenged conventional statistics based quality management approaches in the circumstances of dynamic production. A Bayesian network and big data analytics integrated approach for manufacturing process quality analysis and control is proposed. Based on Hadoop distributed architecture and MapReduce parallel computing model, big volume and variety quality related data generated during the manufacturing process could be dealt with. Artificial intelligent algorithms, including Bayesian network learning, classification and reasoning, are embedded into the Reduce process. Relying on the ability of the Bayesian network in dealing with dynamic and uncertain problem and the parallel computing power of MapReduce, Bayesian network of impact factors on quality are built based on prior probability distribution and modified with posterior probability distribution. A case study on hull segment manufacturing precision management for ship and offshore platform building shows that computing speed accelerates almost directly proportionally to the increase of computing nodes. It is also proved that the proposed model is feasible for locating and reasoning of root causes, forecasting of manufacturing outcome, and intelligent decision for precision problem solving. The integration of bigdata analytics and BN method offers a whole new perspective in manufacturing quality control.
Literature
1.
go back to reference H Kagermann, J Helbig, A Hellinger, et al. Recommendations for Implementing the strategic initiative INDUSTRIE 4.0: securing the future of German manufacturing industry; final report of the Industrie 4.0 working group. Berlin: Acatech, 2013. H Kagermann, J Helbig, A Hellinger, et al. Recommendations for Implementing the strategic initiative INDUSTRIE 4.0: securing the future of German manufacturing industry; final report of the Industrie 4.0 working group. Berlin: Acatech, 2013.
2.
go back to reference S Q Feng, H Terasaki, H Komizo, et al. Development of evaluation technique of GMAW welding quality based on statistical analysis. Chinese Journal of Mechanical Engineering, 2014, 27(06): 1257–1263. S Q Feng, H Terasaki, H Komizo, et al. Development of evaluation technique of GMAW welding quality based on statistical analysis. Chinese Journal of Mechanical Engineering, 2014, 27(06): 1257–1263.
3.
go back to reference J Manyika, M Chui, B Brown, et al., Big data: The next frontier for innovation, competition and productivity. San Francisco: McKinsey Global Institute, 2011. J Manyika, M Chui, B Brown, et al., Big data: The next frontier for innovation, competition and productivity. San Francisco: McKinsey Global Institute, 2011.
4.
go back to reference D Wong. Data is the Next Frontier, Analytics the New Tool. London: Big Innovation Centre, 2012. D Wong. Data is the Next Frontier, Analytics the New Tool. London: Big Innovation Centre, 2012.
5.
go back to reference C F Chien, C W Liu, S C Chuang. Analysing semiconductor manufacturing big data for root cause detection of excursion for yield enhancement. International Journal of Production Research, 2015, 29(9): 1–13. C F Chien, C W Liu, S C Chuang. Analysing semiconductor manufacturing big data for root cause detection of excursion for yield enhancement. International Journal of Production Research, 2015, 29(9): 1–13.
6.
go back to reference R Y Zhong, C Xu, C Chen, et al. Big Data Analytics for Physical Internet-based intelligent manufacturing shop floors. International Journal of Production Research, 2015: 1–12. R Y Zhong, C Xu, C Chen, et al. Big Data Analytics for Physical Internet-based intelligent manufacturing shop floors. International Journal of Production Research, 2015: 1–12.
7.
go back to reference F Chang, J Dean, S Ghemawat, et al. Bigtable: A distributed storage system for structured data. ACM Transactions on Computer Systems (TOCS), 2008, 26(2): 1–26. F Chang, J Dean, S Ghemawat, et al. Bigtable: A distributed storage system for structured data. ACM Transactions on Computer Systems (TOCS), 2008, 26(2): 1–26.
8.
go back to reference S Ghemawat, H Gobioff, S T Leung. The Google file system. ACM SIGOPS Operating Systems Review, 2003, 37(5): 29–43. S Ghemawat, H Gobioff, S T Leung. The Google file system. ACM SIGOPS Operating Systems Review, 2003, 37(5): 29–43.
9.
go back to reference K Shvachko, H Kuang, S Radia, et al. The hadoop distributed file system. 2010 IEEE 26th symposium on mass storage systems and technologies (MSST). Lake Tahoe, NV, USA, May 3–7, 2010. Washington DC: IEEE Computer Society, 2010: 1–10. K Shvachko, H Kuang, S Radia, et al. The hadoop distributed file system. 2010 IEEE 26th symposium on mass storage systems and technologies (MSST). Lake Tahoe, NV, USA, May 3–7, 2010. Washington DC: IEEE Computer Society, 2010: 1–10.
10.
go back to reference J Dean, S Ghemawat. MapReduce: simplified data processing on large clusters. Communications of the ACM, 2008, 51(1): 107–113. J Dean, S Ghemawat. MapReduce: simplified data processing on large clusters. Communications of the ACM, 2008, 51(1): 107–113.
11.
go back to reference J L Deng. Introduction to grey system theory. The Journal of grey system, 1989, 1(1): 1–24. J L Deng. Introduction to grey system theory. The Journal of grey system, 1989, 1(1): 1–24.
12.
go back to reference Z Pawlak. Rough sets. International Journal of Computer & Information Sciences, 1982, 11(5): 341–356. Z Pawlak. Rough sets. International Journal of Computer & Information Sciences, 1982, 11(5): 341–356.
13.
go back to reference G Z Diao, L P Zhao, Y Y Yao. A System Framework of Dynamic Coupled Quality Control Based on Complex Network. Advanced Materials Research, 2013, 711: 773–778. G Z Diao, L P Zhao, Y Y Yao. A System Framework of Dynamic Coupled Quality Control Based on Complex Network. Advanced Materials Research, 2013, 711: 773–778.
14.
go back to reference F V Jensen. An introduction to Bayesian networks. London: UCL Press, 1996. F V Jensen. An introduction to Bayesian networks. London: UCL Press, 1996.
15.
go back to reference K P Murphy. Dynamic bayesian networks. California: UC Berkeley, 2002. K P Murphy. Dynamic bayesian networks. California: UC Berkeley, 2002.
16.
go back to reference Z Ghahramani. Learning dynamic Bayesian networks//Adaptive processing of sequences and data structures. Berlin: Springer Berlin Heidelberg, 1998: 168–197. Z Ghahramani. Learning dynamic Bayesian networks//Adaptive processing of sequences and data structures. Berlin: Springer Berlin Heidelberg, 1998: 168–197.
17.
go back to reference Z J Yang, Y N Kan, F Chen, et al. Bayesian reliability modeling and assessment solution for NC machine tools under small-sample data. Chinese Journal of Mechanical Engineering, 2015, 28(6): 1229–1239. Z J Yang, Y N Kan, F Chen, et al. Bayesian reliability modeling and assessment solution for NC machine tools under small-sample data. Chinese Journal of Mechanical Engineering, 2015, 28(6): 1229–1239.
18.
go back to reference N Friedman, I Nachman, D Peér. Learning bayesian network structure from massive datasets: the sparse candidate algorithm. Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence. Stockholm, Sweden, July 30–August 1, 1999. Burlington: Morgan Kaufmann Publishers Inc., 1999: 206–215. N Friedman, I Nachman, D Peér. Learning bayesian network structure from massive datasets: the sparse candidate algorithm. Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence. Stockholm, Sweden, July 30–August 1, 1999. Burlington: Morgan Kaufmann Publishers Inc., 1999: 206–215.
20.
go back to reference A Basak, I Brinster, X Ma, et al. Accelerating Bayesian network parameter learning using Hadoop and MapReduce. Proceedings of the 1st International Workshop on Big Data, Streams and Heterogeneous Source Mining: Algorithms, Systems, Programming Models and Applications. Beijing, China, August 12–16, 2012. New York: ACM, 2012: 101–108. A Basak, I Brinster, X Ma, et al. Accelerating Bayesian network parameter learning using Hadoop and MapReduce. Proceedings of the 1st International Workshop on Big Data, Streams and Heterogeneous Source Mining: Algorithms, Systems, Programming Models and Applications. Beijing, China, August 12–16, 2012. New York: ACM, 2012: 101–108.
21.
go back to reference A Basak, I Brinster, O J Mengshoel. Mapreduce for Bayesian network parameter learning using the EM algorithm. Proc of Big Learning: Algorithms, Systems and Tools, 2012, 12: 1–6. A Basak, I Brinster, O J Mengshoel. Mapreduce for Bayesian network parameter learning using the EM algorithm. Proc of Big Learning: Algorithms, Systems and Tools, 2012, 12: 1–6.
22.
go back to reference W Chen, T Wang, D Yang, et al. Massively parallel learning of Bayesian networks with MapReduce for factor relationship analysis. 2013 International Joint Conference on Neural Networks (IJCNN). Dallas, TX, USA, Aug 4-9, 2013. New York: IEEE, 2013: 1–5. W Chen, T Wang, D Yang, et al. Massively parallel learning of Bayesian networks with MapReduce for factor relationship analysis. 2013 International Joint Conference on Neural Networks (IJCNN). Dallas, TX, USA, Aug 4-9, 2013. New York: IEEE, 2013: 1–5.
23.
go back to reference Q Fang, K Yue, X Fu, et al. A mapreduce-based method for learning bayesian network from massive data. 15th Asia-Pacific Web Conference on Web Technologies and Applications. Sydney, NSW, Australia, April 4–6, 2013. Berlin: Springer Berlin Heidelberg, 2013: 697–708. Q Fang, K Yue, X Fu, et al. A mapreduce-based method for learning bayesian network from massive data. 15th Asia-Pacific Web Conference on Web Technologies and Applications. Sydney, NSW, Australia, April 4–6, 2013. Berlin: Springer Berlin Heidelberg, 2013: 697–708.
24.
go back to reference X Xi, X Z Wu, Y L Wu, et al. Modeling and analysis of mechanical Quality factor of the resonator for cylinder vibratory gyroscope. Chinese Journal of Mechanical Engineering, 2016, 30(1): 180–189. X Xi, X Z Wu, Y L Wu, et al. Modeling and analysis of mechanical Quality factor of the resonator for cylinder vibratory gyroscope. Chinese Journal of Mechanical Engineering, 2016, 30(1): 180–189.
25.
go back to reference G F Cooper, E Herskovits. A Bayesian method for the induction of probabilistic networks from data. Machine learning, 1992, 9(4): 309–347. G F Cooper, E Herskovits. A Bayesian method for the induction of probabilistic networks from data. Machine learning, 1992, 9(4): 309–347.
26.
go back to reference A P Dempster, N M Laird, D B Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society Series B (Methodological), 1977, 39(1): 1–38. A P Dempster, N M Laird, D B Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society Series B (Methodological), 1977, 39(1): 1–38.
27.
go back to reference N Friedman, K Murphy, S Russell. Learning the structure of dynamic probabilistic networks. Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence. Madison, WI, USA, July 24-26, 1998. San Francisco: Morgan Kaufmann Publishers Inc., 1998: 139–147. N Friedman, K Murphy, S Russell. Learning the structure of dynamic probabilistic networks. Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence. Madison, WI, USA, July 24-26, 1998. San Francisco: Morgan Kaufmann Publishers Inc., 1998: 139–147.
28.
go back to reference G S Hamilton, F Fielding, A W Chiffings, et al. Investigating the Use of a Bayesian Network to Model the Risk of Lyngbya majuscula Bloom Initiation in Deception Bay, Queensland, Australia. Human and Ecological Risk Assessment: An International Journal, 2007, 13(6): 1271–1287. G S Hamilton, F Fielding, A W Chiffings, et al. Investigating the Use of a Bayesian Network to Model the Risk of Lyngbya majuscula Bloom Initiation in Deception Bay, Queensland, Australia. Human and Ecological Risk Assessment: An International Journal, 2007, 13(6): 1271–1287.
29.
go back to reference M K Zheng, X G Ming, M Li, et al. A framework for Industrial Product–Service Systems risk management. Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability, 2015, 229(6): 501–516. M K Zheng, X G Ming, M Li, et al. A framework for Industrial Product–Service Systems risk management. Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability, 2015, 229(6): 501–516.
30.
go back to reference M Li, L Wang. Feature fatigue analysis in product development using Bayesian networks. Expert Systems with Applications, 2011, 38(8): 10631–10637. M Li, L Wang. Feature fatigue analysis in product development using Bayesian networks. Expert Systems with Applications, 2011, 38(8): 10631–10637.
Metadata
Title
MapReduce Based Parallel Bayesian Network for Manufacturing Quality Control
Authors
Mao-Kuan Zheng
Xin-Guo Ming
Xian-Yu Zhang
Guo-Ming Li
Publication date
01-09-2017
Publisher
Chinese Mechanical Engineering Society
Published in
Chinese Journal of Mechanical Engineering / Issue 5/2017
Print ISSN: 1000-9345
Electronic ISSN: 2192-8258
DOI
https://doi.org/10.1007/s10033-017-0179-0

Other articles of this Issue 5/2017

Chinese Journal of Mechanical Engineering 5/2017 Go to the issue

Premium Partners