Skip to main content
Top

2023 | OriginalPaper | Chapter

Learned Manufacturing Inspection Inferences from Image Recognition Capabilities

Authors : Douglas Eddy, Michael White, Damon Blanchette

Published in: Flexible Automation and Intelligent Manufacturing: The Human-Data-Technology Nexus

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Many complex electromechanical assemblies that are essential to some vital function of certain products can be time consuming to inspect to a sufficient level of certainty. Examples include subsystems of machine tools, robots, aircraft, and automobiles. A model-based definition with manufacturing tolerance specifications can address any design-related severe failure modes. However, out of tolerance conditions can occur due to either random common cause variability or undetected nonstandard results, such as foreign object debris. Application of various image recognition techniques potentially can save time by some automation of inspections. However, some of the most meaningful 3D recognitions may not be sufficiently reliable, and it can be an extensive process to train the recognition of all possible anomalies comprehensively enough for inspection certainty. This paper introduces a schema and method that can learn the likelihood that a specific autonomously inspected feature will be within tolerance specifications. These learned manufacturing inspection inferences from image recognition capabilities (LeMIIIRC) may be performed by accepting data inputs that can be obtained during the image recognition training process followed by machine learning of the likely results. The fundamental method is demonstrated by a realistic example with hypothetical manufacturing data.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference See, J.E., Drury, C.G., Speed, A., Williams, A., Khalandi, N.: The role of visual inspection in the 21st century. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 61, no. 1, pp. 262–266. Sage, Los Angeles, CA (2017) See, J.E., Drury, C.G., Speed, A., Williams, A., Khalandi, N.: The role of visual inspection in the 21st century. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 61, no. 1, pp. 262–266. Sage, Los Angeles, CA (2017)
2.
go back to reference See, J.E.: Visual inspection: a review of the literature. Sandia report, SAND2012-8590 (2012) See, J.E.: Visual inspection: a review of the literature. Sandia report, SAND2012-8590 (2012)
3.
go back to reference Liao, H.-C., Lim, Z.-Y., Hu, Y.-X., Tseng, H.-W.: Guidelines of automated optical inspection (AOI) system development. In: 2018 IEEE 3rd International Conference on Signal and Image Processing (ICSIP), pp. 362–366. IEEE (2018) Liao, H.-C., Lim, Z.-Y., Hu, Y.-X., Tseng, H.-W.: Guidelines of automated optical inspection (AOI) system development. In: 2018 IEEE 3rd International Conference on Signal and Image Processing (ICSIP), pp. 362–366. IEEE (2018)
4.
go back to reference Schlake, B.W., Todorovic, S., Edwards, J.R., Hart, J.M., Ahuja, N., Barkan, C.P.: Machine vision condition monitoring of heavy-axle load railcar structural underframe components. Proc. Inst. Mech. Eng. Part F J. Rail Rapid Transit 224(5), 499–511 (2010)CrossRef Schlake, B.W., Todorovic, S., Edwards, J.R., Hart, J.M., Ahuja, N., Barkan, C.P.: Machine vision condition monitoring of heavy-axle load railcar structural underframe components. Proc. Inst. Mech. Eng. Part F J. Rail Rapid Transit 224(5), 499–511 (2010)CrossRef
5.
go back to reference Kumar, A.: Computer-vision-based fabric defect detection: a survey. IEEE Trans. Ind. Electron. 55(1), 348–363 (2008)CrossRef Kumar, A.: Computer-vision-based fabric defect detection: a survey. IEEE Trans. Ind. Electron. 55(1), 348–363 (2008)CrossRef
6.
go back to reference Ahmed, S.: A review on using opportunities of augmented reality and virtual reality in construction project management. Org. Technol. Manag. Constr. Int. J. 10(1), 1839–1852 (2018) Ahmed, S.: A review on using opportunities of augmented reality and virtual reality in construction project management. Org. Technol. Manag. Constr. Int. J. 10(1), 1839–1852 (2018)
7.
go back to reference Aust, J., Mitrovic, A., Pons, D.: Assessment of the effect of cleanliness on the visual inspection of aircraft engine blades: an eye tracking study. Sensors 21(18), 6135 (2021)CrossRef Aust, J., Mitrovic, A., Pons, D.: Assessment of the effect of cleanliness on the visual inspection of aircraft engine blades: an eye tracking study. Sensors 21(18), 6135 (2021)CrossRef
8.
go back to reference Duchowski, A.T.: A breadth-first survey of eye-tracking applications. Behav. Res. Methods Instrum. Comput. 34(4), 455–470 (2002)CrossRef Duchowski, A.T.: A breadth-first survey of eye-tracking applications. Behav. Res. Methods Instrum. Comput. 34(4), 455–470 (2002)CrossRef
9.
go back to reference Pan, H., Pang, Z., Wang, Y., Wang, Y., Chen, L.: A new image recognition and classification method combining transfer learning algorithm and MobileNet model for welding defects. IEEE Access 8, 119951–119960 (2020)CrossRef Pan, H., Pang, Z., Wang, Y., Wang, Y., Chen, L.: A new image recognition and classification method combining transfer learning algorithm and MobileNet model for welding defects. IEEE Access 8, 119951–119960 (2020)CrossRef
10.
go back to reference Akinci, B., Boukamp, F., Gordon, C., Huber, D., Lyons, C., Park, K.: A formalism for utilization of sensor systems and integrated project models for active construction quality control. Autom. Constr. 15(2), 124–138 (2006)CrossRef Akinci, B., Boukamp, F., Gordon, C., Huber, D., Lyons, C., Park, K.: A formalism for utilization of sensor systems and integrated project models for active construction quality control. Autom. Constr. 15(2), 124–138 (2006)CrossRef
11.
go back to reference Hong, K., Nagarajah, R., Iovenitti, P., Dunn, M.: A sociotechnical approach to achieve zero defect manufacturing of complex manual assemblies. Hum. Factors Ergon. Manuf. Serv. Ind. 17(2), 137–148 (2007)CrossRef Hong, K., Nagarajah, R., Iovenitti, P., Dunn, M.: A sociotechnical approach to achieve zero defect manufacturing of complex manual assemblies. Hum. Factors Ergon. Manuf. Serv. Ind. 17(2), 137–148 (2007)CrossRef
12.
go back to reference Galetto, M., Verna, E., Genta, G.: Accurate estimation of prediction models for operator-induced defects in assembly manufacturing processes. Qual. Eng. 32(4), 595–613 (2020)CrossRef Galetto, M., Verna, E., Genta, G.: Accurate estimation of prediction models for operator-induced defects in assembly manufacturing processes. Qual. Eng. 32(4), 595–613 (2020)CrossRef
13.
go back to reference Pugna, A., Negrea, R., Miclea, S.: Using six sigma methodology to improve the assembly process in an automotive company. Procedia Soc. Behav. Sci. 221, 308–316 (2016)CrossRef Pugna, A., Negrea, R., Miclea, S.: Using six sigma methodology to improve the assembly process in an automotive company. Procedia Soc. Behav. Sci. 221, 308–316 (2016)CrossRef
14.
go back to reference Eddy, D., Krishnamurty, S., Grosse, I., White, M., Blanchette, D.: A defect prevention concept using artificial intelligence. In: International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, vol. 83983, p. V009T09A040. American Society of Mechanical Engineers (2020) Eddy, D., Krishnamurty, S., Grosse, I., White, M., Blanchette, D.: A defect prevention concept using artificial intelligence. In: International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, vol. 83983, p. V009T09A040. American Society of Mechanical Engineers (2020)
15.
go back to reference Letham, B., Rudin, C., McCormick, T.H., Madigan, D.: Interpretable classifiers using rules and Bayesian analysis: building a better stroke prediction model. Ann. Appl. Stat. 9(3), 1350–1371 (2015)CrossRef Letham, B., Rudin, C., McCormick, T.H., Madigan, D.: Interpretable classifiers using rules and Bayesian analysis: building a better stroke prediction model. Ann. Appl. Stat. 9(3), 1350–1371 (2015)CrossRef
16.
go back to reference Azangoo, M., et al.: Towards a 3D scanning/VR-based product inspection station. In: 2020 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), vol. 1, pp. 1263–1266. IEEE (2020) Azangoo, M., et al.: Towards a 3D scanning/VR-based product inspection station. In: 2020 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), vol. 1, pp. 1263–1266. IEEE (2020)
17.
go back to reference Kane, S.K., et al.: Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp. 129–138 (2009) Kane, S.K., et al.: Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp. 129–138 (2009)
18.
go back to reference Chaccour, K., Badr, G.: Computer vision guidance system for indoor navigation of visually impaired people. In: 2016 IEEE 8th International Conference on Intelligent Systems (IS), pp. 449–454. IEEE (2016) Chaccour, K., Badr, G.: Computer vision guidance system for indoor navigation of visually impaired people. In: 2016 IEEE 8th International Conference on Intelligent Systems (IS), pp. 449–454. IEEE (2016)
19.
go back to reference Yang, H., Rudin, C., Seltzer, M.: Scalable Bayesian rule lists. In: International Conference on Machine Learning. PMLR, pp. 3921–3930 (2017) Yang, H., Rudin, C., Seltzer, M.: Scalable Bayesian rule lists. In: International Conference on Machine Learning. PMLR, pp. 3921–3930 (2017)
20.
go back to reference Angelino, E., Larus-Stone, N., Alabi, D., Seltzer, M., Rudin, C.: Learning certifiably optimal rule lists for categorical data. arXiv preprint arXiv:1704.01701 (2017) Angelino, E., Larus-Stone, N., Alabi, D., Seltzer, M., Rudin, C.: Learning certifiably optimal rule lists for categorical data. arXiv preprint arXiv:​1704.​01701 (2017)
21.
go back to reference Hu, X., Rudin, C., Seltzer, M.: Optimal sparse decision trees. In: Advances in Neural Information Processing Systems (NeurIPS) (2019) Hu, X., Rudin, C., Seltzer, M.: Optimal sparse decision trees. In: Advances in Neural Information Processing Systems (NeurIPS) (2019)
22.
go back to reference Lin, J., Zhong, C., Hu, D., Rudin, C., Seltzer, M.: Generalized and scalable optimal sparse decision trees. In: International Conference on Machine Learning. PMLR, pp. 6150–6160 (2020) Lin, J., Zhong, C., Hu, D., Rudin, C., Seltzer, M.: Generalized and scalable optimal sparse decision trees. In: International Conference on Machine Learning. PMLR, pp. 6150–6160 (2020)
23.
go back to reference Ahmed, Z., et al.: Machine learning at Microsoft with ML.NET. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 2448–2458 (2019) Ahmed, Z., et al.: Machine learning at Microsoft with ML.NET. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 2448–2458 (2019)
24.
go back to reference Lee, Y., Scolari, A., Chun, B.-G., Weimer, M., Interlandi, M.: From the edge to the cloud: model serving in ML.NET. IEEE Data Eng. Bull. 41(4), 46–53 (2018) Lee, Y., Scolari, A., Chun, B.-G., Weimer, M., Interlandi, M.: From the edge to the cloud: model serving in ML.NET. IEEE Data Eng. Bull. 41(4), 46–53 (2018)
26.
go back to reference Kumari, R., Srivastava, S.K.: Machine learning: a review on binary classification. Int. J. Comput. Appl. 160(7) (2017) Kumari, R., Srivastava, S.K.: Machine learning: a review on binary classification. Int. J. Comput. Appl. 160(7) (2017)
29.
go back to reference Yong-Kang, J., Yong, C., Daquan, T.: Design of an UAV simulation training and assessment system based on Unity3D. In: 2017 IEEE International Conference on Unmanned Systems (ICUS), pp. 163–167. IEEE (2017) Yong-Kang, J., Yong, C., Daquan, T.: Design of an UAV simulation training and assessment system based on Unity3D. In: 2017 IEEE International Conference on Unmanned Systems (ICUS), pp. 163–167. IEEE (2017)
Metadata
Title
Learned Manufacturing Inspection Inferences from Image Recognition Capabilities
Authors
Douglas Eddy
Michael White
Damon Blanchette
Copyright Year
2023
DOI
https://doi.org/10.1007/978-3-031-17629-6_21

Premium Partners